2024-08-17T02:11:37.391 INFO:root:teuthology version: 1.2.0 2024-08-17T02:11:37.416 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-17T02:11:37.497 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858278 branch: wip-mchangir-mgr-volumes-print-thread-name-quincy description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} email: mchangir@redhat.com first_in_suite: false job_id: '7858278' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-mchangir-mgr-volumes-print-thread-name-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - filesystem is online with fewer MDS than max_mds - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: enable_coprs: - ceph/el9 flavor: default sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-mgr-volumes-print-thread-name-quincy sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e owner: scheduled_mchangir@teuthology priority: 25 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 5995 sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e sleep_before_teardown: 0 suite: fs suite_branch: wip-mchangir-mgr-volumes-print-thread-name-quincy suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e targets: smithi107.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAlhycrV5ePAKCdd8cj3Jqe6Z71X0d+LuKyk/mc731mgyO58W0cSNvMKAonZtFls35C77OpTNbECwcVbngGcVuQ= smithi157.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGhF9mG4Vc5+yWvsyrTbZ5/qrxc14bwUtU4IH9EOLvxun/pw7eGDT1HJGWgnP/wLTjSll2hSbSNu0q7STWccsF8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestVolumes - tasks.cephfs.test_volumes.TestSubvolumeGroups - tasks.cephfs.test_volumes.TestSubvolumes teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 67db276914d29505c9707d04f3a3b8fb9d8aee4b timestamp: 2024-08-17_01:02:08 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-17T02:11:37.498 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa; will attempt to use it 2024-08-17T02:11:37.498 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks 2024-08-17T02:11:37.498 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-17T02:11:37.500 INFO:teuthology.task.internal:Checking packages... 2024-08-17T02:11:37.519 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2577e8139c6b8786f9d6d6ea21b8da9244b9260e' 2024-08-17T02:11:37.519 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-17T02:11:37.520 INFO:teuthology.packaging:ref: None 2024-08-17T02:11:37.520 INFO:teuthology.packaging:tag: None 2024-08-17T02:11:37.520 INFO:teuthology.packaging:branch: wip-mchangir-mgr-volumes-print-thread-name-quincy 2024-08-17T02:11:37.520 INFO:teuthology.packaging:sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:11:37.520 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-mchangir-mgr-volumes-print-thread-name-quincy 2024-08-17T02:11:37.660 INFO:teuthology.task.internal:Found packages for ceph version 17.2.7-1375.g2577e813 2024-08-17T02:11:37.662 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-17T02:11:37.669 INFO:teuthology.task.internal:no buildpackages task found 2024-08-17T02:11:37.669 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-17T02:11:37.675 INFO:teuthology.task.internal:Saving configuration 2024-08-17T02:11:37.692 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-17T02:11:37.702 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-17T02:11:37.729 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858278', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-17 02:03:59.135891', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAlhycrV5ePAKCdd8cj3Jqe6Z71X0d+LuKyk/mc731mgyO58W0cSNvMKAonZtFls35C77OpTNbECwcVbngGcVuQ='} 2024-08-17T02:11:37.752 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858278', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-17 02:03:59.134422', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGhF9mG4Vc5+yWvsyrTbZ5/qrxc14bwUtU4IH9EOLvxun/pw7eGDT1HJGWgnP/wLTjSll2hSbSNu0q7STWccsF8='} 2024-08-17T02:11:37.752 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-17T02:11:37.758 INFO:teuthology.task.internal:roles: ubuntu@smithi107.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-08-17T02:11:37.758 INFO:teuthology.task.internal:roles: ubuntu@smithi157.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-08-17T02:11:37.758 INFO:teuthology.run_tasks:Running task console_log... 2024-08-17T02:11:37.817 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1e03a4fac0>, signals=[15]) 2024-08-17T02:11:37.817 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-17T02:11:37.823 INFO:teuthology.task.internal:Opening connections... 2024-08-17T02:11:37.823 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi107.front.sepia.ceph.com 2024-08-17T02:11:37.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:11:37.898 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi157.front.sepia.ceph.com 2024-08-17T02:11:37.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:11:37.971 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-17T02:11:37.978 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2024-08-17T02:11:37.995 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2024-08-17T02:11:37.995 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2024-08-17T02:11:38.052 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream" 2024-08-17T02:11:38.052 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="9" 2024-08-17T02:11:38.052 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos" 2024-08-17T02:11:38.052 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora" 2024-08-17T02:11:38.052 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="9" 2024-08-17T02:11:38.052 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el9" 2024-08-17T02:11:38.052 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-17T02:11:38.053 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2024-08-17T02:11:38.053 INFO:teuthology.orchestra.run.smithi107.stdout:LOGO="fedora-logo-icon" 2024-08-17T02:11:38.053 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-17T02:11:38.053 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/" 2024-08-17T02:11:38.053 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-08-17T02:11:38.053 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-17T02:11:38.053 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-17T02:11:38.054 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2024-08-17T02:11:38.081 DEBUG:teuthology.orchestra.run.smithi157:> uname -m 2024-08-17T02:11:38.099 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2024-08-17T02:11:38.099 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2024-08-17T02:11:38.156 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="CentOS Stream" 2024-08-17T02:11:38.156 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="9" 2024-08-17T02:11:38.156 INFO:teuthology.orchestra.run.smithi157.stdout:ID="centos" 2024-08-17T02:11:38.156 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="rhel fedora" 2024-08-17T02:11:38.157 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="9" 2024-08-17T02:11:38.157 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el9" 2024-08-17T02:11:38.157 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-17T02:11:38.157 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2024-08-17T02:11:38.157 INFO:teuthology.orchestra.run.smithi157.stdout:LOGO="fedora-logo-icon" 2024-08-17T02:11:38.157 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-17T02:11:38.157 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://centos.org/" 2024-08-17T02:11:38.157 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-08-17T02:11:38.157 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-17T02:11:38.157 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-17T02:11:38.158 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2024-08-17T02:11:38.181 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-17T02:11:38.189 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-17T02:11:38.194 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-17T02:11:38.194 DEBUG:teuthology.orchestra.run.smithi107:> test '!' -e /home/ubuntu/cephtest 2024-08-17T02:11:38.197 DEBUG:teuthology.orchestra.run.smithi157:> test '!' -e /home/ubuntu/cephtest 2024-08-17T02:11:38.213 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-17T02:11:38.219 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-17T02:11:38.219 DEBUG:teuthology.orchestra.run.smithi107:> test -z $(ls -A /var/lib/ceph) 2024-08-17T02:11:38.253 DEBUG:teuthology.orchestra.run.smithi157:> test -z $(ls -A /var/lib/ceph) 2024-08-17T02:11:38.357 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-17T02:11:38.409 INFO:teuthology.run_tasks:Running task kernel... 2024-08-17T02:11:38.423 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-08-17T02:11:38.423 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-08-17T02:11:38.423 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-08-17T02:11:38.423 DEBUG:teuthology.orchestra.run.smithi107:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-17T02:11:38.424 DEBUG:teuthology.orchestra.run.smithi157:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-17T02:11:38.440 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:11:38.440 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-08-17T02:11:38.443 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:11:38.444 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-08-17T02:11:38.593 DEBUG:teuthology.task.kernel:sha1 for client.0 is 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:11:38.593 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "7503b862ff5bc4e556b3daee1c7881aa3e90ed62"... 2024-08-17T02:11:38.594 DEBUG:teuthology.orchestra.run.smithi107:> uname -r 2024-08-17T02:11:38.595 DEBUG:teuthology.task.kernel:sha1 for client.1 is 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:11:38.595 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "7503b862ff5bc4e556b3daee1c7881aa3e90ed62"... 2024-08-17T02:11:38.596 DEBUG:teuthology.orchestra.run.smithi157:> uname -r 2024-08-17T02:11:38.611 INFO:teuthology.orchestra.run.smithi107.stdout:5.14.0-437.el9.x86_64 2024-08-17T02:11:38.611 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:11:38.611 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-08-17T02:11:38.612 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum upgrade -y linux-firmware 2024-08-17T02:11:38.613 INFO:teuthology.orchestra.run.smithi157.stdout:5.14.0-437.el9.x86_64 2024-08-17T02:11:38.613 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:11:38.613 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-08-17T02:11:38.613 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum upgrade -y linux-firmware 2024-08-17T02:11:41.811 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - BaseOS 5.2 MB/s | 8.2 MB 00:01 2024-08-17T02:11:42.242 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - BaseOS 4.2 MB/s | 8.2 MB 00:01 2024-08-17T02:11:44.036 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - AppStream 18 MB/s | 20 MB 00:01 2024-08-17T02:11:47.851 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - AppStream 4.5 MB/s | 20 MB 00:04 2024-08-17T02:11:49.670 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 6.6 MB 00:01 2024-08-17T02:11:51.370 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 18 kB 00:00 2024-08-17T02:11:52.458 INFO:teuthology.orchestra.run.smithi107.stdout:Extra Packages for Enterprise Linux 23 MB/s | 22 MB 00:00 2024-08-17T02:11:52.552 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - CRB 7.1 MB/s | 6.6 MB 00:00 2024-08-17T02:11:54.936 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - Extras packages 16 kB/s | 18 kB 00:01 2024-08-17T02:11:55.798 INFO:teuthology.orchestra.run.smithi157.stdout:Extra Packages for Enterprise Linux 31 MB/s | 22 MB 00:00 2024-08-17T02:11:57.846 INFO:teuthology.orchestra.run.smithi107.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-08-17T02:11:59.931 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-08-17T02:11:59.942 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-08-17T02:11:59.942 INFO:teuthology.orchestra.run.smithi107.stdout: Package Architecture Version Repository Size 2024-08-17T02:11:59.942 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-08-17T02:11:59.942 INFO:teuthology.orchestra.run.smithi107.stdout:Upgrading: 2024-08-17T02:11:59.943 INFO:teuthology.orchestra.run.smithi107.stdout: linux-firmware noarch 20240716-145.el9 baseos 383 M 2024-08-17T02:11:59.943 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:11:59.943 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-08-17T02:11:59.943 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-08-17T02:11:59.943 INFO:teuthology.orchestra.run.smithi107.stdout:Upgrade 1 Package 2024-08-17T02:11:59.943 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:11:59.943 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 383 M 2024-08-17T02:11:59.943 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-08-17T02:12:01.104 INFO:teuthology.orchestra.run.smithi157.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-08-17T02:12:03.203 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-08-17T02:12:03.211 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-08-17T02:12:03.212 INFO:teuthology.orchestra.run.smithi157.stdout: Package Architecture Version Repository Size 2024-08-17T02:12:03.212 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-08-17T02:12:03.212 INFO:teuthology.orchestra.run.smithi157.stdout:Upgrading: 2024-08-17T02:12:03.212 INFO:teuthology.orchestra.run.smithi157.stdout: linux-firmware noarch 20240716-145.el9 baseos 383 M 2024-08-17T02:12:03.212 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:12:03.212 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-08-17T02:12:03.212 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-08-17T02:12:03.212 INFO:teuthology.orchestra.run.smithi157.stdout:Upgrade 1 Package 2024-08-17T02:12:03.212 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:12:03.213 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 383 M 2024-08-17T02:12:03.213 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-08-17T02:12:08.463 INFO:teuthology.orchestra.run.smithi157.stdout:linux-firmware-20240716-145.el9.noarch.rpm 77 MB/s | 383 MB 00:04 2024-08-17T02:12:08.463 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:12:08.464 INFO:teuthology.orchestra.run.smithi157.stdout:Total 73 MB/s | 383 MB 00:05 2024-08-17T02:12:11.548 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-08-17T02:12:11.638 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-08-17T02:12:11.638 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-08-17T02:12:14.866 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-08-17T02:12:14.867 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-08-17T02:12:23.801 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-08-17T02:12:24.607 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:12:24.806 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:12:25.655 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:12:25.655 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:12:26.394 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:12:26.395 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:12:26.395 INFO:teuthology.orchestra.run.smithi157.stdout:Upgraded: 2024-08-17T02:12:26.395 INFO:teuthology.orchestra.run.smithi157.stdout: linux-firmware-20240716-145.el9.noarch 2024-08-17T02:12:26.395 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:12:26.395 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-08-17T02:12:26.710 INFO:teuthology.task.kernel:Downloading kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.1... 2024-08-17T02:12:26.711 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:12:26.849 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ 2024-08-17T02:12:26.849 DEBUG:teuthology.orchestra.run.smithi157:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ --input-file=- 2024-08-17T02:12:26.852 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi157.front.sepia.ceph.com to complete... 2024-08-17T02:12:32.817 INFO:teuthology.orchestra.run.smithi107.stdout:linux-firmware-20240716-145.el9.noarch.rpm 12 MB/s | 383 MB 00:32 2024-08-17T02:12:32.817 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:12:32.817 INFO:teuthology.orchestra.run.smithi107.stdout:Total 12 MB/s | 383 MB 00:32 2024-08-17T02:12:35.895 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-08-17T02:12:36.081 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-08-17T02:12:36.081 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-08-17T02:12:39.316 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-08-17T02:12:39.316 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-08-17T02:12:48.244 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-08-17T02:12:48.976 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:12:49.059 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:12:49.621 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:12:49.621 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:12:50.357 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:12:50.357 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:12:50.357 INFO:teuthology.orchestra.run.smithi107.stdout:Upgraded: 2024-08-17T02:12:50.357 INFO:teuthology.orchestra.run.smithi107.stdout: linux-firmware-20240716-145.el9.noarch 2024-08-17T02:12:50.357 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:12:50.358 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-08-17T02:12:50.710 INFO:teuthology.task.kernel:Downloading kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.0... 2024-08-17T02:12:50.711 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:12:50.858 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ 2024-08-17T02:12:50.858 DEBUG:teuthology.orchestra.run.smithi107:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ --input-file=- 2024-08-17T02:12:50.861 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi107.front.sepia.ceph.com to complete... 2024-08-17T02:13:08.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17 02:13:08 URL:https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm [360536130/360536130] -> "/tmp/kernel.x86_64.rpm" [1] 2024-08-17T02:13:08.415 INFO:teuthology.orchestra.run.smithi157.stderr:FINISHED --2024-08-17 02:13:08-- 2024-08-17T02:13:08.415 INFO:teuthology.orchestra.run.smithi157.stderr:Total wall clock time: 42s 2024-08-17T02:13:08.415 INFO:teuthology.orchestra.run.smithi157.stderr:Downloaded: 1 files, 344M in 41s (8.38 MB/s) 2024-08-17T02:13:08.418 INFO:teuthology.task.kernel:Installing kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.1... 2024-08-17T02:13:08.418 DEBUG:teuthology.orchestra.run.smithi157:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-08-17T02:13:10.493 INFO:teuthology.orchestra.run.smithi157.stdout:Verifying... ######################################## 2024-08-17T02:13:10.622 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing... ######################################## 2024-08-17T02:13:10.672 INFO:teuthology.orchestra.run.smithi157.stdout:Updating / installing... 2024-08-17T02:13:15.966 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17 02:13:15 URL:https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm [360536130/360536130] -> "/tmp/kernel.x86_64.rpm" [1] 2024-08-17T02:13:15.966 INFO:teuthology.orchestra.run.smithi107.stderr:FINISHED --2024-08-17 02:13:15-- 2024-08-17T02:13:15.966 INFO:teuthology.orchestra.run.smithi107.stderr:Total wall clock time: 25s 2024-08-17T02:13:15.966 INFO:teuthology.orchestra.run.smithi107.stderr:Downloaded: 1 files, 344M in 25s (14.0 MB/s) 2024-08-17T02:13:15.969 INFO:teuthology.task.kernel:Installing kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.0... 2024-08-17T02:13:15.969 DEBUG:teuthology.orchestra.run.smithi107:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-08-17T02:13:18.034 INFO:teuthology.orchestra.run.smithi107.stdout:Verifying... ######################################## 2024-08-17T02:13:18.103 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing... ######################################## 2024-08-17T02:13:18.153 INFO:teuthology.orchestra.run.smithi107.stdout:Updating / installing... 2024-08-17T02:13:18.676 INFO:teuthology.orchestra.run.smithi157.stdout:kernel-6.11.0_rc3_g7503b862ff5b-1 ######################################## 2024-08-17T02:13:26.191 INFO:teuthology.orchestra.run.smithi107.stdout:kernel-6.11.0_rc3_g7503b862ff5b-1 ######################################## 2024-08-17T02:13:56.973 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi157.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-08-17T02:13:56.973 DEBUG:teuthology.orchestra.run.smithi157:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-08-17T02:13:57.061 INFO:teuthology.orchestra.run.smithi157.stdout:/boot/System.map-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:13:57.061 INFO:teuthology.orchestra.run.smithi157.stdout:/boot/config-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:13:57.061 INFO:teuthology.orchestra.run.smithi157.stdout:/boot/vmlinuz-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:13:57.061 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b 2024-08-17T02:13:57.061 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/System.map 2024-08-17T02:13:57.061 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/config 2024-08-17T02:13:57.061 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel 2024-08-17T02:13:57.061 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch 2024-08-17T02:13:57.062 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86 2024-08-17T02:13:57.062 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto 2024-08-17T02:13:57.062 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-08-17T02:13:57.062 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-08-17T02:13:57.062 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-08-17T02:13:57.062 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-08-17T02:13:57.062 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-08-17T02:13:57.062 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-08-17T02:13:57.062 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-08-17T02:13:57.062 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32c-intel.ko 2024-08-17T02:13:57.062 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-08-17T02:13:57.063 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-08-17T02:13:57.063 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-08-17T02:13:57.063 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-08-17T02:13:57.063 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx2.ko 2024-08-17T02:13:57.063 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-08-17T02:13:57.063 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-08-17T02:13:57.063 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-08-17T02:13:57.063 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-08-17T02:13:57.063 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-08-17T02:13:57.063 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-08-17T02:13:57.063 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-08-17T02:13:57.064 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel 2024-08-17T02:13:57.064 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu 2024-08-17T02:13:57.064 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce 2024-08-17T02:13:57.064 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-08-17T02:13:57.064 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm 2024-08-17T02:13:57.064 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-amd.ko 2024-08-17T02:13:57.064 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-intel.ko 2024-08-17T02:13:57.064 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm.ko 2024-08-17T02:13:57.064 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto 2024-08-17T02:13:57.064 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ansi_cprng.ko 2024-08-17T02:13:57.064 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/anubis.ko 2024-08-17T02:13:57.064 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/arc4.ko 2024-08-17T02:13:57.065 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx 2024-08-17T02:13:57.065 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_memcpy.ko 2024-08-17T02:13:57.065 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_pq.ko 2024-08-17T02:13:57.065 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_raid6_recov.ko 2024-08-17T02:13:57.065 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_tx.ko 2024-08-17T02:13:57.065 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_xor.ko 2024-08-17T02:13:57.065 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/raid6test.ko 2024-08-17T02:13:57.065 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authenc.ko 2024-08-17T02:13:57.065 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authencesn.ko 2024-08-17T02:13:57.065 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blake2b_generic.ko 2024-08-17T02:13:57.065 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_common.ko 2024-08-17T02:13:57.065 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_generic.ko 2024-08-17T02:13:57.066 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/camellia_generic.ko 2024-08-17T02:13:57.066 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast5_generic.ko 2024-08-17T02:13:57.066 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast6_generic.ko 2024-08-17T02:13:57.066 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast_common.ko 2024-08-17T02:13:57.066 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ccm.ko 2024-08-17T02:13:57.066 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cmac.ko 2024-08-17T02:13:57.066 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crc32_generic.ko 2024-08-17T02:13:57.066 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_engine.ko 2024-08-17T02:13:57.066 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_user.ko 2024-08-17T02:13:57.066 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cts.ko 2024-08-17T02:13:57.066 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/des_generic.ko 2024-08-17T02:13:57.067 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/dh_generic.ko 2024-08-17T02:13:57.067 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecc.ko 2024-08-17T02:13:57.067 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecdh_generic.ko 2024-08-17T02:13:57.067 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/echainiv.ko 2024-08-17T02:13:57.067 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/essiv.ko 2024-08-17T02:13:57.067 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/fcrypt.ko 2024-08-17T02:13:57.067 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/khazad.ko 2024-08-17T02:13:57.067 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4.ko 2024-08-17T02:13:57.067 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4hc.ko 2024-08-17T02:13:57.067 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/md4.ko 2024-08-17T02:13:57.067 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/michael_mic.ko 2024-08-17T02:13:57.067 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcbc.ko 2024-08-17T02:13:57.067 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcrypt.ko 2024-08-17T02:13:57.068 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/rmd160.ko 2024-08-17T02:13:57.068 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/seed.ko 2024-08-17T02:13:57.068 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/serpent_generic.ko 2024-08-17T02:13:57.068 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tcrypt.ko 2024-08-17T02:13:57.068 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tea.ko 2024-08-17T02:13:57.068 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_common.ko 2024-08-17T02:13:57.068 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_generic.ko 2024-08-17T02:13:57.068 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/vmac.ko 2024-08-17T02:13:57.068 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/wp512.ko 2024-08-17T02:13:57.068 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xcbc.ko 2024-08-17T02:13:57.068 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xor.ko 2024-08-17T02:13:57.068 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xxhash_generic.ko 2024-08-17T02:13:57.069 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers 2024-08-17T02:13:57.069 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi 2024-08-17T02:13:57.069 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_ipmi.ko 2024-08-17T02:13:57.069 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_pad.ko 2024-08-17T02:13:57.069 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/ec_sys.ko 2024-08-17T02:13:57.069 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/platform_profile.ko 2024-08-17T02:13:57.069 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbs.ko 2024-08-17T02:13:57.069 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbshc.ko 2024-08-17T02:13:57.069 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/video.ko 2024-08-17T02:13:57.069 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata 2024-08-17T02:13:57.069 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/acard-ahci.ko 2024-08-17T02:13:57.069 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ahci_platform.ko 2024-08-17T02:13:57.069 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ata_generic.ko 2024-08-17T02:13:57.070 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/libahci_platform.ko 2024-08-17T02:13:57.070 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_acpi.ko 2024-08-17T02:13:57.070 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ali.ko 2024-08-17T02:13:57.070 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_amd.ko 2024-08-17T02:13:57.070 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_artop.ko 2024-08-17T02:13:57.070 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atiixp.ko 2024-08-17T02:13:57.070 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atp867x.ko 2024-08-17T02:13:57.070 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd640.ko 2024-08-17T02:13:57.070 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd64x.ko 2024-08-17T02:13:57.070 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cypress.ko 2024-08-17T02:13:57.070 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_efar.ko 2024-08-17T02:13:57.070 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt366.ko 2024-08-17T02:13:57.071 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt37x.ko 2024-08-17T02:13:57.071 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x2n.ko 2024-08-17T02:13:57.071 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x3.ko 2024-08-17T02:13:57.071 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it8213.ko 2024-08-17T02:13:57.071 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it821x.ko 2024-08-17T02:13:57.071 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_jmicron.ko 2024-08-17T02:13:57.071 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_marvell.ko 2024-08-17T02:13:57.071 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_mpiix.ko 2024-08-17T02:13:57.071 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_netcell.ko 2024-08-17T02:13:57.071 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ninja32.ko 2024-08-17T02:13:57.071 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87410.ko 2024-08-17T02:13:57.071 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87415.ko 2024-08-17T02:13:57.072 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_oldpiix.ko 2024-08-17T02:13:57.072 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_opti.ko 2024-08-17T02:13:57.072 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_optidma.ko 2024-08-17T02:13:57.072 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pcmcia.ko 2024-08-17T02:13:57.072 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc2027x.ko 2024-08-17T02:13:57.072 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-08-17T02:13:57.072 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_piccolo.ko 2024-08-17T02:13:57.072 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_rdc.ko 2024-08-17T02:13:57.072 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sch.ko 2024-08-17T02:13:57.072 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_serverworks.ko 2024-08-17T02:13:57.072 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sil680.ko 2024-08-17T02:13:57.072 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sis.ko 2024-08-17T02:13:57.073 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sl82c105.ko 2024-08-17T02:13:57.073 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_triflex.ko 2024-08-17T02:13:57.073 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_via.ko 2024-08-17T02:13:57.073 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pdc_adma.ko 2024-08-17T02:13:57.073 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_inic162x.ko 2024-08-17T02:13:57.073 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_mv.ko 2024-08-17T02:13:57.073 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_nv.ko 2024-08-17T02:13:57.073 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_promise.ko 2024-08-17T02:13:57.073 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_qstor.ko 2024-08-17T02:13:57.073 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil.ko 2024-08-17T02:13:57.073 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil24.ko 2024-08-17T02:13:57.073 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sis.ko 2024-08-17T02:13:57.073 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_svw.ko 2024-08-17T02:13:57.074 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sx4.ko 2024-08-17T02:13:57.074 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_uli.ko 2024-08-17T02:13:57.074 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_via.ko 2024-08-17T02:13:57.074 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_vsc.ko 2024-08-17T02:13:57.074 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay 2024-08-17T02:13:57.074 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay/ks0108.ko 2024-08-17T02:13:57.074 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base 2024-08-17T02:13:57.074 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap 2024-08-17T02:13:57.074 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-i2c.ko 2024-08-17T02:13:57.074 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-mmio.ko 2024-08-17T02:13:57.074 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma 2024-08-17T02:13:57.074 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma/bcma.ko 2024-08-17T02:13:57.074 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block 2024-08-17T02:13:57.075 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe 2024-08-17T02:13:57.075 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe/aoe.ko 2024-08-17T02:13:57.075 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/brd.ko 2024-08-17T02:13:57.075 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd 2024-08-17T02:13:57.075 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd/drbd.ko 2024-08-17T02:13:57.075 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/floppy.ko 2024-08-17T02:13:57.075 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/loop.ko 2024-08-17T02:13:57.075 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx 2024-08-17T02:13:57.075 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-08-17T02:13:57.075 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/nbd.ko 2024-08-17T02:13:57.075 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk 2024-08-17T02:13:57.075 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk/null_blk.ko 2024-08-17T02:13:57.075 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/pktcdvd.ko 2024-08-17T02:13:57.076 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/rbd.ko 2024-08-17T02:13:57.076 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/virtio_blk.ko 2024-08-17T02:13:57.076 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback 2024-08-17T02:13:57.076 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-08-17T02:13:57.076 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkfront.ko 2024-08-17T02:13:57.076 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram 2024-08-17T02:13:57.076 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram/zram.ko 2024-08-17T02:13:57.076 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char 2024-08-17T02:13:57.076 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hangcheck-timer.ko 2024-08-17T02:13:57.076 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random 2024-08-17T02:13:57.076 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/amd-rng.ko 2024-08-17T02:13:57.076 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/intel-rng.ko 2024-08-17T02:13:57.076 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-08-17T02:13:57.077 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/via-rng.ko 2024-08-17T02:13:57.077 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/virtio-rng.ko 2024-08-17T02:13:57.077 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi 2024-08-17T02:13:57.077 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-08-17T02:13:57.077 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-08-17T02:13:57.077 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-08-17T02:13:57.077 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_si.ko 2024-08-17T02:13:57.077 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-08-17T02:13:57.077 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-08-17T02:13:57.077 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/lp.ko 2024-08-17T02:13:57.077 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave 2024-08-17T02:13:57.077 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave/mwave.ko 2024-08-17T02:13:57.078 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ppdev.ko 2024-08-17T02:13:57.078 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tlclk.ko 2024-08-17T02:13:57.078 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm 2024-08-17T02:13:57.078 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm.ko 2024-08-17T02:13:57.078 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_atmel.ko 2024-08-17T02:13:57.078 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_infineon.ko 2024-08-17T02:13:57.078 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_nsc.ko 2024-08-17T02:13:57.078 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis.ko 2024-08-17T02:13:57.078 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-08-17T02:13:57.078 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/uv_mmtimer.ko 2024-08-17T02:13:57.078 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/virtio_console.ko 2024-08-17T02:13:57.079 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq 2024-08-17T02:13:57.079 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-08-17T02:13:57.079 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-08-17T02:13:57.079 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/p4-clockmod.ko 2024-08-17T02:13:57.079 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-08-17T02:13:57.079 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/powernow-k8.ko 2024-08-17T02:13:57.079 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/speedstep-lib.ko 2024-08-17T02:13:57.079 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto 2024-08-17T02:13:57.079 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp 2024-08-17T02:13:57.079 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-08-17T02:13:57.079 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp.ko 2024-08-17T02:13:57.079 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel 2024-08-17T02:13:57.079 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat 2024-08-17T02:13:57.080 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common 2024-08-17T02:13:57.080 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-08-17T02:13:57.080 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-08-17T02:13:57.080 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-08-17T02:13:57.080 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-aes.ko 2024-08-17T02:13:57.080 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-sha.ko 2024-08-17T02:13:57.080 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio 2024-08-17T02:13:57.080 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-08-17T02:13:57.080 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca 2024-08-17T02:13:57.080 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca/dca.ko 2024-08-17T02:13:57.080 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq 2024-08-17T02:13:57.080 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-08-17T02:13:57.081 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma 2024-08-17T02:13:57.081 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw 2024-08-17T02:13:57.081 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw/dw_dmac.ko 2024-08-17T02:13:57.081 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat 2024-08-17T02:13:57.081 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat/ioatdma.ko 2024-08-17T02:13:57.081 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac 2024-08-17T02:13:57.081 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/amd64_edac.ko 2024-08-17T02:13:57.081 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/e752x_edac.ko 2024-08-17T02:13:57.081 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/edac_mce_amd.ko 2024-08-17T02:13:57.081 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3000_edac.ko 2024-08-17T02:13:57.081 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3200_edac.ko 2024-08-17T02:13:57.081 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5100_edac.ko 2024-08-17T02:13:57.081 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5400_edac.ko 2024-08-17T02:13:57.082 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7300_edac.ko 2024-08-17T02:13:57.082 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7core_edac.ko 2024-08-17T02:13:57.082 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i82975x_edac.ko 2024-08-17T02:13:57.082 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/ie31200_edac.ko 2024-08-17T02:13:57.082 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/sb_edac.ko 2024-08-17T02:13:57.082 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/x38_edac.ko 2024-08-17T02:13:57.082 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware 2024-08-17T02:13:57.082 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/edd.ko 2024-08-17T02:13:57.082 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/iscsi_ibft.ko 2024-08-17T02:13:57.082 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio 2024-08-17T02:13:57.082 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-ich.ko 2024-08-17T02:13:57.082 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-viperboard.ko 2024-08-17T02:13:57.083 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid 2024-08-17T02:13:57.083 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-appleir.ko 2024-08-17T02:13:57.083 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-aureal.ko 2024-08-17T02:13:57.083 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-axff.ko 2024-08-17T02:13:57.083 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-dr.ko 2024-08-17T02:13:57.083 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elecom.ko 2024-08-17T02:13:57.083 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elo.ko 2024-08-17T02:13:57.083 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-emsff.ko 2024-08-17T02:13:57.083 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gaff.ko 2024-08-17T02:13:57.083 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gt683r.ko 2024-08-17T02:13:57.083 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gyration.ko 2024-08-17T02:13:57.083 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-kbd.ko 2024-08-17T02:13:57.083 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-mouse.ko 2024-08-17T02:13:57.084 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtekff.ko 2024-08-17T02:13:57.084 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-hyperv.ko 2024-08-17T02:13:57.084 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-icade.ko 2024-08-17T02:13:57.084 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-keytouch.ko 2024-08-17T02:13:57.084 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-kye.ko 2024-08-17T02:13:57.084 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lcpower.ko 2024-08-17T02:13:57.084 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-led.ko 2024-08-17T02:13:57.084 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lenovo.ko 2024-08-17T02:13:57.084 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-dj.ko 2024-08-17T02:13:57.084 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-08-17T02:13:57.084 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-multitouch.ko 2024-08-17T02:13:57.084 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-ortek.ko 2024-08-17T02:13:57.084 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-penmount.ko 2024-08-17T02:13:57.085 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-petalynx.ko 2024-08-17T02:13:57.085 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-picolcd.ko 2024-08-17T02:13:57.085 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-pl.ko 2024-08-17T02:13:57.085 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-plantronics.ko 2024-08-17T02:13:57.085 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-primax.ko 2024-08-17T02:13:57.085 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-rmi.ko 2024-08-17T02:13:57.085 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-arvo.ko 2024-08-17T02:13:57.085 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-common.ko 2024-08-17T02:13:57.085 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-isku.ko 2024-08-17T02:13:57.085 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kone.ko 2024-08-17T02:13:57.085 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-08-17T02:13:57.085 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-konepure.ko 2024-08-17T02:13:57.085 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-08-17T02:13:57.086 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-lua.ko 2024-08-17T02:13:57.086 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-pyra.ko 2024-08-17T02:13:57.086 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-ryos.ko 2024-08-17T02:13:57.086 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-savu.ko 2024-08-17T02:13:57.086 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat.ko 2024-08-17T02:13:57.086 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-saitek.ko 2024-08-17T02:13:57.086 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-samsung.ko 2024-08-17T02:13:57.086 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sensor-hub.ko 2024-08-17T02:13:57.086 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sjoy.ko 2024-08-17T02:13:57.087 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sony.ko 2024-08-17T02:13:57.087 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-speedlink.ko 2024-08-17T02:13:57.087 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-steelseries.ko 2024-08-17T02:13:57.087 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sunplus.ko 2024-08-17T02:13:57.087 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-thrustmaster.ko 2024-08-17T02:13:57.087 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tivo.ko 2024-08-17T02:13:57.087 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tmff.ko 2024-08-17T02:13:57.087 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-topseed.ko 2024-08-17T02:13:57.087 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-twinhan.ko 2024-08-17T02:13:57.087 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-uclogic.ko 2024-08-17T02:13:57.087 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-waltop.ko 2024-08-17T02:13:57.087 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-wiimote.ko 2024-08-17T02:13:57.087 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-xinmo.ko 2024-08-17T02:13:57.088 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zpff.ko 2024-08-17T02:13:57.088 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zydacron.ko 2024-08-17T02:13:57.088 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/uhid.ko 2024-08-17T02:13:57.088 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/wacom.ko 2024-08-17T02:13:57.088 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv 2024-08-17T02:13:57.088 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_balloon.ko 2024-08-17T02:13:57.088 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_utils.ko 2024-08-17T02:13:57.088 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_vmbus.ko 2024-08-17T02:13:57.088 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon 2024-08-17T02:13:57.088 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru.ko 2024-08-17T02:13:57.088 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru3.ko 2024-08-17T02:13:57.088 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/acpi_power_meter.ko 2024-08-17T02:13:57.088 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7414.ko 2024-08-17T02:13:57.089 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7418.ko 2024-08-17T02:13:57.089 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adc128d818.ko 2024-08-17T02:13:57.089 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1025.ko 2024-08-17T02:13:57.089 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1026.ko 2024-08-17T02:13:57.089 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1029.ko 2024-08-17T02:13:57.089 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1031.ko 2024-08-17T02:13:57.089 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm9240.ko 2024-08-17T02:13:57.089 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ads7828.ko 2024-08-17T02:13:57.089 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7410.ko 2024-08-17T02:13:57.089 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7411.ko 2024-08-17T02:13:57.089 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7462.ko 2024-08-17T02:13:57.089 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7470.ko 2024-08-17T02:13:57.089 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7475.ko 2024-08-17T02:13:57.090 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7x10.ko 2024-08-17T02:13:57.090 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/amc6821.ko 2024-08-17T02:13:57.090 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/applesmc.ko 2024-08-17T02:13:57.090 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asb100.ko 2024-08-17T02:13:57.090 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asc7621.ko 2024-08-17T02:13:57.090 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asus_atk0110.ko 2024-08-17T02:13:57.090 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/atxp1.ko 2024-08-17T02:13:57.090 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/coretemp.ko 2024-08-17T02:13:57.090 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-08-17T02:13:57.090 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dme1737.ko 2024-08-17T02:13:57.090 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds1621.ko 2024-08-17T02:13:57.090 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds620.ko 2024-08-17T02:13:57.091 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc1403.ko 2024-08-17T02:13:57.091 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc6w201.ko 2024-08-17T02:13:57.091 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71805f.ko 2024-08-17T02:13:57.091 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71882fg.ko 2024-08-17T02:13:57.091 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f75375s.ko 2024-08-17T02:13:57.091 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fam15h_power.ko 2024-08-17T02:13:57.091 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fschmd.ko 2024-08-17T02:13:57.091 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g760a.ko 2024-08-17T02:13:57.091 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g762.ko 2024-08-17T02:13:57.091 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl518sm.ko 2024-08-17T02:13:57.091 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl520sm.ko 2024-08-17T02:13:57.091 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/hwmon-vid.ko 2024-08-17T02:13:57.091 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5500_temp.ko 2024-08-17T02:13:57.092 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5k_amb.ko 2024-08-17T02:13:57.092 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmaem.ko 2024-08-17T02:13:57.092 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmpex.ko 2024-08-17T02:13:57.092 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina209.ko 2024-08-17T02:13:57.092 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina2xx.ko 2024-08-17T02:13:57.092 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/it87.ko 2024-08-17T02:13:57.092 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k10temp.ko 2024-08-17T02:13:57.092 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k8temp.ko 2024-08-17T02:13:57.092 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lineage-pem.ko 2024-08-17T02:13:57.092 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm63.ko 2024-08-17T02:13:57.092 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm73.ko 2024-08-17T02:13:57.092 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm75.ko 2024-08-17T02:13:57.092 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm77.ko 2024-08-17T02:13:57.093 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm78.ko 2024-08-17T02:13:57.093 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm80.ko 2024-08-17T02:13:57.093 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm83.ko 2024-08-17T02:13:57.093 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm85.ko 2024-08-17T02:13:57.093 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm87.ko 2024-08-17T02:13:57.093 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm90.ko 2024-08-17T02:13:57.093 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm92.ko 2024-08-17T02:13:57.093 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm93.ko 2024-08-17T02:13:57.093 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95234.ko 2024-08-17T02:13:57.093 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95241.ko 2024-08-17T02:13:57.093 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95245.ko 2024-08-17T02:13:57.093 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc2945.ko 2024-08-17T02:13:57.093 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4151.ko 2024-08-17T02:13:57.094 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4215.ko 2024-08-17T02:13:57.094 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4222.ko 2024-08-17T02:13:57.094 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4245.ko 2024-08-17T02:13:57.094 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4260.ko 2024-08-17T02:13:57.094 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4261.ko 2024-08-17T02:13:57.094 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max16065.ko 2024-08-17T02:13:57.094 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1619.ko 2024-08-17T02:13:57.094 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1668.ko 2024-08-17T02:13:57.094 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max197.ko 2024-08-17T02:13:57.094 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6639.ko 2024-08-17T02:13:57.094 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6650.ko 2024-08-17T02:13:57.094 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6697.ko 2024-08-17T02:13:57.094 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/mcp3021.ko 2024-08-17T02:13:57.094 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6683.ko 2024-08-17T02:13:57.095 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775-core.ko 2024-08-17T02:13:57.095 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775.ko 2024-08-17T02:13:57.095 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct7802.ko 2024-08-17T02:13:57.095 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87360.ko 2024-08-17T02:13:57.095 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87427.ko 2024-08-17T02:13:57.095 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pcf8591.ko 2024-08-17T02:13:57.095 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus 2024-08-17T02:13:57.095 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-08-17T02:13:57.095 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-08-17T02:13:57.095 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-08-17T02:13:57.095 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max16064.ko 2024-08-17T02:13:57.095 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max34440.ko 2024-08-17T02:13:57.096 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max8688.ko 2024-08-17T02:13:57.096 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-08-17T02:13:57.096 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-08-17T02:13:57.096 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-08-17T02:13:57.096 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-08-17T02:13:57.096 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-08-17T02:13:57.096 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-08-17T02:13:57.096 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/powr1220.ko 2024-08-17T02:13:57.096 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5627.ko 2024-08-17T02:13:57.096 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5636.ko 2024-08-17T02:13:57.096 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch56xx-common.ko 2024-08-17T02:13:57.096 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht15.ko 2024-08-17T02:13:57.096 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht21.ko 2024-08-17T02:13:57.097 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/shtc1.ko 2024-08-17T02:13:57.097 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sis5595.ko 2024-08-17T02:13:57.097 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47b397.ko 2024-08-17T02:13:57.097 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m1.ko 2024-08-17T02:13:57.097 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m192.ko 2024-08-17T02:13:57.097 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/thmc50.ko 2024-08-17T02:13:57.097 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp102.ko 2024-08-17T02:13:57.097 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp103.ko 2024-08-17T02:13:57.097 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp401.ko 2024-08-17T02:13:57.097 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp421.ko 2024-08-17T02:13:57.097 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via-cputemp.ko 2024-08-17T02:13:57.097 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via686a.ko 2024-08-17T02:13:57.097 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt1211.ko 2024-08-17T02:13:57.097 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt8231.ko 2024-08-17T02:13:57.098 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627ehf.ko 2024-08-17T02:13:57.098 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627hf.ko 2024-08-17T02:13:57.098 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83781d.ko 2024-08-17T02:13:57.098 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83791d.ko 2024-08-17T02:13:57.098 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83792d.ko 2024-08-17T02:13:57.098 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83793.ko 2024-08-17T02:13:57.098 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83795.ko 2024-08-17T02:13:57.098 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l785ts.ko 2024-08-17T02:13:57.098 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l786ng.ko 2024-08-17T02:13:57.098 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c 2024-08-17T02:13:57.098 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos 2024-08-17T02:13:57.098 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-08-17T02:13:57.099 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-08-17T02:13:57.099 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses 2024-08-17T02:13:57.099 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-08-17T02:13:57.099 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-08-17T02:13:57.099 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-08-17T02:13:57.099 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-08-17T02:13:57.099 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-08-17T02:13:57.099 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-08-17T02:13:57.099 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-08-17T02:13:57.099 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-08-17T02:13:57.099 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-i801.ko 2024-08-17T02:13:57.099 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-isch.ko 2024-08-17T02:13:57.099 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-08-17T02:13:57.100 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-08-17T02:13:57.100 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-08-17T02:13:57.100 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-parport.ko 2024-08-17T02:13:57.100 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-08-17T02:13:57.100 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-08-17T02:13:57.100 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-08-17T02:13:57.100 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-08-17T02:13:57.100 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-08-17T02:13:57.100 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-08-17T02:13:57.100 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-via.ko 2024-08-17T02:13:57.100 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-08-17T02:13:57.100 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-08-17T02:13:57.100 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-dev.ko 2024-08-17T02:13:57.101 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-mux.ko 2024-08-17T02:13:57.101 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-08-17T02:13:57.101 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-smbus.ko 2024-08-17T02:13:57.101 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-stub.ko 2024-08-17T02:13:57.101 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband 2024-08-17T02:13:57.101 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core 2024-08-17T02:13:57.101 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_cm.ko 2024-08-17T02:13:57.101 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_core.ko 2024-08-17T02:13:57.101 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_umad.ko 2024-08-17T02:13:57.101 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-08-17T02:13:57.101 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/iw_cm.ko 2024-08-17T02:13:57.101 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_cm.ko 2024-08-17T02:13:57.102 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-08-17T02:13:57.102 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw 2024-08-17T02:13:57.102 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4 2024-08-17T02:13:57.102 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-08-17T02:13:57.102 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4 2024-08-17T02:13:57.102 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-08-17T02:13:57.102 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5 2024-08-17T02:13:57.102 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-08-17T02:13:57.102 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca 2024-08-17T02:13:57.102 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-08-17T02:13:57.102 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp 2024-08-17T02:13:57.102 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib 2024-08-17T02:13:57.103 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-08-17T02:13:57.103 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser 2024-08-17T02:13:57.103 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-08-17T02:13:57.103 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert 2024-08-17T02:13:57.103 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-08-17T02:13:57.103 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp 2024-08-17T02:13:57.103 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-08-17T02:13:57.103 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt 2024-08-17T02:13:57.103 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-08-17T02:13:57.103 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input 2024-08-17T02:13:57.103 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport 2024-08-17T02:13:57.103 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-08-17T02:13:57.103 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/fm801-gp.ko 2024-08-17T02:13:57.103 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/gameport.ko 2024-08-17T02:13:57.104 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/joydev.ko 2024-08-17T02:13:57.104 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard 2024-08-17T02:13:57.104 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/gpio_keys.ko 2024-08-17T02:13:57.104 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse 2024-08-17T02:13:57.104 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/appletouch.ko 2024-08-17T02:13:57.104 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/bcm5974.ko 2024-08-17T02:13:57.104 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/cyapatp.ko 2024-08-17T02:13:57.104 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/elan_i2c.ko 2024-08-17T02:13:57.104 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/sermouse.ko 2024-08-17T02:13:57.104 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-08-17T02:13:57.104 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_usb.ko 2024-08-17T02:13:57.104 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/vsxxxaa.ko 2024-08-17T02:13:57.104 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4 2024-08-17T02:13:57.105 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4/rmi_core.ko 2024-08-17T02:13:57.105 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio 2024-08-17T02:13:57.105 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/altera_ps2.ko 2024-08-17T02:13:57.105 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/arc_ps2.ko 2024-08-17T02:13:57.105 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-08-17T02:13:57.105 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/serio_raw.ko 2024-08-17T02:13:57.105 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/sparse-keymap.ko 2024-08-17T02:13:57.105 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds 2024-08-17T02:13:57.105 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-blinkm.ko 2024-08-17T02:13:57.105 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lm3530.ko 2024-08-17T02:13:57.105 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lp3944.ko 2024-08-17T02:13:57.105 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-ss4200.ko 2024-08-17T02:13:57.105 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger 2024-08-17T02:13:57.105 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-08-17T02:13:57.106 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-08-17T02:13:57.106 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-08-17T02:13:57.106 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-08-17T02:13:57.106 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-08-17T02:13:57.106 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-08-17T02:13:57.106 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-08-17T02:13:57.106 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-08-17T02:13:57.106 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md 2024-08-17T02:13:57.106 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache 2024-08-17T02:13:57.106 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache/bcache.ko 2024-08-17T02:13:57.106 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-bio-prison.ko 2024-08-17T02:13:57.106 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache-smq.ko 2024-08-17T02:13:57.107 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache.ko 2024-08-17T02:13:57.107 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-crypt.ko 2024-08-17T02:13:57.107 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-delay.ko 2024-08-17T02:13:57.107 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-flakey.ko 2024-08-17T02:13:57.107 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-log-userspace.ko 2024-08-17T02:13:57.107 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-multipath.ko 2024-08-17T02:13:57.107 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-queue-length.ko 2024-08-17T02:13:57.107 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-raid.ko 2024-08-17T02:13:57.107 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-round-robin.ko 2024-08-17T02:13:57.107 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-service-time.ko 2024-08-17T02:13:57.107 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-switch.ko 2024-08-17T02:13:57.107 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-thin-pool.ko 2024-08-17T02:13:57.108 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-verity.ko 2024-08-17T02:13:57.108 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data 2024-08-17T02:13:57.108 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-08-17T02:13:57.108 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid0.ko 2024-08-17T02:13:57.108 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid1.ko 2024-08-17T02:13:57.108 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid10.ko 2024-08-17T02:13:57.108 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid456.ko 2024-08-17T02:13:57.108 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message 2024-08-17T02:13:57.108 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion 2024-08-17T02:13:57.108 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptbase.ko 2024-08-17T02:13:57.108 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptctl.ko 2024-08-17T02:13:57.108 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptfc.ko 2024-08-17T02:13:57.109 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptlan.ko 2024-08-17T02:13:57.109 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptsas.ko 2024-08-17T02:13:57.109 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptscsih.ko 2024-08-17T02:13:57.109 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptspi.ko 2024-08-17T02:13:57.109 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd 2024-08-17T02:13:57.109 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_ich.ko 2024-08-17T02:13:57.109 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_sch.ko 2024-08-17T02:13:57.109 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/mfd-core.ko 2024-08-17T02:13:57.109 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/sm501.ko 2024-08-17T02:13:57.109 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/viperboard.ko 2024-08-17T02:13:57.109 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/vx855.ko 2024-08-17T02:13:57.109 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/wl1273-core.ko 2024-08-17T02:13:57.109 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc 2024-08-17T02:13:57.110 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl 2024-08-17T02:13:57.110 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-08-17T02:13:57.110 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds9802als.ko 2024-08-17T02:13:57.110 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds990x.ko 2024-08-17T02:13:57.110 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/bh1770glc.ko 2024-08-17T02:13:57.110 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710 2024-08-17T02:13:57.110 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710/cb710.ko 2024-08-17T02:13:57.110 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom 2024-08-17T02:13:57.110 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/at24.ko 2024-08-17T02:13:57.110 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-08-17T02:13:57.110 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/max6875.ko 2024-08-17T02:13:57.110 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/enclosure.ko 2024-08-17T02:13:57.111 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/hpilo.ko 2024-08-17T02:13:57.111 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29003.ko 2024-08-17T02:13:57.111 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29020.ko 2024-08-17T02:13:57.111 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d 2024-08-17T02:13:57.111 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-08-17T02:13:57.111 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-08-17T02:13:57.111 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei 2024-08-17T02:13:57.111 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-me.ko 2024-08-17T02:13:57.111 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-txe.ko 2024-08-17T02:13:57.111 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei.ko 2024-08-17T02:13:57.111 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru 2024-08-17T02:13:57.111 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru/gru.ko 2024-08-17T02:13:57.111 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp 2024-08-17T02:13:57.112 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xp.ko 2024-08-17T02:13:57.112 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpc.ko 2024-08-17T02:13:57.112 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-08-17T02:13:57.112 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_7xx1.ko 2024-08-17T02:13:57.112 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_core.ko 2024-08-17T02:13:57.112 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tsl2550.ko 2024-08-17T02:13:57.112 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_balloon.ko 2024-08-17T02:13:57.112 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci 2024-08-17T02:13:57.112 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-08-17T02:13:57.112 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net 2024-08-17T02:13:57.112 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding 2024-08-17T02:13:57.112 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding/bonding.ko 2024-08-17T02:13:57.112 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa 2024-08-17T02:13:57.112 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53 2024-08-17T02:13:57.113 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53/b53_common.ko 2024-08-17T02:13:57.113 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/bcm-sf2.ko 2024-08-17T02:13:57.113 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6060.ko 2024-08-17T02:13:57.113 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx 2024-08-17T02:13:57.113 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-08-17T02:13:57.113 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dummy.ko 2024-08-17T02:13:57.113 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/eql.ko 2024-08-17T02:13:57.113 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet 2024-08-17T02:13:57.113 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com 2024-08-17T02:13:57.113 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-08-17T02:13:57.113 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-08-17T02:13:57.113 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-08-17T02:13:57.113 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-08-17T02:13:57.114 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390 2024-08-17T02:13:57.114 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/8390.ko 2024-08-17T02:13:57.114 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-08-17T02:13:57.114 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-08-17T02:13:57.114 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-08-17T02:13:57.114 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec 2024-08-17T02:13:57.114 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-08-17T02:13:57.114 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere 2024-08-17T02:13:57.114 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere/et131x.ko 2024-08-17T02:13:57.114 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon 2024-08-17T02:13:57.114 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-08-17T02:13:57.114 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera 2024-08-17T02:13:57.114 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-08-17T02:13:57.115 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd 2024-08-17T02:13:57.115 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-08-17T02:13:57.115 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-08-17T02:13:57.115 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-08-17T02:13:57.115 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros 2024-08-17T02:13:57.115 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx 2024-08-17T02:13:57.115 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-08-17T02:13:57.115 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c 2024-08-17T02:13:57.115 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-08-17T02:13:57.115 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e 2024-08-17T02:13:57.115 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-08-17T02:13:57.115 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx 2024-08-17T02:13:57.115 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-08-17T02:13:57.115 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-08-17T02:13:57.116 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom 2024-08-17T02:13:57.116 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-08-17T02:13:57.116 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-08-17T02:13:57.116 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-08-17T02:13:57.116 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-08-17T02:13:57.116 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-08-17T02:13:57.116 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet 2024-08-17T02:13:57.116 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-08-17T02:13:57.116 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-08-17T02:13:57.116 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade 2024-08-17T02:13:57.116 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna 2024-08-17T02:13:57.116 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-08-17T02:13:57.116 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio 2024-08-17T02:13:57.117 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb 2024-08-17T02:13:57.117 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-08-17T02:13:57.117 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-08-17T02:13:57.117 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-08-17T02:13:57.117 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-08-17T02:13:57.117 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-08-17T02:13:57.117 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-08-17T02:13:57.117 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-08-17T02:13:57.117 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-08-17T02:13:57.117 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-08-17T02:13:57.117 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco 2024-08-17T02:13:57.117 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic 2024-08-17T02:13:57.117 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-08-17T02:13:57.118 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec 2024-08-17T02:13:57.118 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip 2024-08-17T02:13:57.118 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-08-17T02:13:57.118 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-08-17T02:13:57.118 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-08-17T02:13:57.118 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-08-17T02:13:57.118 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-08-17T02:13:57.118 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-08-17T02:13:57.118 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink 2024-08-17T02:13:57.118 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-08-17T02:13:57.118 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-08-17T02:13:57.118 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dnet.ko 2024-08-17T02:13:57.118 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex 2024-08-17T02:13:57.119 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet 2024-08-17T02:13:57.119 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-08-17T02:13:57.119 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ethoc.ko 2024-08-17T02:13:57.119 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/fealnx.ko 2024-08-17T02:13:57.119 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel 2024-08-17T02:13:57.119 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e100.ko 2024-08-17T02:13:57.119 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000 2024-08-17T02:13:57.119 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-08-17T02:13:57.119 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e 2024-08-17T02:13:57.119 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-08-17T02:13:57.119 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k 2024-08-17T02:13:57.119 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-08-17T02:13:57.119 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e 2024-08-17T02:13:57.120 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-08-17T02:13:57.120 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf 2024-08-17T02:13:57.120 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-08-17T02:13:57.120 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb 2024-08-17T02:13:57.120 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-08-17T02:13:57.120 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf 2024-08-17T02:13:57.120 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-08-17T02:13:57.120 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe 2024-08-17T02:13:57.120 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-08-17T02:13:57.120 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf 2024-08-17T02:13:57.120 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-08-17T02:13:57.120 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth 2024-08-17T02:13:57.120 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-08-17T02:13:57.121 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie 2024-08-17T02:13:57.121 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-08-17T02:13:57.121 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/jme.ko 2024-08-17T02:13:57.121 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell 2024-08-17T02:13:57.121 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-08-17T02:13:57.121 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/skge.ko 2024-08-17T02:13:57.121 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-08-17T02:13:57.121 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox 2024-08-17T02:13:57.121 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4 2024-08-17T02:13:57.121 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-08-17T02:13:57.121 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-08-17T02:13:57.121 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5 2024-08-17T02:13:57.122 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-08-17T02:13:57.122 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-08-17T02:13:57.122 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel 2024-08-17T02:13:57.122 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-08-17T02:13:57.122 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom 2024-08-17T02:13:57.122 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge 2024-08-17T02:13:57.122 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-08-17T02:13:57.122 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi 2024-08-17T02:13:57.122 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-08-17T02:13:57.122 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-08-17T02:13:57.122 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion 2024-08-17T02:13:57.122 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-08-17T02:13:57.122 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia 2024-08-17T02:13:57.123 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-08-17T02:13:57.123 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines 2024-08-17T02:13:57.123 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-08-17T02:13:57.123 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-08-17T02:13:57.123 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic 2024-08-17T02:13:57.123 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen 2024-08-17T02:13:57.123 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-08-17T02:13:57.123 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-08-17T02:13:57.123 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-08-17T02:13:57.123 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-08-17T02:13:57.123 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc 2024-08-17T02:13:57.123 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-08-17T02:13:57.124 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek 2024-08-17T02:13:57.124 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-08-17T02:13:57.124 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-08-17T02:13:57.124 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/atp.ko 2024-08-17T02:13:57.124 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-08-17T02:13:57.124 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker 2024-08-17T02:13:57.124 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-08-17T02:13:57.124 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc 2024-08-17T02:13:57.124 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-08-17T02:13:57.124 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan 2024-08-17T02:13:57.124 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-08-17T02:13:57.124 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis 2024-08-17T02:13:57.125 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis190.ko 2024-08-17T02:13:57.125 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis900.ko 2024-08-17T02:13:57.125 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc 2024-08-17T02:13:57.125 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-08-17T02:13:57.125 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-08-17T02:13:57.125 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-08-17T02:13:57.125 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-08-17T02:13:57.125 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro 2024-08-17T02:13:57.125 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac 2024-08-17T02:13:57.125 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-08-17T02:13:57.125 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-08-17T02:13:57.125 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun 2024-08-17T02:13:57.126 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/cassini.ko 2024-08-17T02:13:57.126 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/niu.ko 2024-08-17T02:13:57.126 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sungem.ko 2024-08-17T02:13:57.126 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-08-17T02:13:57.126 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti 2024-08-17T02:13:57.126 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-08-17T02:13:57.126 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti 2024-08-17T02:13:57.126 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti/tlan.ko 2024-08-17T02:13:57.126 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via 2024-08-17T02:13:57.126 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-08-17T02:13:57.126 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-08-17T02:13:57.126 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet 2024-08-17T02:13:57.126 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-08-17T02:13:57.127 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-08-17T02:13:57.127 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom 2024-08-17T02:13:57.127 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-08-17T02:13:57.127 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/geneve.ko 2024-08-17T02:13:57.127 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv 2024-08-17T02:13:57.127 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-08-17T02:13:57.127 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154 2024-08-17T02:13:57.127 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154/fakelb.ko 2024-08-17T02:13:57.127 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ifb.ko 2024-08-17T02:13:57.127 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan 2024-08-17T02:13:57.127 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan/ipvlan.ko 2024-08-17T02:13:57.127 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvlan.ko 2024-08-17T02:13:57.127 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvtap.ko 2024-08-17T02:13:57.127 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio 2024-08-17T02:13:57.128 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio.ko 2024-08-17T02:13:57.128 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-08-17T02:13:57.128 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-08-17T02:13:57.128 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-regmap.ko 2024-08-17T02:13:57.128 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mii.ko 2024-08-17T02:13:57.128 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/net_failover.ko 2024-08-17T02:13:57.128 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/netconsole.ko 2024-08-17T02:13:57.128 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/nlmon.ko 2024-08-17T02:13:57.128 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs 2024-08-17T02:13:57.128 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs-lynx.ko 2024-08-17T02:13:57.128 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-08-17T02:13:57.128 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy 2024-08-17T02:13:57.129 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/amd.ko 2024-08-17T02:13:57.129 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-08-17T02:13:57.129 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-08-17T02:13:57.129 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm7xxx.ko 2024-08-17T02:13:57.129 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm87xx.ko 2024-08-17T02:13:57.129 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/broadcom.ko 2024-08-17T02:13:57.129 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/cicada.ko 2024-08-17T02:13:57.129 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/davicom.ko 2024-08-17T02:13:57.129 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/dp83640.ko 2024-08-17T02:13:57.129 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/et1011c.ko 2024-08-17T02:13:57.129 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/icplus.ko 2024-08-17T02:13:57.129 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/lxt.ko 2024-08-17T02:13:57.129 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/marvell.ko 2024-08-17T02:13:57.129 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/micrel.ko 2024-08-17T02:13:57.129 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/national.ko 2024-08-17T02:13:57.130 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/phylink.ko 2024-08-17T02:13:57.130 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/qsemi.ko 2024-08-17T02:13:57.130 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/realtek.ko 2024-08-17T02:13:57.130 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/smsc.ko 2024-08-17T02:13:57.130 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/ste10Xp.ko 2024-08-17T02:13:57.130 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/vitesse.ko 2024-08-17T02:13:57.130 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp 2024-08-17T02:13:57.130 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/bsd_comp.ko 2024-08-17T02:13:57.130 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_async.ko 2024-08-17T02:13:57.130 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_deflate.ko 2024-08-17T02:13:57.130 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_generic.ko 2024-08-17T02:13:57.130 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_mppe.ko 2024-08-17T02:13:57.130 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_synctty.ko 2024-08-17T02:13:57.131 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppoe.ko 2024-08-17T02:13:57.131 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppox.ko 2024-08-17T02:13:57.131 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pptp.ko 2024-08-17T02:13:57.131 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip 2024-08-17T02:13:57.131 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slhc.ko 2024-08-17T02:13:57.131 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slip.ko 2024-08-17T02:13:57.131 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/sungem_phy.ko 2024-08-17T02:13:57.131 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tap.ko 2024-08-17T02:13:57.131 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team 2024-08-17T02:13:57.131 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team.ko 2024-08-17T02:13:57.131 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_activebackup.ko 2024-08-17T02:13:57.131 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_broadcast.ko 2024-08-17T02:13:57.131 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-08-17T02:13:57.131 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_random.ko 2024-08-17T02:13:57.132 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-08-17T02:13:57.132 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tun.ko 2024-08-17T02:13:57.132 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/veth.ko 2024-08-17T02:13:57.132 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/virtio_net.ko 2024-08-17T02:13:57.132 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3 2024-08-17T02:13:57.132 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-08-17T02:13:57.132 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan 2024-08-17T02:13:57.132 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan/vxlan.ko 2024-08-17T02:13:57.132 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback 2024-08-17T02:13:57.132 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback/xen-netback.ko 2024-08-17T02:13:57.132 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netfront.ko 2024-08-17T02:13:57.132 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb 2024-08-17T02:13:57.132 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb/ntb.ko 2024-08-17T02:13:57.133 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme 2024-08-17T02:13:57.133 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host 2024-08-17T02:13:57.133 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme-core.ko 2024-08-17T02:13:57.133 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme.ko 2024-08-17T02:13:57.133 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport 2024-08-17T02:13:57.133 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport.ko 2024-08-17T02:13:57.133 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_cs.ko 2024-08-17T02:13:57.133 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_pc.ko 2024-08-17T02:13:57.133 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_serial.ko 2024-08-17T02:13:57.133 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci 2024-08-17T02:13:57.133 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug 2024-08-17T02:13:57.133 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-08-17T02:13:57.133 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie 2024-08-17T02:13:57.133 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie/aer_inject.ko 2024-08-17T02:13:57.134 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/xen-pcifront.ko 2024-08-17T02:13:57.134 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia 2024-08-17T02:13:57.134 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/i82092.ko 2024-08-17T02:13:57.134 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/pd6729.ko 2024-08-17T02:13:57.134 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/yenta_socket.ko 2024-08-17T02:13:57.134 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl 2024-08-17T02:13:57.134 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel 2024-08-17T02:13:57.134 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-08-17T02:13:57.134 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform 2024-08-17T02:13:57.134 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86 2024-08-17T02:13:57.134 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acer-wmi.ko 2024-08-17T02:13:57.134 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acerhdf.ko 2024-08-17T02:13:57.135 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/apple-gmux.ko 2024-08-17T02:13:57.135 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-laptop.ko 2024-08-17T02:13:57.135 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-08-17T02:13:57.135 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-wmi.ko 2024-08-17T02:13:57.135 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/classmate-laptop.ko 2024-08-17T02:13:57.135 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-08-17T02:13:57.135 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-08-17T02:13:57.135 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-08-17T02:13:57.135 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-08-17T02:13:57.135 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/hdaps.ko 2024-08-17T02:13:57.135 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel 2024-08-17T02:13:57.135 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-08-17T02:13:57.135 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel_ips.ko 2024-08-17T02:13:57.136 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/msi-wmi.ko 2024-08-17T02:13:57.136 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/mxm-wmi.ko 2024-08-17T02:13:57.136 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-08-17T02:13:57.136 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-laptop.ko 2024-08-17T02:13:57.136 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-q10.ko 2024-08-17T02:13:57.136 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/topstar-laptop.ko 2024-08-17T02:13:57.136 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-08-17T02:13:57.136 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_haps.ko 2024-08-17T02:13:57.136 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi-bmof.ko 2024-08-17T02:13:57.136 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi.ko 2024-08-17T02:13:57.136 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap 2024-08-17T02:13:57.136 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_common.ko 2024-08-17T02:13:57.136 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_msr.ko 2024-08-17T02:13:57.136 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps 2024-08-17T02:13:57.137 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients 2024-08-17T02:13:57.137 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-gpio.ko 2024-08-17T02:13:57.137 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-ldisc.ko 2024-08-17T02:13:57.137 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps_parport.ko 2024-08-17T02:13:57.137 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/pps_core.ko 2024-08-17T02:13:57.137 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp 2024-08-17T02:13:57.137 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp.ko 2024-08-17T02:13:57.137 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp_kvm.ko 2024-08-17T02:13:57.137 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras 2024-08-17T02:13:57.137 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd 2024-08-17T02:13:57.137 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl 2024-08-17T02:13:57.137 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-08-17T02:13:57.137 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/fmpm.ko 2024-08-17T02:13:57.137 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc 2024-08-17T02:13:57.137 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-bq32k.ko 2024-08-17T02:13:57.138 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1286.ko 2024-08-17T02:13:57.138 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1307.ko 2024-08-17T02:13:57.138 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1374.ko 2024-08-17T02:13:57.138 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1511.ko 2024-08-17T02:13:57.138 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1553.ko 2024-08-17T02:13:57.138 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1672.ko 2024-08-17T02:13:57.138 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1742.ko 2024-08-17T02:13:57.138 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds2404.ko 2024-08-17T02:13:57.138 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds3232.ko 2024-08-17T02:13:57.138 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-em3027.ko 2024-08-17T02:13:57.138 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-fm3130.ko 2024-08-17T02:13:57.138 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl12022.ko 2024-08-17T02:13:57.138 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl1208.ko 2024-08-17T02:13:57.139 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m41t80.ko 2024-08-17T02:13:57.139 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t35.ko 2024-08-17T02:13:57.139 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t59.ko 2024-08-17T02:13:57.139 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-max6900.ko 2024-08-17T02:13:57.139 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-msm6242.ko 2024-08-17T02:13:57.141 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf2127.ko 2024-08-17T02:13:57.141 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf85063.ko 2024-08-17T02:13:57.141 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8523.ko 2024-08-17T02:13:57.141 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8563.ko 2024-08-17T02:13:57.141 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8583.ko 2024-08-17T02:13:57.142 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rp5c01.ko 2024-08-17T02:13:57.142 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rs5c372.ko 2024-08-17T02:13:57.142 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-08-17T02:13:57.142 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8025.ko 2024-08-17T02:13:57.142 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8581.ko 2024-08-17T02:13:57.142 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-08-17T02:13:57.142 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-x1205.ko 2024-08-17T02:13:57.142 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi 2024-08-17T02:13:57.142 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-9xxx.ko 2024-08-17T02:13:57.142 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-sas.ko 2024-08-17T02:13:57.142 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-xxxx.ko 2024-08-17T02:13:57.142 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/BusLogic.ko 2024-08-17T02:13:57.142 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/a100u2w.ko 2024-08-17T02:13:57.143 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid 2024-08-17T02:13:57.143 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid/aacraid.ko 2024-08-17T02:13:57.143 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/advansys.ko 2024-08-17T02:13:57.143 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx 2024-08-17T02:13:57.143 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-08-17T02:13:57.143 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-08-17T02:13:57.143 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/am53c974.ko 2024-08-17T02:13:57.143 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr 2024-08-17T02:13:57.143 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-08-17T02:13:57.143 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/atp870u.ko 2024-08-17T02:13:57.143 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi 2024-08-17T02:13:57.143 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-08-17T02:13:57.143 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa 2024-08-17T02:13:57.144 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa/bfa.ko 2024-08-17T02:13:57.144 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc 2024-08-17T02:13:57.144 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-08-17T02:13:57.144 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i 2024-08-17T02:13:57.144 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-08-17T02:13:57.144 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ch.ko 2024-08-17T02:13:57.144 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor 2024-08-17T02:13:57.144 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor/csiostor.ko 2024-08-17T02:13:57.144 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi 2024-08-17T02:13:57.144 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i 2024-08-17T02:13:57.144 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-08-17T02:13:57.144 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i 2024-08-17T02:13:57.144 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-08-17T02:13:57.145 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-08-17T02:13:57.145 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dc395x.ko 2024-08-17T02:13:57.145 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler 2024-08-17T02:13:57.145 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-08-17T02:13:57.145 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-08-17T02:13:57.145 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-08-17T02:13:57.145 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-08-17T02:13:57.145 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dmx3191d.ko 2024-08-17T02:13:57.145 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r 2024-08-17T02:13:57.145 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r/esas2r.ko 2024-08-17T02:13:57.145 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esp_scsi.ko 2024-08-17T02:13:57.145 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe 2024-08-17T02:13:57.145 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/fcoe.ko 2024-08-17T02:13:57.145 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-08-17T02:13:57.146 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic 2024-08-17T02:13:57.146 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic/fnic.ko 2024-08-17T02:13:57.146 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hpsa.ko 2024-08-17T02:13:57.146 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hptiop.ko 2024-08-17T02:13:57.146 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hv_storvsc.ko 2024-08-17T02:13:57.146 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/initio.ko 2024-08-17T02:13:57.146 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ipr.ko 2024-08-17T02:13:57.146 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ips.ko 2024-08-17T02:13:57.146 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci 2024-08-17T02:13:57.146 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci/isci.ko 2024-08-17T02:13:57.146 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-08-17T02:13:57.146 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_tcp.ko 2024-08-17T02:13:57.146 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc 2024-08-17T02:13:57.147 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc/libfc.ko 2024-08-17T02:13:57.147 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi.ko 2024-08-17T02:13:57.147 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi_tcp.ko 2024-08-17T02:13:57.147 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas 2024-08-17T02:13:57.147 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas/libsas.ko 2024-08-17T02:13:57.147 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc 2024-08-17T02:13:57.147 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc/lpfc.ko 2024-08-17T02:13:57.147 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid 2024-08-17T02:13:57.147 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid.ko 2024-08-17T02:13:57.148 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-08-17T02:13:57.148 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-08-17T02:13:57.148 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-08-17T02:13:57.148 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas 2024-08-17T02:13:57.148 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-08-17T02:13:57.148 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas 2024-08-17T02:13:57.148 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas/mvsas.ko 2024-08-17T02:13:57.148 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvumi.ko 2024-08-17T02:13:57.148 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001 2024-08-17T02:13:57.148 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-08-17T02:13:57.148 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pmcraid.ko 2024-08-17T02:13:57.148 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla1280.ko 2024-08-17T02:13:57.149 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx 2024-08-17T02:13:57.149 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-08-17T02:13:57.149 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-08-17T02:13:57.149 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx 2024-08-17T02:13:57.149 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-08-17T02:13:57.149 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/raid_class.ko 2024-08-17T02:13:57.149 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_debug.ko 2024-08-17T02:13:57.149 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_fc.ko 2024-08-17T02:13:57.149 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-08-17T02:13:57.149 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_sas.ko 2024-08-17T02:13:57.149 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_spi.ko 2024-08-17T02:13:57.149 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_srp.ko 2024-08-17T02:13:57.150 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ses.ko 2024-08-17T02:13:57.150 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/st.ko 2024-08-17T02:13:57.150 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/stex.ko 2024-08-17T02:13:57.150 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2 2024-08-17T02:13:57.150 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-08-17T02:13:57.150 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/virtio_scsi.ko 2024-08-17T02:13:57.150 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/vmw_pvscsi.ko 2024-08-17T02:13:57.150 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/wd719x.ko 2024-08-17T02:13:57.150 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb 2024-08-17T02:13:57.150 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb/ssb.ko 2024-08-17T02:13:57.150 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target 2024-08-17T02:13:57.150 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi 2024-08-17T02:13:57.151 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-08-17T02:13:57.151 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback 2024-08-17T02:13:57.151 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback/tcm_loop.ko 2024-08-17T02:13:57.151 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_file.ko 2024-08-17T02:13:57.151 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_iblock.ko 2024-08-17T02:13:57.151 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_mod.ko 2024-08-17T02:13:57.151 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_pscsi.ko 2024-08-17T02:13:57.151 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_user.ko 2024-08-17T02:13:57.151 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc 2024-08-17T02:13:57.151 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-08-17T02:13:57.151 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal 2024-08-17T02:13:57.151 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel 2024-08-17T02:13:57.151 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal 2024-08-17T02:13:57.152 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-08-17T02:13:57.152 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-08-17T02:13:57.152 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-08-17T02:13:57.152 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-08-17T02:13:57.152 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-08-17T02:13:57.152 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-08-17T02:13:57.152 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-08-17T02:13:57.152 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-08-17T02:13:57.152 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-08-17T02:13:57.152 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-08-17T02:13:57.152 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-08-17T02:13:57.153 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-08-17T02:13:57.153 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-08-17T02:13:57.153 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-08-17T02:13:57.153 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-08-17T02:13:57.153 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-08-17T02:13:57.153 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-08-17T02:13:57.153 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-08-17T02:13:57.153 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty 2024-08-17T02:13:57.153 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless 2024-08-17T02:13:57.153 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-08-17T02:13:57.153 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_gsm.ko 2024-08-17T02:13:57.153 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_hdlc.ko 2024-08-17T02:13:57.153 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/nozomi.ko 2024-08-17T02:13:57.154 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial 2024-08-17T02:13:57.154 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250 2024-08-17T02:13:57.154 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-08-17T02:13:57.154 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/arc_uart.ko 2024-08-17T02:13:57.154 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm 2024-08-17T02:13:57.154 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm/jsm.ko 2024-08-17T02:13:57.154 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs 2024-08-17T02:13:57.154 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core 2024-08-17T02:13:57.154 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core/ufshcd-core.ko 2024-08-17T02:13:57.154 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host 2024-08-17T02:13:57.154 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-08-17T02:13:57.154 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio 2024-08-17T02:13:57.155 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio.ko 2024-08-17T02:13:57.155 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_aec.ko 2024-08-17T02:13:57.155 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_cif.ko 2024-08-17T02:13:57.155 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_pci_generic.ko 2024-08-17T02:13:57.155 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_sercos3.ko 2024-08-17T02:13:57.155 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb 2024-08-17T02:13:57.155 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class 2024-08-17T02:13:57.155 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-acm.ko 2024-08-17T02:13:57.155 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-wdm.ko 2024-08-17T02:13:57.155 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usblp.ko 2024-08-17T02:13:57.155 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usbtmc.ko 2024-08-17T02:13:57.155 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host 2024-08-17T02:13:57.155 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/sl811-hcd.ko 2024-08-17T02:13:57.155 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image 2024-08-17T02:13:57.156 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/mdc800.ko 2024-08-17T02:13:57.156 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/microtek.ko 2024-08-17T02:13:57.156 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc 2024-08-17T02:13:57.156 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/adutux.ko 2024-08-17T02:13:57.156 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/appledisplay.ko 2024-08-17T02:13:57.156 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi26.ko 2024-08-17T02:13:57.156 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi62.ko 2024-08-17T02:13:57.156 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ezusb.ko 2024-08-17T02:13:57.156 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/idmouse.ko 2024-08-17T02:13:57.156 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/iowarrior.ko 2024-08-17T02:13:57.156 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/isight_firmware.ko 2024-08-17T02:13:57.156 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ldusb.ko 2024-08-17T02:13:57.157 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/legousbtower.ko 2024-08-17T02:13:57.157 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga 2024-08-17T02:13:57.157 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-08-17T02:13:57.157 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/trancevibrator.ko 2024-08-17T02:13:57.157 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usb3503.ko 2024-08-17T02:13:57.157 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usblcd.ko 2024-08-17T02:13:57.157 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usbsevseg.ko 2024-08-17T02:13:57.157 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/uss720.ko 2024-08-17T02:13:57.157 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/yurex.ko 2024-08-17T02:13:57.157 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy 2024-08-17T02:13:57.157 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy/phy-generic.ko 2024-08-17T02:13:57.157 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial 2024-08-17T02:13:57.157 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/aircable.ko 2024-08-17T02:13:57.157 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ark3116.ko 2024-08-17T02:13:57.158 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/belkin_sa.ko 2024-08-17T02:13:57.158 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ch341.ko 2024-08-17T02:13:57.158 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cp210x.ko 2024-08-17T02:13:57.158 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cyberjack.ko 2024-08-17T02:13:57.158 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cypress_m8.ko 2024-08-17T02:13:57.158 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/digi_acceleport.ko 2024-08-17T02:13:57.158 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/empeg.ko 2024-08-17T02:13:57.158 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ftdi_sio.ko 2024-08-17T02:13:57.158 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/garmin_gps.ko 2024-08-17T02:13:57.158 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_edgeport.ko 2024-08-17T02:13:57.159 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_ti.ko 2024-08-17T02:13:57.159 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipaq.ko 2024-08-17T02:13:57.159 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipw.ko 2024-08-17T02:13:57.159 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ir-usb.ko 2024-08-17T02:13:57.159 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-08-17T02:13:57.159 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan.ko 2024-08-17T02:13:57.159 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan_pda.ko 2024-08-17T02:13:57.160 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kl5kusb105.ko 2024-08-17T02:13:57.160 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kobil_sct.ko 2024-08-17T02:13:57.160 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mct_u232.ko 2024-08-17T02:13:57.160 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7720.ko 2024-08-17T02:13:57.160 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7840.ko 2024-08-17T02:13:57.160 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/navman.ko 2024-08-17T02:13:57.160 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/omninet.ko 2024-08-17T02:13:57.160 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/opticon.ko 2024-08-17T02:13:57.160 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/option.ko 2024-08-17T02:13:57.160 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/oti6858.ko 2024-08-17T02:13:57.160 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/pl2303.ko 2024-08-17T02:13:57.160 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcaux.ko 2024-08-17T02:13:57.160 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcserial.ko 2024-08-17T02:13:57.161 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/quatech2.ko 2024-08-17T02:13:57.161 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/safe_serial.ko 2024-08-17T02:13:57.161 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/sierra.ko 2024-08-17T02:13:57.161 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/spcp8x5.ko 2024-08-17T02:13:57.161 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ssu100.ko 2024-08-17T02:13:57.161 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/symbolserial.ko 2024-08-17T02:13:57.161 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-08-17T02:13:57.161 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-08-17T02:13:57.161 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_debug.ko 2024-08-17T02:13:57.161 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_wwan.ko 2024-08-17T02:13:57.161 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/visor.ko 2024-08-17T02:13:57.161 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/whiteheat.ko 2024-08-17T02:13:57.161 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/xsens_mt.ko 2024-08-17T02:13:57.162 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage 2024-08-17T02:13:57.162 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/uas.ko 2024-08-17T02:13:57.162 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-alauda.ko 2024-08-17T02:13:57.162 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-cypress.ko 2024-08-17T02:13:57.162 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-datafab.ko 2024-08-17T02:13:57.162 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-08-17T02:13:57.162 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-freecom.ko 2024-08-17T02:13:57.162 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-isd200.ko 2024-08-17T02:13:57.162 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-08-17T02:13:57.162 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-karma.ko 2024-08-17T02:13:57.162 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-onetouch.ko 2024-08-17T02:13:57.162 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-realtek.ko 2024-08-17T02:13:57.162 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr09.ko 2024-08-17T02:13:57.162 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr55.ko 2024-08-17T02:13:57.163 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-usbat.ko 2024-08-17T02:13:57.163 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/usb-storage.ko 2024-08-17T02:13:57.163 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip 2024-08-17T02:13:57.163 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-core.ko 2024-08-17T02:13:57.163 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-host.ko 2024-08-17T02:13:57.163 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-08-17T02:13:57.163 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio 2024-08-17T02:13:57.163 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci 2024-08-17T02:13:57.163 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-08-17T02:13:57.163 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci.ko 2024-08-17T02:13:57.163 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio.ko 2024-08-17T02:13:57.163 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-08-17T02:13:57.163 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost 2024-08-17T02:13:57.163 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost.ko 2024-08-17T02:13:57.164 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_iotlb.ko 2024-08-17T02:13:57.164 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_net.ko 2024-08-17T02:13:57.164 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_scsi.ko 2024-08-17T02:13:57.164 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video 2024-08-17T02:13:57.164 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight 2024-08-17T02:13:57.164 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/apple_bl.ko 2024-08-17T02:13:57.164 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/lcd.ko 2024-08-17T02:13:57.164 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/platform_lcd.ko 2024-08-17T02:13:57.164 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio 2024-08-17T02:13:57.164 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio.ko 2024-08-17T02:13:57.164 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_balloon.ko 2024-08-17T02:13:57.164 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_mmio.ko 2024-08-17T02:13:57.164 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci.ko 2024-08-17T02:13:57.165 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-08-17T02:13:57.165 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-08-17T02:13:57.165 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_ring.ko 2024-08-17T02:13:57.165 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1 2024-08-17T02:13:57.165 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters 2024-08-17T02:13:57.165 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2482.ko 2024-08-17T02:13:57.165 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2490.ko 2024-08-17T02:13:57.165 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves 2024-08-17T02:13:57.165 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-08-17T02:13:57.165 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-08-17T02:13:57.165 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-08-17T02:13:57.165 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-08-17T02:13:57.165 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-08-17T02:13:57.165 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-08-17T02:13:57.166 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-08-17T02:13:57.166 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-08-17T02:13:57.166 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-08-17T02:13:57.166 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_smem.ko 2024-08-17T02:13:57.166 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_therm.ko 2024-08-17T02:13:57.166 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/wire.ko 2024-08-17T02:13:57.166 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog 2024-08-17T02:13:57.166 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim1535_wdt.ko 2024-08-17T02:13:57.166 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim7101_wdt.ko 2024-08-17T02:13:57.166 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/f71808e_wdt.ko 2024-08-17T02:13:57.166 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/hpwdt.ko 2024-08-17T02:13:57.166 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/i6300esb.ko 2024-08-17T02:13:57.166 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-08-17T02:13:57.167 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_wdt.ko 2024-08-17T02:13:57.167 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ib700wdt.ko 2024-08-17T02:13:57.167 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ibmasr.ko 2024-08-17T02:13:57.167 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-08-17T02:13:57.167 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it8712f_wdt.ko 2024-08-17T02:13:57.167 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it87_wdt.ko 2024-08-17T02:13:57.167 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/machzwd.ko 2024-08-17T02:13:57.167 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/nv_tco.ko 2024-08-17T02:13:57.167 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_pci.ko 2024-08-17T02:13:57.167 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_usb.ko 2024-08-17T02:13:57.167 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-08-17T02:13:57.167 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sch311x_wdt.ko 2024-08-17T02:13:57.167 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/softdog.ko 2024-08-17T02:13:57.167 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sp5100_tco.ko 2024-08-17T02:13:57.167 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/via_wdt.ko 2024-08-17T02:13:57.168 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-08-17T02:13:57.168 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83877f_wdt.ko 2024-08-17T02:13:57.168 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83977f_wdt.ko 2024-08-17T02:13:57.168 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/wdt_pci.ko 2024-08-17T02:13:57.168 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/xen_wdt.ko 2024-08-17T02:13:57.168 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen 2024-08-17T02:13:57.168 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-acpi-processor.ko 2024-08-17T02:13:57.168 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-evtchn.ko 2024-08-17T02:13:57.168 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntalloc.ko 2024-08-17T02:13:57.168 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntdev.ko 2024-08-17T02:13:57.168 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback 2024-08-17T02:13:57.168 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-08-17T02:13:57.168 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-privcmd.ko 2024-08-17T02:13:57.169 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs 2024-08-17T02:13:57.169 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs/xenfs.ko 2024-08-17T02:13:57.169 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs 2024-08-17T02:13:57.169 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p 2024-08-17T02:13:57.169 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p/9p.ko 2024-08-17T02:13:57.169 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs 2024-08-17T02:13:57.169 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs/affs.ko 2024-08-17T02:13:57.169 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs 2024-08-17T02:13:57.169 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs/befs.ko 2024-08-17T02:13:57.169 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/binfmt_misc.ko 2024-08-17T02:13:57.169 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs 2024-08-17T02:13:57.169 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs/btrfs.ko 2024-08-17T02:13:57.169 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles 2024-08-17T02:13:57.170 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles/cachefiles.ko 2024-08-17T02:13:57.170 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph 2024-08-17T02:13:57.170 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph/ceph.ko 2024-08-17T02:13:57.170 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda 2024-08-17T02:13:57.170 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda/coda.ko 2024-08-17T02:13:57.170 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs 2024-08-17T02:13:57.170 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs/cramfs.ko 2024-08-17T02:13:57.170 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm 2024-08-17T02:13:57.170 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm/dlm.ko 2024-08-17T02:13:57.170 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs 2024-08-17T02:13:57.170 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs/ecryptfs.ko 2024-08-17T02:13:57.170 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs 2024-08-17T02:13:57.170 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs/f2fs.ko 2024-08-17T02:13:57.171 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat 2024-08-17T02:13:57.171 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/fat.ko 2024-08-17T02:13:57.171 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/msdos.ko 2024-08-17T02:13:57.171 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/vfat.ko 2024-08-17T02:13:57.171 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse 2024-08-17T02:13:57.171 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/cuse.ko 2024-08-17T02:13:57.171 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/fuse.ko 2024-08-17T02:13:57.171 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2 2024-08-17T02:13:57.171 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2/gfs2.ko 2024-08-17T02:13:57.171 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs 2024-08-17T02:13:57.171 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs/hfs.ko 2024-08-17T02:13:57.171 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus 2024-08-17T02:13:57.171 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus/hfsplus.ko 2024-08-17T02:13:57.171 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs 2024-08-17T02:13:57.172 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs/isofs.ko 2024-08-17T02:13:57.172 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs 2024-08-17T02:13:57.172 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs/jfs.ko 2024-08-17T02:13:57.172 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd 2024-08-17T02:13:57.172 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd/lockd.ko 2024-08-17T02:13:57.172 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix 2024-08-17T02:13:57.172 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix/minix.ko 2024-08-17T02:13:57.172 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs 2024-08-17T02:13:57.172 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs/netfs.ko 2024-08-17T02:13:57.172 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs 2024-08-17T02:13:57.172 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout 2024-08-17T02:13:57.172 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-08-17T02:13:57.172 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout 2024-08-17T02:13:57.173 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-08-17T02:13:57.173 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout 2024-08-17T02:13:57.173 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-08-17T02:13:57.173 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfs.ko 2024-08-17T02:13:57.173 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv3.ko 2024-08-17T02:13:57.173 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv4.ko 2024-08-17T02:13:57.173 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common 2024-08-17T02:13:57.173 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/grace.ko 2024-08-17T02:13:57.173 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/nfs_acl.ko 2024-08-17T02:13:57.173 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd 2024-08-17T02:13:57.173 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd/nfsd.ko 2024-08-17T02:13:57.173 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2 2024-08-17T02:13:57.173 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2/nilfs2.ko 2024-08-17T02:13:57.173 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls 2024-08-17T02:13:57.174 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-celtic.ko 2024-08-17T02:13:57.174 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-centeuro.ko 2024-08-17T02:13:57.174 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-croatian.ko 2024-08-17T02:13:57.174 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-cyrillic.ko 2024-08-17T02:13:57.174 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-gaelic.ko 2024-08-17T02:13:57.174 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-greek.ko 2024-08-17T02:13:57.174 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-iceland.ko 2024-08-17T02:13:57.174 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-inuit.ko 2024-08-17T02:13:57.174 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-roman.ko 2024-08-17T02:13:57.174 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-romanian.ko 2024-08-17T02:13:57.174 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-turkish.ko 2024-08-17T02:13:57.174 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1250.ko 2024-08-17T02:13:57.175 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1251.ko 2024-08-17T02:13:57.175 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1255.ko 2024-08-17T02:13:57.175 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp737.ko 2024-08-17T02:13:57.175 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp775.ko 2024-08-17T02:13:57.175 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp850.ko 2024-08-17T02:13:57.175 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp852.ko 2024-08-17T02:13:57.175 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp855.ko 2024-08-17T02:13:57.175 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp857.ko 2024-08-17T02:13:57.175 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp860.ko 2024-08-17T02:13:57.175 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp861.ko 2024-08-17T02:13:57.175 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp862.ko 2024-08-17T02:13:57.175 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp863.ko 2024-08-17T02:13:57.175 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp864.ko 2024-08-17T02:13:57.175 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp865.ko 2024-08-17T02:13:57.176 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp866.ko 2024-08-17T02:13:57.176 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp869.ko 2024-08-17T02:13:57.176 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp874.ko 2024-08-17T02:13:57.176 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp932.ko 2024-08-17T02:13:57.176 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp936.ko 2024-08-17T02:13:57.176 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp949.ko 2024-08-17T02:13:57.176 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp950.ko 2024-08-17T02:13:57.176 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_euc-jp.ko 2024-08-17T02:13:57.176 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-1.ko 2024-08-17T02:13:57.176 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-13.ko 2024-08-17T02:13:57.176 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-14.ko 2024-08-17T02:13:57.176 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-15.ko 2024-08-17T02:13:57.176 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-2.ko 2024-08-17T02:13:57.177 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-3.ko 2024-08-17T02:13:57.177 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-4.ko 2024-08-17T02:13:57.177 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-5.ko 2024-08-17T02:13:57.177 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-6.ko 2024-08-17T02:13:57.177 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-7.ko 2024-08-17T02:13:57.177 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-9.ko 2024-08-17T02:13:57.177 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-r.ko 2024-08-17T02:13:57.177 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-ru.ko 2024-08-17T02:13:57.177 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-u.ko 2024-08-17T02:13:57.177 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_ucs2_utils.ko 2024-08-17T02:13:57.177 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_utf8.ko 2024-08-17T02:13:57.177 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2 2024-08-17T02:13:57.177 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster 2024-08-17T02:13:57.177 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-08-17T02:13:57.178 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm 2024-08-17T02:13:57.178 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-08-17T02:13:57.178 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs 2024-08-17T02:13:57.178 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-08-17T02:13:57.178 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2.ko 2024-08-17T02:13:57.178 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-08-17T02:13:57.178 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-08-17T02:13:57.178 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-08-17T02:13:57.178 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs 2024-08-17T02:13:57.178 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs/overlay.ko 2024-08-17T02:13:57.178 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore 2024-08-17T02:13:57.178 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore/ramoops.ko 2024-08-17T02:13:57.178 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs 2024-08-17T02:13:57.179 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs/reiserfs.ko 2024-08-17T02:13:57.179 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs 2024-08-17T02:13:57.179 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs/romfs.ko 2024-08-17T02:13:57.179 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb 2024-08-17T02:13:57.179 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client 2024-08-17T02:13:57.179 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client/cifs.ko 2024-08-17T02:13:57.179 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common 2024-08-17T02:13:57.179 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_arc4.ko 2024-08-17T02:13:57.179 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_md4.ko 2024-08-17T02:13:57.179 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs 2024-08-17T02:13:57.179 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs/squashfs.ko 2024-08-17T02:13:57.179 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv 2024-08-17T02:13:57.179 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv/sysv.ko 2024-08-17T02:13:57.179 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf 2024-08-17T02:13:57.180 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf/udf.ko 2024-08-17T02:13:57.180 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs 2024-08-17T02:13:57.180 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs/ufs.ko 2024-08-17T02:13:57.180 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs 2024-08-17T02:13:57.180 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs/xfs.ko 2024-08-17T02:13:57.180 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel 2024-08-17T02:13:57.180 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu 2024-08-17T02:13:57.180 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu/rcutorture.ko 2024-08-17T02:13:57.180 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/torture.ko 2024-08-17T02:13:57.180 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace 2024-08-17T02:13:57.180 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-08-17T02:13:57.180 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib 2024-08-17T02:13:57.180 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/asn1_encoder.ko 2024-08-17T02:13:57.181 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc-itu-t.ko 2024-08-17T02:13:57.181 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc8.ko 2024-08-17T02:13:57.181 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto 2024-08-17T02:13:57.181 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libaescfb.ko 2024-08-17T02:13:57.181 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libarc4.ko 2024-08-17T02:13:57.181 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libdes.ko 2024-08-17T02:13:57.181 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/libcrc32c.ko 2024-08-17T02:13:57.181 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lru_cache.ko 2024-08-17T02:13:57.181 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4 2024-08-17T02:13:57.181 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4_compress.ko 2024-08-17T02:13:57.181 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4hc_compress.ko 2024-08-17T02:13:57.181 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math 2024-08-17T02:13:57.181 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math/cordic.ko 2024-08-17T02:13:57.182 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6 2024-08-17T02:13:57.182 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6/raid6_pq.ko 2024-08-17T02:13:57.182 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon 2024-08-17T02:13:57.182 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon/reed_solomon.ko 2024-08-17T02:13:57.182 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_bm.ko 2024-08-17T02:13:57.182 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_fsm.ko 2024-08-17T02:13:57.182 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_kmp.ko 2024-08-17T02:13:57.182 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd 2024-08-17T02:13:57.182 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd/zstd_compress.ko 2024-08-17T02:13:57.182 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm 2024-08-17T02:13:57.182 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm/hwpoison-inject.ko 2024-08-17T02:13:57.182 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net 2024-08-17T02:13:57.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan 2024-08-17T02:13:57.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/6lowpan.ko 2024-08-17T02:13:57.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_dest.ko 2024-08-17T02:13:57.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_fragment.ko 2024-08-17T02:13:57.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_hop.ko 2024-08-17T02:13:57.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_ipv6.ko 2024-08-17T02:13:57.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_mobility.ko 2024-08-17T02:13:57.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_routing.ko 2024-08-17T02:13:57.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_udp.ko 2024-08-17T02:13:57.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802 2024-08-17T02:13:57.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/garp.ko 2024-08-17T02:13:57.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/mrp.ko 2024-08-17T02:13:57.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/p8022.ko 2024-08-17T02:13:57.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/psnap.ko 2024-08-17T02:13:57.184 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/stp.ko 2024-08-17T02:13:57.184 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q 2024-08-17T02:13:57.184 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q/8021q.ko 2024-08-17T02:13:57.184 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p 2024-08-17T02:13:57.184 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet.ko 2024-08-17T02:13:57.184 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_fd.ko 2024-08-17T02:13:57.184 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_rdma.ko 2024-08-17T02:13:57.184 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_virtio.ko 2024-08-17T02:13:57.184 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv 2024-08-17T02:13:57.184 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv/batman-adv.ko 2024-08-17T02:13:57.184 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge 2024-08-17T02:13:57.184 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/br_netfilter.ko 2024-08-17T02:13:57.184 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/bridge.ko 2024-08-17T02:13:57.185 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter 2024-08-17T02:13:57.185 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-08-17T02:13:57.185 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_among.ko 2024-08-17T02:13:57.185 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arp.ko 2024-08-17T02:13:57.185 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-08-17T02:13:57.185 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-08-17T02:13:57.185 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip.ko 2024-08-17T02:13:57.185 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-08-17T02:13:57.185 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_limit.ko 2024-08-17T02:13:57.185 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_log.ko 2024-08-17T02:13:57.185 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark.ko 2024-08-17T02:13:57.185 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-08-17T02:13:57.185 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-08-17T02:13:57.185 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-08-17T02:13:57.186 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-08-17T02:13:57.186 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_snat.ko 2024-08-17T02:13:57.186 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_stp.ko 2024-08-17T02:13:57.186 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-08-17T02:13:57.186 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-08-17T02:13:57.186 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-08-17T02:13:57.186 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-08-17T02:13:57.186 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtables.ko 2024-08-17T02:13:57.186 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-08-17T02:13:57.186 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-08-17T02:13:57.186 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-08-17T02:13:57.186 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph 2024-08-17T02:13:57.186 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph/libceph.ko 2024-08-17T02:13:57.187 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core 2024-08-17T02:13:57.187 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/failover.ko 2024-08-17T02:13:57.187 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/pktgen.ko 2024-08-17T02:13:57.187 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp 2024-08-17T02:13:57.187 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp.ko 2024-08-17T02:13:57.187 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_diag.ko 2024-08-17T02:13:57.187 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv4.ko 2024-08-17T02:13:57.187 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv6.ko 2024-08-17T02:13:57.187 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver 2024-08-17T02:13:57.187 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver/dns_resolver.ko 2024-08-17T02:13:57.187 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa 2024-08-17T02:13:57.187 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/dsa_core.ko 2024-08-17T02:13:57.187 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_brcm.ko 2024-08-17T02:13:57.188 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_dsa.ko 2024-08-17T02:13:57.188 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_none.ko 2024-08-17T02:13:57.188 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_trailer.ko 2024-08-17T02:13:57.188 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154 2024-08-17T02:13:57.188 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan 2024-08-17T02:13:57.188 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-08-17T02:13:57.188 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154.ko 2024-08-17T02:13:57.188 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154_socket.ko 2024-08-17T02:13:57.188 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4 2024-08-17T02:13:57.188 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ah4.ko 2024-08-17T02:13:57.188 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/esp4.ko 2024-08-17T02:13:57.188 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/fou.ko 2024-08-17T02:13:57.188 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/gre.ko 2024-08-17T02:13:57.188 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/inet_diag.ko 2024-08-17T02:13:57.188 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_gre.ko 2024-08-17T02:13:57.189 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_tunnel.ko 2024-08-17T02:13:57.189 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_vti.ko 2024-08-17T02:13:57.189 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipcomp.ko 2024-08-17T02:13:57.189 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipip.ko 2024-08-17T02:13:57.189 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter 2024-08-17T02:13:57.189 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arp_tables.ko 2024-08-17T02:13:57.189 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-08-17T02:13:57.189 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-08-17T02:13:57.189 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-08-17T02:13:57.189 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-08-17T02:13:57.189 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-08-17T02:13:57.189 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-08-17T02:13:57.189 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-08-17T02:13:57.190 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-08-17T02:13:57.190 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-08-17T02:13:57.190 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_security.ko 2024-08-17T02:13:57.190 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-08-17T02:13:57.190 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-08-17T02:13:57.190 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-08-17T02:13:57.190 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-08-17T02:13:57.190 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-08-17T02:13:57.190 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-08-17T02:13:57.190 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-08-17T02:13:57.190 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-08-17T02:13:57.190 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-08-17T02:13:57.190 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-08-17T02:13:57.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_bic.ko 2024-08-17T02:13:57.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_dctcp.ko 2024-08-17T02:13:57.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_diag.ko 2024-08-17T02:13:57.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_highspeed.ko 2024-08-17T02:13:57.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_htcp.ko 2024-08-17T02:13:57.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_hybla.ko 2024-08-17T02:13:57.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_illinois.ko 2024-08-17T02:13:57.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_lp.ko 2024-08-17T02:13:57.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_scalable.ko 2024-08-17T02:13:57.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_vegas.ko 2024-08-17T02:13:57.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_veno.ko 2024-08-17T02:13:57.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_westwood.ko 2024-08-17T02:13:57.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_yeah.ko 2024-08-17T02:13:57.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tunnel4.ko 2024-08-17T02:13:57.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_diag.ko 2024-08-17T02:13:57.192 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_tunnel.ko 2024-08-17T02:13:57.192 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/xfrm4_tunnel.ko 2024-08-17T02:13:57.192 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6 2024-08-17T02:13:57.192 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ah6.ko 2024-08-17T02:13:57.192 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/esp6.ko 2024-08-17T02:13:57.192 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/fou6.ko 2024-08-17T02:13:57.192 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_tunnel.ko 2024-08-17T02:13:57.192 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-08-17T02:13:57.192 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_vti.ko 2024-08-17T02:13:57.192 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ipcomp6.ko 2024-08-17T02:13:57.192 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter 2024-08-17T02:13:57.192 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-08-17T02:13:57.192 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-08-17T02:13:57.192 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-08-17T02:13:57.192 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-08-17T02:13:57.193 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-08-17T02:13:57.193 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-08-17T02:13:57.193 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-08-17T02:13:57.193 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-08-17T02:13:57.193 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-08-17T02:13:57.193 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-08-17T02:13:57.193 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-08-17T02:13:57.193 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-08-17T02:13:57.193 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-08-17T02:13:57.193 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-08-17T02:13:57.193 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-08-17T02:13:57.193 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-08-17T02:13:57.193 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-08-17T02:13:57.193 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-08-17T02:13:57.194 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-08-17T02:13:57.194 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-08-17T02:13:57.194 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-08-17T02:13:57.194 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-08-17T02:13:57.194 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-08-17T02:13:57.194 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-08-17T02:13:57.194 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/sit.ko 2024-08-17T02:13:57.194 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/tunnel6.ko 2024-08-17T02:13:57.194 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/xfrm6_tunnel.ko 2024-08-17T02:13:57.194 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key 2024-08-17T02:13:57.194 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key/af_key.ko 2024-08-17T02:13:57.194 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp 2024-08-17T02:13:57.194 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_core.ko 2024-08-17T02:13:57.194 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_debugfs.ko 2024-08-17T02:13:57.195 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_eth.ko 2024-08-17T02:13:57.195 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip.ko 2024-08-17T02:13:57.195 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip6.ko 2024-08-17T02:13:57.195 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_netlink.ko 2024-08-17T02:13:57.195 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ppp.ko 2024-08-17T02:13:57.195 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc 2024-08-17T02:13:57.195 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc/llc.ko 2024-08-17T02:13:57.195 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154 2024-08-17T02:13:57.195 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154/mac802154.ko 2024-08-17T02:13:57.195 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls 2024-08-17T02:13:57.195 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls/mpls_gso.ko 2024-08-17T02:13:57.195 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter 2024-08-17T02:13:57.195 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset 2024-08-17T02:13:57.196 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set.ko 2024-08-17T02:13:57.196 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-08-17T02:13:57.196 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-08-17T02:13:57.196 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-08-17T02:13:57.196 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-08-17T02:13:57.196 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-08-17T02:13:57.196 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-08-17T02:13:57.196 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-08-17T02:13:57.196 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-08-17T02:13:57.196 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-08-17T02:13:57.196 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-08-17T02:13:57.196 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-08-17T02:13:57.197 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-08-17T02:13:57.197 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-08-17T02:13:57.197 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-08-17T02:13:57.197 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-08-17T02:13:57.197 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs 2024-08-17T02:13:57.197 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs.ko 2024-08-17T02:13:57.197 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-08-17T02:13:57.197 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-08-17T02:13:57.197 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-08-17T02:13:57.197 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-08-17T02:13:57.197 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-08-17T02:13:57.197 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-08-17T02:13:57.197 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-08-17T02:13:57.197 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-08-17T02:13:57.198 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-08-17T02:13:57.198 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-08-17T02:13:57.198 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-08-17T02:13:57.198 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-08-17T02:13:57.198 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-08-17T02:13:57.198 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conncount.ko 2024-08-17T02:13:57.198 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack.ko 2024-08-17T02:13:57.198 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-08-17T02:13:57.198 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-08-17T02:13:57.198 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-08-17T02:13:57.198 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_h323.ko 2024-08-17T02:13:57.198 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_irc.ko 2024-08-17T02:13:57.198 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-08-17T02:13:57.198 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-08-17T02:13:57.199 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-08-17T02:13:57.199 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sane.ko 2024-08-17T02:13:57.199 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sip.ko 2024-08-17T02:13:57.199 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-08-17T02:13:57.199 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-08-17T02:13:57.199 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_dup_netdev.ko 2024-08-17T02:13:57.199 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table.ko 2024-08-17T02:13:57.199 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table_inet.ko 2024-08-17T02:13:57.199 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_log_syslog.ko 2024-08-17T02:13:57.199 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat.ko 2024-08-17T02:13:57.199 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_amanda.ko 2024-08-17T02:13:57.199 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_ftp.ko 2024-08-17T02:13:57.200 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_irc.ko 2024-08-17T02:13:57.200 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_sip.ko 2024-08-17T02:13:57.200 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_tftp.ko 2024-08-17T02:13:57.200 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_synproxy_core.ko 2024-08-17T02:13:57.200 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_tables.ko 2024-08-17T02:13:57.200 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink.ko 2024-08-17T02:13:57.200 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_acct.ko 2024-08-17T02:13:57.200 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_log.ko 2024-08-17T02:13:57.200 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_osf.ko 2024-08-17T02:13:57.200 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_queue.ko 2024-08-17T02:13:57.200 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_chain_nat.ko 2024-08-17T02:13:57.200 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_compat.ko 2024-08-17T02:13:57.200 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_ct.ko 2024-08-17T02:13:57.201 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_dup_netdev.ko 2024-08-17T02:13:57.201 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fib.ko 2024-08-17T02:13:57.201 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fwd_netdev.ko 2024-08-17T02:13:57.201 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_hash.ko 2024-08-17T02:13:57.201 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_limit.ko 2024-08-17T02:13:57.201 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_log.ko 2024-08-17T02:13:57.201 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_masq.ko 2024-08-17T02:13:57.201 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_nat.ko 2024-08-17T02:13:57.201 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_numgen.ko 2024-08-17T02:13:57.201 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_queue.ko 2024-08-17T02:13:57.201 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_quota.ko 2024-08-17T02:13:57.201 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_redir.ko 2024-08-17T02:13:57.201 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject.ko 2024-08-17T02:13:57.201 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject_inet.ko 2024-08-17T02:13:57.202 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_socket.ko 2024-08-17T02:13:57.202 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_tunnel.ko 2024-08-17T02:13:57.202 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_AUDIT.ko 2024-08-17T02:13:57.202 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CHECKSUM.ko 2024-08-17T02:13:57.202 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CLASSIFY.ko 2024-08-17T02:13:57.202 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-08-17T02:13:57.202 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CT.ko 2024-08-17T02:13:57.202 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_DSCP.ko 2024-08-17T02:13:57.202 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HL.ko 2024-08-17T02:13:57.202 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HMARK.ko 2024-08-17T02:13:57.202 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_IDLETIMER.ko 2024-08-17T02:13:57.202 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LED.ko 2024-08-17T02:13:57.202 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LOG.ko 2024-08-17T02:13:57.203 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_MASQUERADE.ko 2024-08-17T02:13:57.203 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NETMAP.ko 2024-08-17T02:13:57.203 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFLOG.ko 2024-08-17T02:13:57.203 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFQUEUE.ko 2024-08-17T02:13:57.203 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_RATEEST.ko 2024-08-17T02:13:57.203 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_REDIRECT.ko 2024-08-17T02:13:57.203 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_SECMARK.ko 2024-08-17T02:13:57.203 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPMSS.ko 2024-08-17T02:13:57.203 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-08-17T02:13:57.203 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TEE.ko 2024-08-17T02:13:57.203 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TPROXY.ko 2024-08-17T02:13:57.203 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TRACE.ko 2024-08-17T02:13:57.203 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_addrtype.ko 2024-08-17T02:13:57.204 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_bpf.ko 2024-08-17T02:13:57.204 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cgroup.ko 2024-08-17T02:13:57.204 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cluster.ko 2024-08-17T02:13:57.204 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_comment.ko 2024-08-17T02:13:57.204 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connbytes.ko 2024-08-17T02:13:57.204 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlabel.ko 2024-08-17T02:13:57.204 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlimit.ko 2024-08-17T02:13:57.204 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connmark.ko 2024-08-17T02:13:57.204 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_conntrack.ko 2024-08-17T02:13:57.204 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cpu.ko 2024-08-17T02:13:57.204 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dccp.ko 2024-08-17T02:13:57.204 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_devgroup.ko 2024-08-17T02:13:57.204 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dscp.ko 2024-08-17T02:13:57.205 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ecn.ko 2024-08-17T02:13:57.205 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_esp.ko 2024-08-17T02:13:57.205 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hashlimit.ko 2024-08-17T02:13:57.205 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_helper.ko 2024-08-17T02:13:57.205 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hl.ko 2024-08-17T02:13:57.205 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipcomp.ko 2024-08-17T02:13:57.205 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_iprange.ko 2024-08-17T02:13:57.205 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipvs.ko 2024-08-17T02:13:57.205 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_l2tp.ko 2024-08-17T02:13:57.205 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_length.ko 2024-08-17T02:13:57.205 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_limit.ko 2024-08-17T02:13:57.205 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mac.ko 2024-08-17T02:13:57.205 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mark.ko 2024-08-17T02:13:57.206 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_multiport.ko 2024-08-17T02:13:57.206 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nat.ko 2024-08-17T02:13:57.206 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nfacct.ko 2024-08-17T02:13:57.206 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_osf.ko 2024-08-17T02:13:57.206 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_owner.ko 2024-08-17T02:13:57.206 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_physdev.ko 2024-08-17T02:13:57.206 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_pkttype.ko 2024-08-17T02:13:57.206 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_policy.ko 2024-08-17T02:13:57.206 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_quota.ko 2024-08-17T02:13:57.206 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_rateest.ko 2024-08-17T02:13:57.206 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_realm.ko 2024-08-17T02:13:57.206 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_recent.ko 2024-08-17T02:13:57.206 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_sctp.ko 2024-08-17T02:13:57.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_set.ko 2024-08-17T02:13:57.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_socket.ko 2024-08-17T02:13:57.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_state.ko 2024-08-17T02:13:57.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_statistic.ko 2024-08-17T02:13:57.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_string.ko 2024-08-17T02:13:57.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_tcpmss.ko 2024-08-17T02:13:57.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_time.ko 2024-08-17T02:13:57.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_u32.ko 2024-08-17T02:13:57.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink 2024-08-17T02:13:57.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink/netlink_diag.ko 2024-08-17T02:13:57.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh 2024-08-17T02:13:57.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh/nsh.ko 2024-08-17T02:13:57.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch 2024-08-17T02:13:57.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/openvswitch.ko 2024-08-17T02:13:57.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-geneve.ko 2024-08-17T02:13:57.208 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-gre.ko 2024-08-17T02:13:57.208 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-vxlan.ko 2024-08-17T02:13:57.208 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet 2024-08-17T02:13:57.208 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet/af_packet_diag.ko 2024-08-17T02:13:57.208 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds 2024-08-17T02:13:57.208 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds.ko 2024-08-17T02:13:57.208 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_rdma.ko 2024-08-17T02:13:57.208 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_tcp.ko 2024-08-17T02:13:57.208 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched 2024-08-17T02:13:57.208 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_csum.ko 2024-08-17T02:13:57.208 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_gact.ko 2024-08-17T02:13:57.208 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_mirred.ko 2024-08-17T02:13:57.208 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_nat.ko 2024-08-17T02:13:57.208 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_pedit.ko 2024-08-17T02:13:57.208 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_police.ko 2024-08-17T02:13:57.209 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_simple.ko 2024-08-17T02:13:57.209 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_skbedit.ko 2024-08-17T02:13:57.209 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_vlan.ko 2024-08-17T02:13:57.209 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_basic.ko 2024-08-17T02:13:57.209 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_bpf.ko 2024-08-17T02:13:57.209 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_flow.ko 2024-08-17T02:13:57.209 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_fw.ko 2024-08-17T02:13:57.209 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_route.ko 2024-08-17T02:13:57.209 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_u32.ko 2024-08-17T02:13:57.209 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_cmp.ko 2024-08-17T02:13:57.209 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_ipset.ko 2024-08-17T02:13:57.209 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_meta.ko 2024-08-17T02:13:57.209 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_nbyte.ko 2024-08-17T02:13:57.209 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_text.ko 2024-08-17T02:13:57.210 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_u32.ko 2024-08-17T02:13:57.210 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_choke.ko 2024-08-17T02:13:57.210 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_codel.ko 2024-08-17T02:13:57.210 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_drr.ko 2024-08-17T02:13:57.210 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_fq.ko 2024-08-17T02:13:57.210 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_gred.ko 2024-08-17T02:13:57.210 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hfsc.ko 2024-08-17T02:13:57.210 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hhf.ko 2024-08-17T02:13:57.210 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_htb.ko 2024-08-17T02:13:57.210 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_ingress.ko 2024-08-17T02:13:57.210 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio.ko 2024-08-17T02:13:57.210 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio_lib.ko 2024-08-17T02:13:57.211 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_multiq.ko 2024-08-17T02:13:57.211 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_netem.ko 2024-08-17T02:13:57.211 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_pie.ko 2024-08-17T02:13:57.211 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_plug.ko 2024-08-17T02:13:57.211 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_prio.ko 2024-08-17T02:13:57.211 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_qfq.ko 2024-08-17T02:13:57.211 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_red.ko 2024-08-17T02:13:57.211 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfb.ko 2024-08-17T02:13:57.211 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfq.ko 2024-08-17T02:13:57.211 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_tbf.ko 2024-08-17T02:13:57.211 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_teql.ko 2024-08-17T02:13:57.211 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp 2024-08-17T02:13:57.211 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp.ko 2024-08-17T02:13:57.212 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp_diag.ko 2024-08-17T02:13:57.212 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc 2024-08-17T02:13:57.212 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss 2024-08-17T02:13:57.212 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-08-17T02:13:57.212 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-08-17T02:13:57.212 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/sunrpc.ko 2024-08-17T02:13:57.212 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma 2024-08-17T02:13:57.212 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-08-17T02:13:57.212 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc 2024-08-17T02:13:57.212 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc.ko 2024-08-17T02:13:57.212 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc_diag.ko 2024-08-17T02:13:57.212 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix 2024-08-17T02:13:57.212 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix/unix_diag.ko 2024-08-17T02:13:57.212 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock 2024-08-17T02:13:57.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-08-17T02:13:57.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-08-17T02:13:57.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock.ko 2024-08-17T02:13:57.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_diag.ko 2024-08-17T02:13:57.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_loopback.ko 2024-08-17T02:13:57.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm 2024-08-17T02:13:57.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm/xfrm_ipcomp.ko 2024-08-17T02:13:57.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security 2024-08-17T02:13:57.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys 2024-08-17T02:13:57.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys 2024-08-17T02:13:57.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-08-17T02:13:57.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys 2024-08-17T02:13:57.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys/trusted.ko 2024-08-17T02:13:57.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias 2024-08-17T02:13:57.214 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias.bin 2024-08-17T02:13:57.214 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin 2024-08-17T02:13:57.214 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.alias.bin 2024-08-17T02:13:57.214 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.bin 2024-08-17T02:13:57.214 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.modinfo 2024-08-17T02:13:57.214 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep 2024-08-17T02:13:57.214 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep.bin 2024-08-17T02:13:57.214 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.devname 2024-08-17T02:13:57.214 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.order 2024-08-17T02:13:57.214 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.softdep 2024-08-17T02:13:57.214 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols 2024-08-17T02:13:57.214 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols.bin 2024-08-17T02:13:57.214 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.weakdep 2024-08-17T02:13:57.215 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:13:57.219 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:13:57.219 DEBUG:teuthology.orchestra.run.smithi157:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-08-17T02:13:57.244 INFO:teuthology.orchestra.run.smithi157.stdout:postinstall scriptlet (using /bin/sh): 2024-08-17T02:13:57.244 INFO:teuthology.orchestra.run.smithi157.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:13:57.244 INFO:teuthology.orchestra.run.smithi157.stdout: /usr/bin/kernel-install add 6.11.0-rc3-g7503b862ff5b /lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:13:57.244 INFO:teuthology.orchestra.run.smithi157.stdout:fi 2024-08-17T02:13:57.244 INFO:teuthology.orchestra.run.smithi157.stdout:for file in vmlinuz System.map config; do 2024-08-17T02:13:57.244 INFO:teuthology.orchestra.run.smithi157.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b"; then 2024-08-17T02:13:57.245 INFO:teuthology.orchestra.run.smithi157.stdout: cp "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:13:57.245 INFO:teuthology.orchestra.run.smithi157.stdout: fi 2024-08-17T02:13:57.245 INFO:teuthology.orchestra.run.smithi157.stdout:done 2024-08-17T02:13:57.245 INFO:teuthology.orchestra.run.smithi157.stdout:if [ -d "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" ] && \ 2024-08-17T02:13:57.245 INFO:teuthology.orchestra.run.smithi157.stdout: ! diff -rq "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" >/dev/null 2>&1; then 2024-08-17T02:13:57.245 INFO:teuthology.orchestra.run.smithi157.stdout: rm -rf "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:13:57.245 INFO:teuthology.orchestra.run.smithi157.stdout: cp -r "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:13:57.245 INFO:teuthology.orchestra.run.smithi157.stdout:fi 2024-08-17T02:13:57.245 INFO:teuthology.orchestra.run.smithi157.stdout:if [ ! -e "/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep" ]; then 2024-08-17T02:13:57.245 INFO:teuthology.orchestra.run.smithi157.stdout: /usr/sbin/depmod 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:13:57.245 INFO:teuthology.orchestra.run.smithi157.stdout:fi 2024-08-17T02:13:57.245 INFO:teuthology.orchestra.run.smithi157.stdout:preuninstall scriptlet (using /bin/sh): 2024-08-17T02:13:57.245 INFO:teuthology.orchestra.run.smithi157.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:13:57.245 INFO:teuthology.orchestra.run.smithi157.stdout:kernel-install remove 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:13:57.246 INFO:teuthology.orchestra.run.smithi157.stdout:fi 2024-08-17T02:13:57.247 DEBUG:teuthology.orchestra.run.smithi157:> sudo rpm -qi grub2-tools 2024-08-17T02:13:57.323 INFO:teuthology.orchestra.run.smithi157.stdout:Name : grub2-tools 2024-08-17T02:13:57.323 INFO:teuthology.orchestra.run.smithi157.stdout:Epoch : 1 2024-08-17T02:13:57.323 INFO:teuthology.orchestra.run.smithi157.stdout:Version : 2.06 2024-08-17T02:13:57.323 INFO:teuthology.orchestra.run.smithi157.stdout:Release : 68.el9 2024-08-17T02:13:57.323 INFO:teuthology.orchestra.run.smithi157.stdout:Architecture: x86_64 2024-08-17T02:13:57.324 INFO:teuthology.orchestra.run.smithi157.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-08-17T02:13:57.324 INFO:teuthology.orchestra.run.smithi157.stdout:Group : Unspecified 2024-08-17T02:13:57.324 INFO:teuthology.orchestra.run.smithi157.stdout:Size : 8264254 2024-08-17T02:13:57.324 INFO:teuthology.orchestra.run.smithi157.stdout:License : GPLv3+ 2024-08-17T02:13:57.324 INFO:teuthology.orchestra.run.smithi157.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-08-17T02:13:57.324 INFO:teuthology.orchestra.run.smithi157.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-08-17T02:13:57.324 INFO:teuthology.orchestra.run.smithi157.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-08-17T02:13:57.324 INFO:teuthology.orchestra.run.smithi157.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-08-17T02:13:57.324 INFO:teuthology.orchestra.run.smithi157.stdout:Packager : builder@centos.org 2024-08-17T02:13:57.324 INFO:teuthology.orchestra.run.smithi157.stdout:Vendor : CentOS 2024-08-17T02:13:57.324 INFO:teuthology.orchestra.run.smithi157.stdout:URL : http://www.gnu.org/software/grub/ 2024-08-17T02:13:57.324 INFO:teuthology.orchestra.run.smithi157.stdout:Summary : Support tools for GRUB. 2024-08-17T02:13:57.324 INFO:teuthology.orchestra.run.smithi157.stdout:Description : 2024-08-17T02:13:57.324 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:13:57.325 INFO:teuthology.orchestra.run.smithi157.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-08-17T02:13:57.325 INFO:teuthology.orchestra.run.smithi157.stdout:customizable bootloader with modular architecture. It supports a rich 2024-08-17T02:13:57.325 INFO:teuthology.orchestra.run.smithi157.stdout:variety of kernel formats, file systems, computer architectures and 2024-08-17T02:13:57.325 INFO:teuthology.orchestra.run.smithi157.stdout:hardware devices. 2024-08-17T02:13:57.325 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:13:57.325 INFO:teuthology.orchestra.run.smithi157.stdout:This subpackage provides tools for support of all platforms. 2024-08-17T02:13:57.326 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-08-17T02:13:57.326 INFO:teuthology.task.kernel:Updating grub on smithi157 to boot 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:13:57.326 DEBUG:teuthology.orchestra.run.smithi157:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-08-17T02:13:57.947 INFO:teuthology.orchestra.run.smithi157.stderr:Generating grub configuration file ... 2024-08-17T02:13:59.357 INFO:teuthology.orchestra.run.smithi157.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-08-17T02:13:59.393 INFO:teuthology.orchestra.run.smithi157.stderr:done 2024-08-17T02:13:59.395 DEBUG:teuthology.orchestra.run.smithi157:> mktemp 2024-08-17T02:13:59.415 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.GNJBP2Nq5N 2024-08-17T02:13:59.416 DEBUG:teuthology.orchestra.run.smithi157:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.GNJBP2Nq5N 2024-08-17T02:13:59.489 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.GNJBP2Nq5N 2024-08-17T02:13:59.626 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.GNJBP2Nq5N is 6KB 2024-08-17T02:13:59.673 DEBUG:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.GNJBP2Nq5N 2024-08-17T02:13:59.688 DEBUG:teuthology.orchestra.run.smithi157:> sudo /bin/ls /boot/loader/entries || true 2024-08-17T02:13:59.748 INFO:teuthology.orchestra.run.smithi157.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-08-17T02:13:59.748 INFO:teuthology.orchestra.run.smithi157.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-08-17T02:13:59.748 INFO:teuthology.orchestra.run.smithi157.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-08-17T02:13:59.749 INFO:teuthology.orchestra.run.smithi157.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b.conf 2024-08-17T02:13:59.750 DEBUG:teuthology.orchestra.run.smithi157:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:13:59.912 DEBUG:teuthology.orchestra.run.smithi157:> sudo shutdown -r now 2024-08-17T02:14:05.947 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi107.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-08-17T02:14:05.947 DEBUG:teuthology.orchestra.run.smithi107:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-08-17T02:14:06.031 INFO:teuthology.orchestra.run.smithi107.stdout:/boot/System.map-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:14:06.031 INFO:teuthology.orchestra.run.smithi107.stdout:/boot/config-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:14:06.031 INFO:teuthology.orchestra.run.smithi107.stdout:/boot/vmlinuz-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:14:06.031 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b 2024-08-17T02:14:06.031 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/System.map 2024-08-17T02:14:06.031 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/config 2024-08-17T02:14:06.031 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel 2024-08-17T02:14:06.031 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch 2024-08-17T02:14:06.031 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86 2024-08-17T02:14:06.032 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto 2024-08-17T02:14:06.032 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-08-17T02:14:06.032 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-08-17T02:14:06.032 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-08-17T02:14:06.032 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-08-17T02:14:06.032 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-08-17T02:14:06.032 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-08-17T02:14:06.032 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-08-17T02:14:06.032 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32c-intel.ko 2024-08-17T02:14:06.032 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-08-17T02:14:06.032 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-08-17T02:14:06.032 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-08-17T02:14:06.032 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-08-17T02:14:06.033 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx2.ko 2024-08-17T02:14:06.033 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-08-17T02:14:06.033 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-08-17T02:14:06.033 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-08-17T02:14:06.033 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-08-17T02:14:06.033 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-08-17T02:14:06.033 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-08-17T02:14:06.033 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-08-17T02:14:06.033 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel 2024-08-17T02:14:06.033 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu 2024-08-17T02:14:06.033 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce 2024-08-17T02:14:06.033 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-08-17T02:14:06.033 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm 2024-08-17T02:14:06.034 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-amd.ko 2024-08-17T02:14:06.034 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-intel.ko 2024-08-17T02:14:06.034 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm.ko 2024-08-17T02:14:06.034 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto 2024-08-17T02:14:06.034 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ansi_cprng.ko 2024-08-17T02:14:06.034 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/anubis.ko 2024-08-17T02:14:06.034 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/arc4.ko 2024-08-17T02:14:06.034 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx 2024-08-17T02:14:06.034 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_memcpy.ko 2024-08-17T02:14:06.034 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_pq.ko 2024-08-17T02:14:06.034 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_raid6_recov.ko 2024-08-17T02:14:06.034 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_tx.ko 2024-08-17T02:14:06.035 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_xor.ko 2024-08-17T02:14:06.035 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/raid6test.ko 2024-08-17T02:14:06.035 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authenc.ko 2024-08-17T02:14:06.035 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authencesn.ko 2024-08-17T02:14:06.035 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blake2b_generic.ko 2024-08-17T02:14:06.035 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_common.ko 2024-08-17T02:14:06.035 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_generic.ko 2024-08-17T02:14:06.035 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/camellia_generic.ko 2024-08-17T02:14:06.035 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast5_generic.ko 2024-08-17T02:14:06.035 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast6_generic.ko 2024-08-17T02:14:06.035 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast_common.ko 2024-08-17T02:14:06.035 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ccm.ko 2024-08-17T02:14:06.035 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cmac.ko 2024-08-17T02:14:06.036 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crc32_generic.ko 2024-08-17T02:14:06.036 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_engine.ko 2024-08-17T02:14:06.036 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_user.ko 2024-08-17T02:14:06.036 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cts.ko 2024-08-17T02:14:06.036 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/des_generic.ko 2024-08-17T02:14:06.036 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/dh_generic.ko 2024-08-17T02:14:06.036 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecc.ko 2024-08-17T02:14:06.036 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecdh_generic.ko 2024-08-17T02:14:06.036 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/echainiv.ko 2024-08-17T02:14:06.036 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/essiv.ko 2024-08-17T02:14:06.036 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/fcrypt.ko 2024-08-17T02:14:06.036 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/khazad.ko 2024-08-17T02:14:06.036 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4.ko 2024-08-17T02:14:06.037 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4hc.ko 2024-08-17T02:14:06.037 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/md4.ko 2024-08-17T02:14:06.037 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/michael_mic.ko 2024-08-17T02:14:06.037 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcbc.ko 2024-08-17T02:14:06.037 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcrypt.ko 2024-08-17T02:14:06.037 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/rmd160.ko 2024-08-17T02:14:06.037 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/seed.ko 2024-08-17T02:14:06.037 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/serpent_generic.ko 2024-08-17T02:14:06.037 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tcrypt.ko 2024-08-17T02:14:06.037 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tea.ko 2024-08-17T02:14:06.037 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_common.ko 2024-08-17T02:14:06.037 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_generic.ko 2024-08-17T02:14:06.037 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/vmac.ko 2024-08-17T02:14:06.038 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/wp512.ko 2024-08-17T02:14:06.038 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xcbc.ko 2024-08-17T02:14:06.038 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xor.ko 2024-08-17T02:14:06.038 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xxhash_generic.ko 2024-08-17T02:14:06.038 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers 2024-08-17T02:14:06.038 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi 2024-08-17T02:14:06.038 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_ipmi.ko 2024-08-17T02:14:06.038 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_pad.ko 2024-08-17T02:14:06.038 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/ec_sys.ko 2024-08-17T02:14:06.038 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/platform_profile.ko 2024-08-17T02:14:06.038 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbs.ko 2024-08-17T02:14:06.038 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbshc.ko 2024-08-17T02:14:06.038 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/video.ko 2024-08-17T02:14:06.039 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata 2024-08-17T02:14:06.039 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/acard-ahci.ko 2024-08-17T02:14:06.039 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ahci_platform.ko 2024-08-17T02:14:06.039 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ata_generic.ko 2024-08-17T02:14:06.039 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/libahci_platform.ko 2024-08-17T02:14:06.039 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_acpi.ko 2024-08-17T02:14:06.039 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ali.ko 2024-08-17T02:14:06.039 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_amd.ko 2024-08-17T02:14:06.039 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_artop.ko 2024-08-17T02:14:06.039 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atiixp.ko 2024-08-17T02:14:06.039 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atp867x.ko 2024-08-17T02:14:06.039 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd640.ko 2024-08-17T02:14:06.039 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd64x.ko 2024-08-17T02:14:06.039 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cypress.ko 2024-08-17T02:14:06.040 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_efar.ko 2024-08-17T02:14:06.040 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt366.ko 2024-08-17T02:14:06.040 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt37x.ko 2024-08-17T02:14:06.040 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x2n.ko 2024-08-17T02:14:06.040 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x3.ko 2024-08-17T02:14:06.040 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it8213.ko 2024-08-17T02:14:06.040 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it821x.ko 2024-08-17T02:14:06.040 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_jmicron.ko 2024-08-17T02:14:06.040 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_marvell.ko 2024-08-17T02:14:06.040 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_mpiix.ko 2024-08-17T02:14:06.040 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_netcell.ko 2024-08-17T02:14:06.040 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ninja32.ko 2024-08-17T02:14:06.041 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87410.ko 2024-08-17T02:14:06.041 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87415.ko 2024-08-17T02:14:06.041 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_oldpiix.ko 2024-08-17T02:14:06.041 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_opti.ko 2024-08-17T02:14:06.041 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_optidma.ko 2024-08-17T02:14:06.041 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pcmcia.ko 2024-08-17T02:14:06.041 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc2027x.ko 2024-08-17T02:14:06.041 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-08-17T02:14:06.041 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_piccolo.ko 2024-08-17T02:14:06.041 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_rdc.ko 2024-08-17T02:14:06.041 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sch.ko 2024-08-17T02:14:06.041 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_serverworks.ko 2024-08-17T02:14:06.041 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sil680.ko 2024-08-17T02:14:06.042 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sis.ko 2024-08-17T02:14:06.042 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sl82c105.ko 2024-08-17T02:14:06.042 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_triflex.ko 2024-08-17T02:14:06.042 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_via.ko 2024-08-17T02:14:06.042 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pdc_adma.ko 2024-08-17T02:14:06.042 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_inic162x.ko 2024-08-17T02:14:06.042 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_mv.ko 2024-08-17T02:14:06.042 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_nv.ko 2024-08-17T02:14:06.042 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_promise.ko 2024-08-17T02:14:06.042 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_qstor.ko 2024-08-17T02:14:06.042 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil.ko 2024-08-17T02:14:06.042 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil24.ko 2024-08-17T02:14:06.042 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sis.ko 2024-08-17T02:14:06.042 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_svw.ko 2024-08-17T02:14:06.043 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sx4.ko 2024-08-17T02:14:06.043 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_uli.ko 2024-08-17T02:14:06.043 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_via.ko 2024-08-17T02:14:06.043 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_vsc.ko 2024-08-17T02:14:06.043 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay 2024-08-17T02:14:06.043 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay/ks0108.ko 2024-08-17T02:14:06.043 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base 2024-08-17T02:14:06.043 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap 2024-08-17T02:14:06.043 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-i2c.ko 2024-08-17T02:14:06.043 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-mmio.ko 2024-08-17T02:14:06.043 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma 2024-08-17T02:14:06.043 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma/bcma.ko 2024-08-17T02:14:06.044 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block 2024-08-17T02:14:06.044 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe 2024-08-17T02:14:06.044 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe/aoe.ko 2024-08-17T02:14:06.044 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/brd.ko 2024-08-17T02:14:06.044 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd 2024-08-17T02:14:06.044 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd/drbd.ko 2024-08-17T02:14:06.044 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/floppy.ko 2024-08-17T02:14:06.044 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/loop.ko 2024-08-17T02:14:06.044 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx 2024-08-17T02:14:06.044 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-08-17T02:14:06.044 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/nbd.ko 2024-08-17T02:14:06.044 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk 2024-08-17T02:14:06.045 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk/null_blk.ko 2024-08-17T02:14:06.045 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/pktcdvd.ko 2024-08-17T02:14:06.045 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/rbd.ko 2024-08-17T02:14:06.045 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/virtio_blk.ko 2024-08-17T02:14:06.045 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback 2024-08-17T02:14:06.045 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-08-17T02:14:06.045 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkfront.ko 2024-08-17T02:14:06.045 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram 2024-08-17T02:14:06.045 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram/zram.ko 2024-08-17T02:14:06.045 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char 2024-08-17T02:14:06.045 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hangcheck-timer.ko 2024-08-17T02:14:06.046 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random 2024-08-17T02:14:06.046 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/amd-rng.ko 2024-08-17T02:14:06.046 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/intel-rng.ko 2024-08-17T02:14:06.046 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-08-17T02:14:06.046 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/via-rng.ko 2024-08-17T02:14:06.046 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/virtio-rng.ko 2024-08-17T02:14:06.046 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi 2024-08-17T02:14:06.046 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-08-17T02:14:06.046 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-08-17T02:14:06.046 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-08-17T02:14:06.046 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_si.ko 2024-08-17T02:14:06.046 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-08-17T02:14:06.047 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-08-17T02:14:06.047 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/lp.ko 2024-08-17T02:14:06.047 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave 2024-08-17T02:14:06.047 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave/mwave.ko 2024-08-17T02:14:06.047 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ppdev.ko 2024-08-17T02:14:06.047 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tlclk.ko 2024-08-17T02:14:06.047 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm 2024-08-17T02:14:06.047 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm.ko 2024-08-17T02:14:06.047 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_atmel.ko 2024-08-17T02:14:06.047 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_infineon.ko 2024-08-17T02:14:06.047 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_nsc.ko 2024-08-17T02:14:06.047 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis.ko 2024-08-17T02:14:06.047 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-08-17T02:14:06.047 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/uv_mmtimer.ko 2024-08-17T02:14:06.048 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/virtio_console.ko 2024-08-17T02:14:06.048 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq 2024-08-17T02:14:06.048 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-08-17T02:14:06.048 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-08-17T02:14:06.048 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/p4-clockmod.ko 2024-08-17T02:14:06.048 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-08-17T02:14:06.048 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/powernow-k8.ko 2024-08-17T02:14:06.048 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/speedstep-lib.ko 2024-08-17T02:14:06.048 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto 2024-08-17T02:14:06.048 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp 2024-08-17T02:14:06.048 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-08-17T02:14:06.048 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp.ko 2024-08-17T02:14:06.048 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel 2024-08-17T02:14:06.049 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat 2024-08-17T02:14:06.049 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common 2024-08-17T02:14:06.049 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-08-17T02:14:06.049 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-08-17T02:14:06.049 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-08-17T02:14:06.049 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-aes.ko 2024-08-17T02:14:06.049 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-sha.ko 2024-08-17T02:14:06.049 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio 2024-08-17T02:14:06.049 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-08-17T02:14:06.049 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca 2024-08-17T02:14:06.049 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca/dca.ko 2024-08-17T02:14:06.049 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq 2024-08-17T02:14:06.050 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-08-17T02:14:06.050 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma 2024-08-17T02:14:06.050 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw 2024-08-17T02:14:06.050 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw/dw_dmac.ko 2024-08-17T02:14:06.050 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat 2024-08-17T02:14:06.050 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat/ioatdma.ko 2024-08-17T02:14:06.050 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac 2024-08-17T02:14:06.050 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/amd64_edac.ko 2024-08-17T02:14:06.050 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/e752x_edac.ko 2024-08-17T02:14:06.050 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/edac_mce_amd.ko 2024-08-17T02:14:06.050 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3000_edac.ko 2024-08-17T02:14:06.050 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3200_edac.ko 2024-08-17T02:14:06.051 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5100_edac.ko 2024-08-17T02:14:06.051 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5400_edac.ko 2024-08-17T02:14:06.051 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7300_edac.ko 2024-08-17T02:14:06.051 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7core_edac.ko 2024-08-17T02:14:06.051 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i82975x_edac.ko 2024-08-17T02:14:06.051 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/ie31200_edac.ko 2024-08-17T02:14:06.051 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/sb_edac.ko 2024-08-17T02:14:06.051 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/x38_edac.ko 2024-08-17T02:14:06.051 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware 2024-08-17T02:14:06.051 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/edd.ko 2024-08-17T02:14:06.051 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/iscsi_ibft.ko 2024-08-17T02:14:06.051 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio 2024-08-17T02:14:06.051 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-ich.ko 2024-08-17T02:14:06.052 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-viperboard.ko 2024-08-17T02:14:06.052 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid 2024-08-17T02:14:06.052 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-appleir.ko 2024-08-17T02:14:06.052 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-aureal.ko 2024-08-17T02:14:06.052 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-axff.ko 2024-08-17T02:14:06.052 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-dr.ko 2024-08-17T02:14:06.052 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elecom.ko 2024-08-17T02:14:06.052 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elo.ko 2024-08-17T02:14:06.052 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-emsff.ko 2024-08-17T02:14:06.052 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gaff.ko 2024-08-17T02:14:06.052 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gt683r.ko 2024-08-17T02:14:06.052 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gyration.ko 2024-08-17T02:14:06.052 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-kbd.ko 2024-08-17T02:14:06.053 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-mouse.ko 2024-08-17T02:14:06.053 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtekff.ko 2024-08-17T02:14:06.053 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-hyperv.ko 2024-08-17T02:14:06.053 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-icade.ko 2024-08-17T02:14:06.053 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-keytouch.ko 2024-08-17T02:14:06.053 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-kye.ko 2024-08-17T02:14:06.053 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lcpower.ko 2024-08-17T02:14:06.053 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-led.ko 2024-08-17T02:14:06.053 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lenovo.ko 2024-08-17T02:14:06.053 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-dj.ko 2024-08-17T02:14:06.053 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-08-17T02:14:06.053 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-multitouch.ko 2024-08-17T02:14:06.053 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-ortek.ko 2024-08-17T02:14:06.053 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-penmount.ko 2024-08-17T02:14:06.054 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-petalynx.ko 2024-08-17T02:14:06.054 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-picolcd.ko 2024-08-17T02:14:06.054 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-pl.ko 2024-08-17T02:14:06.054 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-plantronics.ko 2024-08-17T02:14:06.054 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-primax.ko 2024-08-17T02:14:06.054 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-rmi.ko 2024-08-17T02:14:06.054 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-arvo.ko 2024-08-17T02:14:06.054 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-common.ko 2024-08-17T02:14:06.054 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-isku.ko 2024-08-17T02:14:06.054 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kone.ko 2024-08-17T02:14:06.054 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-08-17T02:14:06.054 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-konepure.ko 2024-08-17T02:14:06.055 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-08-17T02:14:06.055 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-lua.ko 2024-08-17T02:14:06.055 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-pyra.ko 2024-08-17T02:14:06.055 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-ryos.ko 2024-08-17T02:14:06.055 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-savu.ko 2024-08-17T02:14:06.055 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat.ko 2024-08-17T02:14:06.055 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-saitek.ko 2024-08-17T02:14:06.055 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-samsung.ko 2024-08-17T02:14:06.055 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sensor-hub.ko 2024-08-17T02:14:06.055 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sjoy.ko 2024-08-17T02:14:06.055 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sony.ko 2024-08-17T02:14:06.055 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-speedlink.ko 2024-08-17T02:14:06.055 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-steelseries.ko 2024-08-17T02:14:06.056 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sunplus.ko 2024-08-17T02:14:06.056 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-thrustmaster.ko 2024-08-17T02:14:06.056 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tivo.ko 2024-08-17T02:14:06.056 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tmff.ko 2024-08-17T02:14:06.056 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-topseed.ko 2024-08-17T02:14:06.056 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-twinhan.ko 2024-08-17T02:14:06.056 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-uclogic.ko 2024-08-17T02:14:06.056 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-waltop.ko 2024-08-17T02:14:06.056 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-wiimote.ko 2024-08-17T02:14:06.056 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-xinmo.ko 2024-08-17T02:14:06.056 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zpff.ko 2024-08-17T02:14:06.056 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zydacron.ko 2024-08-17T02:14:06.056 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/uhid.ko 2024-08-17T02:14:06.056 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/wacom.ko 2024-08-17T02:14:06.057 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv 2024-08-17T02:14:06.057 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_balloon.ko 2024-08-17T02:14:06.057 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_utils.ko 2024-08-17T02:14:06.057 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_vmbus.ko 2024-08-17T02:14:06.057 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon 2024-08-17T02:14:06.057 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru.ko 2024-08-17T02:14:06.057 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru3.ko 2024-08-17T02:14:06.057 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/acpi_power_meter.ko 2024-08-17T02:14:06.057 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7414.ko 2024-08-17T02:14:06.057 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7418.ko 2024-08-17T02:14:06.057 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adc128d818.ko 2024-08-17T02:14:06.057 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1025.ko 2024-08-17T02:14:06.057 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1026.ko 2024-08-17T02:14:06.058 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1029.ko 2024-08-17T02:14:06.058 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1031.ko 2024-08-17T02:14:06.058 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm9240.ko 2024-08-17T02:14:06.058 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ads7828.ko 2024-08-17T02:14:06.058 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7410.ko 2024-08-17T02:14:06.058 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7411.ko 2024-08-17T02:14:06.058 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7462.ko 2024-08-17T02:14:06.058 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7470.ko 2024-08-17T02:14:06.058 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7475.ko 2024-08-17T02:14:06.058 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7x10.ko 2024-08-17T02:14:06.058 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/amc6821.ko 2024-08-17T02:14:06.058 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/applesmc.ko 2024-08-17T02:14:06.059 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asb100.ko 2024-08-17T02:14:06.059 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asc7621.ko 2024-08-17T02:14:06.059 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asus_atk0110.ko 2024-08-17T02:14:06.059 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/atxp1.ko 2024-08-17T02:14:06.059 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/coretemp.ko 2024-08-17T02:14:06.059 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-08-17T02:14:06.059 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dme1737.ko 2024-08-17T02:14:06.059 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds1621.ko 2024-08-17T02:14:06.059 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds620.ko 2024-08-17T02:14:06.059 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc1403.ko 2024-08-17T02:14:06.059 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc6w201.ko 2024-08-17T02:14:06.059 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71805f.ko 2024-08-17T02:14:06.059 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71882fg.ko 2024-08-17T02:14:06.059 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f75375s.ko 2024-08-17T02:14:06.060 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fam15h_power.ko 2024-08-17T02:14:06.060 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fschmd.ko 2024-08-17T02:14:06.060 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g760a.ko 2024-08-17T02:14:06.060 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g762.ko 2024-08-17T02:14:06.060 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl518sm.ko 2024-08-17T02:14:06.060 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl520sm.ko 2024-08-17T02:14:06.060 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/hwmon-vid.ko 2024-08-17T02:14:06.060 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5500_temp.ko 2024-08-17T02:14:06.060 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5k_amb.ko 2024-08-17T02:14:06.060 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmaem.ko 2024-08-17T02:14:06.060 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmpex.ko 2024-08-17T02:14:06.060 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina209.ko 2024-08-17T02:14:06.061 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina2xx.ko 2024-08-17T02:14:06.061 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/it87.ko 2024-08-17T02:14:06.061 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k10temp.ko 2024-08-17T02:14:06.061 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k8temp.ko 2024-08-17T02:14:06.061 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lineage-pem.ko 2024-08-17T02:14:06.061 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm63.ko 2024-08-17T02:14:06.061 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm73.ko 2024-08-17T02:14:06.061 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm75.ko 2024-08-17T02:14:06.061 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm77.ko 2024-08-17T02:14:06.061 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm78.ko 2024-08-17T02:14:06.061 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm80.ko 2024-08-17T02:14:06.061 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm83.ko 2024-08-17T02:14:06.061 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm85.ko 2024-08-17T02:14:06.062 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm87.ko 2024-08-17T02:14:06.062 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm90.ko 2024-08-17T02:14:06.062 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm92.ko 2024-08-17T02:14:06.062 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm93.ko 2024-08-17T02:14:06.062 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95234.ko 2024-08-17T02:14:06.062 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95241.ko 2024-08-17T02:14:06.062 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95245.ko 2024-08-17T02:14:06.062 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc2945.ko 2024-08-17T02:14:06.062 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4151.ko 2024-08-17T02:14:06.062 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4215.ko 2024-08-17T02:14:06.062 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4222.ko 2024-08-17T02:14:06.062 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4245.ko 2024-08-17T02:14:06.062 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4260.ko 2024-08-17T02:14:06.063 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4261.ko 2024-08-17T02:14:06.063 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max16065.ko 2024-08-17T02:14:06.063 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1619.ko 2024-08-17T02:14:06.063 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1668.ko 2024-08-17T02:14:06.063 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max197.ko 2024-08-17T02:14:06.063 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6639.ko 2024-08-17T02:14:06.063 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6650.ko 2024-08-17T02:14:06.063 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6697.ko 2024-08-17T02:14:06.063 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/mcp3021.ko 2024-08-17T02:14:06.063 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6683.ko 2024-08-17T02:14:06.063 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775-core.ko 2024-08-17T02:14:06.063 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775.ko 2024-08-17T02:14:06.063 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct7802.ko 2024-08-17T02:14:06.063 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87360.ko 2024-08-17T02:14:06.064 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87427.ko 2024-08-17T02:14:06.064 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pcf8591.ko 2024-08-17T02:14:06.064 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus 2024-08-17T02:14:06.064 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-08-17T02:14:06.064 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-08-17T02:14:06.064 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-08-17T02:14:06.064 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max16064.ko 2024-08-17T02:14:06.064 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max34440.ko 2024-08-17T02:14:06.064 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max8688.ko 2024-08-17T02:14:06.064 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-08-17T02:14:06.064 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-08-17T02:14:06.064 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-08-17T02:14:06.064 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-08-17T02:14:06.064 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-08-17T02:14:06.065 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-08-17T02:14:06.065 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/powr1220.ko 2024-08-17T02:14:06.065 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5627.ko 2024-08-17T02:14:06.065 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5636.ko 2024-08-17T02:14:06.065 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch56xx-common.ko 2024-08-17T02:14:06.065 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht15.ko 2024-08-17T02:14:06.065 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht21.ko 2024-08-17T02:14:06.065 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/shtc1.ko 2024-08-17T02:14:06.065 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sis5595.ko 2024-08-17T02:14:06.065 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47b397.ko 2024-08-17T02:14:06.065 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m1.ko 2024-08-17T02:14:06.065 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m192.ko 2024-08-17T02:14:06.065 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/thmc50.ko 2024-08-17T02:14:06.065 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp102.ko 2024-08-17T02:14:06.066 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp103.ko 2024-08-17T02:14:06.066 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp401.ko 2024-08-17T02:14:06.066 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp421.ko 2024-08-17T02:14:06.066 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via-cputemp.ko 2024-08-17T02:14:06.066 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via686a.ko 2024-08-17T02:14:06.066 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt1211.ko 2024-08-17T02:14:06.066 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt8231.ko 2024-08-17T02:14:06.066 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627ehf.ko 2024-08-17T02:14:06.066 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627hf.ko 2024-08-17T02:14:06.066 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83781d.ko 2024-08-17T02:14:06.066 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83791d.ko 2024-08-17T02:14:06.066 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83792d.ko 2024-08-17T02:14:06.067 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83793.ko 2024-08-17T02:14:06.067 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83795.ko 2024-08-17T02:14:06.067 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l785ts.ko 2024-08-17T02:14:06.067 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l786ng.ko 2024-08-17T02:14:06.067 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c 2024-08-17T02:14:06.067 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos 2024-08-17T02:14:06.067 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-08-17T02:14:06.067 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-08-17T02:14:06.067 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses 2024-08-17T02:14:06.067 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-08-17T02:14:06.067 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-08-17T02:14:06.067 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-08-17T02:14:06.068 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-08-17T02:14:06.068 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-08-17T02:14:06.068 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-08-17T02:14:06.068 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-08-17T02:14:06.068 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-08-17T02:14:06.068 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-i801.ko 2024-08-17T02:14:06.068 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-isch.ko 2024-08-17T02:14:06.068 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-08-17T02:14:06.068 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-08-17T02:14:06.068 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-08-17T02:14:06.068 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-parport.ko 2024-08-17T02:14:06.068 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-08-17T02:14:06.069 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-08-17T02:14:06.069 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-08-17T02:14:06.069 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-08-17T02:14:06.069 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-08-17T02:14:06.069 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-08-17T02:14:06.069 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-via.ko 2024-08-17T02:14:06.069 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-08-17T02:14:06.069 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-08-17T02:14:06.069 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-dev.ko 2024-08-17T02:14:06.069 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-mux.ko 2024-08-17T02:14:06.069 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-08-17T02:14:06.069 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-smbus.ko 2024-08-17T02:14:06.069 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-stub.ko 2024-08-17T02:14:06.070 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband 2024-08-17T02:14:06.070 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core 2024-08-17T02:14:06.070 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_cm.ko 2024-08-17T02:14:06.070 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_core.ko 2024-08-17T02:14:06.070 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_umad.ko 2024-08-17T02:14:06.070 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-08-17T02:14:06.070 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/iw_cm.ko 2024-08-17T02:14:06.070 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_cm.ko 2024-08-17T02:14:06.070 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-08-17T02:14:06.070 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw 2024-08-17T02:14:06.070 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4 2024-08-17T02:14:06.071 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-08-17T02:14:06.071 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4 2024-08-17T02:14:06.071 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-08-17T02:14:06.071 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5 2024-08-17T02:14:06.071 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-08-17T02:14:06.071 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca 2024-08-17T02:14:06.071 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-08-17T02:14:06.071 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp 2024-08-17T02:14:06.072 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib 2024-08-17T02:14:06.072 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-08-17T02:14:06.072 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser 2024-08-17T02:14:06.072 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-08-17T02:14:06.072 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert 2024-08-17T02:14:06.072 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-08-17T02:14:06.072 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp 2024-08-17T02:14:06.072 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-08-17T02:14:06.072 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt 2024-08-17T02:14:06.072 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-08-17T02:14:06.072 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input 2024-08-17T02:14:06.072 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport 2024-08-17T02:14:06.072 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-08-17T02:14:06.072 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/fm801-gp.ko 2024-08-17T02:14:06.073 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/gameport.ko 2024-08-17T02:14:06.073 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/joydev.ko 2024-08-17T02:14:06.073 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard 2024-08-17T02:14:06.073 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/gpio_keys.ko 2024-08-17T02:14:06.073 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse 2024-08-17T02:14:06.073 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/appletouch.ko 2024-08-17T02:14:06.073 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/bcm5974.ko 2024-08-17T02:14:06.073 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/cyapatp.ko 2024-08-17T02:14:06.073 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/elan_i2c.ko 2024-08-17T02:14:06.073 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/sermouse.ko 2024-08-17T02:14:06.073 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-08-17T02:14:06.073 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_usb.ko 2024-08-17T02:14:06.073 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/vsxxxaa.ko 2024-08-17T02:14:06.074 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4 2024-08-17T02:14:06.074 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4/rmi_core.ko 2024-08-17T02:14:06.074 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio 2024-08-17T02:14:06.074 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/altera_ps2.ko 2024-08-17T02:14:06.074 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/arc_ps2.ko 2024-08-17T02:14:06.074 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-08-17T02:14:06.074 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/serio_raw.ko 2024-08-17T02:14:06.074 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/sparse-keymap.ko 2024-08-17T02:14:06.074 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds 2024-08-17T02:14:06.074 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-blinkm.ko 2024-08-17T02:14:06.074 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lm3530.ko 2024-08-17T02:14:06.074 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lp3944.ko 2024-08-17T02:14:06.074 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-ss4200.ko 2024-08-17T02:14:06.075 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger 2024-08-17T02:14:06.075 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-08-17T02:14:06.075 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-08-17T02:14:06.075 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-08-17T02:14:06.075 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-08-17T02:14:06.075 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-08-17T02:14:06.075 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-08-17T02:14:06.075 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-08-17T02:14:06.075 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-08-17T02:14:06.075 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md 2024-08-17T02:14:06.075 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache 2024-08-17T02:14:06.075 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache/bcache.ko 2024-08-17T02:14:06.075 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-bio-prison.ko 2024-08-17T02:14:06.075 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache-smq.ko 2024-08-17T02:14:06.076 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache.ko 2024-08-17T02:14:06.076 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-crypt.ko 2024-08-17T02:14:06.076 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-delay.ko 2024-08-17T02:14:06.076 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-flakey.ko 2024-08-17T02:14:06.076 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-log-userspace.ko 2024-08-17T02:14:06.076 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-multipath.ko 2024-08-17T02:14:06.076 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-queue-length.ko 2024-08-17T02:14:06.076 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-raid.ko 2024-08-17T02:14:06.076 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-round-robin.ko 2024-08-17T02:14:06.076 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-service-time.ko 2024-08-17T02:14:06.076 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-switch.ko 2024-08-17T02:14:06.076 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-thin-pool.ko 2024-08-17T02:14:06.076 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-verity.ko 2024-08-17T02:14:06.076 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data 2024-08-17T02:14:06.077 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-08-17T02:14:06.077 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid0.ko 2024-08-17T02:14:06.077 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid1.ko 2024-08-17T02:14:06.077 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid10.ko 2024-08-17T02:14:06.077 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid456.ko 2024-08-17T02:14:06.077 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message 2024-08-17T02:14:06.077 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion 2024-08-17T02:14:06.077 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptbase.ko 2024-08-17T02:14:06.077 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptctl.ko 2024-08-17T02:14:06.077 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptfc.ko 2024-08-17T02:14:06.077 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptlan.ko 2024-08-17T02:14:06.077 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptsas.ko 2024-08-17T02:14:06.077 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptscsih.ko 2024-08-17T02:14:06.078 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptspi.ko 2024-08-17T02:14:06.078 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd 2024-08-17T02:14:06.078 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_ich.ko 2024-08-17T02:14:06.078 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_sch.ko 2024-08-17T02:14:06.078 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/mfd-core.ko 2024-08-17T02:14:06.078 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/sm501.ko 2024-08-17T02:14:06.078 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/viperboard.ko 2024-08-17T02:14:06.078 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/vx855.ko 2024-08-17T02:14:06.078 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/wl1273-core.ko 2024-08-17T02:14:06.078 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc 2024-08-17T02:14:06.078 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl 2024-08-17T02:14:06.078 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-08-17T02:14:06.078 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds9802als.ko 2024-08-17T02:14:06.079 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds990x.ko 2024-08-17T02:14:06.079 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/bh1770glc.ko 2024-08-17T02:14:06.079 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710 2024-08-17T02:14:06.079 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710/cb710.ko 2024-08-17T02:14:06.079 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom 2024-08-17T02:14:06.079 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/at24.ko 2024-08-17T02:14:06.079 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-08-17T02:14:06.079 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/max6875.ko 2024-08-17T02:14:06.079 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/enclosure.ko 2024-08-17T02:14:06.079 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/hpilo.ko 2024-08-17T02:14:06.079 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29003.ko 2024-08-17T02:14:06.079 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29020.ko 2024-08-17T02:14:06.079 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d 2024-08-17T02:14:06.080 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-08-17T02:14:06.080 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-08-17T02:14:06.080 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei 2024-08-17T02:14:06.080 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-me.ko 2024-08-17T02:14:06.080 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-txe.ko 2024-08-17T02:14:06.080 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei.ko 2024-08-17T02:14:06.080 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru 2024-08-17T02:14:06.080 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru/gru.ko 2024-08-17T02:14:06.080 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp 2024-08-17T02:14:06.080 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xp.ko 2024-08-17T02:14:06.080 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpc.ko 2024-08-17T02:14:06.080 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-08-17T02:14:06.080 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_7xx1.ko 2024-08-17T02:14:06.080 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_core.ko 2024-08-17T02:14:06.081 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tsl2550.ko 2024-08-17T02:14:06.081 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_balloon.ko 2024-08-17T02:14:06.081 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci 2024-08-17T02:14:06.081 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-08-17T02:14:06.081 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net 2024-08-17T02:14:06.081 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding 2024-08-17T02:14:06.081 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding/bonding.ko 2024-08-17T02:14:06.081 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa 2024-08-17T02:14:06.081 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53 2024-08-17T02:14:06.081 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53/b53_common.ko 2024-08-17T02:14:06.081 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/bcm-sf2.ko 2024-08-17T02:14:06.081 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6060.ko 2024-08-17T02:14:06.081 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx 2024-08-17T02:14:06.082 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-08-17T02:14:06.082 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dummy.ko 2024-08-17T02:14:06.082 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/eql.ko 2024-08-17T02:14:06.082 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet 2024-08-17T02:14:06.082 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com 2024-08-17T02:14:06.082 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-08-17T02:14:06.082 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-08-17T02:14:06.082 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-08-17T02:14:06.082 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-08-17T02:14:06.082 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390 2024-08-17T02:14:06.082 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/8390.ko 2024-08-17T02:14:06.082 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-08-17T02:14:06.082 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-08-17T02:14:06.083 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-08-17T02:14:06.083 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec 2024-08-17T02:14:06.083 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-08-17T02:14:06.083 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere 2024-08-17T02:14:06.083 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere/et131x.ko 2024-08-17T02:14:06.083 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon 2024-08-17T02:14:06.083 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-08-17T02:14:06.083 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera 2024-08-17T02:14:06.083 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-08-17T02:14:06.083 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd 2024-08-17T02:14:06.083 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-08-17T02:14:06.083 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-08-17T02:14:06.083 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-08-17T02:14:06.084 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros 2024-08-17T02:14:06.084 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx 2024-08-17T02:14:06.084 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-08-17T02:14:06.084 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c 2024-08-17T02:14:06.084 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-08-17T02:14:06.084 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e 2024-08-17T02:14:06.084 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-08-17T02:14:06.084 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx 2024-08-17T02:14:06.084 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-08-17T02:14:06.084 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-08-17T02:14:06.084 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom 2024-08-17T02:14:06.084 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-08-17T02:14:06.084 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-08-17T02:14:06.085 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-08-17T02:14:06.085 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-08-17T02:14:06.085 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-08-17T02:14:06.085 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet 2024-08-17T02:14:06.085 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-08-17T02:14:06.085 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-08-17T02:14:06.085 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade 2024-08-17T02:14:06.085 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna 2024-08-17T02:14:06.085 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-08-17T02:14:06.085 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio 2024-08-17T02:14:06.085 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb 2024-08-17T02:14:06.085 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-08-17T02:14:06.085 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-08-17T02:14:06.085 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-08-17T02:14:06.086 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-08-17T02:14:06.086 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-08-17T02:14:06.086 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-08-17T02:14:06.086 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-08-17T02:14:06.086 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-08-17T02:14:06.086 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-08-17T02:14:06.086 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco 2024-08-17T02:14:06.086 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic 2024-08-17T02:14:06.086 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-08-17T02:14:06.086 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec 2024-08-17T02:14:06.086 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip 2024-08-17T02:14:06.086 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-08-17T02:14:06.086 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-08-17T02:14:06.087 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-08-17T02:14:06.087 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-08-17T02:14:06.087 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-08-17T02:14:06.087 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-08-17T02:14:06.087 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink 2024-08-17T02:14:06.087 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-08-17T02:14:06.087 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-08-17T02:14:06.087 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dnet.ko 2024-08-17T02:14:06.087 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex 2024-08-17T02:14:06.087 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet 2024-08-17T02:14:06.087 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-08-17T02:14:06.087 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ethoc.ko 2024-08-17T02:14:06.087 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/fealnx.ko 2024-08-17T02:14:06.088 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel 2024-08-17T02:14:06.088 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e100.ko 2024-08-17T02:14:06.088 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000 2024-08-17T02:14:06.088 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-08-17T02:14:06.088 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e 2024-08-17T02:14:06.088 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-08-17T02:14:06.088 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k 2024-08-17T02:14:06.088 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-08-17T02:14:06.088 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e 2024-08-17T02:14:06.088 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-08-17T02:14:06.088 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf 2024-08-17T02:14:06.088 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-08-17T02:14:06.088 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb 2024-08-17T02:14:06.089 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-08-17T02:14:06.089 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf 2024-08-17T02:14:06.089 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-08-17T02:14:06.089 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe 2024-08-17T02:14:06.089 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-08-17T02:14:06.089 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf 2024-08-17T02:14:06.089 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-08-17T02:14:06.089 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth 2024-08-17T02:14:06.089 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-08-17T02:14:06.089 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie 2024-08-17T02:14:06.089 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-08-17T02:14:06.089 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/jme.ko 2024-08-17T02:14:06.090 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell 2024-08-17T02:14:06.090 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-08-17T02:14:06.090 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/skge.ko 2024-08-17T02:14:06.090 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-08-17T02:14:06.090 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox 2024-08-17T02:14:06.090 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4 2024-08-17T02:14:06.090 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-08-17T02:14:06.090 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-08-17T02:14:06.090 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5 2024-08-17T02:14:06.090 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-08-17T02:14:06.090 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-08-17T02:14:06.091 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel 2024-08-17T02:14:06.091 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-08-17T02:14:06.091 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom 2024-08-17T02:14:06.091 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge 2024-08-17T02:14:06.091 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-08-17T02:14:06.091 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi 2024-08-17T02:14:06.091 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-08-17T02:14:06.091 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-08-17T02:14:06.091 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion 2024-08-17T02:14:06.091 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-08-17T02:14:06.091 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia 2024-08-17T02:14:06.091 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-08-17T02:14:06.091 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines 2024-08-17T02:14:06.091 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-08-17T02:14:06.092 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-08-17T02:14:06.092 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic 2024-08-17T02:14:06.092 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen 2024-08-17T02:14:06.092 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-08-17T02:14:06.092 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-08-17T02:14:06.092 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-08-17T02:14:06.092 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-08-17T02:14:06.092 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc 2024-08-17T02:14:06.092 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-08-17T02:14:06.092 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek 2024-08-17T02:14:06.092 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-08-17T02:14:06.092 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-08-17T02:14:06.092 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/atp.ko 2024-08-17T02:14:06.093 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-08-17T02:14:06.093 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker 2024-08-17T02:14:06.093 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-08-17T02:14:06.093 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc 2024-08-17T02:14:06.093 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-08-17T02:14:06.093 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan 2024-08-17T02:14:06.093 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-08-17T02:14:06.093 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis 2024-08-17T02:14:06.093 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis190.ko 2024-08-17T02:14:06.093 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis900.ko 2024-08-17T02:14:06.093 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc 2024-08-17T02:14:06.094 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-08-17T02:14:06.094 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-08-17T02:14:06.094 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-08-17T02:14:06.094 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-08-17T02:14:06.094 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro 2024-08-17T02:14:06.094 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac 2024-08-17T02:14:06.094 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-08-17T02:14:06.094 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-08-17T02:14:06.094 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun 2024-08-17T02:14:06.094 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/cassini.ko 2024-08-17T02:14:06.094 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/niu.ko 2024-08-17T02:14:06.094 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sungem.ko 2024-08-17T02:14:06.094 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-08-17T02:14:06.095 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti 2024-08-17T02:14:06.095 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-08-17T02:14:06.095 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti 2024-08-17T02:14:06.095 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti/tlan.ko 2024-08-17T02:14:06.095 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via 2024-08-17T02:14:06.095 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-08-17T02:14:06.095 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-08-17T02:14:06.095 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet 2024-08-17T02:14:06.095 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-08-17T02:14:06.095 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-08-17T02:14:06.095 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom 2024-08-17T02:14:06.095 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-08-17T02:14:06.095 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/geneve.ko 2024-08-17T02:14:06.095 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv 2024-08-17T02:14:06.096 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-08-17T02:14:06.096 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154 2024-08-17T02:14:06.096 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154/fakelb.ko 2024-08-17T02:14:06.096 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ifb.ko 2024-08-17T02:14:06.096 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan 2024-08-17T02:14:06.096 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan/ipvlan.ko 2024-08-17T02:14:06.096 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvlan.ko 2024-08-17T02:14:06.096 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvtap.ko 2024-08-17T02:14:06.096 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio 2024-08-17T02:14:06.096 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio.ko 2024-08-17T02:14:06.096 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-08-17T02:14:06.096 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-08-17T02:14:06.096 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-regmap.ko 2024-08-17T02:14:06.097 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mii.ko 2024-08-17T02:14:06.097 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/net_failover.ko 2024-08-17T02:14:06.097 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/netconsole.ko 2024-08-17T02:14:06.097 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/nlmon.ko 2024-08-17T02:14:06.097 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs 2024-08-17T02:14:06.097 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs-lynx.ko 2024-08-17T02:14:06.097 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-08-17T02:14:06.097 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy 2024-08-17T02:14:06.097 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/amd.ko 2024-08-17T02:14:06.097 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-08-17T02:14:06.097 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-08-17T02:14:06.097 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm7xxx.ko 2024-08-17T02:14:06.097 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm87xx.ko 2024-08-17T02:14:06.097 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/broadcom.ko 2024-08-17T02:14:06.098 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/cicada.ko 2024-08-17T02:14:06.098 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/davicom.ko 2024-08-17T02:14:06.098 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/dp83640.ko 2024-08-17T02:14:06.098 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/et1011c.ko 2024-08-17T02:14:06.098 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/icplus.ko 2024-08-17T02:14:06.098 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/lxt.ko 2024-08-17T02:14:06.098 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/marvell.ko 2024-08-17T02:14:06.098 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/micrel.ko 2024-08-17T02:14:06.098 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/national.ko 2024-08-17T02:14:06.098 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/phylink.ko 2024-08-17T02:14:06.098 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/qsemi.ko 2024-08-17T02:14:06.098 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/realtek.ko 2024-08-17T02:14:06.098 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/smsc.ko 2024-08-17T02:14:06.099 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/ste10Xp.ko 2024-08-17T02:14:06.099 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/vitesse.ko 2024-08-17T02:14:06.099 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp 2024-08-17T02:14:06.099 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/bsd_comp.ko 2024-08-17T02:14:06.099 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_async.ko 2024-08-17T02:14:06.099 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_deflate.ko 2024-08-17T02:14:06.099 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_generic.ko 2024-08-17T02:14:06.099 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_mppe.ko 2024-08-17T02:14:06.099 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_synctty.ko 2024-08-17T02:14:06.099 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppoe.ko 2024-08-17T02:14:06.099 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppox.ko 2024-08-17T02:14:06.099 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pptp.ko 2024-08-17T02:14:06.100 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip 2024-08-17T02:14:06.100 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slhc.ko 2024-08-17T02:14:06.100 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slip.ko 2024-08-17T02:14:06.100 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/sungem_phy.ko 2024-08-17T02:14:06.100 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tap.ko 2024-08-17T02:14:06.100 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team 2024-08-17T02:14:06.100 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team.ko 2024-08-17T02:14:06.100 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_activebackup.ko 2024-08-17T02:14:06.100 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_broadcast.ko 2024-08-17T02:14:06.100 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-08-17T02:14:06.100 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_random.ko 2024-08-17T02:14:06.100 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-08-17T02:14:06.100 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tun.ko 2024-08-17T02:14:06.100 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/veth.ko 2024-08-17T02:14:06.101 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/virtio_net.ko 2024-08-17T02:14:06.101 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3 2024-08-17T02:14:06.101 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-08-17T02:14:06.101 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan 2024-08-17T02:14:06.101 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan/vxlan.ko 2024-08-17T02:14:06.101 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback 2024-08-17T02:14:06.101 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback/xen-netback.ko 2024-08-17T02:14:06.101 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netfront.ko 2024-08-17T02:14:06.101 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb 2024-08-17T02:14:06.101 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb/ntb.ko 2024-08-17T02:14:06.101 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme 2024-08-17T02:14:06.101 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host 2024-08-17T02:14:06.101 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme-core.ko 2024-08-17T02:14:06.101 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme.ko 2024-08-17T02:14:06.102 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport 2024-08-17T02:14:06.102 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport.ko 2024-08-17T02:14:06.102 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_cs.ko 2024-08-17T02:14:06.102 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_pc.ko 2024-08-17T02:14:06.102 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_serial.ko 2024-08-17T02:14:06.102 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci 2024-08-17T02:14:06.102 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug 2024-08-17T02:14:06.102 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-08-17T02:14:06.102 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie 2024-08-17T02:14:06.102 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie/aer_inject.ko 2024-08-17T02:14:06.102 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/xen-pcifront.ko 2024-08-17T02:14:06.102 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia 2024-08-17T02:14:06.102 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/i82092.ko 2024-08-17T02:14:06.103 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/pd6729.ko 2024-08-17T02:14:06.103 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/yenta_socket.ko 2024-08-17T02:14:06.103 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl 2024-08-17T02:14:06.103 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel 2024-08-17T02:14:06.103 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-08-17T02:14:06.103 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform 2024-08-17T02:14:06.103 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86 2024-08-17T02:14:06.103 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acer-wmi.ko 2024-08-17T02:14:06.103 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acerhdf.ko 2024-08-17T02:14:06.103 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/apple-gmux.ko 2024-08-17T02:14:06.103 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-laptop.ko 2024-08-17T02:14:06.103 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-08-17T02:14:06.103 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-wmi.ko 2024-08-17T02:14:06.104 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/classmate-laptop.ko 2024-08-17T02:14:06.104 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-08-17T02:14:06.104 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-08-17T02:14:06.104 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-08-17T02:14:06.104 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-08-17T02:14:06.104 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/hdaps.ko 2024-08-17T02:14:06.104 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel 2024-08-17T02:14:06.104 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-08-17T02:14:06.104 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel_ips.ko 2024-08-17T02:14:06.104 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/msi-wmi.ko 2024-08-17T02:14:06.104 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/mxm-wmi.ko 2024-08-17T02:14:06.104 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-08-17T02:14:06.104 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-laptop.ko 2024-08-17T02:14:06.105 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-q10.ko 2024-08-17T02:14:06.105 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/topstar-laptop.ko 2024-08-17T02:14:06.105 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-08-17T02:14:06.105 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_haps.ko 2024-08-17T02:14:06.105 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi-bmof.ko 2024-08-17T02:14:06.105 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi.ko 2024-08-17T02:14:06.105 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap 2024-08-17T02:14:06.105 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_common.ko 2024-08-17T02:14:06.105 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_msr.ko 2024-08-17T02:14:06.105 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps 2024-08-17T02:14:06.105 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients 2024-08-17T02:14:06.105 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-gpio.ko 2024-08-17T02:14:06.105 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-ldisc.ko 2024-08-17T02:14:06.105 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps_parport.ko 2024-08-17T02:14:06.106 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/pps_core.ko 2024-08-17T02:14:06.106 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp 2024-08-17T02:14:06.106 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp.ko 2024-08-17T02:14:06.106 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp_kvm.ko 2024-08-17T02:14:06.106 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras 2024-08-17T02:14:06.106 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd 2024-08-17T02:14:06.106 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl 2024-08-17T02:14:06.106 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-08-17T02:14:06.106 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/fmpm.ko 2024-08-17T02:14:06.106 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc 2024-08-17T02:14:06.106 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-bq32k.ko 2024-08-17T02:14:06.106 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1286.ko 2024-08-17T02:14:06.107 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1307.ko 2024-08-17T02:14:06.107 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1374.ko 2024-08-17T02:14:06.107 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1511.ko 2024-08-17T02:14:06.107 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1553.ko 2024-08-17T02:14:06.107 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1672.ko 2024-08-17T02:14:06.107 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1742.ko 2024-08-17T02:14:06.107 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds2404.ko 2024-08-17T02:14:06.107 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds3232.ko 2024-08-17T02:14:06.107 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-em3027.ko 2024-08-17T02:14:06.107 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-fm3130.ko 2024-08-17T02:14:06.107 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl12022.ko 2024-08-17T02:14:06.107 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl1208.ko 2024-08-17T02:14:06.107 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m41t80.ko 2024-08-17T02:14:06.108 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t35.ko 2024-08-17T02:14:06.108 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t59.ko 2024-08-17T02:14:06.108 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-max6900.ko 2024-08-17T02:14:06.108 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-msm6242.ko 2024-08-17T02:14:06.108 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf2127.ko 2024-08-17T02:14:06.108 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf85063.ko 2024-08-17T02:14:06.108 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8523.ko 2024-08-17T02:14:06.108 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8563.ko 2024-08-17T02:14:06.108 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8583.ko 2024-08-17T02:14:06.108 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rp5c01.ko 2024-08-17T02:14:06.108 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rs5c372.ko 2024-08-17T02:14:06.108 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-08-17T02:14:06.108 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8025.ko 2024-08-17T02:14:06.109 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8581.ko 2024-08-17T02:14:06.109 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-08-17T02:14:06.109 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-x1205.ko 2024-08-17T02:14:06.109 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi 2024-08-17T02:14:06.109 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-9xxx.ko 2024-08-17T02:14:06.109 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-sas.ko 2024-08-17T02:14:06.109 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-xxxx.ko 2024-08-17T02:14:06.109 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/BusLogic.ko 2024-08-17T02:14:06.109 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/a100u2w.ko 2024-08-17T02:14:06.109 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid 2024-08-17T02:14:06.109 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid/aacraid.ko 2024-08-17T02:14:06.109 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/advansys.ko 2024-08-17T02:14:06.110 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx 2024-08-17T02:14:06.110 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-08-17T02:14:06.110 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-08-17T02:14:06.110 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/am53c974.ko 2024-08-17T02:14:06.110 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr 2024-08-17T02:14:06.110 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-08-17T02:14:06.110 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/atp870u.ko 2024-08-17T02:14:06.110 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi 2024-08-17T02:14:06.110 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-08-17T02:14:06.110 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa 2024-08-17T02:14:06.110 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa/bfa.ko 2024-08-17T02:14:06.110 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc 2024-08-17T02:14:06.111 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-08-17T02:14:06.111 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i 2024-08-17T02:14:06.111 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-08-17T02:14:06.111 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ch.ko 2024-08-17T02:14:06.111 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor 2024-08-17T02:14:06.111 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor/csiostor.ko 2024-08-17T02:14:06.111 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi 2024-08-17T02:14:06.111 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i 2024-08-17T02:14:06.111 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-08-17T02:14:06.111 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i 2024-08-17T02:14:06.111 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-08-17T02:14:06.111 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-08-17T02:14:06.111 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dc395x.ko 2024-08-17T02:14:06.111 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler 2024-08-17T02:14:06.112 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-08-17T02:14:06.112 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-08-17T02:14:06.112 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-08-17T02:14:06.112 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-08-17T02:14:06.112 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dmx3191d.ko 2024-08-17T02:14:06.112 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r 2024-08-17T02:14:06.112 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r/esas2r.ko 2024-08-17T02:14:06.112 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esp_scsi.ko 2024-08-17T02:14:06.112 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe 2024-08-17T02:14:06.113 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/fcoe.ko 2024-08-17T02:14:06.113 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-08-17T02:14:06.113 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic 2024-08-17T02:14:06.113 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic/fnic.ko 2024-08-17T02:14:06.113 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hpsa.ko 2024-08-17T02:14:06.113 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hptiop.ko 2024-08-17T02:14:06.113 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hv_storvsc.ko 2024-08-17T02:14:06.113 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/initio.ko 2024-08-17T02:14:06.113 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ipr.ko 2024-08-17T02:14:06.113 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ips.ko 2024-08-17T02:14:06.113 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci 2024-08-17T02:14:06.113 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci/isci.ko 2024-08-17T02:14:06.113 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-08-17T02:14:06.113 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_tcp.ko 2024-08-17T02:14:06.114 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc 2024-08-17T02:14:06.114 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc/libfc.ko 2024-08-17T02:14:06.114 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi.ko 2024-08-17T02:14:06.114 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi_tcp.ko 2024-08-17T02:14:06.114 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas 2024-08-17T02:14:06.114 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas/libsas.ko 2024-08-17T02:14:06.114 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc 2024-08-17T02:14:06.114 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc/lpfc.ko 2024-08-17T02:14:06.114 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid 2024-08-17T02:14:06.114 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid.ko 2024-08-17T02:14:06.114 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-08-17T02:14:06.114 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-08-17T02:14:06.114 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-08-17T02:14:06.115 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas 2024-08-17T02:14:06.115 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-08-17T02:14:06.115 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas 2024-08-17T02:14:06.115 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas/mvsas.ko 2024-08-17T02:14:06.115 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvumi.ko 2024-08-17T02:14:06.115 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001 2024-08-17T02:14:06.115 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-08-17T02:14:06.115 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pmcraid.ko 2024-08-17T02:14:06.115 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla1280.ko 2024-08-17T02:14:06.115 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx 2024-08-17T02:14:06.115 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-08-17T02:14:06.115 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-08-17T02:14:06.115 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx 2024-08-17T02:14:06.116 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-08-17T02:14:06.116 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/raid_class.ko 2024-08-17T02:14:06.116 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_debug.ko 2024-08-17T02:14:06.116 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_fc.ko 2024-08-17T02:14:06.116 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-08-17T02:14:06.116 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_sas.ko 2024-08-17T02:14:06.116 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_spi.ko 2024-08-17T02:14:06.116 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_srp.ko 2024-08-17T02:14:06.116 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ses.ko 2024-08-17T02:14:06.116 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/st.ko 2024-08-17T02:14:06.116 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/stex.ko 2024-08-17T02:14:06.116 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2 2024-08-17T02:14:06.117 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-08-17T02:14:06.117 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/virtio_scsi.ko 2024-08-17T02:14:06.117 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/vmw_pvscsi.ko 2024-08-17T02:14:06.117 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/wd719x.ko 2024-08-17T02:14:06.117 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb 2024-08-17T02:14:06.117 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb/ssb.ko 2024-08-17T02:14:06.117 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target 2024-08-17T02:14:06.117 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi 2024-08-17T02:14:06.117 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-08-17T02:14:06.117 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback 2024-08-17T02:14:06.117 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback/tcm_loop.ko 2024-08-17T02:14:06.117 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_file.ko 2024-08-17T02:14:06.117 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_iblock.ko 2024-08-17T02:14:06.118 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_mod.ko 2024-08-17T02:14:06.118 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_pscsi.ko 2024-08-17T02:14:06.118 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_user.ko 2024-08-17T02:14:06.118 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc 2024-08-17T02:14:06.118 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-08-17T02:14:06.118 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal 2024-08-17T02:14:06.118 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel 2024-08-17T02:14:06.118 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal 2024-08-17T02:14:06.118 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-08-17T02:14:06.118 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-08-17T02:14:06.118 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-08-17T02:14:06.118 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-08-17T02:14:06.119 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-08-17T02:14:06.119 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-08-17T02:14:06.119 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-08-17T02:14:06.119 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-08-17T02:14:06.119 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-08-17T02:14:06.119 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-08-17T02:14:06.119 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-08-17T02:14:06.119 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-08-17T02:14:06.119 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-08-17T02:14:06.119 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-08-17T02:14:06.119 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-08-17T02:14:06.119 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-08-17T02:14:06.119 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-08-17T02:14:06.120 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-08-17T02:14:06.120 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty 2024-08-17T02:14:06.120 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless 2024-08-17T02:14:06.120 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-08-17T02:14:06.120 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_gsm.ko 2024-08-17T02:14:06.120 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_hdlc.ko 2024-08-17T02:14:06.120 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/nozomi.ko 2024-08-17T02:14:06.120 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial 2024-08-17T02:14:06.120 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250 2024-08-17T02:14:06.120 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-08-17T02:14:06.120 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/arc_uart.ko 2024-08-17T02:14:06.120 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm 2024-08-17T02:14:06.120 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm/jsm.ko 2024-08-17T02:14:06.121 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs 2024-08-17T02:14:06.121 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core 2024-08-17T02:14:06.121 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core/ufshcd-core.ko 2024-08-17T02:14:06.121 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host 2024-08-17T02:14:06.121 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-08-17T02:14:06.121 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio 2024-08-17T02:14:06.121 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio.ko 2024-08-17T02:14:06.121 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_aec.ko 2024-08-17T02:14:06.121 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_cif.ko 2024-08-17T02:14:06.121 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_pci_generic.ko 2024-08-17T02:14:06.121 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_sercos3.ko 2024-08-17T02:14:06.121 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb 2024-08-17T02:14:06.121 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class 2024-08-17T02:14:06.121 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-acm.ko 2024-08-17T02:14:06.122 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-wdm.ko 2024-08-17T02:14:06.122 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usblp.ko 2024-08-17T02:14:06.122 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usbtmc.ko 2024-08-17T02:14:06.122 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host 2024-08-17T02:14:06.122 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/sl811-hcd.ko 2024-08-17T02:14:06.122 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image 2024-08-17T02:14:06.122 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/mdc800.ko 2024-08-17T02:14:06.122 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/microtek.ko 2024-08-17T02:14:06.122 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc 2024-08-17T02:14:06.122 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/adutux.ko 2024-08-17T02:14:06.122 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/appledisplay.ko 2024-08-17T02:14:06.122 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi26.ko 2024-08-17T02:14:06.123 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi62.ko 2024-08-17T02:14:06.123 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ezusb.ko 2024-08-17T02:14:06.123 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/idmouse.ko 2024-08-17T02:14:06.123 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/iowarrior.ko 2024-08-17T02:14:06.123 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/isight_firmware.ko 2024-08-17T02:14:06.123 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ldusb.ko 2024-08-17T02:14:06.123 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/legousbtower.ko 2024-08-17T02:14:06.123 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga 2024-08-17T02:14:06.123 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-08-17T02:14:06.123 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/trancevibrator.ko 2024-08-17T02:14:06.123 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usb3503.ko 2024-08-17T02:14:06.123 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usblcd.ko 2024-08-17T02:14:06.123 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usbsevseg.ko 2024-08-17T02:14:06.124 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/uss720.ko 2024-08-17T02:14:06.124 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/yurex.ko 2024-08-17T02:14:06.124 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy 2024-08-17T02:14:06.124 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy/phy-generic.ko 2024-08-17T02:14:06.124 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial 2024-08-17T02:14:06.124 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/aircable.ko 2024-08-17T02:14:06.124 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ark3116.ko 2024-08-17T02:14:06.124 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/belkin_sa.ko 2024-08-17T02:14:06.124 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ch341.ko 2024-08-17T02:14:06.124 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cp210x.ko 2024-08-17T02:14:06.124 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cyberjack.ko 2024-08-17T02:14:06.124 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cypress_m8.ko 2024-08-17T02:14:06.124 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/digi_acceleport.ko 2024-08-17T02:14:06.124 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/empeg.ko 2024-08-17T02:14:06.125 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ftdi_sio.ko 2024-08-17T02:14:06.125 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/garmin_gps.ko 2024-08-17T02:14:06.125 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_edgeport.ko 2024-08-17T02:14:06.125 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_ti.ko 2024-08-17T02:14:06.125 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipaq.ko 2024-08-17T02:14:06.125 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipw.ko 2024-08-17T02:14:06.125 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ir-usb.ko 2024-08-17T02:14:06.125 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-08-17T02:14:06.125 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan.ko 2024-08-17T02:14:06.125 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan_pda.ko 2024-08-17T02:14:06.125 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kl5kusb105.ko 2024-08-17T02:14:06.125 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kobil_sct.ko 2024-08-17T02:14:06.126 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mct_u232.ko 2024-08-17T02:14:06.126 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7720.ko 2024-08-17T02:14:06.126 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7840.ko 2024-08-17T02:14:06.126 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/navman.ko 2024-08-17T02:14:06.126 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/omninet.ko 2024-08-17T02:14:06.126 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/opticon.ko 2024-08-17T02:14:06.126 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/option.ko 2024-08-17T02:14:06.126 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/oti6858.ko 2024-08-17T02:14:06.126 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/pl2303.ko 2024-08-17T02:14:06.126 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcaux.ko 2024-08-17T02:14:06.126 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcserial.ko 2024-08-17T02:14:06.126 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/quatech2.ko 2024-08-17T02:14:06.127 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/safe_serial.ko 2024-08-17T02:14:06.127 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/sierra.ko 2024-08-17T02:14:06.127 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/spcp8x5.ko 2024-08-17T02:14:06.127 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ssu100.ko 2024-08-17T02:14:06.127 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/symbolserial.ko 2024-08-17T02:14:06.127 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-08-17T02:14:06.127 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-08-17T02:14:06.127 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_debug.ko 2024-08-17T02:14:06.127 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_wwan.ko 2024-08-17T02:14:06.127 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/visor.ko 2024-08-17T02:14:06.127 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/whiteheat.ko 2024-08-17T02:14:06.127 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/xsens_mt.ko 2024-08-17T02:14:06.127 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage 2024-08-17T02:14:06.127 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/uas.ko 2024-08-17T02:14:06.128 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-alauda.ko 2024-08-17T02:14:06.128 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-cypress.ko 2024-08-17T02:14:06.128 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-datafab.ko 2024-08-17T02:14:06.128 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-08-17T02:14:06.128 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-freecom.ko 2024-08-17T02:14:06.128 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-isd200.ko 2024-08-17T02:14:06.128 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-08-17T02:14:06.128 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-karma.ko 2024-08-17T02:14:06.128 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-onetouch.ko 2024-08-17T02:14:06.128 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-realtek.ko 2024-08-17T02:14:06.128 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr09.ko 2024-08-17T02:14:06.128 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr55.ko 2024-08-17T02:14:06.129 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-usbat.ko 2024-08-17T02:14:06.129 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/usb-storage.ko 2024-08-17T02:14:06.129 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip 2024-08-17T02:14:06.129 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-core.ko 2024-08-17T02:14:06.129 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-host.ko 2024-08-17T02:14:06.129 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-08-17T02:14:06.129 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio 2024-08-17T02:14:06.129 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci 2024-08-17T02:14:06.129 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-08-17T02:14:06.129 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci.ko 2024-08-17T02:14:06.129 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio.ko 2024-08-17T02:14:06.129 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-08-17T02:14:06.130 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost 2024-08-17T02:14:06.130 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost.ko 2024-08-17T02:14:06.130 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_iotlb.ko 2024-08-17T02:14:06.130 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_net.ko 2024-08-17T02:14:06.130 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_scsi.ko 2024-08-17T02:14:06.130 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video 2024-08-17T02:14:06.130 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight 2024-08-17T02:14:06.130 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/apple_bl.ko 2024-08-17T02:14:06.130 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/lcd.ko 2024-08-17T02:14:06.130 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/platform_lcd.ko 2024-08-17T02:14:06.130 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio 2024-08-17T02:14:06.130 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio.ko 2024-08-17T02:14:06.130 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_balloon.ko 2024-08-17T02:14:06.131 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_mmio.ko 2024-08-17T02:14:06.131 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci.ko 2024-08-17T02:14:06.131 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-08-17T02:14:06.131 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-08-17T02:14:06.131 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_ring.ko 2024-08-17T02:14:06.131 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1 2024-08-17T02:14:06.131 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters 2024-08-17T02:14:06.131 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2482.ko 2024-08-17T02:14:06.131 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2490.ko 2024-08-17T02:14:06.131 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves 2024-08-17T02:14:06.131 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-08-17T02:14:06.131 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-08-17T02:14:06.132 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-08-17T02:14:06.132 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-08-17T02:14:06.132 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-08-17T02:14:06.132 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-08-17T02:14:06.132 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-08-17T02:14:06.132 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-08-17T02:14:06.132 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-08-17T02:14:06.132 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_smem.ko 2024-08-17T02:14:06.132 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_therm.ko 2024-08-17T02:14:06.132 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/wire.ko 2024-08-17T02:14:06.132 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog 2024-08-17T02:14:06.132 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim1535_wdt.ko 2024-08-17T02:14:06.132 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim7101_wdt.ko 2024-08-17T02:14:06.133 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/f71808e_wdt.ko 2024-08-17T02:14:06.133 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/hpwdt.ko 2024-08-17T02:14:06.133 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/i6300esb.ko 2024-08-17T02:14:06.133 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-08-17T02:14:06.133 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_wdt.ko 2024-08-17T02:14:06.133 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ib700wdt.ko 2024-08-17T02:14:06.133 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ibmasr.ko 2024-08-17T02:14:06.133 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-08-17T02:14:06.133 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it8712f_wdt.ko 2024-08-17T02:14:06.133 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it87_wdt.ko 2024-08-17T02:14:06.133 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/machzwd.ko 2024-08-17T02:14:06.133 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/nv_tco.ko 2024-08-17T02:14:06.134 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_pci.ko 2024-08-17T02:14:06.134 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_usb.ko 2024-08-17T02:14:06.134 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-08-17T02:14:06.134 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sch311x_wdt.ko 2024-08-17T02:14:06.134 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/softdog.ko 2024-08-17T02:14:06.134 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sp5100_tco.ko 2024-08-17T02:14:06.134 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/via_wdt.ko 2024-08-17T02:14:06.134 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-08-17T02:14:06.134 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83877f_wdt.ko 2024-08-17T02:14:06.134 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83977f_wdt.ko 2024-08-17T02:14:06.134 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/wdt_pci.ko 2024-08-17T02:14:06.134 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/xen_wdt.ko 2024-08-17T02:14:06.134 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen 2024-08-17T02:14:06.135 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-acpi-processor.ko 2024-08-17T02:14:06.135 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-evtchn.ko 2024-08-17T02:14:06.135 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntalloc.ko 2024-08-17T02:14:06.135 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntdev.ko 2024-08-17T02:14:06.135 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback 2024-08-17T02:14:06.135 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-08-17T02:14:06.135 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-privcmd.ko 2024-08-17T02:14:06.135 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs 2024-08-17T02:14:06.135 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs/xenfs.ko 2024-08-17T02:14:06.135 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs 2024-08-17T02:14:06.135 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p 2024-08-17T02:14:06.135 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p/9p.ko 2024-08-17T02:14:06.136 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs 2024-08-17T02:14:06.136 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs/affs.ko 2024-08-17T02:14:06.136 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs 2024-08-17T02:14:06.136 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs/befs.ko 2024-08-17T02:14:06.136 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/binfmt_misc.ko 2024-08-17T02:14:06.136 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs 2024-08-17T02:14:06.136 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs/btrfs.ko 2024-08-17T02:14:06.136 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles 2024-08-17T02:14:06.136 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles/cachefiles.ko 2024-08-17T02:14:06.136 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph 2024-08-17T02:14:06.136 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph/ceph.ko 2024-08-17T02:14:06.136 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda 2024-08-17T02:14:06.136 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda/coda.ko 2024-08-17T02:14:06.137 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs 2024-08-17T02:14:06.137 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs/cramfs.ko 2024-08-17T02:14:06.137 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm 2024-08-17T02:14:06.137 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm/dlm.ko 2024-08-17T02:14:06.137 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs 2024-08-17T02:14:06.137 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs/ecryptfs.ko 2024-08-17T02:14:06.137 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs 2024-08-17T02:14:06.137 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs/f2fs.ko 2024-08-17T02:14:06.137 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat 2024-08-17T02:14:06.137 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/fat.ko 2024-08-17T02:14:06.137 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/msdos.ko 2024-08-17T02:14:06.137 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/vfat.ko 2024-08-17T02:14:06.137 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse 2024-08-17T02:14:06.137 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/cuse.ko 2024-08-17T02:14:06.138 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/fuse.ko 2024-08-17T02:14:06.138 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2 2024-08-17T02:14:06.138 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2/gfs2.ko 2024-08-17T02:14:06.138 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs 2024-08-17T02:14:06.138 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs/hfs.ko 2024-08-17T02:14:06.138 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus 2024-08-17T02:14:06.138 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus/hfsplus.ko 2024-08-17T02:14:06.138 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs 2024-08-17T02:14:06.138 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs/isofs.ko 2024-08-17T02:14:06.138 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs 2024-08-17T02:14:06.138 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs/jfs.ko 2024-08-17T02:14:06.138 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd 2024-08-17T02:14:06.139 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd/lockd.ko 2024-08-17T02:14:06.139 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix 2024-08-17T02:14:06.139 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix/minix.ko 2024-08-17T02:14:06.139 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs 2024-08-17T02:14:06.139 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs/netfs.ko 2024-08-17T02:14:06.139 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs 2024-08-17T02:14:06.139 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout 2024-08-17T02:14:06.139 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-08-17T02:14:06.139 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout 2024-08-17T02:14:06.139 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-08-17T02:14:06.139 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout 2024-08-17T02:14:06.139 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-08-17T02:14:06.140 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfs.ko 2024-08-17T02:14:06.140 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv3.ko 2024-08-17T02:14:06.140 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv4.ko 2024-08-17T02:14:06.140 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common 2024-08-17T02:14:06.140 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/grace.ko 2024-08-17T02:14:06.140 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/nfs_acl.ko 2024-08-17T02:14:06.140 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd 2024-08-17T02:14:06.140 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd/nfsd.ko 2024-08-17T02:14:06.140 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2 2024-08-17T02:14:06.140 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2/nilfs2.ko 2024-08-17T02:14:06.140 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls 2024-08-17T02:14:06.140 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-celtic.ko 2024-08-17T02:14:06.140 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-centeuro.ko 2024-08-17T02:14:06.140 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-croatian.ko 2024-08-17T02:14:06.141 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-cyrillic.ko 2024-08-17T02:14:06.141 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-gaelic.ko 2024-08-17T02:14:06.141 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-greek.ko 2024-08-17T02:14:06.141 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-iceland.ko 2024-08-17T02:14:06.141 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-inuit.ko 2024-08-17T02:14:06.141 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-roman.ko 2024-08-17T02:14:06.141 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-romanian.ko 2024-08-17T02:14:06.141 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-turkish.ko 2024-08-17T02:14:06.141 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1250.ko 2024-08-17T02:14:06.141 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1251.ko 2024-08-17T02:14:06.141 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1255.ko 2024-08-17T02:14:06.141 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp737.ko 2024-08-17T02:14:06.141 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp775.ko 2024-08-17T02:14:06.142 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp850.ko 2024-08-17T02:14:06.142 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp852.ko 2024-08-17T02:14:06.142 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp855.ko 2024-08-17T02:14:06.142 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp857.ko 2024-08-17T02:14:06.142 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp860.ko 2024-08-17T02:14:06.142 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp861.ko 2024-08-17T02:14:06.142 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp862.ko 2024-08-17T02:14:06.142 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp863.ko 2024-08-17T02:14:06.142 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp864.ko 2024-08-17T02:14:06.142 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp865.ko 2024-08-17T02:14:06.142 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp866.ko 2024-08-17T02:14:06.142 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp869.ko 2024-08-17T02:14:06.142 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp874.ko 2024-08-17T02:14:06.143 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp932.ko 2024-08-17T02:14:06.143 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp936.ko 2024-08-17T02:14:06.143 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp949.ko 2024-08-17T02:14:06.143 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp950.ko 2024-08-17T02:14:06.143 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_euc-jp.ko 2024-08-17T02:14:06.143 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-1.ko 2024-08-17T02:14:06.143 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-13.ko 2024-08-17T02:14:06.143 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-14.ko 2024-08-17T02:14:06.143 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-15.ko 2024-08-17T02:14:06.143 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-2.ko 2024-08-17T02:14:06.143 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-3.ko 2024-08-17T02:14:06.143 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-4.ko 2024-08-17T02:14:06.143 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-5.ko 2024-08-17T02:14:06.143 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-6.ko 2024-08-17T02:14:06.143 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-7.ko 2024-08-17T02:14:06.144 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-9.ko 2024-08-17T02:14:06.144 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-r.ko 2024-08-17T02:14:06.144 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-ru.ko 2024-08-17T02:14:06.144 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-u.ko 2024-08-17T02:14:06.144 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_ucs2_utils.ko 2024-08-17T02:14:06.144 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_utf8.ko 2024-08-17T02:14:06.144 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2 2024-08-17T02:14:06.144 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster 2024-08-17T02:14:06.144 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-08-17T02:14:06.144 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm 2024-08-17T02:14:06.144 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-08-17T02:14:06.144 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs 2024-08-17T02:14:06.144 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-08-17T02:14:06.145 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2.ko 2024-08-17T02:14:06.145 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-08-17T02:14:06.145 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-08-17T02:14:06.145 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-08-17T02:14:06.145 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs 2024-08-17T02:14:06.145 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs/overlay.ko 2024-08-17T02:14:06.145 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore 2024-08-17T02:14:06.145 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore/ramoops.ko 2024-08-17T02:14:06.145 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs 2024-08-17T02:14:06.145 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs/reiserfs.ko 2024-08-17T02:14:06.145 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs 2024-08-17T02:14:06.145 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs/romfs.ko 2024-08-17T02:14:06.145 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb 2024-08-17T02:14:06.146 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client 2024-08-17T02:14:06.146 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client/cifs.ko 2024-08-17T02:14:06.146 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common 2024-08-17T02:14:06.146 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_arc4.ko 2024-08-17T02:14:06.146 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_md4.ko 2024-08-17T02:14:06.146 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs 2024-08-17T02:14:06.146 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs/squashfs.ko 2024-08-17T02:14:06.146 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv 2024-08-17T02:14:06.146 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv/sysv.ko 2024-08-17T02:14:06.146 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf 2024-08-17T02:14:06.146 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf/udf.ko 2024-08-17T02:14:06.147 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs 2024-08-17T02:14:06.147 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs/ufs.ko 2024-08-17T02:14:06.147 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs 2024-08-17T02:14:06.147 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs/xfs.ko 2024-08-17T02:14:06.147 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel 2024-08-17T02:14:06.147 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu 2024-08-17T02:14:06.147 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu/rcutorture.ko 2024-08-17T02:14:06.147 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/torture.ko 2024-08-17T02:14:06.147 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace 2024-08-17T02:14:06.147 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-08-17T02:14:06.147 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib 2024-08-17T02:14:06.147 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/asn1_encoder.ko 2024-08-17T02:14:06.147 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc-itu-t.ko 2024-08-17T02:14:06.148 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc8.ko 2024-08-17T02:14:06.148 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto 2024-08-17T02:14:06.148 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libaescfb.ko 2024-08-17T02:14:06.148 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libarc4.ko 2024-08-17T02:14:06.148 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libdes.ko 2024-08-17T02:14:06.148 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/libcrc32c.ko 2024-08-17T02:14:06.148 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lru_cache.ko 2024-08-17T02:14:06.148 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4 2024-08-17T02:14:06.148 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4_compress.ko 2024-08-17T02:14:06.148 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4hc_compress.ko 2024-08-17T02:14:06.148 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math 2024-08-17T02:14:06.148 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math/cordic.ko 2024-08-17T02:14:06.149 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6 2024-08-17T02:14:06.149 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6/raid6_pq.ko 2024-08-17T02:14:06.149 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon 2024-08-17T02:14:06.149 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon/reed_solomon.ko 2024-08-17T02:14:06.149 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_bm.ko 2024-08-17T02:14:06.149 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_fsm.ko 2024-08-17T02:14:06.149 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_kmp.ko 2024-08-17T02:14:06.149 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd 2024-08-17T02:14:06.149 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd/zstd_compress.ko 2024-08-17T02:14:06.149 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm 2024-08-17T02:14:06.149 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm/hwpoison-inject.ko 2024-08-17T02:14:06.149 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net 2024-08-17T02:14:06.150 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan 2024-08-17T02:14:06.150 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/6lowpan.ko 2024-08-17T02:14:06.150 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_dest.ko 2024-08-17T02:14:06.150 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_fragment.ko 2024-08-17T02:14:06.150 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_hop.ko 2024-08-17T02:14:06.150 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_ipv6.ko 2024-08-17T02:14:06.150 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_mobility.ko 2024-08-17T02:14:06.150 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_routing.ko 2024-08-17T02:14:06.150 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_udp.ko 2024-08-17T02:14:06.150 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802 2024-08-17T02:14:06.150 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/garp.ko 2024-08-17T02:14:06.150 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/mrp.ko 2024-08-17T02:14:06.151 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/p8022.ko 2024-08-17T02:14:06.151 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/psnap.ko 2024-08-17T02:14:06.151 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/stp.ko 2024-08-17T02:14:06.151 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q 2024-08-17T02:14:06.151 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q/8021q.ko 2024-08-17T02:14:06.151 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p 2024-08-17T02:14:06.151 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet.ko 2024-08-17T02:14:06.151 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_fd.ko 2024-08-17T02:14:06.151 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_rdma.ko 2024-08-17T02:14:06.151 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_virtio.ko 2024-08-17T02:14:06.151 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv 2024-08-17T02:14:06.151 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv/batman-adv.ko 2024-08-17T02:14:06.152 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge 2024-08-17T02:14:06.152 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/br_netfilter.ko 2024-08-17T02:14:06.152 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/bridge.ko 2024-08-17T02:14:06.152 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter 2024-08-17T02:14:06.152 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-08-17T02:14:06.152 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_among.ko 2024-08-17T02:14:06.152 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arp.ko 2024-08-17T02:14:06.152 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-08-17T02:14:06.152 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-08-17T02:14:06.152 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip.ko 2024-08-17T02:14:06.152 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-08-17T02:14:06.152 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_limit.ko 2024-08-17T02:14:06.152 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_log.ko 2024-08-17T02:14:06.153 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark.ko 2024-08-17T02:14:06.153 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-08-17T02:14:06.153 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-08-17T02:14:06.153 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-08-17T02:14:06.153 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-08-17T02:14:06.153 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_snat.ko 2024-08-17T02:14:06.153 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_stp.ko 2024-08-17T02:14:06.153 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-08-17T02:14:06.153 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-08-17T02:14:06.153 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-08-17T02:14:06.153 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-08-17T02:14:06.153 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtables.ko 2024-08-17T02:14:06.154 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-08-17T02:14:06.154 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-08-17T02:14:06.154 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-08-17T02:14:06.154 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph 2024-08-17T02:14:06.154 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph/libceph.ko 2024-08-17T02:14:06.154 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core 2024-08-17T02:14:06.154 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/failover.ko 2024-08-17T02:14:06.154 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/pktgen.ko 2024-08-17T02:14:06.154 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp 2024-08-17T02:14:06.154 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp.ko 2024-08-17T02:14:06.154 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_diag.ko 2024-08-17T02:14:06.154 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv4.ko 2024-08-17T02:14:06.155 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv6.ko 2024-08-17T02:14:06.155 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver 2024-08-17T02:14:06.155 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver/dns_resolver.ko 2024-08-17T02:14:06.155 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa 2024-08-17T02:14:06.155 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/dsa_core.ko 2024-08-17T02:14:06.155 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_brcm.ko 2024-08-17T02:14:06.155 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_dsa.ko 2024-08-17T02:14:06.155 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_none.ko 2024-08-17T02:14:06.155 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_trailer.ko 2024-08-17T02:14:06.155 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154 2024-08-17T02:14:06.155 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan 2024-08-17T02:14:06.155 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-08-17T02:14:06.156 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154.ko 2024-08-17T02:14:06.156 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154_socket.ko 2024-08-17T02:14:06.156 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4 2024-08-17T02:14:06.156 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ah4.ko 2024-08-17T02:14:06.156 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/esp4.ko 2024-08-17T02:14:06.156 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/fou.ko 2024-08-17T02:14:06.156 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/gre.ko 2024-08-17T02:14:06.156 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/inet_diag.ko 2024-08-17T02:14:06.156 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_gre.ko 2024-08-17T02:14:06.156 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_tunnel.ko 2024-08-17T02:14:06.156 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_vti.ko 2024-08-17T02:14:06.156 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipcomp.ko 2024-08-17T02:14:06.157 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipip.ko 2024-08-17T02:14:06.157 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter 2024-08-17T02:14:06.157 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arp_tables.ko 2024-08-17T02:14:06.157 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-08-17T02:14:06.157 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-08-17T02:14:06.157 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-08-17T02:14:06.157 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-08-17T02:14:06.157 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-08-17T02:14:06.157 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-08-17T02:14:06.157 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-08-17T02:14:06.157 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-08-17T02:14:06.157 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-08-17T02:14:06.158 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_security.ko 2024-08-17T02:14:06.158 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-08-17T02:14:06.158 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-08-17T02:14:06.158 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-08-17T02:14:06.158 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-08-17T02:14:06.158 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-08-17T02:14:06.158 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-08-17T02:14:06.158 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-08-17T02:14:06.158 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-08-17T02:14:06.158 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-08-17T02:14:06.158 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-08-17T02:14:06.158 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_bic.ko 2024-08-17T02:14:06.159 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_dctcp.ko 2024-08-17T02:14:06.159 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_diag.ko 2024-08-17T02:14:06.159 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_highspeed.ko 2024-08-17T02:14:06.159 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_htcp.ko 2024-08-17T02:14:06.159 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_hybla.ko 2024-08-17T02:14:06.159 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_illinois.ko 2024-08-17T02:14:06.159 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_lp.ko 2024-08-17T02:14:06.159 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_scalable.ko 2024-08-17T02:14:06.159 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_vegas.ko 2024-08-17T02:14:06.159 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_veno.ko 2024-08-17T02:14:06.159 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_westwood.ko 2024-08-17T02:14:06.159 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_yeah.ko 2024-08-17T02:14:06.159 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tunnel4.ko 2024-08-17T02:14:06.160 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_diag.ko 2024-08-17T02:14:06.160 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_tunnel.ko 2024-08-17T02:14:06.160 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/xfrm4_tunnel.ko 2024-08-17T02:14:06.160 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6 2024-08-17T02:14:06.160 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ah6.ko 2024-08-17T02:14:06.160 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/esp6.ko 2024-08-17T02:14:06.160 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/fou6.ko 2024-08-17T02:14:06.160 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_tunnel.ko 2024-08-17T02:14:06.160 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-08-17T02:14:06.160 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_vti.ko 2024-08-17T02:14:06.160 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ipcomp6.ko 2024-08-17T02:14:06.160 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter 2024-08-17T02:14:06.160 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-08-17T02:14:06.161 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-08-17T02:14:06.161 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-08-17T02:14:06.161 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-08-17T02:14:06.161 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-08-17T02:14:06.161 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-08-17T02:14:06.161 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-08-17T02:14:06.161 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-08-17T02:14:06.161 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-08-17T02:14:06.161 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-08-17T02:14:06.161 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-08-17T02:14:06.161 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-08-17T02:14:06.161 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-08-17T02:14:06.161 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-08-17T02:14:06.161 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-08-17T02:14:06.162 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-08-17T02:14:06.162 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-08-17T02:14:06.162 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-08-17T02:14:06.162 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-08-17T02:14:06.162 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-08-17T02:14:06.162 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-08-17T02:14:06.162 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-08-17T02:14:06.162 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-08-17T02:14:06.162 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-08-17T02:14:06.162 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/sit.ko 2024-08-17T02:14:06.162 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/tunnel6.ko 2024-08-17T02:14:06.162 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/xfrm6_tunnel.ko 2024-08-17T02:14:06.162 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key 2024-08-17T02:14:06.163 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key/af_key.ko 2024-08-17T02:14:06.163 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp 2024-08-17T02:14:06.163 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_core.ko 2024-08-17T02:14:06.163 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_debugfs.ko 2024-08-17T02:14:06.163 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_eth.ko 2024-08-17T02:14:06.163 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip.ko 2024-08-17T02:14:06.163 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip6.ko 2024-08-17T02:14:06.163 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_netlink.ko 2024-08-17T02:14:06.163 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ppp.ko 2024-08-17T02:14:06.163 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc 2024-08-17T02:14:06.163 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc/llc.ko 2024-08-17T02:14:06.163 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154 2024-08-17T02:14:06.163 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154/mac802154.ko 2024-08-17T02:14:06.163 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls 2024-08-17T02:14:06.163 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls/mpls_gso.ko 2024-08-17T02:14:06.164 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter 2024-08-17T02:14:06.164 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset 2024-08-17T02:14:06.164 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set.ko 2024-08-17T02:14:06.164 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-08-17T02:14:06.164 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-08-17T02:14:06.164 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-08-17T02:14:06.164 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-08-17T02:14:06.164 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-08-17T02:14:06.164 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-08-17T02:14:06.164 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-08-17T02:14:06.164 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-08-17T02:14:06.164 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-08-17T02:14:06.164 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-08-17T02:14:06.165 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-08-17T02:14:06.165 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-08-17T02:14:06.165 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-08-17T02:14:06.165 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-08-17T02:14:06.165 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-08-17T02:14:06.165 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs 2024-08-17T02:14:06.165 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs.ko 2024-08-17T02:14:06.165 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-08-17T02:14:06.165 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-08-17T02:14:06.165 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-08-17T02:14:06.165 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-08-17T02:14:06.165 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-08-17T02:14:06.165 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-08-17T02:14:06.165 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-08-17T02:14:06.166 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-08-17T02:14:06.166 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-08-17T02:14:06.166 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-08-17T02:14:06.166 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-08-17T02:14:06.166 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-08-17T02:14:06.166 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-08-17T02:14:06.166 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conncount.ko 2024-08-17T02:14:06.166 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack.ko 2024-08-17T02:14:06.166 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-08-17T02:14:06.166 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-08-17T02:14:06.166 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-08-17T02:14:06.166 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_h323.ko 2024-08-17T02:14:06.167 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_irc.ko 2024-08-17T02:14:06.167 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-08-17T02:14:06.167 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-08-17T02:14:06.167 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-08-17T02:14:06.167 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sane.ko 2024-08-17T02:14:06.167 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sip.ko 2024-08-17T02:14:06.167 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-08-17T02:14:06.167 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-08-17T02:14:06.167 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_dup_netdev.ko 2024-08-17T02:14:06.167 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table.ko 2024-08-17T02:14:06.167 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table_inet.ko 2024-08-17T02:14:06.167 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_log_syslog.ko 2024-08-17T02:14:06.167 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat.ko 2024-08-17T02:14:06.168 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_amanda.ko 2024-08-17T02:14:06.168 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_ftp.ko 2024-08-17T02:14:06.168 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_irc.ko 2024-08-17T02:14:06.168 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_sip.ko 2024-08-17T02:14:06.168 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_tftp.ko 2024-08-17T02:14:06.168 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_synproxy_core.ko 2024-08-17T02:14:06.168 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_tables.ko 2024-08-17T02:14:06.168 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink.ko 2024-08-17T02:14:06.168 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_acct.ko 2024-08-17T02:14:06.168 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_log.ko 2024-08-17T02:14:06.168 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_osf.ko 2024-08-17T02:14:06.168 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_queue.ko 2024-08-17T02:14:06.168 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_chain_nat.ko 2024-08-17T02:14:06.169 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_compat.ko 2024-08-17T02:14:06.169 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_ct.ko 2024-08-17T02:14:06.169 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_dup_netdev.ko 2024-08-17T02:14:06.169 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fib.ko 2024-08-17T02:14:06.169 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fwd_netdev.ko 2024-08-17T02:14:06.169 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_hash.ko 2024-08-17T02:14:06.169 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_limit.ko 2024-08-17T02:14:06.169 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_log.ko 2024-08-17T02:14:06.169 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_masq.ko 2024-08-17T02:14:06.169 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_nat.ko 2024-08-17T02:14:06.169 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_numgen.ko 2024-08-17T02:14:06.170 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_queue.ko 2024-08-17T02:14:06.170 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_quota.ko 2024-08-17T02:14:06.170 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_redir.ko 2024-08-17T02:14:06.170 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject.ko 2024-08-17T02:14:06.170 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject_inet.ko 2024-08-17T02:14:06.170 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_socket.ko 2024-08-17T02:14:06.170 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_tunnel.ko 2024-08-17T02:14:06.170 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_AUDIT.ko 2024-08-17T02:14:06.170 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CHECKSUM.ko 2024-08-17T02:14:06.170 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CLASSIFY.ko 2024-08-17T02:14:06.170 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-08-17T02:14:06.170 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CT.ko 2024-08-17T02:14:06.170 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_DSCP.ko 2024-08-17T02:14:06.171 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HL.ko 2024-08-17T02:14:06.171 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HMARK.ko 2024-08-17T02:14:06.171 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_IDLETIMER.ko 2024-08-17T02:14:06.171 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LED.ko 2024-08-17T02:14:06.171 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LOG.ko 2024-08-17T02:14:06.171 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_MASQUERADE.ko 2024-08-17T02:14:06.171 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NETMAP.ko 2024-08-17T02:14:06.171 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFLOG.ko 2024-08-17T02:14:06.171 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFQUEUE.ko 2024-08-17T02:14:06.171 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_RATEEST.ko 2024-08-17T02:14:06.171 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_REDIRECT.ko 2024-08-17T02:14:06.172 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_SECMARK.ko 2024-08-17T02:14:06.172 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPMSS.ko 2024-08-17T02:14:06.172 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-08-17T02:14:06.172 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TEE.ko 2024-08-17T02:14:06.172 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TPROXY.ko 2024-08-17T02:14:06.172 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TRACE.ko 2024-08-17T02:14:06.172 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_addrtype.ko 2024-08-17T02:14:06.172 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_bpf.ko 2024-08-17T02:14:06.172 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cgroup.ko 2024-08-17T02:14:06.172 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cluster.ko 2024-08-17T02:14:06.172 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_comment.ko 2024-08-17T02:14:06.172 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connbytes.ko 2024-08-17T02:14:06.172 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlabel.ko 2024-08-17T02:14:06.173 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlimit.ko 2024-08-17T02:14:06.173 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connmark.ko 2024-08-17T02:14:06.173 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_conntrack.ko 2024-08-17T02:14:06.173 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cpu.ko 2024-08-17T02:14:06.173 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dccp.ko 2024-08-17T02:14:06.173 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_devgroup.ko 2024-08-17T02:14:06.173 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dscp.ko 2024-08-17T02:14:06.173 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ecn.ko 2024-08-17T02:14:06.173 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_esp.ko 2024-08-17T02:14:06.173 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hashlimit.ko 2024-08-17T02:14:06.173 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_helper.ko 2024-08-17T02:14:06.173 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hl.ko 2024-08-17T02:14:06.173 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipcomp.ko 2024-08-17T02:14:06.173 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_iprange.ko 2024-08-17T02:14:06.174 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipvs.ko 2024-08-17T02:14:06.174 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_l2tp.ko 2024-08-17T02:14:06.174 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_length.ko 2024-08-17T02:14:06.174 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_limit.ko 2024-08-17T02:14:06.174 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mac.ko 2024-08-17T02:14:06.174 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mark.ko 2024-08-17T02:14:06.174 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_multiport.ko 2024-08-17T02:14:06.174 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nat.ko 2024-08-17T02:14:06.174 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nfacct.ko 2024-08-17T02:14:06.174 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_osf.ko 2024-08-17T02:14:06.174 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_owner.ko 2024-08-17T02:14:06.174 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_physdev.ko 2024-08-17T02:14:06.175 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_pkttype.ko 2024-08-17T02:14:06.175 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_policy.ko 2024-08-17T02:14:06.175 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_quota.ko 2024-08-17T02:14:06.175 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_rateest.ko 2024-08-17T02:14:06.175 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_realm.ko 2024-08-17T02:14:06.175 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_recent.ko 2024-08-17T02:14:06.175 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_sctp.ko 2024-08-17T02:14:06.175 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_set.ko 2024-08-17T02:14:06.175 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_socket.ko 2024-08-17T02:14:06.175 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_state.ko 2024-08-17T02:14:06.175 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_statistic.ko 2024-08-17T02:14:06.175 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_string.ko 2024-08-17T02:14:06.175 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_tcpmss.ko 2024-08-17T02:14:06.176 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_time.ko 2024-08-17T02:14:06.176 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_u32.ko 2024-08-17T02:14:06.176 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink 2024-08-17T02:14:06.176 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink/netlink_diag.ko 2024-08-17T02:14:06.176 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh 2024-08-17T02:14:06.176 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh/nsh.ko 2024-08-17T02:14:06.176 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch 2024-08-17T02:14:06.176 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/openvswitch.ko 2024-08-17T02:14:06.176 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-geneve.ko 2024-08-17T02:14:06.176 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-gre.ko 2024-08-17T02:14:06.176 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-vxlan.ko 2024-08-17T02:14:06.176 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet 2024-08-17T02:14:06.176 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet/af_packet_diag.ko 2024-08-17T02:14:06.177 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds 2024-08-17T02:14:06.177 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds.ko 2024-08-17T02:14:06.177 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_rdma.ko 2024-08-17T02:14:06.177 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_tcp.ko 2024-08-17T02:14:06.177 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched 2024-08-17T02:14:06.177 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_csum.ko 2024-08-17T02:14:06.177 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_gact.ko 2024-08-17T02:14:06.177 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_mirred.ko 2024-08-17T02:14:06.177 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_nat.ko 2024-08-17T02:14:06.177 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_pedit.ko 2024-08-17T02:14:06.177 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_police.ko 2024-08-17T02:14:06.177 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_simple.ko 2024-08-17T02:14:06.177 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_skbedit.ko 2024-08-17T02:14:06.178 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_vlan.ko 2024-08-17T02:14:06.178 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_basic.ko 2024-08-17T02:14:06.178 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_bpf.ko 2024-08-17T02:14:06.178 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_flow.ko 2024-08-17T02:14:06.178 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_fw.ko 2024-08-17T02:14:06.178 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_route.ko 2024-08-17T02:14:06.178 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_u32.ko 2024-08-17T02:14:06.178 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_cmp.ko 2024-08-17T02:14:06.178 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_ipset.ko 2024-08-17T02:14:06.178 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_meta.ko 2024-08-17T02:14:06.178 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_nbyte.ko 2024-08-17T02:14:06.178 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_text.ko 2024-08-17T02:14:06.179 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_u32.ko 2024-08-17T02:14:06.179 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_choke.ko 2024-08-17T02:14:06.179 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_codel.ko 2024-08-17T02:14:06.179 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_drr.ko 2024-08-17T02:14:06.179 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_fq.ko 2024-08-17T02:14:06.179 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_gred.ko 2024-08-17T02:14:06.179 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hfsc.ko 2024-08-17T02:14:06.179 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hhf.ko 2024-08-17T02:14:06.179 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_htb.ko 2024-08-17T02:14:06.179 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_ingress.ko 2024-08-17T02:14:06.179 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio.ko 2024-08-17T02:14:06.179 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio_lib.ko 2024-08-17T02:14:06.179 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_multiq.ko 2024-08-17T02:14:06.179 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_netem.ko 2024-08-17T02:14:06.179 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_pie.ko 2024-08-17T02:14:06.180 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_plug.ko 2024-08-17T02:14:06.180 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_prio.ko 2024-08-17T02:14:06.180 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_qfq.ko 2024-08-17T02:14:06.180 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_red.ko 2024-08-17T02:14:06.180 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfb.ko 2024-08-17T02:14:06.180 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfq.ko 2024-08-17T02:14:06.180 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_tbf.ko 2024-08-17T02:14:06.180 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_teql.ko 2024-08-17T02:14:06.180 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp 2024-08-17T02:14:06.180 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp.ko 2024-08-17T02:14:06.180 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp_diag.ko 2024-08-17T02:14:06.180 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc 2024-08-17T02:14:06.180 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss 2024-08-17T02:14:06.181 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-08-17T02:14:06.181 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-08-17T02:14:06.181 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/sunrpc.ko 2024-08-17T02:14:06.181 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma 2024-08-17T02:14:06.181 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-08-17T02:14:06.181 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc 2024-08-17T02:14:06.181 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc.ko 2024-08-17T02:14:06.181 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc_diag.ko 2024-08-17T02:14:06.181 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix 2024-08-17T02:14:06.181 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix/unix_diag.ko 2024-08-17T02:14:06.181 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock 2024-08-17T02:14:06.181 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-08-17T02:14:06.181 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-08-17T02:14:06.181 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock.ko 2024-08-17T02:14:06.182 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_diag.ko 2024-08-17T02:14:06.182 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_loopback.ko 2024-08-17T02:14:06.182 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm 2024-08-17T02:14:06.182 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm/xfrm_ipcomp.ko 2024-08-17T02:14:06.182 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security 2024-08-17T02:14:06.182 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys 2024-08-17T02:14:06.182 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys 2024-08-17T02:14:06.182 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-08-17T02:14:06.182 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys 2024-08-17T02:14:06.182 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys/trusted.ko 2024-08-17T02:14:06.182 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias 2024-08-17T02:14:06.182 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias.bin 2024-08-17T02:14:06.182 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin 2024-08-17T02:14:06.182 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.alias.bin 2024-08-17T02:14:06.183 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.bin 2024-08-17T02:14:06.183 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.modinfo 2024-08-17T02:14:06.183 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep 2024-08-17T02:14:06.183 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep.bin 2024-08-17T02:14:06.183 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.devname 2024-08-17T02:14:06.183 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.order 2024-08-17T02:14:06.183 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.softdep 2024-08-17T02:14:06.183 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols 2024-08-17T02:14:06.183 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols.bin 2024-08-17T02:14:06.183 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.weakdep 2024-08-17T02:14:06.183 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:14:06.187 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:14:06.187 DEBUG:teuthology.orchestra.run.smithi107:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-08-17T02:14:06.209 INFO:teuthology.orchestra.run.smithi107.stdout:postinstall scriptlet (using /bin/sh): 2024-08-17T02:14:06.209 INFO:teuthology.orchestra.run.smithi107.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:14:06.209 INFO:teuthology.orchestra.run.smithi107.stdout: /usr/bin/kernel-install add 6.11.0-rc3-g7503b862ff5b /lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:14:06.209 INFO:teuthology.orchestra.run.smithi107.stdout:fi 2024-08-17T02:14:06.209 INFO:teuthology.orchestra.run.smithi107.stdout:for file in vmlinuz System.map config; do 2024-08-17T02:14:06.210 INFO:teuthology.orchestra.run.smithi107.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b"; then 2024-08-17T02:14:06.210 INFO:teuthology.orchestra.run.smithi107.stdout: cp "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:14:06.210 INFO:teuthology.orchestra.run.smithi107.stdout: fi 2024-08-17T02:14:06.210 INFO:teuthology.orchestra.run.smithi107.stdout:done 2024-08-17T02:14:06.210 INFO:teuthology.orchestra.run.smithi107.stdout:if [ -d "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" ] && \ 2024-08-17T02:14:06.210 INFO:teuthology.orchestra.run.smithi107.stdout: ! diff -rq "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" >/dev/null 2>&1; then 2024-08-17T02:14:06.210 INFO:teuthology.orchestra.run.smithi107.stdout: rm -rf "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:14:06.210 INFO:teuthology.orchestra.run.smithi107.stdout: cp -r "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:14:06.210 INFO:teuthology.orchestra.run.smithi107.stdout:fi 2024-08-17T02:14:06.210 INFO:teuthology.orchestra.run.smithi107.stdout:if [ ! -e "/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep" ]; then 2024-08-17T02:14:06.210 INFO:teuthology.orchestra.run.smithi107.stdout: /usr/sbin/depmod 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:14:06.210 INFO:teuthology.orchestra.run.smithi107.stdout:fi 2024-08-17T02:14:06.210 INFO:teuthology.orchestra.run.smithi107.stdout:preuninstall scriptlet (using /bin/sh): 2024-08-17T02:14:06.211 INFO:teuthology.orchestra.run.smithi107.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:14:06.211 INFO:teuthology.orchestra.run.smithi107.stdout:kernel-install remove 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:14:06.211 INFO:teuthology.orchestra.run.smithi107.stdout:fi 2024-08-17T02:14:06.211 DEBUG:teuthology.orchestra.run.smithi107:> sudo rpm -qi grub2-tools 2024-08-17T02:14:06.284 INFO:teuthology.orchestra.run.smithi107.stdout:Name : grub2-tools 2024-08-17T02:14:06.285 INFO:teuthology.orchestra.run.smithi107.stdout:Epoch : 1 2024-08-17T02:14:06.285 INFO:teuthology.orchestra.run.smithi107.stdout:Version : 2.06 2024-08-17T02:14:06.285 INFO:teuthology.orchestra.run.smithi107.stdout:Release : 68.el9 2024-08-17T02:14:06.285 INFO:teuthology.orchestra.run.smithi107.stdout:Architecture: x86_64 2024-08-17T02:14:06.285 INFO:teuthology.orchestra.run.smithi107.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-08-17T02:14:06.285 INFO:teuthology.orchestra.run.smithi107.stdout:Group : Unspecified 2024-08-17T02:14:06.285 INFO:teuthology.orchestra.run.smithi107.stdout:Size : 8264254 2024-08-17T02:14:06.285 INFO:teuthology.orchestra.run.smithi107.stdout:License : GPLv3+ 2024-08-17T02:14:06.285 INFO:teuthology.orchestra.run.smithi107.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-08-17T02:14:06.285 INFO:teuthology.orchestra.run.smithi107.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-08-17T02:14:06.285 INFO:teuthology.orchestra.run.smithi107.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-08-17T02:14:06.285 INFO:teuthology.orchestra.run.smithi107.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-08-17T02:14:06.286 INFO:teuthology.orchestra.run.smithi107.stdout:Packager : builder@centos.org 2024-08-17T02:14:06.286 INFO:teuthology.orchestra.run.smithi107.stdout:Vendor : CentOS 2024-08-17T02:14:06.286 INFO:teuthology.orchestra.run.smithi107.stdout:URL : http://www.gnu.org/software/grub/ 2024-08-17T02:14:06.286 INFO:teuthology.orchestra.run.smithi107.stdout:Summary : Support tools for GRUB. 2024-08-17T02:14:06.286 INFO:teuthology.orchestra.run.smithi107.stdout:Description : 2024-08-17T02:14:06.286 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:14:06.286 INFO:teuthology.orchestra.run.smithi107.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-08-17T02:14:06.286 INFO:teuthology.orchestra.run.smithi107.stdout:customizable bootloader with modular architecture. It supports a rich 2024-08-17T02:14:06.286 INFO:teuthology.orchestra.run.smithi107.stdout:variety of kernel formats, file systems, computer architectures and 2024-08-17T02:14:06.286 INFO:teuthology.orchestra.run.smithi107.stdout:hardware devices. 2024-08-17T02:14:06.286 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:14:06.286 INFO:teuthology.orchestra.run.smithi107.stdout:This subpackage provides tools for support of all platforms. 2024-08-17T02:14:06.287 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-08-17T02:14:06.287 INFO:teuthology.task.kernel:Updating grub on smithi107 to boot 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:14:06.287 DEBUG:teuthology.orchestra.run.smithi107:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-08-17T02:14:06.851 INFO:teuthology.orchestra.run.smithi107.stderr:Generating grub configuration file ... 2024-08-17T02:14:08.262 INFO:teuthology.orchestra.run.smithi107.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-08-17T02:14:08.289 INFO:teuthology.orchestra.run.smithi107.stderr:done 2024-08-17T02:14:08.291 DEBUG:teuthology.orchestra.run.smithi107:> mktemp 2024-08-17T02:14:08.309 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.6s2dri282t 2024-08-17T02:14:08.309 DEBUG:teuthology.orchestra.run.smithi107:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.6s2dri282t 2024-08-17T02:14:08.378 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.6s2dri282t 2024-08-17T02:14:08.520 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.6s2dri282t is 6KB 2024-08-17T02:14:08.569 DEBUG:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.6s2dri282t 2024-08-17T02:14:08.583 DEBUG:teuthology.orchestra.run.smithi107:> sudo /bin/ls /boot/loader/entries || true 2024-08-17T02:14:08.651 INFO:teuthology.orchestra.run.smithi107.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-08-17T02:14:08.652 INFO:teuthology.orchestra.run.smithi107.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-08-17T02:14:08.652 INFO:teuthology.orchestra.run.smithi107.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-08-17T02:14:08.652 INFO:teuthology.orchestra.run.smithi107.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b.conf 2024-08-17T02:14:08.653 DEBUG:teuthology.orchestra.run.smithi107:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:14:08.834 DEBUG:teuthology.orchestra.run.smithi107:> sudo shutdown -r now 2024-08-17T02:14:29.917 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-08-17T02:14:29.917 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-08-17T02:14:29.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:14:38.845 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-08-17T02:14:38.846 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-08-17T02:14:38.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:14:48.287 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-08-17T02:14:57.247 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-08-17T02:14:57.288 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-08-17T02:14:57.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:15:00.350 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-08-17T02:15:06.251 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-08-17T02:15:06.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:15:09.317 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-08-17T02:15:12.354 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-08-17T02:15:12.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:15:15.429 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-08-17T02:15:21.323 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-08-17T02:15:21.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:15:30.441 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-08-17T02:15:30.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:15:39.743 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-08-17T02:15:48.959 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-08-17T02:15:54.746 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-08-17T02:15:54.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:15:56.185 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-08-17T02:15:56.675 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-08-17T02:15:56.675 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc3-g7503b862ff5b"... 2024-08-17T02:15:56.676 DEBUG:teuthology.orchestra.run.smithi107:> uname -r 2024-08-17T02:15:56.710 INFO:teuthology.orchestra.run.smithi107.stdout:6.11.0-rc3-g7503b862ff5b 2024-08-17T02:15:56.711 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc3-g7503b862ff5b vs 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:15:56.711 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-17T02:15:56.711 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-08-17T02:15:57.714 DEBUG:teuthology.parallel:result is None 2024-08-17T02:16:06.960 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-08-17T02:16:06.961 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:16:07.626 DEBUG:teuthology.orchestra.run.smithi157:> true 2024-08-17T02:16:08.146 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-08-17T02:16:08.146 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.11.0-rc3-g7503b862ff5b"... 2024-08-17T02:16:08.147 DEBUG:teuthology.orchestra.run.smithi157:> uname -r 2024-08-17T02:16:08.182 INFO:teuthology.orchestra.run.smithi157.stdout:6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:08.182 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc3-g7503b862ff5b vs 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:08.183 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-17T02:16:08.183 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-08-17T02:16:09.186 DEBUG:teuthology.parallel:result is None 2024-08-17T02:16:09.187 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-17T02:16:09.197 INFO:teuthology.task.internal:Creating test directory... 2024-08-17T02:16:09.197 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-17T02:16:09.213 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-17T02:16:09.283 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-17T02:16:09.289 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-17T02:16:09.296 INFO:teuthology.task.internal:Creating archive directory... 2024-08-17T02:16:09.296 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-17T02:16:09.305 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-17T02:16:09.385 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-17T02:16:09.393 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-17T02:16:09.393 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-17T02:16:09.401 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-17T02:16:09.579 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:16:09.605 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:16:09.637 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:16:09.677 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:16:09.684 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-17T02:16:09.690 INFO:teuthology.task.internal:Configuring sudo... 2024-08-17T02:16:09.691 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-17T02:16:09.700 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-17T02:16:09.763 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-17T02:16:09.773 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-17T02:16:09.773 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-17T02:16:09.777 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-17T02:16:09.812 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:16:09.915 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:16:09.989 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:16:10.061 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:16:10.133 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:16:10.134 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-17T02:16:10.189 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:16:10.252 DEBUG:teuthology.orchestra.run.smithi157:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:16:10.328 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:16:10.391 DEBUG:teuthology.orchestra.run.smithi157:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:16:10.462 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-08-17T02:16:10.462 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-17T02:16:10.518 DEBUG:teuthology.orchestra.run.smithi107:> sudo service rsyslog restart 2024-08-17T02:16:10.523 DEBUG:teuthology.orchestra.run.smithi157:> sudo service rsyslog restart 2024-08-17T02:16:10.603 INFO:teuthology.orchestra.run.smithi107.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:16:10.644 INFO:teuthology.orchestra.run.smithi157.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:16:10.920 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-17T02:16:10.929 INFO:teuthology.task.internal:Starting timer... 2024-08-17T02:16:10.930 INFO:teuthology.run_tasks:Running task pcp... 2024-08-17T02:16:10.941 INFO:teuthology.run_tasks:Running task selinux... 2024-08-17T02:16:10.950 DEBUG:teuthology.orchestra.run.smithi107:> sudo service auditd rotate 2024-08-17T02:16:11.267 INFO:teuthology.orchestra.run.smithi107.stdout:Rotating logs: 2024-08-17T02:16:11.271 DEBUG:teuthology.orchestra.run.smithi157:> sudo service auditd rotate 2024-08-17T02:16:11.387 INFO:teuthology.orchestra.run.smithi157.stdout:Rotating logs: 2024-08-17T02:16:11.391 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-17T02:16:11.391 DEBUG:teuthology.orchestra.run.smithi107:> /usr/sbin/getenforce 2024-08-17T02:16:11.494 INFO:teuthology.orchestra.run.smithi107.stdout:Permissive 2024-08-17T02:16:11.495 DEBUG:teuthology.orchestra.run.smithi157:> /usr/sbin/getenforce 2024-08-17T02:16:11.546 INFO:teuthology.orchestra.run.smithi157.stdout:Permissive 2024-08-17T02:16:11.546 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi107.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi157.front.sepia.ceph.com': 'permissive'} 2024-08-17T02:16:11.547 DEBUG:teuthology.orchestra.run.smithi107:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:16:11.611 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:16:11.612 DEBUG:teuthology.orchestra.run.smithi157:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:16:11.669 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:16:11.670 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-17T02:16:11.670 DEBUG:teuthology.orchestra.run.smithi107:> sudo /usr/sbin/setenforce permissive 2024-08-17T02:16:11.745 DEBUG:teuthology.orchestra.run.smithi157:> sudo /usr/sbin/setenforce permissive 2024-08-17T02:16:11.802 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-17T02:16:11.811 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-17T02:16:11.825 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-17T02:16:11.826 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi107.front.sepia.ceph.com,smithi157.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-17T02:21:48.467 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi107.front.sepia.ceph.com'), Remote(name='ubuntu@smithi157.front.sepia.ceph.com')] 2024-08-17T02:21:48.468 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-08-17T02:21:48.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:21:48.563 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-08-17T02:21:48.665 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-08-17T02:21:48.665 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-08-17T02:21:48.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:21:48.760 DEBUG:teuthology.orchestra.run.smithi157:> true 2024-08-17T02:21:48.863 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-08-17T02:21:48.863 INFO:teuthology.run_tasks:Running task clock... 2024-08-17T02:21:48.878 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-17T02:21:48.879 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-17T02:21:48.880 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:21:48.884 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-17T02:21:48.884 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:21:48.941 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-17T02:21:48.966 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-17T02:21:48.970 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-17T02:21:48.996 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-17T02:21:49.021 INFO:teuthology.orchestra.run.smithi107.stderr:sudo: ntpd: command not found 2024-08-17T02:21:49.045 INFO:teuthology.orchestra.run.smithi107.stdout:506 Cannot talk to daemon 2024-08-17T02:21:49.053 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: ntpd: command not found 2024-08-17T02:21:49.073 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-17T02:21:49.080 INFO:teuthology.orchestra.run.smithi157.stdout:506 Cannot talk to daemon 2024-08-17T02:21:49.104 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-17T02:21:49.110 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-17T02:21:49.140 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-17T02:21:49.194 INFO:teuthology.orchestra.run.smithi107.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:21:49.200 INFO:teuthology.orchestra.run.smithi107.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:21:49.201 INFO:teuthology.orchestra.run.smithi107.stdout:=============================================================================== 2024-08-17T02:21:49.201 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:21:49.201 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:21:49.201 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:21:49.201 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:21:49.236 INFO:teuthology.orchestra.run.smithi157.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:21:49.242 INFO:teuthology.orchestra.run.smithi157.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:21:49.242 INFO:teuthology.orchestra.run.smithi157.stdout:=============================================================================== 2024-08-17T02:21:49.242 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:21:49.243 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:21:49.243 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:21:49.243 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:21:49.244 INFO:teuthology.run_tasks:Running task install... 2024-08-17T02:21:49.253 DEBUG:teuthology.task.install:project ceph 2024-08-17T02:21:49.253 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}} 2024-08-17T02:21:49.253 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'} 2024-08-17T02:21:49.253 INFO:teuthology.task.install:Using flavor: default 2024-08-17T02:21:49.262 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-17T02:21:49.262 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-08-17T02:21:49.263 DEBUG:teuthology.orchestra.run.smithi107:> sudo dnf -y install 'dnf-command(copr)' 2024-08-17T02:21:49.263 DEBUG:teuthology.orchestra.run.smithi157:> sudo dnf -y install 'dnf-command(copr)' 2024-08-17T02:21:49.959 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:18 ago on Sat 17 Aug 2024 02:20:31 AM UTC. 2024-08-17T02:21:49.972 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:16 ago on Sat 17 Aug 2024 02:20:33 AM UTC. 2024-08-17T02:21:50.047 INFO:teuthology.orchestra.run.smithi107.stdout:Package dnf-plugins-core-4.3.0-16.el9.noarch is already installed. 2024-08-17T02:21:50.060 INFO:teuthology.orchestra.run.smithi157.stdout:Package dnf-plugins-core-4.3.0-16.el9.noarch is already installed. 2024-08-17T02:21:50.090 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-08-17T02:21:50.091 INFO:teuthology.orchestra.run.smithi107.stdout:Nothing to do. 2024-08-17T02:21:50.091 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-08-17T02:21:50.102 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-08-17T02:21:50.104 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2024-08-17T02:21:50.104 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-08-17T02:21:50.163 DEBUG:teuthology.orchestra.run.smithi107:> sudo dnf -y copr enable ceph/el9 2024-08-17T02:21:50.179 DEBUG:teuthology.orchestra.run.smithi157:> sudo dnf -y copr enable ceph/el9 2024-08-17T02:21:50.412 INFO:teuthology.orchestra.run.smithi107.stderr:Enabling a Copr repository. Please note that this repository is not part 2024-08-17T02:21:50.412 INFO:teuthology.orchestra.run.smithi107.stderr:of the main distribution, and quality may vary. 2024-08-17T02:21:50.413 INFO:teuthology.orchestra.run.smithi107.stderr: 2024-08-17T02:21:50.413 INFO:teuthology.orchestra.run.smithi107.stderr:The Fedora Project does not exercise any power over the contents of 2024-08-17T02:21:50.413 INFO:teuthology.orchestra.run.smithi107.stderr:this repository beyond the rules outlined in the Copr FAQ at 2024-08-17T02:21:50.413 INFO:teuthology.orchestra.run.smithi107.stderr:, 2024-08-17T02:21:50.413 INFO:teuthology.orchestra.run.smithi107.stderr:and packages are not held to any quality or security level. 2024-08-17T02:21:50.413 INFO:teuthology.orchestra.run.smithi107.stderr: 2024-08-17T02:21:50.413 INFO:teuthology.orchestra.run.smithi107.stderr:Please do not file bug reports about these packages in Fedora 2024-08-17T02:21:50.413 INFO:teuthology.orchestra.run.smithi107.stderr:Bugzilla. In case of problems, contact the owner of this repository. 2024-08-17T02:21:50.438 INFO:teuthology.orchestra.run.smithi157.stderr:Enabling a Copr repository. Please note that this repository is not part 2024-08-17T02:21:50.438 INFO:teuthology.orchestra.run.smithi157.stderr:of the main distribution, and quality may vary. 2024-08-17T02:21:50.438 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-08-17T02:21:50.438 INFO:teuthology.orchestra.run.smithi157.stderr:The Fedora Project does not exercise any power over the contents of 2024-08-17T02:21:50.438 INFO:teuthology.orchestra.run.smithi157.stderr:this repository beyond the rules outlined in the Copr FAQ at 2024-08-17T02:21:50.438 INFO:teuthology.orchestra.run.smithi157.stderr:, 2024-08-17T02:21:50.438 INFO:teuthology.orchestra.run.smithi157.stderr:and packages are not held to any quality or security level. 2024-08-17T02:21:50.439 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-08-17T02:21:50.439 INFO:teuthology.orchestra.run.smithi157.stderr:Please do not file bug reports about these packages in Fedora 2024-08-17T02:21:50.439 INFO:teuthology.orchestra.run.smithi157.stderr:Bugzilla. In case of problems, contact the owner of this repository. 2024-08-17T02:21:50.495 INFO:teuthology.orchestra.run.smithi107.stdout:Repository successfully enabled. 2024-08-17T02:21:50.516 INFO:teuthology.orchestra.run.smithi157.stdout:Repository successfully enabled. 2024-08-17T02:21:50.541 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'tag': None, 'wait_for_package': False} 2024-08-17T02:21:50.542 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:21:50.562 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'tag': None, 'wait_for_package': False} 2024-08-17T02:21:50.562 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:21:50.693 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/ 2024-08-17T02:21:50.693 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1375.g2577e813 2024-08-17T02:21:50.708 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/ 2024-08-17T02:21:50.709 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1375.g2577e813 2024-08-17T02:21:50.961 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-17T02:21:50.962 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:21:50.962 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-17T02:21:50.989 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-17T02:21:50.989 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-08-17T02:21:50.989 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-17T02:21:51.019 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-08-17T02:21:51.019 DEBUG:teuthology.orchestra.run.smithi107:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-17T02:21:51.046 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-08-17T02:21:51.047 DEBUG:teuthology.orchestra.run.smithi157:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-17T02:21:51.117 DEBUG:teuthology.orchestra.run.smithi107:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-17T02:21:51.144 DEBUG:teuthology.orchestra.run.smithi157:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-17T02:21:51.195 DEBUG:teuthology.orchestra.run.smithi107:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-17T02:21:51.223 DEBUG:teuthology.orchestra.run.smithi157:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-17T02:21:51.250 INFO:teuthology.orchestra.run.smithi107.stdout:check_obsoletes = 1 2024-08-17T02:21:51.253 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum clean all 2024-08-17T02:21:51.279 INFO:teuthology.orchestra.run.smithi157.stdout:check_obsoletes = 1 2024-08-17T02:21:51.282 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum clean all 2024-08-17T02:21:51.523 INFO:teuthology.orchestra.run.smithi107.stdout:45 files removed 2024-08-17T02:21:51.550 INFO:teuthology.orchestra.run.smithi157.stdout:45 files removed 2024-08-17T02:21:51.555 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-08-17T02:21:51.584 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-08-17T02:21:52.267 INFO:teuthology.orchestra.run.smithi107.stdout:ceph packages for x86_64 220 kB/s | 77 kB 00:00 2024-08-17T02:21:52.290 INFO:teuthology.orchestra.run.smithi157.stdout:ceph packages for x86_64 225 kB/s | 77 kB 00:00 2024-08-17T02:21:52.626 INFO:teuthology.orchestra.run.smithi107.stdout:ceph noarch packages 34 kB/s | 11 kB 00:00 2024-08-17T02:21:52.641 INFO:teuthology.orchestra.run.smithi157.stdout:ceph noarch packages 35 kB/s | 11 kB 00:00 2024-08-17T02:21:52.977 INFO:teuthology.orchestra.run.smithi107.stdout:ceph source packages 5.7 kB/s | 1.8 kB 00:00 2024-08-17T02:21:53.008 INFO:teuthology.orchestra.run.smithi157.stdout:ceph source packages 5.4 kB/s | 1.8 kB 00:00 2024-08-17T02:21:53.202 INFO:teuthology.orchestra.run.smithi107.stdout:Copr repo for el9 owned by ceph 40 kB/s | 7.6 kB 00:00 2024-08-17T02:21:53.234 INFO:teuthology.orchestra.run.smithi157.stdout:Copr repo for el9 owned by ceph 40 kB/s | 7.6 kB 00:00 2024-08-17T02:21:53.844 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.2 MB 00:00 2024-08-17T02:21:54.625 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - BaseOS 6.0 MB/s | 8.2 MB 00:01 2024-08-17T02:21:56.387 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - AppStream 14 MB/s | 20 MB 00:01 2024-08-17T02:21:56.727 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - AppStream 21 MB/s | 20 MB 00:00 2024-08-17T02:22:00.854 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.6 MB 00:00 2024-08-17T02:22:01.386 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - CRB 8.9 MB/s | 6.6 MB 00:00 2024-08-17T02:22:02.488 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - Extras packages 59 kB/s | 18 kB 00:00 2024-08-17T02:22:02.970 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 18 kB 00:00 2024-08-17T02:22:03.500 INFO:teuthology.orchestra.run.smithi107.stdout:Extra Packages for Enterprise Linux 25 MB/s | 22 MB 00:00 2024-08-17T02:22:04.041 INFO:teuthology.orchestra.run.smithi157.stdout:Extra Packages for Enterprise Linux 24 MB/s | 22 MB 00:00 2024-08-17T02:22:09.723 INFO:teuthology.orchestra.run.smithi107.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-08-17T02:22:10.380 INFO:teuthology.orchestra.run.smithi157.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-08-17T02:22:12.252 INFO:teuthology.orchestra.run.smithi107.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:22:12.252 INFO:teuthology.orchestra.run.smithi107.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:22:12.263 INFO:teuthology.orchestra.run.smithi107.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-08-17T02:22:12.264 INFO:teuthology.orchestra.run.smithi107.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-17T02:22:12.264 INFO:teuthology.orchestra.run.smithi107.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-17T02:22:12.265 INFO:teuthology.orchestra.run.smithi107.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-17T02:22:12.267 INFO:teuthology.orchestra.run.smithi107.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-17T02:22:12.269 INFO:teuthology.orchestra.run.smithi107.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-17T02:22:12.270 INFO:teuthology.orchestra.run.smithi107.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-08-17T02:22:12.330 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-08-17T02:22:12.344 INFO:teuthology.orchestra.run.smithi107.stdout:======================================================================================= 2024-08-17T02:22:12.344 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2024-08-17T02:22:12.344 INFO:teuthology.orchestra.run.smithi107.stdout:======================================================================================= 2024-08-17T02:22:12.345 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-08-17T02:22:12.345 INFO:teuthology.orchestra.run.smithi107.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-17T02:22:12.345 INFO:teuthology.orchestra.run.smithi107.stdout: ceph x86_64 2:17.2.7-1375.g2577e813.el9 ceph 6.5 k 2024-08-17T02:22:12.345 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base x86_64 2:17.2.7-1375.g2577e813.el9 ceph 5.0 M 2024-08-17T02:22:12.345 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 813 k 2024-08-17T02:22:12.345 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1375.g2577e813.el9 ceph 137 k 2024-08-17T02:22:12.345 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr x86_64 2:17.2.7-1375.g2577e813.el9 ceph 1.4 M 2024-08-17T02:22:12.345 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 124 k 2024-08-17T02:22:12.345 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 3.4 M 2024-08-17T02:22:12.345 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 7.4 M 2024-08-17T02:22:12.345 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-rook noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 47 k 2024-08-17T02:22:12.346 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-radosgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 14 M 2024-08-17T02:22:12.346 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-test x86_64 2:17.2.7-1375.g2577e813.el9 ceph 48 M 2024-08-17T02:22:12.346 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-volume noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 269 k 2024-08-17T02:22:12.346 INFO:teuthology.orchestra.run.smithi107.stdout: cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 83 k 2024-08-17T02:22:12.346 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 215 k 2024-08-17T02:22:12.346 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-top noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 18 k 2024-08-17T02:22:12.346 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-17T02:22:12.346 INFO:teuthology.orchestra.run.smithi107.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-17T02:22:12.346 INFO:teuthology.orchestra.run.smithi107.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-17T02:22:12.346 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:22:12.346 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 636 k 2024-08-17T02:22:12.347 INFO:teuthology.orchestra.run.smithi107.stdout: librados-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 126 k 2024-08-17T02:22:12.347 INFO:teuthology.orchestra.run.smithi107.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-17T02:22:12.347 INFO:teuthology.orchestra.run.smithi107.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-17T02:22:12.347 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-17T02:22:12.347 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cephfs x86_64 2:17.2.7-1375.g2577e813.el9 ceph 182 k 2024-08-17T02:22:12.347 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rados x86_64 2:17.2.7-1375.g2577e813.el9 ceph 369 k 2024-08-17T02:22:12.347 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 344 k 2024-08-17T02:22:12.347 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 116 k 2024-08-17T02:22:12.347 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 82 k 2024-08-17T02:22:12.347 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:22:12.347 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-nbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 165 k 2024-08-17T02:22:12.347 INFO:teuthology.orchestra.run.smithi107.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-08-17T02:22:12.348 INFO:teuthology.orchestra.run.smithi107.stdout:Upgrading: 2024-08-17T02:22:12.348 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-08-17T02:22:12.348 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-08-17T02:22:12.348 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-08-17T02:22:12.348 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-08-17T02:22:12.348 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-08-17T02:22:12.348 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-08-17T02:22:12.348 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-08-17T02:22:12.348 INFO:teuthology.orchestra.run.smithi107.stdout: librados2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.1 M 2024-08-17T02:22:12.348 INFO:teuthology.orchestra.run.smithi107.stdout: librbd1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:22:12.348 INFO:teuthology.orchestra.run.smithi107.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-08-17T02:22:12.348 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-08-17T02:22:12.349 INFO:teuthology.orchestra.run.smithi107.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-08-17T02:22:12.349 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-08-17T02:22:12.349 INFO:teuthology.orchestra.run.smithi107.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-17T02:22:12.349 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 22 M 2024-08-17T02:22:12.349 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 24 k 2024-08-17T02:22:12.349 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mds x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.1 M 2024-08-17T02:22:12.349 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 240 k 2024-08-17T02:22:12.349 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mon x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.9 M 2024-08-17T02:22:12.349 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-osd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 15 M 2024-08-17T02:22:12.349 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 15 k 2024-08-17T02:22:12.349 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-selinux x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:22:12.349 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-17T02:22:12.349 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-17T02:22:12.350 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-17T02:22:12.350 INFO:teuthology.orchestra.run.smithi107.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-17T02:22:12.350 INFO:teuthology.orchestra.run.smithi107.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-17T02:22:12.350 INFO:teuthology.orchestra.run.smithi107.stdout: libcephsqlite x86_64 2:17.2.7-1375.g2577e813.el9 ceph 163 k 2024-08-17T02:22:12.350 INFO:teuthology.orchestra.run.smithi107.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-17T02:22:12.350 INFO:teuthology.orchestra.run.smithi107.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-17T02:22:12.350 INFO:teuthology.orchestra.run.smithi107.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-17T02:22:12.350 INFO:teuthology.orchestra.run.smithi107.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-17T02:22:12.350 INFO:teuthology.orchestra.run.smithi107.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-17T02:22:12.350 INFO:teuthology.orchestra.run.smithi107.stdout: libradosstriper1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 458 k 2024-08-17T02:22:12.350 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-17T02:22:12.350 INFO:teuthology.orchestra.run.smithi107.stdout: librgw2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 4.9 M 2024-08-17T02:22:12.351 INFO:teuthology.orchestra.run.smithi107.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-17T02:22:12.351 INFO:teuthology.orchestra.run.smithi107.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-17T02:22:12.351 INFO:teuthology.orchestra.run.smithi107.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-17T02:22:12.351 INFO:teuthology.orchestra.run.smithi107.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-17T02:22:12.351 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-17T02:22:12.351 INFO:teuthology.orchestra.run.smithi107.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-17T02:22:12.351 INFO:teuthology.orchestra.run.smithi107.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-17T02:22:12.351 INFO:teuthology.orchestra.run.smithi107.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-17T02:22:12.351 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-17T02:22:12.351 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-argparse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 45 k 2024-08-17T02:22:12.351 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 120 k 2024-08-17T02:22:12.351 INFO:teuthology.orchestra.run.smithi107.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-17T02:22:12.351 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-17T02:22:12.352 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-17T02:22:12.352 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-17T02:22:12.352 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-17T02:22:12.352 INFO:teuthology.orchestra.run.smithi107.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-08-17T02:22:12.352 INFO:teuthology.orchestra.run.smithi107.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-17T02:22:12.352 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-17T02:22:12.352 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-17T02:22:12.352 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-17T02:22:12.352 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-17T02:22:12.352 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-17T02:22:12.352 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-17T02:22:12.352 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-17T02:22:12.353 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-17T02:22:12.353 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-08-17T02:22:12.353 INFO:teuthology.orchestra.run.smithi107.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-17T02:22:12.353 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-17T02:22:12.353 INFO:teuthology.orchestra.run.smithi107.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-17T02:22:12.353 INFO:teuthology.orchestra.run.smithi107.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-17T02:22:12.353 INFO:teuthology.orchestra.run.smithi107.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-17T02:22:12.353 INFO:teuthology.orchestra.run.smithi107.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-17T02:22:12.353 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-17T02:22:12.353 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-17T02:22:12.353 INFO:teuthology.orchestra.run.smithi107.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-17T02:22:12.353 INFO:teuthology.orchestra.run.smithi107.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-17T02:22:12.353 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-17T02:22:12.353 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-17T02:22:12.354 INFO:teuthology.orchestra.run.smithi107.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-17T02:22:12.354 INFO:teuthology.orchestra.run.smithi107.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-17T02:22:12.354 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-17T02:22:12.354 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-17T02:22:12.354 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-17T02:22:12.354 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-17T02:22:12.354 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-17T02:22:12.354 INFO:teuthology.orchestra.run.smithi107.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-17T02:22:12.354 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-17T02:22:12.354 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-17T02:22:12.354 INFO:teuthology.orchestra.run.smithi107.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-17T02:22:12.354 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-17T02:22:12.355 INFO:teuthology.orchestra.run.smithi107.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-17T02:22:12.355 INFO:teuthology.orchestra.run.smithi107.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-17T02:22:12.355 INFO:teuthology.orchestra.run.smithi107.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-17T02:22:12.355 INFO:teuthology.orchestra.run.smithi107.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-17T02:22:12.355 INFO:teuthology.orchestra.run.smithi107.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-17T02:22:12.355 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-17T02:22:12.355 INFO:teuthology.orchestra.run.smithi107.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-17T02:22:12.355 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-17T02:22:12.355 INFO:teuthology.orchestra.run.smithi107.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-17T02:22:12.355 INFO:teuthology.orchestra.run.smithi107.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-17T02:22:12.355 INFO:teuthology.orchestra.run.smithi107.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-17T02:22:12.355 INFO:teuthology.orchestra.run.smithi107.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-17T02:22:12.355 INFO:teuthology.orchestra.run.smithi107.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-17T02:22:12.356 INFO:teuthology.orchestra.run.smithi107.stdout:Installing weak dependencies: 2024-08-17T02:22:12.356 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-08-17T02:22:12.356 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:22:12.356 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-08-17T02:22:12.356 INFO:teuthology.orchestra.run.smithi107.stdout:======================================================================================= 2024-08-17T02:22:12.356 INFO:teuthology.orchestra.run.smithi107.stdout:Install 121 Packages 2024-08-17T02:22:12.356 INFO:teuthology.orchestra.run.smithi107.stdout:Upgrade 12 Packages 2024-08-17T02:22:12.356 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:22:12.357 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 206 M 2024-08-17T02:22:12.357 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-08-17T02:22:12.932 INFO:teuthology.orchestra.run.smithi107.stdout:(1/133): ceph-17.2.7-1375.g2577e813.el9.x86_64. 33 kB/s | 6.5 kB 00:00 2024-08-17T02:22:12.950 INFO:teuthology.orchestra.run.smithi157.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:22:12.951 INFO:teuthology.orchestra.run.smithi157.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:22:12.961 INFO:teuthology.orchestra.run.smithi157.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-08-17T02:22:12.962 INFO:teuthology.orchestra.run.smithi157.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-17T02:22:12.963 INFO:teuthology.orchestra.run.smithi157.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-17T02:22:12.964 INFO:teuthology.orchestra.run.smithi157.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-17T02:22:12.965 INFO:teuthology.orchestra.run.smithi157.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-17T02:22:12.968 INFO:teuthology.orchestra.run.smithi157.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-17T02:22:12.969 INFO:teuthology.orchestra.run.smithi157.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-08-17T02:22:13.028 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-08-17T02:22:13.045 INFO:teuthology.orchestra.run.smithi157.stdout:======================================================================================= 2024-08-17T02:22:13.045 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2024-08-17T02:22:13.045 INFO:teuthology.orchestra.run.smithi157.stdout:======================================================================================= 2024-08-17T02:22:13.046 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-08-17T02:22:13.046 INFO:teuthology.orchestra.run.smithi157.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-17T02:22:13.046 INFO:teuthology.orchestra.run.smithi157.stdout: ceph x86_64 2:17.2.7-1375.g2577e813.el9 ceph 6.5 k 2024-08-17T02:22:13.046 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-base x86_64 2:17.2.7-1375.g2577e813.el9 ceph 5.0 M 2024-08-17T02:22:13.046 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 813 k 2024-08-17T02:22:13.046 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1375.g2577e813.el9 ceph 137 k 2024-08-17T02:22:13.046 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr x86_64 2:17.2.7-1375.g2577e813.el9 ceph 1.4 M 2024-08-17T02:22:13.046 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 124 k 2024-08-17T02:22:13.046 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 3.4 M 2024-08-17T02:22:13.046 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 7.4 M 2024-08-17T02:22:13.046 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-rook noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 47 k 2024-08-17T02:22:13.046 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-radosgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 14 M 2024-08-17T02:22:13.047 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-test x86_64 2:17.2.7-1375.g2577e813.el9 ceph 48 M 2024-08-17T02:22:13.047 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-volume noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 269 k 2024-08-17T02:22:13.047 INFO:teuthology.orchestra.run.smithi157.stdout: cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 83 k 2024-08-17T02:22:13.047 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 215 k 2024-08-17T02:22:13.047 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-top noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 18 k 2024-08-17T02:22:13.047 INFO:teuthology.orchestra.run.smithi157.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-17T02:22:13.047 INFO:teuthology.orchestra.run.smithi157.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-17T02:22:13.047 INFO:teuthology.orchestra.run.smithi157.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-17T02:22:13.047 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:22:13.047 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 636 k 2024-08-17T02:22:13.047 INFO:teuthology.orchestra.run.smithi157.stdout: librados-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 126 k 2024-08-17T02:22:13.047 INFO:teuthology.orchestra.run.smithi157.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-17T02:22:13.047 INFO:teuthology.orchestra.run.smithi157.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-17T02:22:13.048 INFO:teuthology.orchestra.run.smithi157.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-17T02:22:13.048 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cephfs x86_64 2:17.2.7-1375.g2577e813.el9 ceph 182 k 2024-08-17T02:22:13.048 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rados x86_64 2:17.2.7-1375.g2577e813.el9 ceph 369 k 2024-08-17T02:22:13.048 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 344 k 2024-08-17T02:22:13.048 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 116 k 2024-08-17T02:22:13.048 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 82 k 2024-08-17T02:22:13.048 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:22:13.048 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-nbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 165 k 2024-08-17T02:22:13.048 INFO:teuthology.orchestra.run.smithi157.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-08-17T02:22:13.048 INFO:teuthology.orchestra.run.smithi157.stdout:Upgrading: 2024-08-17T02:22:13.048 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-08-17T02:22:13.048 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-08-17T02:22:13.049 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-08-17T02:22:13.049 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-08-17T02:22:13.049 INFO:teuthology.orchestra.run.smithi157.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-08-17T02:22:13.049 INFO:teuthology.orchestra.run.smithi157.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-08-17T02:22:13.049 INFO:teuthology.orchestra.run.smithi157.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-08-17T02:22:13.049 INFO:teuthology.orchestra.run.smithi157.stdout: librados2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.1 M 2024-08-17T02:22:13.049 INFO:teuthology.orchestra.run.smithi157.stdout: librbd1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:22:13.049 INFO:teuthology.orchestra.run.smithi157.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-08-17T02:22:13.049 INFO:teuthology.orchestra.run.smithi157.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-08-17T02:22:13.049 INFO:teuthology.orchestra.run.smithi157.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-08-17T02:22:13.049 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2024-08-17T02:22:13.049 INFO:teuthology.orchestra.run.smithi157.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-17T02:22:13.049 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 22 M 2024-08-17T02:22:13.050 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 24 k 2024-08-17T02:22:13.050 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mds x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.1 M 2024-08-17T02:22:13.050 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 240 k 2024-08-17T02:22:13.050 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mon x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.9 M 2024-08-17T02:22:13.050 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-osd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 15 M 2024-08-17T02:22:13.050 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 15 k 2024-08-17T02:22:13.050 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-selinux x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:22:13.050 INFO:teuthology.orchestra.run.smithi157.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-17T02:22:13.050 INFO:teuthology.orchestra.run.smithi157.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-17T02:22:13.050 INFO:teuthology.orchestra.run.smithi157.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-17T02:22:13.050 INFO:teuthology.orchestra.run.smithi157.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-17T02:22:13.050 INFO:teuthology.orchestra.run.smithi157.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-17T02:22:13.050 INFO:teuthology.orchestra.run.smithi157.stdout: libcephsqlite x86_64 2:17.2.7-1375.g2577e813.el9 ceph 163 k 2024-08-17T02:22:13.051 INFO:teuthology.orchestra.run.smithi157.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-17T02:22:13.051 INFO:teuthology.orchestra.run.smithi157.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-17T02:22:13.051 INFO:teuthology.orchestra.run.smithi157.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-17T02:22:13.051 INFO:teuthology.orchestra.run.smithi157.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-17T02:22:13.051 INFO:teuthology.orchestra.run.smithi157.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-17T02:22:13.051 INFO:teuthology.orchestra.run.smithi157.stdout: libradosstriper1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 458 k 2024-08-17T02:22:13.051 INFO:teuthology.orchestra.run.smithi157.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-17T02:22:13.051 INFO:teuthology.orchestra.run.smithi157.stdout: librgw2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 4.9 M 2024-08-17T02:22:13.051 INFO:teuthology.orchestra.run.smithi157.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-17T02:22:13.051 INFO:teuthology.orchestra.run.smithi157.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-17T02:22:13.051 INFO:teuthology.orchestra.run.smithi157.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-17T02:22:13.051 INFO:teuthology.orchestra.run.smithi157.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-17T02:22:13.052 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-17T02:22:13.052 INFO:teuthology.orchestra.run.smithi157.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-17T02:22:13.052 INFO:teuthology.orchestra.run.smithi157.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-17T02:22:13.052 INFO:teuthology.orchestra.run.smithi157.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-17T02:22:13.052 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-17T02:22:13.052 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-argparse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 45 k 2024-08-17T02:22:13.052 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 120 k 2024-08-17T02:22:13.052 INFO:teuthology.orchestra.run.smithi157.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-17T02:22:13.052 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-17T02:22:13.052 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-17T02:22:13.052 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-17T02:22:13.052 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-17T02:22:13.052 INFO:teuthology.orchestra.run.smithi157.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-08-17T02:22:13.052 INFO:teuthology.orchestra.run.smithi157.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-17T02:22:13.053 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-17T02:22:13.053 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-17T02:22:13.053 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-17T02:22:13.053 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-17T02:22:13.053 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-17T02:22:13.053 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-17T02:22:13.053 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-17T02:22:13.053 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-17T02:22:13.053 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-08-17T02:22:13.053 INFO:teuthology.orchestra.run.smithi157.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-17T02:22:13.053 INFO:teuthology.orchestra.run.smithi157.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-17T02:22:13.053 INFO:teuthology.orchestra.run.smithi157.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-17T02:22:13.053 INFO:teuthology.orchestra.run.smithi157.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-17T02:22:13.054 INFO:teuthology.orchestra.run.smithi157.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-17T02:22:13.054 INFO:teuthology.orchestra.run.smithi157.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-17T02:22:13.054 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-17T02:22:13.054 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-17T02:22:13.054 INFO:teuthology.orchestra.run.smithi157.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-17T02:22:13.054 INFO:teuthology.orchestra.run.smithi157.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-17T02:22:13.054 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-17T02:22:13.054 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-17T02:22:13.054 INFO:teuthology.orchestra.run.smithi157.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-17T02:22:13.054 INFO:teuthology.orchestra.run.smithi157.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-17T02:22:13.054 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-17T02:22:13.054 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-17T02:22:13.055 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-17T02:22:13.055 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-17T02:22:13.055 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-17T02:22:13.055 INFO:teuthology.orchestra.run.smithi157.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-17T02:22:13.055 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-17T02:22:13.055 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-17T02:22:13.055 INFO:teuthology.orchestra.run.smithi157.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-17T02:22:13.055 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-17T02:22:13.055 INFO:teuthology.orchestra.run.smithi157.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-17T02:22:13.055 INFO:teuthology.orchestra.run.smithi157.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-17T02:22:13.055 INFO:teuthology.orchestra.run.smithi157.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-17T02:22:13.055 INFO:teuthology.orchestra.run.smithi157.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-17T02:22:13.055 INFO:teuthology.orchestra.run.smithi157.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-17T02:22:13.056 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-17T02:22:13.056 INFO:teuthology.orchestra.run.smithi157.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-17T02:22:13.056 INFO:teuthology.orchestra.run.smithi157.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-17T02:22:13.056 INFO:teuthology.orchestra.run.smithi157.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-17T02:22:13.056 INFO:teuthology.orchestra.run.smithi157.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-17T02:22:13.056 INFO:teuthology.orchestra.run.smithi157.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-17T02:22:13.056 INFO:teuthology.orchestra.run.smithi157.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-17T02:22:13.056 INFO:teuthology.orchestra.run.smithi157.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-17T02:22:13.056 INFO:teuthology.orchestra.run.smithi157.stdout:Installing weak dependencies: 2024-08-17T02:22:13.056 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-08-17T02:22:13.056 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:22:13.056 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-08-17T02:22:13.056 INFO:teuthology.orchestra.run.smithi157.stdout:======================================================================================= 2024-08-17T02:22:13.056 INFO:teuthology.orchestra.run.smithi157.stdout:Install 121 Packages 2024-08-17T02:22:13.057 INFO:teuthology.orchestra.run.smithi157.stdout:Upgrade 12 Packages 2024-08-17T02:22:13.057 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:22:13.057 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 206 M 2024-08-17T02:22:13.057 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-08-17T02:22:13.133 INFO:teuthology.orchestra.run.smithi107.stdout:(2/133): ceph-fuse-17.2.7-1375.g2577e813.el9.x8 4.0 MB/s | 813 kB 00:00 2024-08-17T02:22:13.233 INFO:teuthology.orchestra.run.smithi107.stdout:(3/133): ceph-base-17.2.7-1375.g2577e813.el9.x8 10 MB/s | 5.0 MB 00:00 2024-08-17T02:22:13.258 INFO:teuthology.orchestra.run.smithi107.stdout:(4/133): ceph-immutable-object-cache-17.2.7-137 1.1 MB/s | 137 kB 00:00 2024-08-17T02:22:13.333 INFO:teuthology.orchestra.run.smithi107.stdout:(5/133): ceph-mds-17.2.7-1375.g2577e813.el9.x86 21 MB/s | 2.1 MB 00:00 2024-08-17T02:22:13.526 INFO:teuthology.orchestra.run.smithi107.stdout:(6/133): ceph-mgr-17.2.7-1375.g2577e813.el9.x86 5.3 MB/s | 1.4 MB 00:00 2024-08-17T02:22:13.592 INFO:teuthology.orchestra.run.smithi107.stdout:(7/133): ceph-mon-17.2.7-1375.g2577e813.el9.x86 15 MB/s | 3.9 MB 00:00 2024-08-17T02:22:13.951 INFO:teuthology.orchestra.run.smithi107.stdout:(8/133): ceph-common-17.2.7-1375.g2577e813.el9. 18 MB/s | 22 MB 00:01 2024-08-17T02:22:13.964 INFO:teuthology.orchestra.run.smithi157.stdout:(1/133): ceph-17.2.7-1375.g2577e813.el9.x86_64. 32 kB/s | 6.5 kB 00:00 2024-08-17T02:22:14.001 INFO:teuthology.orchestra.run.smithi107.stdout:(9/133): ceph-selinux-17.2.7-1375.g2577e813.el9 506 kB/s | 25 kB 00:00 2024-08-17T02:22:14.498 INFO:teuthology.orchestra.run.smithi157.stdout:(2/133): ceph-fuse-17.2.7-1375.g2577e813.el9.x8 1.5 MB/s | 813 kB 00:00 2024-08-17T02:22:14.631 INFO:teuthology.orchestra.run.smithi157.stdout:(3/133): ceph-immutable-object-cache-17.2.7-137 1.0 MB/s | 137 kB 00:00 2024-08-17T02:22:14.823 INFO:teuthology.orchestra.run.smithi157.stdout:(4/133): ceph-base-17.2.7-1375.g2577e813.el9.x8 4.7 MB/s | 5.0 MB 00:01 2024-08-17T02:22:14.951 INFO:teuthology.orchestra.run.smithi107.stdout:(10/133): ceph-osd-17.2.7-1375.g2577e813.el9.x8 11 MB/s | 15 MB 00:01 2024-08-17T02:22:14.974 INFO:teuthology.orchestra.run.smithi157.stdout:(5/133): ceph-mgr-17.2.7-1375.g2577e813.el9.x86 9.4 MB/s | 1.4 MB 00:00 2024-08-17T02:22:15.010 INFO:teuthology.orchestra.run.smithi107.stdout:(11/133): cephfs-mirror-17.2.7-1375.g2577e813.e 3.6 MB/s | 215 kB 00:00 2024-08-17T02:22:15.102 INFO:teuthology.orchestra.run.smithi107.stdout:(12/133): libcephfs-devel-17.2.7-1375.g2577e813 273 kB/s | 25 kB 00:00 2024-08-17T02:22:15.277 INFO:teuthology.orchestra.run.smithi107.stdout:(13/133): ceph-radosgw-17.2.7-1375.g2577e813.el 8.4 MB/s | 14 MB 00:01 2024-08-17T02:22:15.311 INFO:teuthology.orchestra.run.smithi107.stdout:(14/133): libcephfs2-17.2.7-1375.g2577e813.el9. 3.0 MB/s | 636 kB 00:00 2024-08-17T02:22:15.336 INFO:teuthology.orchestra.run.smithi107.stdout:(15/133): libcephsqlite-17.2.7-1375.g2577e813.e 2.7 MB/s | 163 kB 00:00 2024-08-17T02:22:15.361 INFO:teuthology.orchestra.run.smithi107.stdout:(16/133): librados-devel-17.2.7-1375.g2577e813. 2.5 MB/s | 126 kB 00:00 2024-08-17T02:22:15.399 INFO:teuthology.orchestra.run.smithi157.stdout:(6/133): ceph-mds-17.2.7-1375.g2577e813.el9.x86 2.7 MB/s | 2.1 MB 00:00 2024-08-17T02:22:15.445 INFO:teuthology.orchestra.run.smithi107.stdout:(17/133): libradosstriper1-17.2.7-1375.g2577e81 4.1 MB/s | 458 kB 00:00 2024-08-17T02:22:15.508 INFO:teuthology.orchestra.run.smithi157.stdout:(7/133): ceph-mon-17.2.7-1375.g2577e813.el9.x86 7.3 MB/s | 3.9 MB 00:00 2024-08-17T02:22:15.520 INFO:teuthology.orchestra.run.smithi107.stdout:(18/133): python3-ceph-argparse-17.2.7-1375.g25 602 kB/s | 45 kB 00:00 2024-08-17T02:22:15.604 INFO:teuthology.orchestra.run.smithi107.stdout:(19/133): python3-ceph-common-17.2.7-1375.g2577 1.4 MB/s | 120 kB 00:00 2024-08-17T02:22:15.695 INFO:teuthology.orchestra.run.smithi107.stdout:(20/133): python3-cephfs-17.2.7-1375.g2577e813. 1.9 MB/s | 182 kB 00:00 2024-08-17T02:22:15.787 INFO:teuthology.orchestra.run.smithi107.stdout:(21/133): python3-rados-17.2.7-1375.g2577e813.e 3.9 MB/s | 369 kB 00:00 2024-08-17T02:22:15.888 INFO:teuthology.orchestra.run.smithi107.stdout:(22/133): librgw2-17.2.7-1375.g2577e813.el9.x86 9.3 MB/s | 4.9 MB 00:00 2024-08-17T02:22:15.938 INFO:teuthology.orchestra.run.smithi107.stdout:(23/133): python3-rbd-17.2.7-1375.g2577e813.el9 2.2 MB/s | 344 kB 00:00 2024-08-17T02:22:15.972 INFO:teuthology.orchestra.run.smithi107.stdout:(24/133): python3-rgw-17.2.7-1375.g2577e813.el9 1.4 MB/s | 116 kB 00:00 2024-08-17T02:22:16.014 INFO:teuthology.orchestra.run.smithi107.stdout:(25/133): rbd-fuse-17.2.7-1375.g2577e813.el9.x8 1.1 MB/s | 82 kB 00:00 2024-08-17T02:22:16.540 INFO:teuthology.orchestra.run.smithi107.stdout:(26/133): ceph-test-17.2.7-1375.g2577e813.el9.x 19 MB/s | 48 MB 00:02 2024-08-17T02:22:16.564 INFO:teuthology.orchestra.run.smithi107.stdout:(27/133): rbd-nbd-17.2.7-1375.g2577e813.el9.x86 300 kB/s | 165 kB 00:00 2024-08-17T02:22:16.598 INFO:teuthology.orchestra.run.smithi107.stdout:(28/133): ceph-grafana-dashboards-17.2.7-1375.g 420 kB/s | 24 kB 00:00 2024-08-17T02:22:16.665 INFO:teuthology.orchestra.run.smithi107.stdout:(29/133): rbd-mirror-17.2.7-1375.g2577e813.el9. 4.2 MB/s | 2.9 MB 00:00 2024-08-17T02:22:16.691 INFO:teuthology.orchestra.run.smithi107.stdout:(30/133): ceph-mgr-cephadm-17.2.7-1375.g2577e81 988 kB/s | 124 kB 00:00 2024-08-17T02:22:16.866 INFO:teuthology.orchestra.run.smithi107.stdout:(31/133): ceph-mgr-modules-core-17.2.7-1375.g25 1.3 MB/s | 240 kB 00:00 2024-08-17T02:22:16.933 INFO:teuthology.orchestra.run.smithi107.stdout:(32/133): ceph-mgr-dashboard-17.2.7-1375.g2577e 10 MB/s | 3.4 MB 00:00 2024-08-17T02:22:16.949 INFO:teuthology.orchestra.run.smithi107.stdout:(33/133): ceph-mgr-rook-17.2.7-1375.g2577e813.e 569 kB/s | 47 kB 00:00 2024-08-17T02:22:17.033 INFO:teuthology.orchestra.run.smithi107.stdout:(34/133): ceph-prometheus-alerts-17.2.7-1375.g2 146 kB/s | 15 kB 00:00 2024-08-17T02:22:17.059 INFO:teuthology.orchestra.run.smithi107.stdout:(35/133): ceph-volume-17.2.7-1375.g2577e813.el9 2.4 MB/s | 269 kB 00:00 2024-08-17T02:22:17.109 INFO:teuthology.orchestra.run.smithi107.stdout:(36/133): cephadm-17.2.7-1375.g2577e813.el9.noa 1.1 MB/s | 83 kB 00:00 2024-08-17T02:22:17.142 INFO:teuthology.orchestra.run.smithi107.stdout:(37/133): cephfs-top-17.2.7-1375.g2577e813.el9. 218 kB/s | 18 kB 00:00 2024-08-17T02:22:17.266 INFO:teuthology.orchestra.run.smithi157.stdout:(8/133): ceph-radosgw-17.2.7-1375.g2577e813.el9 8.1 MB/s | 14 MB 00:01 2024-08-17T02:22:17.284 INFO:teuthology.orchestra.run.smithi107.stdout:(38/133): fuse-2.9.9-16.el9.x86_64.rpm 455 kB/s | 80 kB 00:00 2024-08-17T02:22:17.318 INFO:teuthology.orchestra.run.smithi107.stdout:(39/133): libgfortran-11.4.1-3.el9.x86_64.rpm 4.5 MB/s | 803 kB 00:00 2024-08-17T02:22:17.350 INFO:teuthology.orchestra.run.smithi157.stdout:(9/133): ceph-selinux-17.2.7-1375.g2577e813.el9 304 kB/s | 25 kB 00:00 2024-08-17T02:22:17.351 INFO:teuthology.orchestra.run.smithi107.stdout:(40/133): libquadmath-11.4.1-3.el9.x86_64.rpm 2.9 MB/s | 195 kB 00:00 2024-08-17T02:22:17.377 INFO:teuthology.orchestra.run.smithi107.stdout:(41/133): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-08-17T02:22:17.436 INFO:teuthology.orchestra.run.smithi107.stdout:(42/133): python3-cryptography-36.0.1-4.el9.x86 15 MB/s | 1.2 MB 00:00 2024-08-17T02:22:17.461 INFO:teuthology.orchestra.run.smithi107.stdout:(43/133): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2024-08-17T02:22:17.495 INFO:teuthology.orchestra.run.smithi107.stdout:(44/133): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-08-17T02:22:17.520 INFO:teuthology.orchestra.run.smithi107.stdout:(45/133): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-08-17T02:22:17.553 INFO:teuthology.orchestra.run.smithi107.stdout:(46/133): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-08-17T02:22:17.670 INFO:teuthology.orchestra.run.smithi107.stdout:(47/133): ceph-mgr-diskprediction-local-17.2.7- 7.4 MB/s | 7.4 MB 00:01 2024-08-17T02:22:17.745 INFO:teuthology.orchestra.run.smithi107.stdout:(48/133): elfutils-libelf-devel-0.191-4.el9.x86 291 kB/s | 22 kB 00:00 2024-08-17T02:22:17.779 INFO:teuthology.orchestra.run.smithi107.stdout:(49/133): automake-1.16.2-8.el9.noarch.rpm 2.6 MB/s | 689 kB 00:00 2024-08-17T02:22:17.813 INFO:teuthology.orchestra.run.smithi107.stdout:(50/133): bison-3.7.4-5.el9.x86_64.rpm 3.6 MB/s | 943 kB 00:00 2024-08-17T02:22:17.838 INFO:teuthology.orchestra.run.smithi107.stdout:(51/133): flexiblas-3.0.4-8.el9.x86_64.rpm 557 kB/s | 33 kB 00:00 2024-08-17T02:22:17.872 INFO:teuthology.orchestra.run.smithi107.stdout:(52/133): flex-2.6.4-9.el9.x86_64.rpm 2.4 MB/s | 313 kB 00:00 2024-08-17T02:22:17.898 INFO:teuthology.orchestra.run.smithi107.stdout:(53/133): flexiblas-openblas-openmp-3.0.4-8.el9 310 kB/s | 18 kB 00:00 2024-08-17T02:22:17.923 INFO:teuthology.orchestra.run.smithi107.stdout:(54/133): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-08-17T02:22:17.948 INFO:teuthology.orchestra.run.smithi107.stdout:(55/133): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-08-17T02:22:17.973 INFO:teuthology.orchestra.run.smithi107.stdout:(56/133): librabbitmq-0.11.0-7.el9.x86_64.rpm 900 kB/s | 45 kB 00:00 2024-08-17T02:22:18.007 INFO:teuthology.orchestra.run.smithi107.stdout:(57/133): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-08-17T02:22:18.040 INFO:teuthology.orchestra.run.smithi107.stdout:(58/133): libtool-2.4.6-46.el9.x86_64.rpm 8.5 MB/s | 581 kB 00:00 2024-08-17T02:22:18.066 INFO:teuthology.orchestra.run.smithi107.stdout:(59/133): libuuid-devel-2.37.4-18.el9.x86_64.rp 435 kB/s | 25 kB 00:00 2024-08-17T02:22:18.108 INFO:teuthology.orchestra.run.smithi107.stdout:(60/133): libzstd-devel-1.5.1-2.el9.x86_64.rpm 711 kB/s | 47 kB 00:00 2024-08-17T02:22:18.158 INFO:teuthology.orchestra.run.smithi107.stdout:(61/133): flexiblas-netlib-3.0.4-8.el9.x86_64.r 8.7 MB/s | 3.0 MB 00:00 2024-08-17T02:22:18.183 INFO:teuthology.orchestra.run.smithi107.stdout:(62/133): openblas-0.3.21-2.el9.x86_64.rpm 469 kB/s | 35 kB 00:00 2024-08-17T02:22:18.216 INFO:teuthology.orchestra.run.smithi107.stdout:(63/133): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.9 MB/s | 292 kB 00:00 2024-08-17T02:22:18.325 INFO:teuthology.orchestra.run.smithi107.stdout:(64/133): openssl-devel-3.2.2-2.el9.x86_64.rpm 31 MB/s | 4.4 MB 00:00 2024-08-17T02:22:18.392 INFO:teuthology.orchestra.run.smithi107.stdout:(65/133): openblas-openmp-0.3.21-2.el9.x86_64.r 20 MB/s | 4.7 MB 00:00 2024-08-17T02:22:18.417 INFO:teuthology.orchestra.run.smithi107.stdout:(66/133): python3-devel-3.9.18-3.el9.x86_64.rpm 2.6 MB/s | 244 kB 00:00 2024-08-17T02:22:18.443 INFO:teuthology.orchestra.run.smithi107.stdout:(67/133): python3-jinja2-2.11.3-6.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-08-17T02:22:18.460 INFO:teuthology.orchestra.run.smithi107.stdout:(68/133): python3-jsonpatch-1.21-16.el9.noarch. 614 kB/s | 26 kB 00:00 2024-08-17T02:22:18.477 INFO:teuthology.orchestra.run.smithi107.stdout:(69/133): python3-jsonpointer-2.0-4.el9.noarch. 571 kB/s | 19 kB 00:00 2024-08-17T02:22:18.502 INFO:teuthology.orchestra.run.smithi107.stdout:(70/133): python3-mako-1.1.4-6.el9.noarch.rpm 4.0 MB/s | 172 kB 00:00 2024-08-17T02:22:18.527 INFO:teuthology.orchestra.run.smithi107.stdout:(71/133): python3-markupsafe-1.1.1-12.el9.x86_6 696 kB/s | 35 kB 00:00 2024-08-17T02:22:18.628 INFO:teuthology.orchestra.run.smithi107.stdout:(72/133): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-08-17T02:22:18.653 INFO:teuthology.orchestra.run.smithi107.stdout:(73/133): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.0 MB/s | 250 kB 00:00 2024-08-17T02:22:18.678 INFO:teuthology.orchestra.run.smithi107.stdout:(74/133): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-08-17T02:22:18.703 INFO:teuthology.orchestra.run.smithi107.stdout:(75/133): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-08-17T02:22:18.729 INFO:teuthology.orchestra.run.smithi107.stdout:(76/133): python3-prettytable-0.7.2-27.el9.noar 839 kB/s | 42 kB 00:00 2024-08-17T02:22:18.754 INFO:teuthology.orchestra.run.smithi107.stdout:(77/133): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-08-17T02:22:18.788 INFO:teuthology.orchestra.run.smithi107.stdout:(78/133): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-08-17T02:22:18.813 INFO:teuthology.orchestra.run.smithi107.stdout:(79/133): python3-pytz-2021.1-5.el9.noarch.rpm 871 kB/s | 51 kB 00:00 2024-08-17T02:22:18.838 INFO:teuthology.orchestra.run.smithi107.stdout:(80/133): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-08-17T02:22:18.922 INFO:teuthology.orchestra.run.smithi107.stdout:(81/133): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-08-17T02:22:18.956 INFO:teuthology.orchestra.run.smithi107.stdout:(82/133): python3-toml-0.10.2-6.el9.noarch.rpm 355 kB/s | 42 kB 00:00 2024-08-17T02:22:18.981 INFO:teuthology.orchestra.run.smithi107.stdout:(83/133): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-08-17T02:22:18.998 INFO:teuthology.orchestra.run.smithi107.stdout:(84/133): xfsprogs-devel-6.4.0-3.el9.x86_64.rpm 2.2 MB/s | 96 kB 00:00 2024-08-17T02:22:19.023 INFO:teuthology.orchestra.run.smithi107.stdout:(85/133): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-08-17T02:22:19.048 INFO:teuthology.orchestra.run.smithi107.stdout:(86/133): zlib-devel-1.2.11-41.el9.x86_64.rpm 894 kB/s | 45 kB 00:00 2024-08-17T02:22:19.140 INFO:teuthology.orchestra.run.smithi107.stdout:(87/133): liboath-2.6.7-2.el9.x86_64.rpm 531 kB/s | 49 kB 00:00 2024-08-17T02:22:19.166 INFO:teuthology.orchestra.run.smithi107.stdout:(88/133): gperftools-libs-2.9.1-2.el9.x86_64.rp 2.1 MB/s | 309 kB 00:00 2024-08-17T02:22:19.216 INFO:teuthology.orchestra.run.smithi107.stdout:(89/133): libunwind-1.6.2-1.el9.x86_64.rpm 898 kB/s | 67 kB 00:00 2024-08-17T02:22:19.241 INFO:teuthology.orchestra.run.smithi107.stdout:(90/133): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-08-17T02:22:19.266 INFO:teuthology.orchestra.run.smithi107.stdout:(91/133): python3-cachetools-4.2.4-1.el9.noarch 1.3 MB/s | 32 kB 00:00 2024-08-17T02:22:19.292 INFO:teuthology.orchestra.run.smithi107.stdout:(92/133): python3-certifi-2023.05.07-4.el9.noar 567 kB/s | 14 kB 00:00 2024-08-17T02:22:19.325 INFO:teuthology.orchestra.run.smithi107.stdout:(93/133): python3-asyncssh-2.13.2-5.el9.noarch. 3.4 MB/s | 548 kB 00:00 2024-08-17T02:22:19.351 INFO:teuthology.orchestra.run.smithi107.stdout:(94/133): python3-cheroot-8.6.0-4.el9.noarch.rp 2.9 MB/s | 172 kB 00:00 2024-08-17T02:22:19.384 INFO:teuthology.orchestra.run.smithi107.stdout:(95/133): python3-cherrypy-18.6.1-2.el9.noarch. 6.0 MB/s | 358 kB 00:00 2024-08-17T02:22:19.410 INFO:teuthology.orchestra.run.smithi107.stdout:(96/133): python3-jaraco-8.2.1-3.el9.noarch.rpm 425 kB/s | 11 kB 00:00 2024-08-17T02:22:19.435 INFO:teuthology.orchestra.run.smithi107.stdout:(97/133): python3-jaraco-classes-3.2.1-5.el9.no 716 kB/s | 18 kB 00:00 2024-08-17T02:22:19.460 INFO:teuthology.orchestra.run.smithi107.stdout:(98/133): python3-google-auth-2.33.0-1.el9.noar 2.0 MB/s | 220 kB 00:00 2024-08-17T02:22:19.486 INFO:teuthology.orchestra.run.smithi107.stdout:(99/133): python3-jaraco-collections-3.0.0-8.el 459 kB/s | 23 kB 00:00 2024-08-17T02:22:19.511 INFO:teuthology.orchestra.run.smithi107.stdout:(100/133): python3-jaraco-functools-3.5.0-2.el9 385 kB/s | 19 kB 00:00 2024-08-17T02:22:19.538 INFO:teuthology.orchestra.run.smithi107.stdout:(101/133): python3-jaraco-text-3.2.0-6.el9.noar 394 kB/s | 20 kB 00:00 2024-08-17T02:22:19.562 INFO:teuthology.orchestra.run.smithi107.stdout:(102/133): python3-jwt+crypto-2.4.0-1.el9.noarc 180 kB/s | 9.0 kB 00:00 2024-08-17T02:22:19.587 INFO:teuthology.orchestra.run.smithi107.stdout:(103/133): python3-jwt-2.4.0-1.el9.noarch.rpm 810 kB/s | 41 kB 00:00 2024-08-17T02:22:19.612 INFO:teuthology.orchestra.run.smithi107.stdout:(104/133): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-17T02:22:19.637 INFO:teuthology.orchestra.run.smithi107.stdout:(105/133): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-17T02:22:19.654 INFO:teuthology.orchestra.run.smithi107.stdout:(106/133): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-08-17T02:22:19.688 INFO:teuthology.orchestra.run.smithi107.stdout:(107/133): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-08-17T02:22:19.705 INFO:teuthology.orchestra.run.smithi107.stdout:(108/133): python3-portend-3.1.0-2.el9.noarch.r 989 kB/s | 16 kB 00:00 2024-08-17T02:22:19.730 INFO:teuthology.orchestra.run.smithi107.stdout:(109/133): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-08-17T02:22:19.767 INFO:teuthology.orchestra.run.smithi157.stdout:(10/133): ceph-common-17.2.7-1375.g2577e813.el9 3.7 MB/s | 22 MB 00:06 2024-08-17T02:22:19.772 INFO:teuthology.orchestra.run.smithi107.stdout:(110/133): python3-kubernetes-26.1.0-2.el9.noar 4.9 MB/s | 1.0 MB 00:00 2024-08-17T02:22:19.798 INFO:teuthology.orchestra.run.smithi107.stdout:(111/133): python3-repoze-lru-0.7-16.el9.noarch 455 kB/s | 31 kB 00:00 2024-08-17T02:22:19.823 INFO:teuthology.orchestra.run.smithi107.stdout:(112/133): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-08-17T02:22:19.848 INFO:teuthology.orchestra.run.smithi107.stdout:(113/133): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-08-17T02:22:19.873 INFO:teuthology.orchestra.run.smithi107.stdout:(114/133): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-08-17T02:22:19.892 INFO:teuthology.orchestra.run.smithi157.stdout:(11/133): cephfs-mirror-17.2.7-1375.g2577e813.e 1.7 MB/s | 215 kB 00:00 2024-08-17T02:22:19.899 INFO:teuthology.orchestra.run.smithi107.stdout:(115/133): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-08-17T02:22:19.924 INFO:teuthology.orchestra.run.smithi107.stdout:(116/133): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-08-17T02:22:19.950 INFO:teuthology.orchestra.run.smithi107.stdout:(117/133): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-08-17T02:22:19.975 INFO:teuthology.orchestra.run.smithi107.stdout:(118/133): python3-zc-lockfile-2.0-10.el9.noarc 797 kB/s | 20 kB 00:00 2024-08-17T02:22:19.975 INFO:teuthology.orchestra.run.smithi157.stdout:(12/133): libcephfs-devel-17.2.7-1375.g2577e813 299 kB/s | 25 kB 00:00 2024-08-17T02:22:20.017 INFO:teuthology.orchestra.run.smithi107.stdout:(119/133): python3-werkzeug-2.0.3-3.el9.1.noarc 4.5 MB/s | 427 kB 00:00 2024-08-17T02:22:20.075 INFO:teuthology.orchestra.run.smithi107.stdout:(120/133): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-08-17T02:22:20.289 INFO:teuthology.orchestra.run.smithi107.stdout:(121/133): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-08-17T02:22:20.334 INFO:teuthology.orchestra.run.smithi157.stdout:(13/133): libcephfs2-17.2.7-1375.g2577e813.el9. 1.7 MB/s | 636 kB 00:00 2024-08-17T02:22:20.401 INFO:teuthology.orchestra.run.smithi107.stdout:(122/133): NetworkManager-1.48.2-2.el9.x86_64.r 21 MB/s | 2.3 MB 00:00 2024-08-17T02:22:20.476 INFO:teuthology.orchestra.run.smithi107.stdout:(123/133): NetworkManager-libnm-1.48.2-2.el9.x8 24 MB/s | 1.8 MB 00:00 2024-08-17T02:22:20.493 INFO:teuthology.orchestra.run.smithi157.stdout:(14/133): ceph-osd-17.2.7-1375.g2577e813.el9.x8 3.0 MB/s | 15 MB 00:05 2024-08-17T02:22:20.518 INFO:teuthology.orchestra.run.smithi157.stdout:(15/133): libcephsqlite-17.2.7-1375.g2577e813.e 888 kB/s | 163 kB 00:00 2024-08-17T02:22:20.535 INFO:teuthology.orchestra.run.smithi107.stdout:(124/133): NetworkManager-team-1.48.2-2.el9.x86 703 kB/s | 41 kB 00:00 2024-08-17T02:22:20.570 INFO:teuthology.orchestra.run.smithi157.stdout:(16/133): librados-devel-17.2.7-1375.g2577e813. 1.6 MB/s | 126 kB 00:00 2024-08-17T02:22:20.593 INFO:teuthology.orchestra.run.smithi107.stdout:(125/133): NetworkManager-tui-1.48.2-2.el9.x86_ 4.1 MB/s | 247 kB 00:00 2024-08-17T02:22:20.652 INFO:teuthology.orchestra.run.smithi107.stdout:(126/133): elfutils-debuginfod-client-0.191-4.e 633 kB/s | 37 kB 00:00 2024-08-17T02:22:20.702 INFO:teuthology.orchestra.run.smithi107.stdout:(127/133): elfutils-libelf-0.191-4.el9.x86_64.r 4.1 MB/s | 207 kB 00:00 2024-08-17T02:22:20.761 INFO:teuthology.orchestra.run.smithi107.stdout:(128/133): librados2-17.2.7-1375.g2577e813.el9. 4.1 MB/s | 3.1 MB 00:00 2024-08-17T02:22:20.777 INFO:teuthology.orchestra.run.smithi157.stdout:(17/133): libradosstriper1-17.2.7-1375.g2577e81 1.7 MB/s | 458 kB 00:00 2024-08-17T02:22:20.786 INFO:teuthology.orchestra.run.smithi107.stdout:(129/133): elfutils-libs-0.191-4.el9.x86_64.rpm 3.0 MB/s | 260 kB 00:00 2024-08-17T02:22:20.845 INFO:teuthology.orchestra.run.smithi107.stdout:(130/133): librbd1-17.2.7-1375.g2577e813.el9.x8 3.8 MB/s | 2.9 MB 00:00 2024-08-17T02:22:20.852 INFO:teuthology.orchestra.run.smithi157.stdout:(18/133): python3-ceph-argparse-17.2.7-1375.g25 601 kB/s | 45 kB 00:00 2024-08-17T02:22:20.887 INFO:teuthology.orchestra.run.smithi107.stdout:(131/133): openssl-3.2.2-2.el9.x86_64.rpm 11 MB/s | 1.4 MB 00:00 2024-08-17T02:22:20.919 INFO:teuthology.orchestra.run.smithi157.stdout:(19/133): python3-ceph-common-17.2.7-1375.g2577 1.8 MB/s | 120 kB 00:00 2024-08-17T02:22:20.937 INFO:teuthology.orchestra.run.smithi107.stdout:(132/133): openssl-libs-3.2.2-2.el9.x86_64.rpm 16 MB/s | 2.4 MB 00:00 2024-08-17T02:22:21.012 INFO:teuthology.orchestra.run.smithi107.stdout:(133/133): xfsprogs-6.4.0-3.el9.x86_64.rpm 6.5 MB/s | 1.1 MB 00:00 2024-08-17T02:22:21.016 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:22:21.017 INFO:teuthology.orchestra.run.smithi107.stdout:Total 24 MB/s | 206 MB 00:08 2024-08-17T02:22:21.036 INFO:teuthology.orchestra.run.smithi157.stdout:(20/133): python3-cephfs-17.2.7-1375.g2577e813. 1.5 MB/s | 182 kB 00:00 2024-08-17T02:22:21.186 INFO:teuthology.orchestra.run.smithi157.stdout:(21/133): python3-rados-17.2.7-1375.g2577e813.e 2.4 MB/s | 369 kB 00:00 2024-08-17T02:22:21.353 INFO:teuthology.orchestra.run.smithi157.stdout:(22/133): python3-rbd-17.2.7-1375.g2577e813.el9 2.0 MB/s | 344 kB 00:00 2024-08-17T02:22:21.411 INFO:teuthology.orchestra.run.smithi157.stdout:(23/133): python3-rgw-17.2.7-1375.g2577e813.el9 1.9 MB/s | 116 kB 00:00 2024-08-17T02:22:21.462 INFO:teuthology.orchestra.run.smithi157.stdout:(24/133): rbd-fuse-17.2.7-1375.g2577e813.el9.x8 1.6 MB/s | 82 kB 00:00 2024-08-17T02:22:21.730 INFO:teuthology.orchestra.run.smithi157.stdout:(25/133): librgw2-17.2.7-1375.g2577e813.el9.x86 4.2 MB/s | 4.9 MB 00:01 2024-08-17T02:22:21.779 INFO:teuthology.orchestra.run.smithi157.stdout:(26/133): rbd-nbd-17.2.7-1375.g2577e813.el9.x86 3.3 MB/s | 165 kB 00:00 2024-08-17T02:22:21.850 INFO:teuthology.orchestra.run.smithi157.stdout:(27/133): ceph-grafana-dashboards-17.2.7-1375.g 345 kB/s | 24 kB 00:00 2024-08-17T02:22:21.896 INFO:teuthology.orchestra.run.smithi157.stdout:(28/133): ceph-mgr-cephadm-17.2.7-1375.g2577e81 2.6 MB/s | 124 kB 00:00 2024-08-17T02:22:22.113 INFO:teuthology.orchestra.run.smithi157.stdout:(29/133): rbd-mirror-17.2.7-1375.g2577e813.el9. 4.5 MB/s | 2.9 MB 00:00 2024-08-17T02:22:22.589 INFO:teuthology.orchestra.run.smithi157.stdout:(30/133): ceph-mgr-dashboard-17.2.7-1375.g2577e 4.8 MB/s | 3.4 MB 00:00 2024-08-17T02:22:22.656 INFO:teuthology.orchestra.run.smithi157.stdout:(31/133): ceph-mgr-modules-core-17.2.7-1375.g25 3.5 MB/s | 240 kB 00:00 2024-08-17T02:22:22.706 INFO:teuthology.orchestra.run.smithi157.stdout:(32/133): ceph-mgr-rook-17.2.7-1375.g2577e813.e 953 kB/s | 47 kB 00:00 2024-08-17T02:22:22.708 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-08-17T02:22:22.756 INFO:teuthology.orchestra.run.smithi157.stdout:(33/133): ceph-prometheus-alerts-17.2.7-1375.g2 292 kB/s | 15 kB 00:00 2024-08-17T02:22:22.823 INFO:teuthology.orchestra.run.smithi157.stdout:(34/133): ceph-volume-17.2.7-1375.g2577e813.el9 4.0 MB/s | 269 kB 00:00 2024-08-17T02:22:22.890 INFO:teuthology.orchestra.run.smithi157.stdout:(35/133): cephadm-17.2.7-1375.g2577e813.el9.noa 1.2 MB/s | 83 kB 00:00 2024-08-17T02:22:22.917 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-08-17T02:22:22.917 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-08-17T02:22:22.948 INFO:teuthology.orchestra.run.smithi157.stdout:(36/133): cephfs-top-17.2.7-1375.g2577e813.el9. 312 kB/s | 18 kB 00:00 2024-08-17T02:22:23.099 INFO:teuthology.orchestra.run.smithi157.stdout:(37/133): fuse-2.9.9-16.el9.x86_64.rpm 532 kB/s | 80 kB 00:00 2024-08-17T02:22:23.274 INFO:teuthology.orchestra.run.smithi157.stdout:(38/133): libgfortran-11.4.1-3.el9.x86_64.rpm 4.5 MB/s | 803 kB 00:00 2024-08-17T02:22:23.383 INFO:teuthology.orchestra.run.smithi157.stdout:(39/133): libquadmath-11.4.1-3.el9.x86_64.rpm 1.8 MB/s | 195 kB 00:00 2024-08-17T02:22:23.467 INFO:teuthology.orchestra.run.smithi157.stdout:(40/133): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-08-17T02:22:23.750 INFO:teuthology.orchestra.run.smithi157.stdout:(41/133): python3-cryptography-36.0.1-4.el9.x86 4.3 MB/s | 1.2 MB 00:00 2024-08-17T02:22:23.809 INFO:teuthology.orchestra.run.smithi157.stdout:(42/133): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-08-17T02:22:23.868 INFO:teuthology.orchestra.run.smithi157.stdout:(43/133): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-08-17T02:22:23.926 INFO:teuthology.orchestra.run.smithi157.stdout:(44/133): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-08-17T02:22:24.010 INFO:teuthology.orchestra.run.smithi157.stdout:(45/133): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-08-17T02:22:24.219 INFO:teuthology.orchestra.run.smithi157.stdout:(46/133): ceph-mgr-diskprediction-local-17.2.7- 3.5 MB/s | 7.4 MB 00:02 2024-08-17T02:22:24.244 INFO:teuthology.orchestra.run.smithi157.stdout:(47/133): automake-1.16.2-8.el9.noarch.rpm 2.9 MB/s | 689 kB 00:00 2024-08-17T02:22:24.294 INFO:teuthology.orchestra.run.smithi157.stdout:(48/133): elfutils-libelf-devel-0.191-4.el9.x86 436 kB/s | 22 kB 00:00 2024-08-17T02:22:24.911 INFO:teuthology.orchestra.run.smithi157.stdout:(49/133): ceph-test-17.2.7-1375.g2577e813.el9.x 6.3 MB/s | 48 MB 00:07 2024-08-17T02:22:24.936 INFO:teuthology.orchestra.run.smithi157.stdout:(50/133): flex-2.6.4-9.el9.x86_64.rpm 488 kB/s | 313 kB 00:00 2024-08-17T02:22:24.979 INFO:teuthology.orchestra.run.smithi157.stdout:(51/133): bison-3.7.4-5.el9.x86_64.rpm 1.2 MB/s | 943 kB 00:00 2024-08-17T02:22:24.988 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-08-17T02:22:24.989 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-08-17T02:22:25.029 INFO:teuthology.orchestra.run.smithi157.stdout:(52/133): flexiblas-openblas-openmp-3.0.4-8.el9 369 kB/s | 18 kB 00:00 2024-08-17T02:22:25.062 INFO:teuthology.orchestra.run.smithi157.stdout:(53/133): flexiblas-3.0.4-8.el9.x86_64.rpm 217 kB/s | 33 kB 00:00 2024-08-17T02:22:25.089 INFO:teuthology.orchestra.run.smithi157.stdout:(54/133): libaio-devel-0.3.111-13.el9.x86_64.rp 190 kB/s | 11 kB 00:00 2024-08-17T02:22:25.121 INFO:teuthology.orchestra.run.smithi157.stdout:(55/133): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-08-17T02:22:25.146 INFO:teuthology.orchestra.run.smithi157.stdout:(56/133): librabbitmq-0.11.0-7.el9.x86_64.rpm 775 kB/s | 45 kB 00:00 2024-08-17T02:22:25.213 INFO:teuthology.orchestra.run.smithi157.stdout:(57/133): librdkafka-1.6.1-102.el9.x86_64.rpm 7.1 MB/s | 662 kB 00:00 2024-08-17T02:22:25.264 INFO:teuthology.orchestra.run.smithi157.stdout:(58/133): libuuid-devel-2.37.4-18.el9.x86_64.rp 509 kB/s | 25 kB 00:00 2024-08-17T02:22:25.306 INFO:teuthology.orchestra.run.smithi157.stdout:(59/133): libtool-2.4.6-46.el9.x86_64.rpm 3.6 MB/s | 581 kB 00:00 2024-08-17T02:22:25.331 INFO:teuthology.orchestra.run.smithi157.stdout:(60/133): libzstd-devel-1.5.1-2.el9.x86_64.rpm 712 kB/s | 47 kB 00:00 2024-08-17T02:22:25.364 INFO:teuthology.orchestra.run.smithi157.stdout:(61/133): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-08-17T02:22:25.390 INFO:teuthology.orchestra.run.smithi157.stdout:(62/133): openblas-0.3.21-2.el9.x86_64.rpm 601 kB/s | 35 kB 00:00 2024-08-17T02:22:25.591 INFO:teuthology.orchestra.run.smithi157.stdout:(63/133): openblas-openmp-0.3.21-2.el9.x86_64.r 21 MB/s | 4.7 MB 00:00 2024-08-17T02:22:25.682 INFO:teuthology.orchestra.run.smithi157.stdout:(64/133): openssl-devel-3.2.2-2.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-08-17T02:22:25.741 INFO:teuthology.orchestra.run.smithi157.stdout:(65/133): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.7 MB/s | 3.0 MB 00:00 2024-08-17T02:22:25.766 INFO:teuthology.orchestra.run.smithi157.stdout:(66/133): python3-devel-3.9.18-3.el9.x86_64.rpm 2.9 MB/s | 244 kB 00:00 2024-08-17T02:22:25.825 INFO:teuthology.orchestra.run.smithi157.stdout:(67/133): python3-jsonpatch-1.21-16.el9.noarch. 439 kB/s | 26 kB 00:00 2024-08-17T02:22:25.850 INFO:teuthology.orchestra.run.smithi157.stdout:(68/133): python3-jinja2-2.11.3-6.el9.noarch.rp 2.2 MB/s | 248 kB 00:00 2024-08-17T02:22:25.875 INFO:teuthology.orchestra.run.smithi157.stdout:(69/133): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-08-17T02:22:25.976 INFO:teuthology.orchestra.run.smithi157.stdout:(70/133): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-08-17T02:22:26.001 INFO:teuthology.orchestra.run.smithi157.stdout:(71/133): python3-markupsafe-1.1.1-12.el9.x86_6 278 kB/s | 35 kB 00:00 2024-08-17T02:22:26.026 INFO:teuthology.orchestra.run.smithi157.stdout:(72/133): python3-mako-1.1.4-6.el9.noarch.rpm 980 kB/s | 172 kB 00:00 2024-08-17T02:22:26.068 INFO:teuthology.orchestra.run.smithi157.stdout:(73/133): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-08-17T02:22:26.143 INFO:teuthology.orchestra.run.smithi157.stdout:(74/133): python3-numpy-1.20.1-5.el9.x86_64.rpm 31 MB/s | 5.1 MB 00:00 2024-08-17T02:22:26.169 INFO:teuthology.orchestra.run.smithi157.stdout:(75/133): python3-oauthlib-3.1.1-5.el9.noarch.r 1.5 MB/s | 222 kB 00:00 2024-08-17T02:22:26.185 INFO:teuthology.orchestra.run.smithi157.stdout:(76/133): python3-packaging-20.9-5.el9.noarch.r 659 kB/s | 77 kB 00:00 2024-08-17T02:22:26.211 INFO:teuthology.orchestra.run.smithi157.stdout:(77/133): python3-prettytable-0.7.2-27.el9.noar 630 kB/s | 42 kB 00:00 2024-08-17T02:22:26.236 INFO:teuthology.orchestra.run.smithi157.stdout:(78/133): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-08-17T02:22:26.261 INFO:teuthology.orchestra.run.smithi157.stdout:(79/133): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-08-17T02:22:26.286 INFO:teuthology.orchestra.run.smithi157.stdout:(80/133): python3-pytz-2021.1-5.el9.noarch.rpm 676 kB/s | 51 kB 00:00 2024-08-17T02:22:26.312 INFO:teuthology.orchestra.run.smithi157.stdout:(81/133): python3-requests-oauthlib-1.3.0-12.el 710 kB/s | 54 kB 00:00 2024-08-17T02:22:26.362 INFO:teuthology.orchestra.run.smithi157.stdout:(82/133): python3-toml-0.10.2-6.el9.noarch.rpm 552 kB/s | 42 kB 00:00 2024-08-17T02:22:26.454 INFO:teuthology.orchestra.run.smithi157.stdout:(83/133): socat-1.7.4.1-6.el9.x86_64.rpm 2.1 MB/s | 304 kB 00:00 2024-08-17T02:22:26.479 INFO:teuthology.orchestra.run.smithi157.stdout:(84/133): xfsprogs-devel-6.4.0-3.el9.x86_64.rpm 821 kB/s | 96 kB 00:00 2024-08-17T02:22:26.505 INFO:teuthology.orchestra.run.smithi157.stdout:(85/133): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-08-17T02:22:26.563 INFO:teuthology.orchestra.run.smithi157.stdout:(86/133): zlib-devel-1.2.11-41.el9.x86_64.rpm 536 kB/s | 45 kB 00:00 2024-08-17T02:22:26.622 INFO:teuthology.orchestra.run.smithi157.stdout:(87/133): gperftools-libs-2.9.1-2.el9.x86_64.rp 2.6 MB/s | 309 kB 00:00 2024-08-17T02:22:26.647 INFO:teuthology.orchestra.run.smithi157.stdout:(88/133): libunwind-1.6.2-1.el9.x86_64.rpm 2.9 MB/s | 67 kB 00:00 2024-08-17T02:22:26.672 INFO:teuthology.orchestra.run.smithi157.stdout:(89/133): liboath-2.6.7-2.el9.x86_64.rpm 456 kB/s | 49 kB 00:00 2024-08-17T02:22:26.698 INFO:teuthology.orchestra.run.smithi157.stdout:(90/133): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-08-17T02:22:26.723 INFO:teuthology.orchestra.run.smithi157.stdout:(91/133): python3-cachetools-4.2.4-1.el9.noarch 1.3 MB/s | 32 kB 00:00 2024-08-17T02:22:26.748 INFO:teuthology.orchestra.run.smithi157.stdout:(92/133): python3-certifi-2023.05.07-4.el9.noar 569 kB/s | 14 kB 00:00 2024-08-17T02:22:26.782 INFO:teuthology.orchestra.run.smithi157.stdout:(93/133): python3-asyncssh-2.13.2-5.el9.noarch. 4.0 MB/s | 548 kB 00:00 2024-08-17T02:22:26.808 INFO:teuthology.orchestra.run.smithi157.stdout:(94/133): python3-cheroot-8.6.0-4.el9.noarch.rp 2.9 MB/s | 172 kB 00:00 2024-08-17T02:22:26.850 INFO:teuthology.orchestra.run.smithi157.stdout:(95/133): python3-cherrypy-18.6.1-2.el9.noarch. 8.5 MB/s | 358 kB 00:00 2024-08-17T02:22:26.875 INFO:teuthology.orchestra.run.smithi157.stdout:(96/133): python3-google-auth-2.33.0-1.el9.noar 3.2 MB/s | 220 kB 00:00 2024-08-17T02:22:26.900 INFO:teuthology.orchestra.run.smithi157.stdout:(97/133): python3-jaraco-8.2.1-3.el9.noarch.rpm 213 kB/s | 11 kB 00:00 2024-08-17T02:22:26.956 INFO:teuthology.orchestra.run.smithi157.stdout:(98/133): python3-jaraco-classes-3.2.1-5.el9.no 218 kB/s | 18 kB 00:00 2024-08-17T02:22:26.984 INFO:teuthology.orchestra.run.smithi157.stdout:(99/133): python3-jaraco-collections-3.0.0-8.el 277 kB/s | 23 kB 00:00 2024-08-17T02:22:27.009 INFO:teuthology.orchestra.run.smithi157.stdout:(100/133): python3-jaraco-functools-3.5.0-2.el9 368 kB/s | 19 kB 00:00 2024-08-17T02:22:27.034 INFO:teuthology.orchestra.run.smithi157.stdout:(101/133): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-08-17T02:22:27.061 INFO:teuthology.orchestra.run.smithi157.stdout:(102/133): python3-jwt+crypto-2.4.0-1.el9.noarc 179 kB/s | 9.0 kB 00:00 2024-08-17T02:22:27.085 INFO:teuthology.orchestra.run.smithi157.stdout:(103/133): python3-jwt-2.4.0-1.el9.noarch.rpm 818 kB/s | 41 kB 00:00 2024-08-17T02:22:27.110 INFO:teuthology.orchestra.run.smithi157.stdout:(104/133): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-17T02:22:27.136 INFO:teuthology.orchestra.run.smithi157.stdout:(105/133): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-17T02:22:27.161 INFO:teuthology.orchestra.run.smithi157.stdout:(106/133): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-08-17T02:22:27.195 INFO:teuthology.orchestra.run.smithi157.stdout:(107/133): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-08-17T02:22:27.220 INFO:teuthology.orchestra.run.smithi157.stdout:(108/133): python3-portend-3.1.0-2.el9.noarch.r 666 kB/s | 16 kB 00:00 2024-08-17T02:22:27.246 INFO:teuthology.orchestra.run.smithi157.stdout:(109/133): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-08-17T02:22:27.271 INFO:teuthology.orchestra.run.smithi157.stdout:(110/133): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-08-17T02:22:27.304 INFO:teuthology.orchestra.run.smithi157.stdout:(111/133): python3-kubernetes-26.1.0-2.el9.noar 4.2 MB/s | 1.0 MB 00:00 2024-08-17T02:22:27.329 INFO:teuthology.orchestra.run.smithi157.stdout:(112/133): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-08-17T02:22:27.355 INFO:teuthology.orchestra.run.smithi157.stdout:(113/133): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-08-17T02:22:27.380 INFO:teuthology.orchestra.run.smithi157.stdout:(114/133): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-08-17T02:22:27.405 INFO:teuthology.orchestra.run.smithi157.stdout:(115/133): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-08-17T02:22:27.459 INFO:teuthology.orchestra.run.smithi157.stdout:(116/133): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-08-17T02:22:27.489 INFO:teuthology.orchestra.run.smithi157.stdout:(117/133): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-08-17T02:22:27.515 INFO:teuthology.orchestra.run.smithi157.stdout:(118/133): python3-zc-lockfile-2.0-10.el9.noarc 801 kB/s | 20 kB 00:00 2024-08-17T02:22:27.548 INFO:teuthology.orchestra.run.smithi157.stdout:(119/133): python3-werkzeug-2.0.3-3.el9.1.noarc 4.7 MB/s | 427 kB 00:00 2024-08-17T02:22:27.724 INFO:teuthology.orchestra.run.smithi157.stdout:(120/133): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-08-17T02:22:27.774 INFO:teuthology.orchestra.run.smithi157.stdout:(121/133): thrift-0.15.0-2.el9.x86_64.rpm 6.1 MB/s | 1.6 MB 00:00 2024-08-17T02:22:28.274 INFO:teuthology.orchestra.run.smithi157.stdout:(122/133): NetworkManager-1.48.2-2.el9.x86_64.r 4.6 MB/s | 2.3 MB 00:00 2024-08-17T02:22:28.325 INFO:teuthology.orchestra.run.smithi157.stdout:(123/133): librbd1-17.2.7-1375.g2577e813.el9.x8 4.9 MB/s | 2.9 MB 00:00 2024-08-17T02:22:28.383 INFO:teuthology.orchestra.run.smithi157.stdout:(124/133): NetworkManager-team-1.48.2-2.el9.x86 702 kB/s | 41 kB 00:00 2024-08-17T02:22:28.434 INFO:teuthology.orchestra.run.smithi157.stdout:(125/133): librados2-17.2.7-1375.g2577e813.el9. 3.5 MB/s | 3.1 MB 00:00 2024-08-17T02:22:28.459 INFO:teuthology.orchestra.run.smithi157.stdout:(126/133): NetworkManager-tui-1.48.2-2.el9.x86_ 3.2 MB/s | 247 kB 00:00 2024-08-17T02:22:28.509 INFO:teuthology.orchestra.run.smithi157.stdout:(127/133): elfutils-debuginfod-client-0.191-4.e 489 kB/s | 37 kB 00:00 2024-08-17T02:22:28.534 INFO:teuthology.orchestra.run.smithi157.stdout:(128/133): elfutils-libelf-0.191-4.el9.x86_64.r 2.7 MB/s | 207 kB 00:00 2024-08-17T02:22:28.577 INFO:teuthology.orchestra.run.smithi157.stdout:(129/133): NetworkManager-libnm-1.48.2-2.el9.x8 6.0 MB/s | 1.8 MB 00:00 2024-08-17T02:22:28.627 INFO:teuthology.orchestra.run.smithi157.stdout:(130/133): elfutils-libs-0.191-4.el9.x86_64.rpm 2.2 MB/s | 260 kB 00:00 2024-08-17T02:22:28.669 INFO:teuthology.orchestra.run.smithi157.stdout:(131/133): openssl-3.2.2-2.el9.x86_64.rpm 10 MB/s | 1.4 MB 00:00 2024-08-17T02:22:28.769 INFO:teuthology.orchestra.run.smithi157.stdout:(132/133): xfsprogs-6.4.0-3.el9.x86_64.rpm 7.6 MB/s | 1.1 MB 00:00 2024-08-17T02:22:28.936 INFO:teuthology.orchestra.run.smithi157.stdout:(133/133): openssl-libs-3.2.2-2.el9.x86_64.rpm 6.7 MB/s | 2.4 MB 00:00 2024-08-17T02:22:28.941 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:22:28.941 INFO:teuthology.orchestra.run.smithi157.stdout:Total 13 MB/s | 206 MB 00:15 2024-08-17T02:22:30.589 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-08-17T02:22:30.651 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-08-17T02:22:30.684 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/145 2024-08-17T02:22:30.743 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/145 2024-08-17T02:22:30.861 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-08-17T02:22:30.861 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-08-17T02:22:30.982 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/145 2024-08-17T02:22:31.027 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/145 2024-08-17T02:22:31.059 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/145 2024-08-17T02:22:31.121 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/145 2024-08-17T02:22:31.471 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/145 2024-08-17T02:22:31.576 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:22:31.712 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:22:31.744 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:22:31.863 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:22:32.331 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:22:32.362 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:22:32.463 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:22:32.538 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/145 2024-08-17T02:22:32.564 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:22:32.686 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:22:32.715 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:22:32.878 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:22:32.969 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-08-17T02:22:32.970 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-08-17T02:22:33.166 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 15/145 2024-08-17T02:22:33.371 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:22:33.449 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:22:33.557 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:22:33.665 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:22:34.039 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:22:34.080 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/145 2024-08-17T02:22:34.126 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/145 2024-08-17T02:22:34.207 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/145 2024-08-17T02:22:34.258 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/145 2024-08-17T02:22:34.292 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/145 2024-08-17T02:22:34.381 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 23/145 2024-08-17T02:22:34.451 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 24/145 2024-08-17T02:22:34.511 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 25/145 2024-08-17T02:22:34.558 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 26/145 2024-08-17T02:22:34.637 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 27/145 2024-08-17T02:22:34.673 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 28/145 2024-08-17T02:22:34.719 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 29/145 2024-08-17T02:22:34.804 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 30/145 2024-08-17T02:22:34.966 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/145 2024-08-17T02:22:35.032 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/145 2024-08-17T02:22:35.681 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/145 2024-08-17T02:22:35.776 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 34/145 2024-08-17T02:22:35.817 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 35/145 2024-08-17T02:22:35.871 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 36/145 2024-08-17T02:22:36.015 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 37/145 2024-08-17T02:22:36.053 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 38/145 2024-08-17T02:22:36.106 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/145 2024-08-17T02:22:36.145 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 40/145 2024-08-17T02:22:36.205 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/145 2024-08-17T02:22:36.290 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/145 2024-08-17T02:22:36.337 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 43/145 2024-08-17T02:22:36.373 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/145 2024-08-17T02:22:36.432 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/145 2024-08-17T02:22:36.484 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/145 2024-08-17T02:22:36.543 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/145 2024-08-17T02:22:36.715 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/145 2024-08-17T02:22:36.768 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/145 2024-08-17T02:22:36.810 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/145 2024-08-17T02:22:36.928 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/145 2024-08-17T02:22:36.967 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 52/145 2024-08-17T02:22:37.015 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/145 2024-08-17T02:22:37.049 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 54/145 2024-08-17T02:22:37.077 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 55/145 2024-08-17T02:22:37.115 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 56/145 2024-08-17T02:22:37.153 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 57/145 2024-08-17T02:22:37.187 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 58/145 2024-08-17T02:22:37.220 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 59/145 2024-08-17T02:22:37.272 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 60/145 2024-08-17T02:22:37.305 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 61/145 2024-08-17T02:22:37.340 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 62/145 2024-08-17T02:22:37.390 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 63/145 2024-08-17T02:22:37.513 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-packaging-20.9-5.el9.noarch 64/145 2024-08-17T02:22:37.578 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 65/145 2024-08-17T02:22:38.474 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 66/145 2024-08-17T02:22:38.530 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 67/145 2024-08-17T02:22:38.563 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 68/145 2024-08-17T02:22:38.680 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:22:38.730 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 70/145 2024-08-17T02:22:38.779 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-08-17T02:22:38.874 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/145 2024-08-17T02:22:38.928 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/145 2024-08-17T02:22:38.958 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openblas-0.3.21-2.el9.x86_64 71/145 2024-08-17T02:22:38.994 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 72/145 2024-08-17T02:22:38.999 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/145 2024-08-17T02:22:39.042 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/145 2024-08-17T02:22:39.074 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/145 2024-08-17T02:22:39.088 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 73/145 2024-08-17T02:22:39.134 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/145 2024-08-17T02:22:39.476 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/145 2024-08-17T02:22:39.583 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:22:39.719 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:22:39.776 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:22:39.885 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:22:39.888 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 74/145 2024-08-17T02:22:40.040 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 75/145 2024-08-17T02:22:40.358 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:22:40.386 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:22:40.490 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:22:40.561 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/145 2024-08-17T02:22:40.588 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:22:40.701 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:22:40.733 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:22:40.893 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:22:41.169 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 15/145 2024-08-17T02:22:41.375 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:22:41.450 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:22:41.559 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:22:41.637 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 76/145 2024-08-17T02:22:41.668 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:22:41.731 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 77/145 2024-08-17T02:22:41.767 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 78/145 2024-08-17T02:22:41.800 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 79/145 2024-08-17T02:22:42.051 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:22:42.106 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/145 2024-08-17T02:22:42.120 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 80/145 2024-08-17T02:22:42.150 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/145 2024-08-17T02:22:42.161 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:22:42.232 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/145 2024-08-17T02:22:42.275 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/145 2024-08-17T02:22:42.293 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:22:42.309 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/145 2024-08-17T02:22:42.321 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 82/145 2024-08-17T02:22:42.405 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 23/145 2024-08-17T02:22:42.468 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 24/145 2024-08-17T02:22:42.505 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 25/145 2024-08-17T02:22:42.551 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 26/145 2024-08-17T02:22:42.638 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 27/145 2024-08-17T02:22:42.675 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 28/145 2024-08-17T02:22:42.712 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 29/145 2024-08-17T02:22:42.787 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 30/145 2024-08-17T02:22:42.950 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/145 2024-08-17T02:22:43.018 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/145 2024-08-17T02:22:43.678 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/145 2024-08-17T02:22:43.785 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 34/145 2024-08-17T02:22:43.866 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 35/145 2024-08-17T02:22:43.942 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 36/145 2024-08-17T02:22:43.991 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 37/145 2024-08-17T02:22:44.029 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 38/145 2024-08-17T02:22:44.316 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/145 2024-08-17T02:22:44.354 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 40/145 2024-08-17T02:22:44.413 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/145 2024-08-17T02:22:44.515 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/145 2024-08-17T02:22:44.563 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 43/145 2024-08-17T02:22:44.599 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/145 2024-08-17T02:22:44.657 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/145 2024-08-17T02:22:44.701 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/145 2024-08-17T02:22:44.752 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/145 2024-08-17T02:22:44.921 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/145 2024-08-17T02:22:44.924 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:22:44.967 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:22:44.977 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/145 2024-08-17T02:22:45.020 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/145 2024-08-17T02:22:45.135 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/145 2024-08-17T02:22:45.178 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 52/145 2024-08-17T02:22:45.228 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/145 2024-08-17T02:22:45.260 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 54/145 2024-08-17T02:22:45.296 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 55/145 2024-08-17T02:22:45.334 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 56/145 2024-08-17T02:22:45.374 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 57/145 2024-08-17T02:22:45.406 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 58/145 2024-08-17T02:22:45.461 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 59/145 2024-08-17T02:22:45.508 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 60/145 2024-08-17T02:22:45.541 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 61/145 2024-08-17T02:22:45.561 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:22:45.576 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 62/145 2024-08-17T02:22:45.627 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 63/145 2024-08-17T02:22:45.653 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:22:45.747 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-packaging-20.9-5.el9.noarch 64/145 2024-08-17T02:22:45.814 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 65/145 2024-08-17T02:22:46.191 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:22:46.191 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-17T02:22:46.191 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-17T02:22:46.191 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:22:46.229 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:22:46.679 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 66/145 2024-08-17T02:22:46.742 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 67/145 2024-08-17T02:22:46.776 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 68/145 2024-08-17T02:22:46.887 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:22:46.934 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 70/145 2024-08-17T02:22:47.178 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : openblas-0.3.21-2.el9.x86_64 71/145 2024-08-17T02:22:47.215 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 72/145 2024-08-17T02:22:47.315 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 73/145 2024-08-17T02:22:48.111 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 74/145 2024-08-17T02:22:48.261 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 75/145 2024-08-17T02:22:49.821 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 76/145 2024-08-17T02:22:49.945 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 77/145 2024-08-17T02:22:49.980 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 78/145 2024-08-17T02:22:50.014 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 79/145 2024-08-17T02:22:50.357 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 80/145 2024-08-17T02:22:50.401 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:22:50.507 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:22:50.561 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 82/145 2024-08-17T02:22:53.159 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:22:53.199 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:22:53.802 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:22:53.844 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:22:53.977 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:22:53.977 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-17T02:22:53.977 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-17T02:22:53.978 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:22:54.004 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:22:58.128 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:22:58.129 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /sys 2024-08-17T02:22:58.129 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /proc 2024-08-17T02:22:58.129 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /mnt 2024-08-17T02:22:58.129 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /var/tmp 2024-08-17T02:22:58.129 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /home 2024-08-17T02:22:58.129 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /root 2024-08-17T02:22:58.129 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /tmp 2024-08-17T02:22:58.129 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:22:58.327 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:22:58.362 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:22:58.362 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:22:58.362 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-17T02:22:58.363 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:22:59.877 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:22:59.935 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:22:59.936 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:22:59.936 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-17T02:22:59.936 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:22:59.936 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:22:59.936 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:23:00.160 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:23:00.212 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:23:00.212 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:23:00.212 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-17T02:23:00.212 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:23:00.212 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:23:00.213 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:23:00.612 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:23:00.663 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:23:00.663 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:23:00.663 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-17T02:23:00.663 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:23:00.663 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:23:00.663 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:23:00.787 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : automake-1.16.2-8.el9.noarch 90/145 2024-08-17T02:23:00.847 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ply-3.11-14.el9.noarch 91/145 2024-08-17T02:23:00.912 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 92/145 2024-08-17T02:23:01.138 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 93/145 2024-08-17T02:23:01.199 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 94/145 2024-08-17T02:23:01.285 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 95/145 2024-08-17T02:23:01.395 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/145 2024-08-17T02:23:01.554 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 97/145 2024-08-17T02:23:01.621 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 98/145 2024-08-17T02:23:01.646 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 99/145 2024-08-17T02:23:01.682 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 100/145 2024-08-17T02:23:01.731 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 101/145 2024-08-17T02:23:01.756 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : fuse-2.9.9-16.el9.x86_64 102/145 2024-08-17T02:23:02.218 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:23:02.256 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:23:02.294 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 104/145 2024-08-17T02:23:02.356 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 105/145 2024-08-17T02:23:02.387 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:23:03.547 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:23:03.589 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:23:04.675 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:23:04.706 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:23:04.844 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:23:05.001 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 109/145 2024-08-17T02:23:05.033 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:23:05.085 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:23:05.085 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:23:05.085 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-17T02:23:05.086 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:23:05.086 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:23:05.086 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:23:05.133 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:23:05.160 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:23:05.260 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 112/145 2024-08-17T02:23:05.329 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 113/145 2024-08-17T02:23:05.857 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:23:05.857 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /sys 2024-08-17T02:23:05.857 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /proc 2024-08-17T02:23:05.857 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /mnt 2024-08-17T02:23:05.857 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /var/tmp 2024-08-17T02:23:05.858 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /home 2024-08-17T02:23:05.858 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /root 2024-08-17T02:23:05.858 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /tmp 2024-08-17T02:23:05.858 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:23:06.066 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:23:06.101 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:23:06.101 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:23:06.101 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-17T02:23:06.101 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:23:06.665 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libtool-2.4.6-46.el9.x86_64 114/145 2024-08-17T02:23:06.703 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:23:06.825 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:23:06.825 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:23:06.825 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-17T02:23:06.825 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:23:06.825 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:23:06.825 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:23:06.882 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:23:06.929 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:23:06.930 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:23:06.930 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-17T02:23:06.930 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:23:06.988 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:23:07.039 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:23:07.039 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:23:07.039 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-17T02:23:07.039 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:23:07.040 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:23:07.040 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:23:07.356 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:23:07.407 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:23:07.407 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:23:07.407 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-17T02:23:07.407 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:23:07.407 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:23:07.408 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:23:07.586 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:23:07.644 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:23:07.644 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:23:07.644 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-17T02:23:07.644 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:23:07.645 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:23:07.645 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:23:07.870 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:23:07.920 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:23:07.920 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:23:07.920 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-17T02:23:07.920 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:23:07.921 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:23:07.921 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:23:08.329 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:23:08.379 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:23:08.379 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:23:08.379 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-17T02:23:08.379 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:23:08.379 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:23:08.380 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:23:08.520 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : automake-1.16.2-8.el9.noarch 90/145 2024-08-17T02:23:08.596 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-ply-3.11-14.el9.noarch 91/145 2024-08-17T02:23:08.661 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 92/145 2024-08-17T02:23:08.885 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 93/145 2024-08-17T02:23:08.941 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 94/145 2024-08-17T02:23:09.025 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 95/145 2024-08-17T02:23:09.143 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/145 2024-08-17T02:23:09.298 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 97/145 2024-08-17T02:23:09.353 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 98/145 2024-08-17T02:23:09.379 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 99/145 2024-08-17T02:23:09.415 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 100/145 2024-08-17T02:23:09.455 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 101/145 2024-08-17T02:23:09.481 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : fuse-2.9.9-16.el9.x86_64 102/145 2024-08-17T02:23:09.959 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:23:09.981 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:23:10.018 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 104/145 2024-08-17T02:23:10.099 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 105/145 2024-08-17T02:23:10.136 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:23:11.288 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:23:11.330 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:23:12.109 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 119/145 2024-08-17T02:23:12.159 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 120/145 2024-08-17T02:23:12.206 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 121/145 2024-08-17T02:23:12.241 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 122/145 2024-08-17T02:23:12.274 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 123/145 2024-08-17T02:23:12.309 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 124/145 2024-08-17T02:23:12.349 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 125/145 2024-08-17T02:23:12.380 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:23:12.419 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:23:12.437 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 127/145 2024-08-17T02:23:12.455 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:23:12.591 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:23:12.775 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 109/145 2024-08-17T02:23:12.807 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:23:12.860 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:23:12.860 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:23:12.860 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-17T02:23:12.860 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:23:12.860 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:23:12.860 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:23:12.916 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:23:12.942 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:23:13.033 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 112/145 2024-08-17T02:23:13.102 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 113/145 2024-08-17T02:23:13.727 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 128/145 2024-08-17T02:23:13.975 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 129/145 2024-08-17T02:23:14.050 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 130/145 2024-08-17T02:23:14.097 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 131/145 2024-08-17T02:23:14.207 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flex-2.6.4-9.el9.x86_64 132/145 2024-08-17T02:23:14.254 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : bison-3.7.4-5.el9.x86_64 133/145 2024-08-17T02:23:14.279 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 134/145 2024-08-17T02:23:14.304 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:23:14.333 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 136/145 2024-08-17T02:23:14.333 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:23:14.432 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:23:14.453 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libtool-2.4.6-46.el9.x86_64 114/145 2024-08-17T02:23:14.464 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 138/145 2024-08-17T02:23:14.464 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:23:14.485 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:23:14.575 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:23:14.599 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:23:14.599 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:23:14.599 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-17T02:23:14.599 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:23:14.599 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:23:14.599 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:23:14.600 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 140/145 2024-08-17T02:23:14.616 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:23:14.616 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:23:14.645 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:23:14.695 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:23:14.695 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:23:14.695 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-17T02:23:14.695 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:23:14.762 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:23:14.813 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:23:14.813 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:23:14.813 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-17T02:23:14.814 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:23:14.814 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:23:14.814 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:23:14.869 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:23:14.869 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:23:14.961 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:23:14.994 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:23:15.021 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 144/145 2024-08-17T02:23:15.093 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:23:15.138 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:23:15.189 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:23:15.189 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:23:15.189 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-17T02:23:15.189 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:23:15.189 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:23:15.190 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:23:15.296 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:23:15.296 INFO:teuthology.orchestra.run.smithi107.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-08-17T02:23:15.296 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:23:19.908 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 119/145 2024-08-17T02:23:19.950 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 120/145 2024-08-17T02:23:19.994 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 121/145 2024-08-17T02:23:20.022 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 122/145 2024-08-17T02:23:20.048 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 123/145 2024-08-17T02:23:20.083 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 124/145 2024-08-17T02:23:20.123 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 125/145 2024-08-17T02:23:20.154 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:23:20.193 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 127/145 2024-08-17T02:23:20.501 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 1/145 2024-08-17T02:23:20.502 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2/145 2024-08-17T02:23:20.502 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 3/145 2024-08-17T02:23:20.502 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 4/145 2024-08-17T02:23:20.502 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 5/145 2024-08-17T02:23:20.502 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 6/145 2024-08-17T02:23:20.502 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 7/145 2024-08-17T02:23:20.502 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:23:20.502 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:23:20.502 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:23:20.502 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:23:20.502 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 12/145 2024-08-17T02:23:20.503 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:23:20.503 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 14/145 2024-08-17T02:23:20.503 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 15/145 2024-08-17T02:23:20.503 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 16/145 2024-08-17T02:23:20.503 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 17/145 2024-08-17T02:23:20.503 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 18/145 2024-08-17T02:23:20.503 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 19/145 2024-08-17T02:23:20.503 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 20/145 2024-08-17T02:23:20.503 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 21/145 2024-08-17T02:23:20.503 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 22/145 2024-08-17T02:23:20.503 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 23/145 2024-08-17T02:23:20.503 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 24/145 2024-08-17T02:23:20.504 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 25/145 2024-08-17T02:23:20.504 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 26/145 2024-08-17T02:23:20.504 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 27/145 2024-08-17T02:23:20.504 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 28/145 2024-08-17T02:23:20.504 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 29/145 2024-08-17T02:23:20.514 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 30/145 2024-08-17T02:23:20.515 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 31/145 2024-08-17T02:23:20.515 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 32/145 2024-08-17T02:23:20.515 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 33/145 2024-08-17T02:23:20.515 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 34/145 2024-08-17T02:23:20.515 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 35/145 2024-08-17T02:23:20.515 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 36/145 2024-08-17T02:23:20.515 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 37/145 2024-08-17T02:23:20.515 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 38/145 2024-08-17T02:23:20.515 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/145 2024-08-17T02:23:20.515 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 40/145 2024-08-17T02:23:20.515 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 41/145 2024-08-17T02:23:20.515 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/145 2024-08-17T02:23:20.516 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/145 2024-08-17T02:23:20.516 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/145 2024-08-17T02:23:20.516 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/145 2024-08-17T02:23:20.516 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/145 2024-08-17T02:23:20.516 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/145 2024-08-17T02:23:20.516 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/145 2024-08-17T02:23:20.516 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/145 2024-08-17T02:23:20.516 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 50/145 2024-08-17T02:23:20.516 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flex-2.6.4-9.el9.x86_64 51/145 2024-08-17T02:23:20.516 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 52/145 2024-08-17T02:23:20.516 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 53/145 2024-08-17T02:23:20.516 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 54/145 2024-08-17T02:23:20.517 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 55/145 2024-08-17T02:23:20.517 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 56/145 2024-08-17T02:23:20.517 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 57/145 2024-08-17T02:23:20.517 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 58/145 2024-08-17T02:23:20.517 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 59/145 2024-08-17T02:23:20.517 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 60/145 2024-08-17T02:23:20.517 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 61/145 2024-08-17T02:23:20.517 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 62/145 2024-08-17T02:23:20.517 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 63/145 2024-08-17T02:23:20.517 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 64/145 2024-08-17T02:23:20.517 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 65/145 2024-08-17T02:23:20.517 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/145 2024-08-17T02:23:20.517 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 67/145 2024-08-17T02:23:20.518 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 68/145 2024-08-17T02:23:20.518 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:23:20.518 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 70/145 2024-08-17T02:23:20.518 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 71/145 2024-08-17T02:23:20.518 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 72/145 2024-08-17T02:23:20.518 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 73/145 2024-08-17T02:23:20.518 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 74/145 2024-08-17T02:23:20.518 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 75/145 2024-08-17T02:23:20.518 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 76/145 2024-08-17T02:23:20.518 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 77/145 2024-08-17T02:23:20.518 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/145 2024-08-17T02:23:20.518 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/145 2024-08-17T02:23:20.518 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/145 2024-08-17T02:23:20.519 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/145 2024-08-17T02:23:20.519 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/145 2024-08-17T02:23:20.519 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/145 2024-08-17T02:23:20.519 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 84/145 2024-08-17T02:23:20.519 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 85/145 2024-08-17T02:23:20.519 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 86/145 2024-08-17T02:23:20.519 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 87/145 2024-08-17T02:23:20.519 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/145 2024-08-17T02:23:20.519 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 89/145 2024-08-17T02:23:20.519 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 90/145 2024-08-17T02:23:20.519 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 91/145 2024-08-17T02:23:20.519 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 92/145 2024-08-17T02:23:20.519 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 93/145 2024-08-17T02:23:20.520 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 94/145 2024-08-17T02:23:20.520 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 95/145 2024-08-17T02:23:20.520 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 96/145 2024-08-17T02:23:20.520 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 97/145 2024-08-17T02:23:20.520 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 98/145 2024-08-17T02:23:20.520 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 99/145 2024-08-17T02:23:20.520 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 100/145 2024-08-17T02:23:20.520 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 101/145 2024-08-17T02:23:20.520 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 102/145 2024-08-17T02:23:20.520 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 103/145 2024-08-17T02:23:20.520 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 104/145 2024-08-17T02:23:20.520 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 105/145 2024-08-17T02:23:20.520 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 106/145 2024-08-17T02:23:20.520 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 107/145 2024-08-17T02:23:20.521 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 108/145 2024-08-17T02:23:20.521 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 109/145 2024-08-17T02:23:20.521 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 110/145 2024-08-17T02:23:20.521 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 111/145 2024-08-17T02:23:20.521 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 112/145 2024-08-17T02:23:20.521 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 113/145 2024-08-17T02:23:20.521 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 114/145 2024-08-17T02:23:20.521 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 115/145 2024-08-17T02:23:20.521 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 116/145 2024-08-17T02:23:20.521 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 117/145 2024-08-17T02:23:20.521 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 118/145 2024-08-17T02:23:20.521 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 119/145 2024-08-17T02:23:20.521 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 120/145 2024-08-17T02:23:20.521 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 121/145 2024-08-17T02:23:20.522 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 122/145 2024-08-17T02:23:20.522 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 123/145 2024-08-17T02:23:20.522 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 124/145 2024-08-17T02:23:20.522 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 125/145 2024-08-17T02:23:20.522 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:23:20.522 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 127/145 2024-08-17T02:23:20.522 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 128/145 2024-08-17T02:23:20.522 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 129/145 2024-08-17T02:23:20.522 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 130/145 2024-08-17T02:23:20.522 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 131/145 2024-08-17T02:23:20.522 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 132/145 2024-08-17T02:23:20.522 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 133/145 2024-08-17T02:23:20.522 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 134/145 2024-08-17T02:23:20.523 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:23:20.523 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 136/145 2024-08-17T02:23:20.523 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 137/145 2024-08-17T02:23:20.523 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 138/145 2024-08-17T02:23:20.523 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 139/145 2024-08-17T02:23:20.523 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 140/145 2024-08-17T02:23:20.523 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 141/145 2024-08-17T02:23:20.523 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 142/145 2024-08-17T02:23:20.523 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:23:20.523 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 144/145 2024-08-17T02:23:21.480 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 128/145 2024-08-17T02:23:21.737 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 129/145 2024-08-17T02:23:21.815 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 130/145 2024-08-17T02:23:21.869 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 131/145 2024-08-17T02:23:21.975 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : flex-2.6.4-9.el9.x86_64 132/145 2024-08-17T02:23:22.009 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : bison-3.7.4-5.el9.x86_64 133/145 2024-08-17T02:23:22.034 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 134/145 2024-08-17T02:23:22.059 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:23:22.087 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 136/145 2024-08-17T02:23:22.088 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:23:22.187 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:23:22.228 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 138/145 2024-08-17T02:23:22.228 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:23:22.363 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:23:22.387 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 140/145 2024-08-17T02:23:22.412 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:23:22.412 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:23:22.471 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:23:22.471 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:23:22.471 INFO:teuthology.orchestra.run.smithi107.stdout:Upgraded: 2024-08-17T02:23:22.471 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-08-17T02:23:22.471 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-08-17T02:23:22.471 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-08-17T02:23:22.472 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-08-17T02:23:22.472 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-08-17T02:23:22.472 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-08-17T02:23:22.472 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-08-17T02:23:22.472 INFO:teuthology.orchestra.run.smithi107.stdout: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:22.472 INFO:teuthology.orchestra.run.smithi107.stdout: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:22.472 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-08-17T02:23:22.472 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-08-17T02:23:22.472 INFO:teuthology.orchestra.run.smithi107.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-08-17T02:23:22.472 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-08-17T02:23:22.472 INFO:teuthology.orchestra.run.smithi107.stdout: automake-1.16.2-8.el9.noarch 2024-08-17T02:23:22.472 INFO:teuthology.orchestra.run.smithi107.stdout: bison-3.7.4-5.el9.x86_64 2024-08-17T02:23:22.472 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:22.473 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:22.473 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:22.473 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:22.473 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-grafana-dashboards-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:23:22.473 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-immutable-object-cache-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:22.473 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:22.473 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:22.473 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:23:22.473 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:23:22.473 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:23:22.473 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:23:22.473 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:23:22.474 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:22.474 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:22.474 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:23:22.474 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:22.474 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:22.474 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:22.474 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:23:22.474 INFO:teuthology.orchestra.run.smithi107.stdout: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:23:22.474 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:22.474 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:23:22.474 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-17T02:23:22.474 INFO:teuthology.orchestra.run.smithi107.stdout: flex-2.6.4-9.el9.x86_64 2024-08-17T02:23:22.475 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-17T02:23:22.475 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-17T02:23:22.475 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-17T02:23:22.475 INFO:teuthology.orchestra.run.smithi107.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-17T02:23:22.475 INFO:teuthology.orchestra.run.smithi107.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-17T02:23:22.475 INFO:teuthology.orchestra.run.smithi107.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-17T02:23:22.475 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:22.475 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:22.475 INFO:teuthology.orchestra.run.smithi107.stdout: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:22.475 INFO:teuthology.orchestra.run.smithi107.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-17T02:23:22.475 INFO:teuthology.orchestra.run.smithi107.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-17T02:23:22.475 INFO:teuthology.orchestra.run.smithi107.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-17T02:23:22.475 INFO:teuthology.orchestra.run.smithi107.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-17T02:23:22.475 INFO:teuthology.orchestra.run.smithi107.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-17T02:23:22.476 INFO:teuthology.orchestra.run.smithi107.stdout: librados-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:22.476 INFO:teuthology.orchestra.run.smithi107.stdout: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:22.476 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-17T02:23:22.476 INFO:teuthology.orchestra.run.smithi107.stdout: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:22.476 INFO:teuthology.orchestra.run.smithi107.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-17T02:23:22.476 INFO:teuthology.orchestra.run.smithi107.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-17T02:23:22.476 INFO:teuthology.orchestra.run.smithi107.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-17T02:23:22.476 INFO:teuthology.orchestra.run.smithi107.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-17T02:23:22.476 INFO:teuthology.orchestra.run.smithi107.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-17T02:23:22.476 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-17T02:23:22.476 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-17T02:23:22.476 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-17T02:23:22.476 INFO:teuthology.orchestra.run.smithi107.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-17T02:23:22.477 INFO:teuthology.orchestra.run.smithi107.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-17T02:23:22.477 INFO:teuthology.orchestra.run.smithi107.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-17T02:23:22.477 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-17T02:23:22.477 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-argparse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:22.477 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:22.477 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:22.477 INFO:teuthology.orchestra.run.smithi107.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-17T02:23:22.477 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-17T02:23:22.477 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-17T02:23:22.477 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-17T02:23:22.477 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-17T02:23:22.477 INFO:teuthology.orchestra.run.smithi107.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-08-17T02:23:22.477 INFO:teuthology.orchestra.run.smithi107.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-17T02:23:22.478 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-17T02:23:22.478 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-17T02:23:22.478 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-17T02:23:22.478 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-17T02:23:22.478 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-17T02:23:22.478 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-17T02:23:22.478 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-17T02:23:22.478 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-17T02:23:22.478 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-08-17T02:23:22.478 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-08-17T02:23:22.478 INFO:teuthology.orchestra.run.smithi107.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-17T02:23:22.478 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-17T02:23:22.478 INFO:teuthology.orchestra.run.smithi107.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-17T02:23:22.479 INFO:teuthology.orchestra.run.smithi107.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-17T02:23:22.479 INFO:teuthology.orchestra.run.smithi107.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-17T02:23:22.479 INFO:teuthology.orchestra.run.smithi107.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-17T02:23:22.479 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-17T02:23:22.479 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-17T02:23:22.479 INFO:teuthology.orchestra.run.smithi107.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-17T02:23:22.479 INFO:teuthology.orchestra.run.smithi107.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-17T02:23:22.479 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-17T02:23:22.479 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ply-3.11-14.el9.noarch 2024-08-17T02:23:22.479 INFO:teuthology.orchestra.run.smithi107.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-17T02:23:22.479 INFO:teuthology.orchestra.run.smithi107.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-17T02:23:22.479 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-17T02:23:22.479 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-17T02:23:22.480 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-17T02:23:22.480 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-17T02:23:22.480 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-17T02:23:22.480 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:22.480 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:22.480 INFO:teuthology.orchestra.run.smithi107.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-17T02:23:22.480 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-17T02:23:22.480 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-17T02:23:22.480 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:22.480 INFO:teuthology.orchestra.run.smithi107.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-17T02:23:22.480 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-17T02:23:22.480 INFO:teuthology.orchestra.run.smithi107.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-17T02:23:22.480 INFO:teuthology.orchestra.run.smithi107.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-17T02:23:22.480 INFO:teuthology.orchestra.run.smithi107.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-17T02:23:22.481 INFO:teuthology.orchestra.run.smithi107.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-17T02:23:22.481 INFO:teuthology.orchestra.run.smithi107.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-17T02:23:22.481 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-17T02:23:22.481 INFO:teuthology.orchestra.run.smithi107.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-17T02:23:22.481 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-17T02:23:22.481 INFO:teuthology.orchestra.run.smithi107.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-17T02:23:22.481 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:22.481 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:22.481 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:22.481 INFO:teuthology.orchestra.run.smithi107.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-17T02:23:22.481 INFO:teuthology.orchestra.run.smithi107.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-17T02:23:22.481 INFO:teuthology.orchestra.run.smithi107.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-08-17T02:23:22.481 INFO:teuthology.orchestra.run.smithi107.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-17T02:23:22.482 INFO:teuthology.orchestra.run.smithi107.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-17T02:23:22.482 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:23:22.482 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-08-17T02:23:22.664 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:23:22.664 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:23:22.800 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:23:22.879 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:23:22.950 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 144/145 2024-08-17T02:23:23.039 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:23:23.102 DEBUG:teuthology.parallel:result is None 2024-08-17T02:23:23.263 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:23:23.263 INFO:teuthology.orchestra.run.smithi157.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-08-17T02:23:23.263 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:23:29.005 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 1/145 2024-08-17T02:23:29.005 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2/145 2024-08-17T02:23:29.005 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 3/145 2024-08-17T02:23:29.005 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 4/145 2024-08-17T02:23:29.005 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 5/145 2024-08-17T02:23:29.005 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 6/145 2024-08-17T02:23:29.006 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 7/145 2024-08-17T02:23:29.006 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:23:29.006 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:23:29.006 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:23:29.006 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:23:29.006 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 12/145 2024-08-17T02:23:29.006 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:23:29.006 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 14/145 2024-08-17T02:23:29.006 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 15/145 2024-08-17T02:23:29.006 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 16/145 2024-08-17T02:23:29.006 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 17/145 2024-08-17T02:23:29.006 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 18/145 2024-08-17T02:23:29.007 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 19/145 2024-08-17T02:23:29.007 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 20/145 2024-08-17T02:23:29.007 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 21/145 2024-08-17T02:23:29.007 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 22/145 2024-08-17T02:23:29.007 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 23/145 2024-08-17T02:23:29.007 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 24/145 2024-08-17T02:23:29.007 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 25/145 2024-08-17T02:23:29.007 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 26/145 2024-08-17T02:23:29.007 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 27/145 2024-08-17T02:23:29.019 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 28/145 2024-08-17T02:23:29.019 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 29/145 2024-08-17T02:23:29.020 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 30/145 2024-08-17T02:23:29.020 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 31/145 2024-08-17T02:23:29.020 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 32/145 2024-08-17T02:23:29.020 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 33/145 2024-08-17T02:23:29.020 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 34/145 2024-08-17T02:23:29.020 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 35/145 2024-08-17T02:23:29.020 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 36/145 2024-08-17T02:23:29.020 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 37/145 2024-08-17T02:23:29.020 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 38/145 2024-08-17T02:23:29.020 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/145 2024-08-17T02:23:29.020 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 40/145 2024-08-17T02:23:29.021 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 41/145 2024-08-17T02:23:29.021 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/145 2024-08-17T02:23:29.021 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/145 2024-08-17T02:23:29.021 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/145 2024-08-17T02:23:29.021 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/145 2024-08-17T02:23:29.021 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/145 2024-08-17T02:23:29.021 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/145 2024-08-17T02:23:29.021 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/145 2024-08-17T02:23:29.021 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/145 2024-08-17T02:23:29.021 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 50/145 2024-08-17T02:23:29.021 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : flex-2.6.4-9.el9.x86_64 51/145 2024-08-17T02:23:29.021 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 52/145 2024-08-17T02:23:29.021 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 53/145 2024-08-17T02:23:29.022 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 54/145 2024-08-17T02:23:29.022 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 55/145 2024-08-17T02:23:29.022 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 56/145 2024-08-17T02:23:29.022 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 57/145 2024-08-17T02:23:29.022 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 58/145 2024-08-17T02:23:29.022 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 59/145 2024-08-17T02:23:29.022 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 60/145 2024-08-17T02:23:29.022 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 61/145 2024-08-17T02:23:29.022 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 62/145 2024-08-17T02:23:29.022 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 63/145 2024-08-17T02:23:29.023 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 64/145 2024-08-17T02:23:29.023 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 65/145 2024-08-17T02:23:29.023 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/145 2024-08-17T02:23:29.023 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 67/145 2024-08-17T02:23:29.023 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 68/145 2024-08-17T02:23:29.024 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:23:29.024 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 70/145 2024-08-17T02:23:29.024 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 71/145 2024-08-17T02:23:29.024 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 72/145 2024-08-17T02:23:29.024 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 73/145 2024-08-17T02:23:29.024 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 74/145 2024-08-17T02:23:29.024 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 75/145 2024-08-17T02:23:29.024 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 76/145 2024-08-17T02:23:29.024 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 77/145 2024-08-17T02:23:29.024 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/145 2024-08-17T02:23:29.024 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/145 2024-08-17T02:23:29.024 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/145 2024-08-17T02:23:29.025 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/145 2024-08-17T02:23:29.025 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/145 2024-08-17T02:23:29.025 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/145 2024-08-17T02:23:29.025 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 84/145 2024-08-17T02:23:29.025 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 85/145 2024-08-17T02:23:29.025 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 86/145 2024-08-17T02:23:29.025 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 87/145 2024-08-17T02:23:29.025 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/145 2024-08-17T02:23:29.026 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 89/145 2024-08-17T02:23:29.026 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 90/145 2024-08-17T02:23:29.026 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 91/145 2024-08-17T02:23:29.026 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 92/145 2024-08-17T02:23:29.026 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 93/145 2024-08-17T02:23:29.026 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 94/145 2024-08-17T02:23:29.026 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 95/145 2024-08-17T02:23:29.026 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 96/145 2024-08-17T02:23:29.026 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 97/145 2024-08-17T02:23:29.026 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 98/145 2024-08-17T02:23:29.026 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 99/145 2024-08-17T02:23:29.026 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 100/145 2024-08-17T02:23:29.027 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 101/145 2024-08-17T02:23:29.027 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 102/145 2024-08-17T02:23:29.027 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 103/145 2024-08-17T02:23:29.027 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 104/145 2024-08-17T02:23:29.027 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 105/145 2024-08-17T02:23:29.027 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 106/145 2024-08-17T02:23:29.027 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 107/145 2024-08-17T02:23:29.027 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 108/145 2024-08-17T02:23:29.027 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 109/145 2024-08-17T02:23:29.027 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 110/145 2024-08-17T02:23:29.027 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 111/145 2024-08-17T02:23:29.027 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 112/145 2024-08-17T02:23:29.027 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 113/145 2024-08-17T02:23:29.028 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 114/145 2024-08-17T02:23:29.028 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 115/145 2024-08-17T02:23:29.028 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 116/145 2024-08-17T02:23:29.028 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 117/145 2024-08-17T02:23:29.028 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 118/145 2024-08-17T02:23:29.028 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 119/145 2024-08-17T02:23:29.028 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 120/145 2024-08-17T02:23:29.028 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 121/145 2024-08-17T02:23:29.028 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 122/145 2024-08-17T02:23:29.028 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 123/145 2024-08-17T02:23:29.028 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 124/145 2024-08-17T02:23:29.028 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 125/145 2024-08-17T02:23:29.029 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:23:29.029 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 127/145 2024-08-17T02:23:29.029 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 128/145 2024-08-17T02:23:29.029 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 129/145 2024-08-17T02:23:29.029 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 130/145 2024-08-17T02:23:29.029 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 131/145 2024-08-17T02:23:29.029 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 132/145 2024-08-17T02:23:29.029 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 133/145 2024-08-17T02:23:29.029 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 134/145 2024-08-17T02:23:29.029 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:23:29.029 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 136/145 2024-08-17T02:23:29.029 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 137/145 2024-08-17T02:23:29.029 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 138/145 2024-08-17T02:23:29.030 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 139/145 2024-08-17T02:23:29.030 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 140/145 2024-08-17T02:23:29.030 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 141/145 2024-08-17T02:23:29.030 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 142/145 2024-08-17T02:23:29.030 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:23:29.030 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 144/145 2024-08-17T02:23:30.976 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:23:30.976 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:23:30.976 INFO:teuthology.orchestra.run.smithi157.stdout:Upgraded: 2024-08-17T02:23:30.976 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-08-17T02:23:30.976 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-08-17T02:23:30.976 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-08-17T02:23:30.976 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-08-17T02:23:30.977 INFO:teuthology.orchestra.run.smithi157.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-08-17T02:23:30.977 INFO:teuthology.orchestra.run.smithi157.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-08-17T02:23:30.977 INFO:teuthology.orchestra.run.smithi157.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-08-17T02:23:30.977 INFO:teuthology.orchestra.run.smithi157.stdout: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:30.977 INFO:teuthology.orchestra.run.smithi157.stdout: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:30.977 INFO:teuthology.orchestra.run.smithi157.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-08-17T02:23:30.977 INFO:teuthology.orchestra.run.smithi157.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-08-17T02:23:30.977 INFO:teuthology.orchestra.run.smithi157.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-08-17T02:23:30.977 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-08-17T02:23:30.977 INFO:teuthology.orchestra.run.smithi157.stdout: automake-1.16.2-8.el9.noarch 2024-08-17T02:23:30.977 INFO:teuthology.orchestra.run.smithi157.stdout: bison-3.7.4-5.el9.x86_64 2024-08-17T02:23:30.977 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:30.977 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:30.978 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:30.978 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:30.978 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-grafana-dashboards-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:23:30.978 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-immutable-object-cache-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:30.978 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:30.978 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:30.978 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:23:30.978 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:23:30.978 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:23:30.978 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:23:30.978 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:23:30.978 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:30.979 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:30.979 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:23:30.979 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:30.979 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:30.979 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:30.979 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:23:30.979 INFO:teuthology.orchestra.run.smithi157.stdout: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:23:30.979 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:30.979 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:23:30.979 INFO:teuthology.orchestra.run.smithi157.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-17T02:23:30.979 INFO:teuthology.orchestra.run.smithi157.stdout: flex-2.6.4-9.el9.x86_64 2024-08-17T02:23:30.979 INFO:teuthology.orchestra.run.smithi157.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-17T02:23:30.980 INFO:teuthology.orchestra.run.smithi157.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-17T02:23:30.980 INFO:teuthology.orchestra.run.smithi157.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-17T02:23:30.980 INFO:teuthology.orchestra.run.smithi157.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-17T02:23:30.980 INFO:teuthology.orchestra.run.smithi157.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-17T02:23:30.980 INFO:teuthology.orchestra.run.smithi157.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-17T02:23:30.980 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:30.980 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:30.980 INFO:teuthology.orchestra.run.smithi157.stdout: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:30.980 INFO:teuthology.orchestra.run.smithi157.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-17T02:23:30.980 INFO:teuthology.orchestra.run.smithi157.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-17T02:23:30.981 INFO:teuthology.orchestra.run.smithi157.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-17T02:23:30.981 INFO:teuthology.orchestra.run.smithi157.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-17T02:23:30.981 INFO:teuthology.orchestra.run.smithi157.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-17T02:23:30.981 INFO:teuthology.orchestra.run.smithi157.stdout: librados-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:30.981 INFO:teuthology.orchestra.run.smithi157.stdout: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:30.981 INFO:teuthology.orchestra.run.smithi157.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-17T02:23:30.981 INFO:teuthology.orchestra.run.smithi157.stdout: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:30.981 INFO:teuthology.orchestra.run.smithi157.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-17T02:23:30.981 INFO:teuthology.orchestra.run.smithi157.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-17T02:23:30.981 INFO:teuthology.orchestra.run.smithi157.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-17T02:23:30.981 INFO:teuthology.orchestra.run.smithi157.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-17T02:23:30.981 INFO:teuthology.orchestra.run.smithi157.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-17T02:23:30.982 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-17T02:23:30.982 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-17T02:23:30.982 INFO:teuthology.orchestra.run.smithi157.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-17T02:23:30.982 INFO:teuthology.orchestra.run.smithi157.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-17T02:23:30.982 INFO:teuthology.orchestra.run.smithi157.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-17T02:23:30.982 INFO:teuthology.orchestra.run.smithi157.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-17T02:23:30.982 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-17T02:23:30.982 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-argparse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:30.982 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:30.982 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:30.982 INFO:teuthology.orchestra.run.smithi157.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-17T02:23:30.982 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-17T02:23:30.982 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-17T02:23:30.983 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-17T02:23:30.983 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-17T02:23:30.983 INFO:teuthology.orchestra.run.smithi157.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-08-17T02:23:30.983 INFO:teuthology.orchestra.run.smithi157.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-17T02:23:30.983 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-17T02:23:30.983 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-17T02:23:30.983 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-17T02:23:30.983 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-17T02:23:30.983 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-17T02:23:30.983 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-17T02:23:30.983 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-17T02:23:30.983 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-17T02:23:30.983 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-08-17T02:23:30.984 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-08-17T02:23:30.984 INFO:teuthology.orchestra.run.smithi157.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-17T02:23:30.984 INFO:teuthology.orchestra.run.smithi157.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-17T02:23:30.984 INFO:teuthology.orchestra.run.smithi157.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-17T02:23:30.984 INFO:teuthology.orchestra.run.smithi157.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-17T02:23:30.984 INFO:teuthology.orchestra.run.smithi157.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-17T02:23:30.984 INFO:teuthology.orchestra.run.smithi157.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-17T02:23:30.984 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-17T02:23:30.984 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-17T02:23:30.984 INFO:teuthology.orchestra.run.smithi157.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-17T02:23:30.984 INFO:teuthology.orchestra.run.smithi157.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-17T02:23:30.984 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-17T02:23:30.984 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ply-3.11-14.el9.noarch 2024-08-17T02:23:30.985 INFO:teuthology.orchestra.run.smithi157.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-17T02:23:30.985 INFO:teuthology.orchestra.run.smithi157.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-17T02:23:30.985 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-17T02:23:30.985 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-17T02:23:30.985 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-17T02:23:30.985 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-17T02:23:30.985 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-17T02:23:30.985 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:30.985 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:30.985 INFO:teuthology.orchestra.run.smithi157.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-17T02:23:30.985 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-17T02:23:30.985 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-17T02:23:30.985 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:30.986 INFO:teuthology.orchestra.run.smithi157.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-17T02:23:30.986 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-17T02:23:30.986 INFO:teuthology.orchestra.run.smithi157.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-17T02:23:30.986 INFO:teuthology.orchestra.run.smithi157.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-17T02:23:30.986 INFO:teuthology.orchestra.run.smithi157.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-17T02:23:30.986 INFO:teuthology.orchestra.run.smithi157.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-17T02:23:30.986 INFO:teuthology.orchestra.run.smithi157.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-17T02:23:30.986 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-17T02:23:30.986 INFO:teuthology.orchestra.run.smithi157.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-17T02:23:30.986 INFO:teuthology.orchestra.run.smithi157.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-17T02:23:30.986 INFO:teuthology.orchestra.run.smithi157.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-17T02:23:30.986 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:30.986 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:30.987 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:23:30.987 INFO:teuthology.orchestra.run.smithi157.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-17T02:23:30.987 INFO:teuthology.orchestra.run.smithi157.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-17T02:23:30.987 INFO:teuthology.orchestra.run.smithi157.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-08-17T02:23:30.987 INFO:teuthology.orchestra.run.smithi157.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-17T02:23:30.987 INFO:teuthology.orchestra.run.smithi157.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-17T02:23:30.987 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:23:30.988 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-08-17T02:23:31.602 DEBUG:teuthology.parallel:result is None 2024-08-17T02:23:31.603 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:23:31.744 DEBUG:teuthology.orchestra.run.smithi107:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-17T02:23:31.795 INFO:teuthology.orchestra.run.smithi107.stdout:17.2.7-1375.g2577e813.el9 2024-08-17T02:23:31.796 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1375.g2577e813.el9 2024-08-17T02:23:31.796 INFO:teuthology.task.install:The correct ceph version 17.2.7-1375.g2577e813 is installed. 2024-08-17T02:23:31.798 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:23:31.939 DEBUG:teuthology.orchestra.run.smithi157:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-17T02:23:31.984 INFO:teuthology.orchestra.run.smithi157.stdout:17.2.7-1375.g2577e813.el9 2024-08-17T02:23:31.985 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1375.g2577e813.el9 2024-08-17T02:23:31.985 INFO:teuthology.task.install:The correct ceph version 17.2.7-1375.g2577e813 is installed. 2024-08-17T02:23:31.987 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-17T02:23:31.987 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:23:31.987 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-17T02:23:32.052 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-08-17T02:23:32.052 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-17T02:23:32.113 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-17T02:23:32.113 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:23:32.114 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/daemon-helper 2024-08-17T02:23:32.172 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-17T02:23:32.270 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-08-17T02:23:32.270 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/daemon-helper 2024-08-17T02:23:32.328 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-17T02:23:32.425 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-17T02:23:32.426 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:23:32.426 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-17T02:23:32.482 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-17T02:23:32.578 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-08-17T02:23:32.578 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-17T02:23:32.640 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-17T02:23:32.738 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-17T02:23:32.738 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:23:32.738 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/stdin-killer 2024-08-17T02:23:32.793 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-17T02:23:32.888 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-08-17T02:23:32.889 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/stdin-killer 2024-08-17T02:23:32.947 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-17T02:23:33.049 INFO:teuthology.run_tasks:Running task ceph... 2024-08-17T02:23:33.143 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-08-17T02:23:33.144 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 777 /var/log/ceph 2024-08-17T02:23:33.147 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 777 /var/log/ceph 2024-08-17T02:23:33.203 INFO:tasks.ceph:Disabling ceph logrotate... 2024-08-17T02:23:33.203 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-17T02:23:33.207 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-17T02:23:33.265 INFO:tasks.ceph:Creating extra log directories... 2024-08-17T02:23:33.265 DEBUG:teuthology.orchestra.run.smithi107:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-17T02:23:33.268 DEBUG:teuthology.orchestra.run.smithi157:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-17T02:23:33.334 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-08-17T02:23:33.334 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-08-17T02:23:33.334 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-08-17T02:23:33.334 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:23:33.334 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-17T02:23:33.370 DEBUG:teuthology.orchestra.run.smithi107:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-17T02:23:33.537 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-08-17T02:23:33.592 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-08-17T02:23:33.592 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-17T02:23:33.628 DEBUG:teuthology.orchestra.run.smithi157:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-17T02:23:33.802 DEBUG:teuthology.orchestra.run.smithi157:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-08-17T02:23:33.866 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-08-17T02:23:33.866 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-08-17T02:23:33.866 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858278', 'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}}', 'email': 'mchangir@redhat.com', 'first_in_suite': False, 'job_id': '7858278', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, 'owner': 'scheduled_mchangir@teuthology', 'priority': 25, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 5995, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'targets': {'smithi107.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAlhycrV5ePAKCdd8cj3Jqe6Z71X0d+LuKyk/mc731mgyO58W0cSNvMKAonZtFls35C77OpTNbECwcVbngGcVuQ=', 'smithi157.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGhF9mG4Vc5+yWvsyrTbZ5/qrxc14bwUtU4IH9EOLvxun/pw7eGDT1HJGWgnP/wLTjSll2hSbSNu0q7STWccsF8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestVolumes', 'tasks.cephfs.test_volumes.TestSubvolumeGroups', 'tasks.cephfs.test_volumes.TestSubvolumes']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '67db276914d29505c9707d04f3a3b8fb9d8aee4b', 'timestamp': '2024-08-17_01:02:08', 'tube': 'smithi', 'user': 'mchangir', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-08-17T02:23:33.867 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-17T02:23:33.871 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-17T02:23:33.907 DEBUG:teuthology.orchestra.run.smithi107:> sudo install -d -m0777 -- /var/run/ceph 2024-08-17T02:23:33.947 DEBUG:teuthology.orchestra.run.smithi157:> sudo install -d -m0777 -- /var/run/ceph 2024-08-17T02:23:34.004 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:23:34.004 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/scratch_devs of=/dev/stdout 2024-08-17T02:23:34.039 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-17T02:23:34.040 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_1 2024-08-17T02:23:34.115 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-17T02:23:34.116 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:23:34.116 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 6h/6d Inode: 638 Links: 1 2024-08-17T02:23:34.116 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:23:34.116 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:23:34.116 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-08-17 02:23:15.634046571 +0000 2024-08-17T02:23:34.116 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-08-17 02:21:00.683385742 +0000 2024-08-17T02:23:34.117 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-08-17 02:21:00.683385742 +0000 2024-08-17T02:23:34.117 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-08-17 02:21:00.683385742 +0000 2024-08-17T02:23:34.117 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-17T02:23:34.208 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-08-17T02:23:34.208 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-08-17T02:23:34.208 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000301121 s, 1.7 MB/s 2024-08-17T02:23:34.211 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-17T02:23:34.248 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_2 2024-08-17T02:23:34.323 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-17T02:23:34.324 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:23:34.324 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 6h/6d Inode: 659 Links: 1 2024-08-17T02:23:34.324 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:23:34.324 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:23:34.324 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-08-17 02:23:15.634046571 +0000 2024-08-17T02:23:34.325 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-08-17 02:21:01.162377994 +0000 2024-08-17T02:23:34.325 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-08-17 02:21:01.162377994 +0000 2024-08-17T02:23:34.325 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-08-17 02:21:01.162377994 +0000 2024-08-17T02:23:34.325 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-17T02:23:34.416 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-08-17T02:23:34.416 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-08-17T02:23:34.416 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000249523 s, 2.1 MB/s 2024-08-17T02:23:34.418 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-17T02:23:34.455 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_3 2024-08-17T02:23:34.530 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-17T02:23:34.530 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:23:34.530 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 6h/6d Inode: 678 Links: 1 2024-08-17T02:23:34.530 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:23:34.530 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:23:34.531 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-08-17 02:23:15.635046555 +0000 2024-08-17T02:23:34.531 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-08-17 02:21:01.648370132 +0000 2024-08-17T02:23:34.531 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-08-17 02:21:01.648370132 +0000 2024-08-17T02:23:34.531 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-08-17 02:21:01.648370132 +0000 2024-08-17T02:23:34.531 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-17T02:23:34.623 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-08-17T02:23:34.623 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-08-17T02:23:34.623 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000361201 s, 1.4 MB/s 2024-08-17T02:23:34.625 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-17T02:23:34.662 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_4 2024-08-17T02:23:34.737 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-17T02:23:34.737 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:23:34.737 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 6h/6d Inode: 695 Links: 1 2024-08-17T02:23:34.737 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:23:34.738 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:23:34.738 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-08-17 02:23:15.636046539 +0000 2024-08-17T02:23:34.738 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-08-17 02:21:02.124362431 +0000 2024-08-17T02:23:34.738 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-08-17 02:21:02.124362431 +0000 2024-08-17T02:23:34.738 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-08-17 02:21:02.124362431 +0000 2024-08-17T02:23:34.738 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-17T02:23:34.829 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-08-17T02:23:34.830 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-08-17T02:23:34.830 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000258789 s, 2.0 MB/s 2024-08-17T02:23:34.832 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-17T02:23:34.869 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:23:34.869 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-08-17T02:23:34.869 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/scratch_devs of=/dev/stdout 2024-08-17T02:23:34.909 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-17T02:23:34.909 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_1 2024-08-17T02:23:34.988 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-17T02:23:34.988 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:23:34.988 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 6h/6d Inode: 634 Links: 1 2024-08-17T02:23:34.989 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:23:34.989 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:23:34.989 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-08-17 02:23:23.621531000 +0000 2024-08-17T02:23:34.989 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-08-17 02:21:01.904163799 +0000 2024-08-17T02:23:34.989 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-08-17 02:21:01.904163799 +0000 2024-08-17T02:23:34.989 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: 2024-08-17 02:21:01.904163799 +0000 2024-08-17T02:23:34.990 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-17T02:23:35.083 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-08-17T02:23:35.083 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-08-17T02:23:35.083 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000182481 s, 2.8 MB/s 2024-08-17T02:23:35.086 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-17T02:23:35.123 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_2 2024-08-17T02:23:35.200 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-17T02:23:35.200 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:23:35.201 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 6h/6d Inode: 651 Links: 1 2024-08-17T02:23:35.201 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:23:35.201 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:23:35.201 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-08-17 02:23:23.622530981 +0000 2024-08-17T02:23:35.201 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-08-17 02:21:02.372154891 +0000 2024-08-17T02:23:35.201 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-08-17 02:21:02.372154891 +0000 2024-08-17T02:23:35.201 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: 2024-08-17 02:21:02.372154891 +0000 2024-08-17T02:23:35.201 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-17T02:23:35.293 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-08-17T02:23:35.294 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-08-17T02:23:35.294 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000182957 s, 2.8 MB/s 2024-08-17T02:23:35.296 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-17T02:23:35.333 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_3 2024-08-17T02:23:35.408 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-17T02:23:35.408 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:23:35.409 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 6h/6d Inode: 669 Links: 1 2024-08-17T02:23:35.409 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:23:35.409 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:23:35.409 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-08-17 02:23:23.622530981 +0000 2024-08-17T02:23:35.409 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-08-17 02:21:02.869145431 +0000 2024-08-17T02:23:35.409 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-08-17 02:21:02.869145431 +0000 2024-08-17T02:23:35.410 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: 2024-08-17 02:21:02.869145431 +0000 2024-08-17T02:23:35.410 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-17T02:23:35.501 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-08-17T02:23:35.502 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-08-17T02:23:35.502 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000192243 s, 2.7 MB/s 2024-08-17T02:23:35.504 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-17T02:23:35.540 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_4 2024-08-17T02:23:35.616 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-17T02:23:35.616 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:23:35.616 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 6h/6d Inode: 689 Links: 1 2024-08-17T02:23:35.616 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:23:35.616 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:23:35.616 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-08-17 02:23:23.624530943 +0000 2024-08-17T02:23:35.616 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-08-17 02:21:03.357136143 +0000 2024-08-17T02:23:35.617 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-08-17 02:21:03.357136143 +0000 2024-08-17T02:23:35.617 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: 2024-08-17 02:21:03.357136143 +0000 2024-08-17T02:23:35.617 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-17T02:23:35.708 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-08-17T02:23:35.708 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-08-17T02:23:35.708 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000179631 s, 2.9 MB/s 2024-08-17T02:23:35.711 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-17T02:23:35.747 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:23:35.747 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi107.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi157.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-17T02:23:35.747 INFO:tasks.ceph:Generating config... 2024-08-17T02:23:35.748 INFO:tasks.ceph:[client] client mount timeout = 600 2024-08-17T02:23:35.748 INFO:tasks.ceph:[client] debug client = 20 2024-08-17T02:23:35.748 INFO:tasks.ceph:[client] debug ms = 1 2024-08-17T02:23:35.749 INFO:tasks.ceph:[client] pid file = 2024-08-17T02:23:35.749 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-08-17T02:23:35.749 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-08-17T02:23:35.749 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-08-17T02:23:35.749 INFO:tasks.ceph:[mds] debug mds = 20 2024-08-17T02:23:35.749 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-08-17T02:23:35.749 INFO:tasks.ceph:[mds] debug ms = 1 2024-08-17T02:23:35.749 INFO:tasks.ceph:[mds] mds debug frag = True 2024-08-17T02:23:35.749 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-08-17T02:23:35.749 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-08-17T02:23:35.749 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-08-17T02:23:35.749 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-08-17T02:23:35.749 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-08-17T02:23:35.750 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-08-17T02:23:35.750 INFO:tasks.ceph:[mgr] debug client = 20 2024-08-17T02:23:35.750 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-08-17T02:23:35.750 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-08-17T02:23:35.750 INFO:tasks.ceph:[mgr] debug ms = 1 2024-08-17T02:23:35.750 INFO:tasks.ceph:[mon] debug mon = 20 2024-08-17T02:23:35.750 INFO:tasks.ceph:[mon] debug ms = 1 2024-08-17T02:23:35.750 INFO:tasks.ceph:[mon] debug paxos = 20 2024-08-17T02:23:35.750 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-08-17T02:23:35.750 INFO:tasks.ceph:[osd] bdev async discard = True 2024-08-17T02:23:35.750 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-08-17T02:23:35.750 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-08-17T02:23:35.750 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-08-17T02:23:35.751 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-08-17T02:23:35.751 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-08-17T02:23:35.751 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-08-17T02:23:35.751 INFO:tasks.ceph:[osd] debug ms = 1 2024-08-17T02:23:35.751 INFO:tasks.ceph:[osd] debug osd = 20 2024-08-17T02:23:35.751 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-08-17T02:23:35.751 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-08-17T02:23:35.751 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-08-17T02:23:35.751 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-08-17T02:23:35.751 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-08-17T02:23:35.751 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-08-17T02:23:35.751 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-08-17T02:23:35.752 INFO:tasks.ceph:Setting up mon.a... 2024-08-17T02:23:35.752 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-08-17T02:23:35.843 INFO:teuthology.orchestra.run.smithi107.stdout:creating /etc/ceph/ceph.keyring 2024-08-17T02:23:35.848 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-08-17T02:23:35.928 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:23:35.983 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.107'), ('mon.b', '172.21.15.157'), ('mon.c', '[v2:172.21.15.157:3301,v1:172.21.15.157:6790]')] 2024-08-17T02:23:35.985 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.107,172.21.15.157,[v2:172.21.15.157:3301,v1:172.21.15.157:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-08-17T02:23:35.986 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:23:35.986 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-08-17T02:23:36.021 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.107 --add b 172.21.15.157 --addv c '[v2:172.21.15.157:3301,v1:172.21.15.157:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:23:36.133 INFO:teuthology.orchestra.run.smithi107.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:23:36.133 INFO:teuthology.orchestra.run.smithi107.stdout:monmaptool: generated fsid f207b4c0-329d-46b8-b83f-aaf30bdb6ce3 2024-08-17T02:23:36.133 INFO:teuthology.orchestra.run.smithi107.stdout:setting min_mon_release = octopus 2024-08-17T02:23:36.133 INFO:teuthology.orchestra.run.smithi107.stdout:epoch 0 2024-08-17T02:23:36.133 INFO:teuthology.orchestra.run.smithi107.stdout:fsid f207b4c0-329d-46b8-b83f-aaf30bdb6ce3 2024-08-17T02:23:36.133 INFO:teuthology.orchestra.run.smithi107.stdout:last_changed 2024-08-17T02:23:36.133386+0000 2024-08-17T02:23:36.133 INFO:teuthology.orchestra.run.smithi107.stdout:created 2024-08-17T02:23:36.133386+0000 2024-08-17T02:23:36.133 INFO:teuthology.orchestra.run.smithi107.stdout:min_mon_release 15 (octopus) 2024-08-17T02:23:36.134 INFO:teuthology.orchestra.run.smithi107.stdout:election_strategy: 1 2024-08-17T02:23:36.134 INFO:teuthology.orchestra.run.smithi107.stdout:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-08-17T02:23:36.134 INFO:teuthology.orchestra.run.smithi107.stdout:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-08-17T02:23:36.134 INFO:teuthology.orchestra.run.smithi107.stdout:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-08-17T02:23:36.134 INFO:teuthology.orchestra.run.smithi107.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-08-17T02:23:36.136 DEBUG:teuthology.orchestra.run.smithi107:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-08-17T02:23:36.171 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f207b4c0-329d-46b8-b83f-aaf30bdb6ce3... 2024-08-17T02:23:36.172 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-17T02:23:36.216 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-17T02:23:36.310 INFO:teuthology.orchestra.run.smithi107.stdout:[global] 2024-08-17T02:23:36.311 INFO:teuthology.orchestra.run.smithi107.stdout: chdir = "" 2024-08-17T02:23:36.311 INFO:teuthology.orchestra.run.smithi107.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-17T02:23:36.311 INFO:teuthology.orchestra.run.smithi107.stdout: auth supported = cephx 2024-08-17T02:23:36.311 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:23:36.311 INFO:teuthology.orchestra.run.smithi107.stdout: filestore xattr use omap = true 2024-08-17T02:23:36.312 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:23:36.312 INFO:teuthology.orchestra.run.smithi107.stdout: mon clock drift allowed = 1.000 2024-08-17T02:23:36.312 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:23:36.312 INFO:teuthology.orchestra.run.smithi107.stdout: osd crush chooseleaf type = 0 2024-08-17T02:23:36.312 INFO:teuthology.orchestra.run.smithi107.stdout: auth debug = true 2024-08-17T02:23:36.312 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:23:36.313 INFO:teuthology.orchestra.run.smithi107.stdout: ms die on old message = true 2024-08-17T02:23:36.313 INFO:teuthology.orchestra.run.smithi107.stdout: ms die on bug = true 2024-08-17T02:23:36.313 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:23:36.313 INFO:teuthology.orchestra.run.smithi107.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-17T02:23:36.313 INFO:teuthology.orchestra.run.smithi107.stdout: mon pg warn max object skew = 0 2024-08-17T02:23:36.313 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:23:36.314 INFO:teuthology.orchestra.run.smithi107.stdout: # disable pg_autoscaler by default for new pools 2024-08-17T02:23:36.314 INFO:teuthology.orchestra.run.smithi107.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-17T02:23:36.314 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:23:36.314 INFO:teuthology.orchestra.run.smithi107.stdout: osd pool default size = 2 2024-08-17T02:23:36.314 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:23:36.314 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd allow primary affinity = true 2024-08-17T02:23:36.315 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd allow pg remap = true 2024-08-17T02:23:36.315 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on legacy crush tunables = false 2024-08-17T02:23:36.315 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on crush straw calc version zero = false 2024-08-17T02:23:36.315 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on no sortbitwise = false 2024-08-17T02:23:36.315 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on osd down out interval zero = false 2024-08-17T02:23:36.316 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on too few osds = false 2024-08-17T02:23:36.316 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-17T02:23:36.316 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-17T02:23:36.316 INFO:teuthology.orchestra.run.smithi107.stdout: mon_allow_pool_size_one = true 2024-08-17T02:23:36.316 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:23:36.316 INFO:teuthology.orchestra.run.smithi107.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-17T02:23:36.317 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:23:36.317 INFO:teuthology.orchestra.run.smithi107.stdout: osd default data pool replay window = 5 2024-08-17T02:23:36.317 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:23:36.317 INFO:teuthology.orchestra.run.smithi107.stdout: mon allow pool delete = true 2024-08-17T02:23:36.317 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:23:36.317 INFO:teuthology.orchestra.run.smithi107.stdout: mon cluster log file level = debug 2024-08-17T02:23:36.318 INFO:teuthology.orchestra.run.smithi107.stdout: debug asserts on shutdown = true 2024-08-17T02:23:36.318 INFO:teuthology.orchestra.run.smithi107.stdout: mon health detail to clog = false 2024-08-17T02:23:36.318 INFO:teuthology.orchestra.run.smithi107.stdout: mon host = "172.21.15.107,172.21.15.157,[v2:172.21.15.157:3301,v1:172.21.15.157:6790]" 2024-08-17T02:23:36.318 INFO:teuthology.orchestra.run.smithi107.stdout: ms die on skipped message = False 2024-08-17T02:23:36.318 INFO:teuthology.orchestra.run.smithi107.stdout: fsid = f207b4c0-329d-46b8-b83f-aaf30bdb6ce3 2024-08-17T02:23:36.319 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:23:36.320 INFO:teuthology.orchestra.run.smithi107.stdout:[osd] 2024-08-17T02:23:36.320 INFO:teuthology.orchestra.run.smithi107.stdout: osd journal size = 100 2024-08-17T02:23:36.320 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:23:36.320 INFO:teuthology.orchestra.run.smithi107.stdout: osd scrub load threshold = 5.0 2024-08-17T02:23:36.320 INFO:teuthology.orchestra.run.smithi107.stdout: osd scrub max interval = 600 2024-08-17T02:23:36.320 INFO:teuthology.orchestra.run.smithi107.stdout: osd mclock profile = high_recovery_ops 2024-08-17T02:23:36.320 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:23:36.320 INFO:teuthology.orchestra.run.smithi107.stdout: osd recover clone overlap = true 2024-08-17T02:23:36.320 INFO:teuthology.orchestra.run.smithi107.stdout: osd recovery max chunk = 1048576 2024-08-17T02:23:36.321 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:23:36.321 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug shutdown = true 2024-08-17T02:23:36.321 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug op order = true 2024-08-17T02:23:36.321 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug verify stray on activate = true 2024-08-17T02:23:36.322 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:23:36.322 INFO:teuthology.orchestra.run.smithi107.stdout: osd open classes on start = true 2024-08-17T02:23:36.322 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug pg log writeout = true 2024-08-17T02:23:36.322 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:23:36.322 INFO:teuthology.orchestra.run.smithi107.stdout: osd deep scrub update digest min age = 30 2024-08-17T02:23:36.322 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:23:36.322 INFO:teuthology.orchestra.run.smithi107.stdout: osd map max advance = 10 2024-08-17T02:23:36.322 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:23:36.322 INFO:teuthology.orchestra.run.smithi107.stdout: journal zero on create = true 2024-08-17T02:23:36.323 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:23:36.323 INFO:teuthology.orchestra.run.smithi107.stdout: filestore ondisk finisher threads = 3 2024-08-17T02:23:36.323 INFO:teuthology.orchestra.run.smithi107.stdout: filestore apply finisher threads = 3 2024-08-17T02:23:36.323 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:23:36.323 INFO:teuthology.orchestra.run.smithi107.stdout: bdev debug aio = true 2024-08-17T02:23:36.323 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug misdirected ops = true 2024-08-17T02:23:36.323 INFO:teuthology.orchestra.run.smithi107.stdout: bdev async discard = True 2024-08-17T02:23:36.323 INFO:teuthology.orchestra.run.smithi107.stdout: bdev enable discard = True 2024-08-17T02:23:36.323 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore allocator = bitmap 2024-08-17T02:23:36.323 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore block size = 96636764160 2024-08-17T02:23:36.323 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore fsck on mount = True 2024-08-17T02:23:36.323 INFO:teuthology.orchestra.run.smithi107.stdout: debug bluefs = 1/20 2024-08-17T02:23:36.323 INFO:teuthology.orchestra.run.smithi107.stdout: debug bluestore = 1/20 2024-08-17T02:23:36.324 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-08-17T02:23:36.324 INFO:teuthology.orchestra.run.smithi107.stdout: debug osd = 20 2024-08-17T02:23:36.324 INFO:teuthology.orchestra.run.smithi107.stdout: debug rocksdb = 4/10 2024-08-17T02:23:36.324 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd backfillfull_ratio = 0.85 2024-08-17T02:23:36.324 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd full ratio = 0.9 2024-08-17T02:23:36.324 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd nearfull ratio = 0.8 2024-08-17T02:23:36.324 INFO:teuthology.orchestra.run.smithi107.stdout: osd failsafe full ratio = 0.95 2024-08-17T02:23:36.324 INFO:teuthology.orchestra.run.smithi107.stdout: osd objectstore = bluestore 2024-08-17T02:23:36.324 INFO:teuthology.orchestra.run.smithi107.stdout: osd op complaint time = 180 2024-08-17T02:23:36.325 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:23:36.325 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr] 2024-08-17T02:23:36.325 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-08-17T02:23:36.325 INFO:teuthology.orchestra.run.smithi107.stdout: debug mgr = 20 2024-08-17T02:23:36.325 INFO:teuthology.orchestra.run.smithi107.stdout: debug mon = 20 2024-08-17T02:23:36.325 INFO:teuthology.orchestra.run.smithi107.stdout: debug auth = 20 2024-08-17T02:23:36.325 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:23:36.325 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:23:36.325 INFO:teuthology.orchestra.run.smithi107.stdout: mgr/telemetry/nag = false 2024-08-17T02:23:36.326 INFO:teuthology.orchestra.run.smithi107.stdout: debug client = 20 2024-08-17T02:23:36.326 INFO:teuthology.orchestra.run.smithi107.stdout: debug finisher = 20 2024-08-17T02:23:36.326 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:23:36.326 INFO:teuthology.orchestra.run.smithi107.stdout:[mon] 2024-08-17T02:23:36.326 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-08-17T02:23:36.326 INFO:teuthology.orchestra.run.smithi107.stdout: debug mon = 20 2024-08-17T02:23:36.326 INFO:teuthology.orchestra.run.smithi107.stdout: debug paxos = 20 2024-08-17T02:23:36.326 INFO:teuthology.orchestra.run.smithi107.stdout: debug auth = 20 2024-08-17T02:23:36.326 INFO:teuthology.orchestra.run.smithi107.stdout: mon data avail warn = 5 2024-08-17T02:23:36.326 INFO:teuthology.orchestra.run.smithi107.stdout: mon mgr mkfs grace = 240 2024-08-17T02:23:36.326 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:23:36.326 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd reporter subtree level = osd 2024-08-17T02:23:36.327 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd prime pg temp = true 2024-08-17T02:23:36.327 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:23:36.327 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:23:36.327 INFO:teuthology.orchestra.run.smithi107.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-17T02:23:36.327 INFO:teuthology.orchestra.run.smithi107.stdout: auth mon ticket ttl = 660 # 11m 2024-08-17T02:23:36.327 INFO:teuthology.orchestra.run.smithi107.stdout: auth service ticket ttl = 240 # 4m 2024-08-17T02:23:36.327 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:23:36.327 INFO:teuthology.orchestra.run.smithi107.stdout: # don't complain about insecure global_id in the test suite 2024-08-17T02:23:36.327 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-17T02:23:36.328 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-17T02:23:36.328 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:23:36.328 INFO:teuthology.orchestra.run.smithi107.stdout: # 1m isn't quite enough 2024-08-17T02:23:36.328 INFO:teuthology.orchestra.run.smithi107.stdout: mon_down_mkfs_grace = 2m 2024-08-17T02:23:36.328 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:23:36.328 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_filestore_osds = false 2024-08-17T02:23:36.328 INFO:teuthology.orchestra.run.smithi107.stdout: mon op complaint time = 120 2024-08-17T02:23:36.328 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:23:36.328 INFO:teuthology.orchestra.run.smithi107.stdout:[client] 2024-08-17T02:23:36.328 INFO:teuthology.orchestra.run.smithi107.stdout: rgw cache enabled = true 2024-08-17T02:23:36.328 INFO:teuthology.orchestra.run.smithi107.stdout: rgw enable ops log = true 2024-08-17T02:23:36.328 INFO:teuthology.orchestra.run.smithi107.stdout: rgw enable usage log = true 2024-08-17T02:23:36.328 INFO:teuthology.orchestra.run.smithi107.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-17T02:23:36.328 INFO:teuthology.orchestra.run.smithi107.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-17T02:23:36.329 INFO:teuthology.orchestra.run.smithi107.stdout: client mount timeout = 600 2024-08-17T02:23:36.329 INFO:teuthology.orchestra.run.smithi107.stdout: debug client = 20 2024-08-17T02:23:36.329 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-08-17T02:23:36.329 INFO:teuthology.orchestra.run.smithi107.stdout: pid file = "" 2024-08-17T02:23:36.329 INFO:teuthology.orchestra.run.smithi107.stdout: rados mon op timeout = 900 2024-08-17T02:23:36.329 INFO:teuthology.orchestra.run.smithi107.stdout: rados osd op timeout = 900 2024-08-17T02:23:36.329 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.a] 2024-08-17T02:23:36.329 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.b] 2024-08-17T02:23:36.329 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.c] 2024-08-17T02:23:36.329 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.a] 2024-08-17T02:23:36.329 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.c] 2024-08-17T02:23:36.329 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.b] 2024-08-17T02:23:36.329 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.d] 2024-08-17T02:23:36.329 INFO:teuthology.orchestra.run.smithi107.stdout:[mds] 2024-08-17T02:23:36.329 INFO:teuthology.orchestra.run.smithi107.stdout: debug mds = 20 2024-08-17T02:23:36.330 INFO:teuthology.orchestra.run.smithi107.stdout: debug mds balancer = 20 2024-08-17T02:23:36.330 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-08-17T02:23:36.330 INFO:teuthology.orchestra.run.smithi107.stdout: mds debug frag = True 2024-08-17T02:23:36.330 INFO:teuthology.orchestra.run.smithi107.stdout: mds debug scatterstat = True 2024-08-17T02:23:36.330 INFO:teuthology.orchestra.run.smithi107.stdout: mds op complaint time = 180 2024-08-17T02:23:36.330 INFO:teuthology.orchestra.run.smithi107.stdout: mds verify scatter = True 2024-08-17T02:23:36.330 INFO:teuthology.orchestra.run.smithi107.stdout: osd op complaint time = 180 2024-08-17T02:23:36.330 INFO:teuthology.orchestra.run.smithi107.stdout: rados mon op timeout = 900 2024-08-17T02:23:36.330 INFO:teuthology.orchestra.run.smithi107.stdout: rados osd op timeout = 900 2024-08-17T02:23:36.331 INFO:teuthology.orchestra.run.smithi157.stdout:[global] 2024-08-17T02:23:36.331 INFO:teuthology.orchestra.run.smithi157.stdout: chdir = "" 2024-08-17T02:23:36.331 INFO:teuthology.orchestra.run.smithi157.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-17T02:23:36.331 INFO:teuthology.orchestra.run.smithi157.stdout: auth supported = cephx 2024-08-17T02:23:36.331 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:23:36.331 INFO:teuthology.orchestra.run.smithi157.stdout: filestore xattr use omap = true 2024-08-17T02:23:36.331 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:23:36.331 INFO:teuthology.orchestra.run.smithi157.stdout: mon clock drift allowed = 1.000 2024-08-17T02:23:36.331 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:23:36.331 INFO:teuthology.orchestra.run.smithi157.stdout: osd crush chooseleaf type = 0 2024-08-17T02:23:36.331 INFO:teuthology.orchestra.run.smithi157.stdout: auth debug = true 2024-08-17T02:23:36.331 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:23:36.332 INFO:teuthology.orchestra.run.smithi157.stdout: ms die on old message = true 2024-08-17T02:23:36.332 INFO:teuthology.orchestra.run.smithi157.stdout: ms die on bug = true 2024-08-17T02:23:36.332 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:23:36.332 INFO:teuthology.orchestra.run.smithi157.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-17T02:23:36.332 INFO:teuthology.orchestra.run.smithi157.stdout: mon pg warn max object skew = 0 2024-08-17T02:23:36.332 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:23:36.332 INFO:teuthology.orchestra.run.smithi157.stdout: # disable pg_autoscaler by default for new pools 2024-08-17T02:23:36.332 INFO:teuthology.orchestra.run.smithi157.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-17T02:23:36.332 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:23:36.332 INFO:teuthology.orchestra.run.smithi157.stdout: osd pool default size = 2 2024-08-17T02:23:36.332 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:23:36.332 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd allow primary affinity = true 2024-08-17T02:23:36.332 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd allow pg remap = true 2024-08-17T02:23:36.332 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on legacy crush tunables = false 2024-08-17T02:23:36.332 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on crush straw calc version zero = false 2024-08-17T02:23:36.333 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on no sortbitwise = false 2024-08-17T02:23:36.333 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on osd down out interval zero = false 2024-08-17T02:23:36.333 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on too few osds = false 2024-08-17T02:23:36.333 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-17T02:23:36.333 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-17T02:23:36.333 INFO:teuthology.orchestra.run.smithi157.stdout: mon_allow_pool_size_one = true 2024-08-17T02:23:36.333 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:23:36.333 INFO:teuthology.orchestra.run.smithi157.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-17T02:23:36.333 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:23:36.333 INFO:teuthology.orchestra.run.smithi157.stdout: osd default data pool replay window = 5 2024-08-17T02:23:36.333 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:23:36.333 INFO:teuthology.orchestra.run.smithi157.stdout: mon allow pool delete = true 2024-08-17T02:23:36.333 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:23:36.333 INFO:teuthology.orchestra.run.smithi157.stdout: mon cluster log file level = debug 2024-08-17T02:23:36.334 INFO:teuthology.orchestra.run.smithi157.stdout: debug asserts on shutdown = true 2024-08-17T02:23:36.334 INFO:teuthology.orchestra.run.smithi157.stdout: mon health detail to clog = false 2024-08-17T02:23:36.334 INFO:teuthology.orchestra.run.smithi157.stdout: mon host = "172.21.15.107,172.21.15.157,[v2:172.21.15.157:3301,v1:172.21.15.157:6790]" 2024-08-17T02:23:36.334 INFO:teuthology.orchestra.run.smithi157.stdout: ms die on skipped message = False 2024-08-17T02:23:36.334 INFO:teuthology.orchestra.run.smithi157.stdout: fsid = f207b4c0-329d-46b8-b83f-aaf30bdb6ce3 2024-08-17T02:23:36.334 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:23:36.334 INFO:teuthology.orchestra.run.smithi157.stdout:[osd] 2024-08-17T02:23:36.334 INFO:teuthology.orchestra.run.smithi157.stdout: osd journal size = 100 2024-08-17T02:23:36.334 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:23:36.334 INFO:teuthology.orchestra.run.smithi157.stdout: osd scrub load threshold = 5.0 2024-08-17T02:23:36.334 INFO:teuthology.orchestra.run.smithi157.stdout: osd scrub max interval = 600 2024-08-17T02:23:36.334 INFO:teuthology.orchestra.run.smithi157.stdout: osd mclock profile = high_recovery_ops 2024-08-17T02:23:36.335 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:23:36.335 INFO:teuthology.orchestra.run.smithi157.stdout: osd recover clone overlap = true 2024-08-17T02:23:36.335 INFO:teuthology.orchestra.run.smithi157.stdout: osd recovery max chunk = 1048576 2024-08-17T02:23:36.335 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:23:36.335 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug shutdown = true 2024-08-17T02:23:36.335 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug op order = true 2024-08-17T02:23:36.336 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug verify stray on activate = true 2024-08-17T02:23:36.336 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:23:36.336 INFO:teuthology.orchestra.run.smithi157.stdout: osd open classes on start = true 2024-08-17T02:23:36.336 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug pg log writeout = true 2024-08-17T02:23:36.336 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:23:36.336 INFO:teuthology.orchestra.run.smithi157.stdout: osd deep scrub update digest min age = 30 2024-08-17T02:23:36.336 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:23:36.336 INFO:teuthology.orchestra.run.smithi157.stdout: osd map max advance = 10 2024-08-17T02:23:36.336 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:23:36.336 INFO:teuthology.orchestra.run.smithi157.stdout: journal zero on create = true 2024-08-17T02:23:36.336 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:23:36.336 INFO:teuthology.orchestra.run.smithi157.stdout: filestore ondisk finisher threads = 3 2024-08-17T02:23:36.337 INFO:teuthology.orchestra.run.smithi157.stdout: filestore apply finisher threads = 3 2024-08-17T02:23:36.337 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:23:36.337 INFO:teuthology.orchestra.run.smithi157.stdout: bdev debug aio = true 2024-08-17T02:23:36.337 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug misdirected ops = true 2024-08-17T02:23:36.337 INFO:teuthology.orchestra.run.smithi157.stdout: bdev async discard = True 2024-08-17T02:23:36.337 INFO:teuthology.orchestra.run.smithi157.stdout: bdev enable discard = True 2024-08-17T02:23:36.337 INFO:teuthology.orchestra.run.smithi157.stdout: bluestore allocator = bitmap 2024-08-17T02:23:36.337 INFO:teuthology.orchestra.run.smithi157.stdout: bluestore block size = 96636764160 2024-08-17T02:23:36.337 INFO:teuthology.orchestra.run.smithi157.stdout: bluestore fsck on mount = True 2024-08-17T02:23:36.338 INFO:teuthology.orchestra.run.smithi157.stdout: debug bluefs = 1/20 2024-08-17T02:23:36.338 INFO:teuthology.orchestra.run.smithi157.stdout: debug bluestore = 1/20 2024-08-17T02:23:36.338 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-08-17T02:23:36.338 INFO:teuthology.orchestra.run.smithi157.stdout: debug osd = 20 2024-08-17T02:23:36.338 INFO:teuthology.orchestra.run.smithi157.stdout: debug rocksdb = 4/10 2024-08-17T02:23:36.338 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd backfillfull_ratio = 0.85 2024-08-17T02:23:36.338 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd full ratio = 0.9 2024-08-17T02:23:36.338 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd nearfull ratio = 0.8 2024-08-17T02:23:36.338 INFO:teuthology.orchestra.run.smithi157.stdout: osd failsafe full ratio = 0.95 2024-08-17T02:23:36.338 INFO:teuthology.orchestra.run.smithi157.stdout: osd objectstore = bluestore 2024-08-17T02:23:36.338 INFO:teuthology.orchestra.run.smithi157.stdout: osd op complaint time = 180 2024-08-17T02:23:36.338 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:23:36.339 INFO:teuthology.orchestra.run.smithi157.stdout:[mgr] 2024-08-17T02:23:36.339 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-08-17T02:23:36.339 INFO:teuthology.orchestra.run.smithi157.stdout: debug mgr = 20 2024-08-17T02:23:36.339 INFO:teuthology.orchestra.run.smithi157.stdout: debug mon = 20 2024-08-17T02:23:36.339 INFO:teuthology.orchestra.run.smithi157.stdout: debug auth = 20 2024-08-17T02:23:36.339 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:23:36.339 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:23:36.339 INFO:teuthology.orchestra.run.smithi157.stdout: mgr/telemetry/nag = false 2024-08-17T02:23:36.339 INFO:teuthology.orchestra.run.smithi157.stdout: debug client = 20 2024-08-17T02:23:36.339 INFO:teuthology.orchestra.run.smithi157.stdout: debug finisher = 20 2024-08-17T02:23:36.339 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:23:36.339 INFO:teuthology.orchestra.run.smithi157.stdout:[mon] 2024-08-17T02:23:36.339 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-08-17T02:23:36.339 INFO:teuthology.orchestra.run.smithi157.stdout: debug mon = 20 2024-08-17T02:23:36.340 INFO:teuthology.orchestra.run.smithi157.stdout: debug paxos = 20 2024-08-17T02:23:36.340 INFO:teuthology.orchestra.run.smithi157.stdout: debug auth = 20 2024-08-17T02:23:36.340 INFO:teuthology.orchestra.run.smithi157.stdout: mon data avail warn = 5 2024-08-17T02:23:36.340 INFO:teuthology.orchestra.run.smithi157.stdout: mon mgr mkfs grace = 240 2024-08-17T02:23:36.340 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:23:36.340 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd reporter subtree level = osd 2024-08-17T02:23:36.340 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd prime pg temp = true 2024-08-17T02:23:36.340 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:23:36.340 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:23:36.340 INFO:teuthology.orchestra.run.smithi157.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-17T02:23:36.340 INFO:teuthology.orchestra.run.smithi157.stdout: auth mon ticket ttl = 660 # 11m 2024-08-17T02:23:36.340 INFO:teuthology.orchestra.run.smithi157.stdout: auth service ticket ttl = 240 # 4m 2024-08-17T02:23:36.340 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:23:36.341 INFO:teuthology.orchestra.run.smithi157.stdout: # don't complain about insecure global_id in the test suite 2024-08-17T02:23:36.341 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-17T02:23:36.341 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-17T02:23:36.341 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:23:36.341 INFO:teuthology.orchestra.run.smithi157.stdout: # 1m isn't quite enough 2024-08-17T02:23:36.341 INFO:teuthology.orchestra.run.smithi157.stdout: mon_down_mkfs_grace = 2m 2024-08-17T02:23:36.341 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:23:36.341 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_filestore_osds = false 2024-08-17T02:23:36.341 INFO:teuthology.orchestra.run.smithi157.stdout: mon op complaint time = 120 2024-08-17T02:23:36.341 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-08-17T02:23:36.341 INFO:teuthology.orchestra.run.smithi157.stdout:[client] 2024-08-17T02:23:36.342 INFO:teuthology.orchestra.run.smithi157.stdout: rgw cache enabled = true 2024-08-17T02:23:36.342 INFO:teuthology.orchestra.run.smithi157.stdout: rgw enable ops log = true 2024-08-17T02:23:36.342 INFO:teuthology.orchestra.run.smithi157.stdout: rgw enable usage log = true 2024-08-17T02:23:36.342 INFO:teuthology.orchestra.run.smithi157.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-17T02:23:36.342 INFO:teuthology.orchestra.run.smithi157.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-17T02:23:36.342 INFO:teuthology.orchestra.run.smithi157.stdout: client mount timeout = 600 2024-08-17T02:23:36.342 INFO:teuthology.orchestra.run.smithi157.stdout: debug client = 20 2024-08-17T02:23:36.342 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-08-17T02:23:36.342 INFO:teuthology.orchestra.run.smithi157.stdout: pid file = "" 2024-08-17T02:23:36.342 INFO:teuthology.orchestra.run.smithi157.stdout: rados mon op timeout = 900 2024-08-17T02:23:36.342 INFO:teuthology.orchestra.run.smithi157.stdout: rados osd op timeout = 900 2024-08-17T02:23:36.342 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.a] 2024-08-17T02:23:36.343 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.b] 2024-08-17T02:23:36.343 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.c] 2024-08-17T02:23:36.343 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.a] 2024-08-17T02:23:36.343 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.c] 2024-08-17T02:23:36.343 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.b] 2024-08-17T02:23:36.343 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.d] 2024-08-17T02:23:36.343 INFO:teuthology.orchestra.run.smithi157.stdout:[mds] 2024-08-17T02:23:36.343 INFO:teuthology.orchestra.run.smithi157.stdout: debug mds = 20 2024-08-17T02:23:36.343 INFO:teuthology.orchestra.run.smithi157.stdout: debug mds balancer = 20 2024-08-17T02:23:36.343 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-08-17T02:23:36.343 INFO:teuthology.orchestra.run.smithi157.stdout: mds debug frag = True 2024-08-17T02:23:36.343 INFO:teuthology.orchestra.run.smithi157.stdout: mds debug scatterstat = True 2024-08-17T02:23:36.343 INFO:teuthology.orchestra.run.smithi157.stdout: mds op complaint time = 180 2024-08-17T02:23:36.343 INFO:teuthology.orchestra.run.smithi157.stdout: mds verify scatter = True 2024-08-17T02:23:36.344 INFO:teuthology.orchestra.run.smithi157.stdout: osd op complaint time = 180 2024-08-17T02:23:36.344 INFO:teuthology.orchestra.run.smithi157.stdout: rados mon op timeout = 900 2024-08-17T02:23:36.344 INFO:teuthology.orchestra.run.smithi157.stdout: rados osd op timeout = 900 2024-08-17T02:23:36.345 INFO:tasks.ceph:Creating admin key on mon.a... 2024-08-17T02:23:36.346 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-08-17T02:23:36.437 INFO:tasks.ceph:Copying monmap to all nodes... 2024-08-17T02:23:36.437 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:23:36.437 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-08-17T02:23:36.473 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:23:36.473 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-08-17T02:23:36.547 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi107.front.sepia.ceph.com 2024-08-17T02:23:36.548 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:23:36.548 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-17T02:23:36.548 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:23:36.667 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:23:36.667 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:23:36.742 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi157.front.sepia.ceph.com 2024-08-17T02:23:36.742 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-08-17T02:23:36.742 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-17T02:23:36.742 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:23:36.822 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-08-17T02:23:36.822 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:23:36.897 INFO:tasks.ceph:Setting up mon nodes... 2024-08-17T02:23:36.897 INFO:tasks.ceph:Setting up mgr nodes... 2024-08-17T02:23:36.897 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-08-17T02:23:36.996 INFO:teuthology.orchestra.run.smithi107.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-08-17T02:23:37.002 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-08-17T02:23:37.117 INFO:teuthology.orchestra.run.smithi157.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-08-17T02:23:37.123 INFO:tasks.ceph:Setting up mds nodes... 2024-08-17T02:23:37.123 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-08-17T02:23:37.222 INFO:teuthology.orchestra.run.smithi107.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-08-17T02:23:37.226 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-08-17T02:23:37.282 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-08-17T02:23:37.379 INFO:teuthology.orchestra.run.smithi107.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-08-17T02:23:37.383 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-08-17T02:23:37.438 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-08-17T02:23:37.538 INFO:teuthology.orchestra.run.smithi157.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-08-17T02:23:37.542 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-08-17T02:23:37.599 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-08-17T02:23:37.696 INFO:teuthology.orchestra.run.smithi157.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-08-17T02:23:37.701 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-08-17T02:23:37.757 INFO:tasks.ceph_client:Setting up client nodes... 2024-08-17T02:23:37.758 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-17T02:23:37.833 INFO:teuthology.orchestra.run.smithi107.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-08-17T02:23:37.859 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-08-17T02:23:37.934 INFO:teuthology.orchestra.run.smithi107.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-08-17T02:23:37.961 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-08-17T02:23:38.055 INFO:teuthology.orchestra.run.smithi157.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-08-17T02:23:38.082 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-08-17T02:23:38.157 INFO:teuthology.orchestra.run.smithi157.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-08-17T02:23:38.184 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-08-17T02:23:38.184 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi107.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi157.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-17T02:23:38.184 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-08-17T02:23:38.240 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:23:38.240 INFO:tasks.ceph:role: osd.0 2024-08-17T02:23:38.240 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi107.front.sepia.ceph.com 2024-08-17T02:23:38.240 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-17T02:23:38.302 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:23:38.302 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:23:38.302 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:23:38.302 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:23:38.302 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:23:38.303 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:23:38.303 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:23:38.303 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:23:38.303 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:23:38.303 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:23:38.709 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-08-17T02:23:38.713 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-08-17T02:23:38.713 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-08-17T02:23:38.839 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-08-17T02:23:38.902 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-08-17T02:23:38.958 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:23:38.958 INFO:tasks.ceph:role: osd.1 2024-08-17T02:23:38.958 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi107.front.sepia.ceph.com 2024-08-17T02:23:38.958 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-17T02:23:39.021 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:23:39.021 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:23:39.021 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:23:39.021 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:23:39.021 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:23:39.021 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:23:39.021 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:23:39.021 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:23:39.021 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:23:39.021 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:23:39.379 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-08-17T02:23:39.382 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-08-17T02:23:39.383 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-08-17T02:23:39.466 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-08-17T02:23:39.527 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-08-17T02:23:39.583 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:23:39.583 INFO:tasks.ceph:role: osd.2 2024-08-17T02:23:39.583 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi107.front.sepia.ceph.com 2024-08-17T02:23:39.584 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-17T02:23:39.645 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:23:39.646 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:23:39.646 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:23:39.646 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:23:39.646 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:23:39.646 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:23:39.646 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:23:39.646 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:23:39.646 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:23:39.646 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:23:40.032 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-08-17T02:23:40.035 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-08-17T02:23:40.036 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-08-17T02:23:40.138 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-08-17T02:23:40.202 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-08-17T02:23:40.258 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:23:40.258 INFO:tasks.ceph:role: osd.3 2024-08-17T02:23:40.258 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi107.front.sepia.ceph.com 2024-08-17T02:23:40.258 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-17T02:23:40.321 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:23:40.321 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:23:40.321 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:23:40.321 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:23:40.321 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:23:40.321 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:23:40.321 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:23:40.321 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:23:40.321 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:23:40.321 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:23:40.749 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-08-17T02:23:40.753 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-08-17T02:23:40.753 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-08-17T02:23:40.871 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-08-17T02:23:40.938 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:23:41.035 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:23:41.034+0000 7fd9d11232c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-08-17T02:23:41.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:23:41.038+0000 7fd9d11232c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-08-17T02:23:41.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:23:41.038+0000 7fd9d11232c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:23:41.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:23:41.038+0000 7fd9d11232c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:23:41.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:23:41.038+0000 7fd9d11232c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:23:41.048 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:23:41.047+0000 7fd9d11232c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-08-17T02:23:41.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:23:41.592+0000 7fd9d11232c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:42.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:23:42.358+0000 7fd9d11232c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:43.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:23:43.132+0000 7fd9d11232c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:43.965 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-17T02:23:44.024 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:23:44.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:23:44.108+0000 7fde8ef252c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-08-17T02:23:44.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:23:44.108+0000 7fde8ef252c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-08-17T02:23:44.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:23:44.108+0000 7fde8ef252c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:23:44.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:23:44.108+0000 7fde8ef252c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:23:44.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:23:44.108+0000 7fde8ef252c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:23:44.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:23:44.110+0000 7fde8ef252c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-08-17T02:23:44.654 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:23:44.653+0000 7fde8ef252c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:45.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:23:45.416+0000 7fde8ef252c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:46.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:23:46.191+0000 7fde8ef252c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:47.016 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-17T02:23:47.073 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:23:47.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:23:47.155+0000 7f95426092c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-08-17T02:23:47.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:23:47.157+0000 7f95426092c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-08-17T02:23:47.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:23:47.157+0000 7f95426092c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:23:47.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:23:47.157+0000 7f95426092c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:23:47.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:23:47.157+0000 7f95426092c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:23:47.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:23:47.158+0000 7f95426092c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-08-17T02:23:47.706 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:23:47.704+0000 7f95426092c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:48.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:23:48.472+0000 7f95426092c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:49.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:23:49.253+0000 7f95426092c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:50.087 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-17T02:23:50.143 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:23:50.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:23:50.226+0000 7fafd380e2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-08-17T02:23:50.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:23:50.226+0000 7fafd380e2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-08-17T02:23:50.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:23:50.226+0000 7fafd380e2c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:23:50.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:23:50.226+0000 7fafd380e2c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:23:50.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:23:50.226+0000 7fafd380e2c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:23:50.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:23:50.229+0000 7fafd380e2c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-08-17T02:23:50.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:23:50.771+0000 7fafd380e2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:51.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:23:51.540+0000 7fafd380e2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:52.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:23:52.311+0000 7fafd380e2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:53.139 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-17T02:23:53.196 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-08-17T02:23:53.259 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:23:53.259 INFO:tasks.ceph:role: osd.4 2024-08-17T02:23:53.259 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi157.front.sepia.ceph.com 2024-08-17T02:23:53.259 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-17T02:23:53.316 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:23:53.316 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:23:53.316 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:23:53.316 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:23:53.316 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:23:53.316 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:23:53.317 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:23:53.317 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:23:53.317 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:23:53.317 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:23:53.350 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2024-08-17T02:23:53.354 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2024-08-17T02:23:53.354 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-08-17T02:23:53.436 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-08-17T02:23:53.498 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-08-17T02:23:53.557 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:23:53.557 INFO:tasks.ceph:role: osd.5 2024-08-17T02:23:53.557 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi157.front.sepia.ceph.com 2024-08-17T02:23:53.557 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-17T02:23:53.614 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:23:53.614 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:23:53.614 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:23:53.614 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:23:53.614 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:23:53.615 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:23:53.615 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:23:53.615 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:23:53.615 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:23:53.615 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:23:53.647 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2024-08-17T02:23:53.651 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2024-08-17T02:23:53.652 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-08-17T02:23:53.732 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-08-17T02:23:53.798 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-08-17T02:23:53.854 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:23:53.854 INFO:tasks.ceph:role: osd.6 2024-08-17T02:23:53.854 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi157.front.sepia.ceph.com 2024-08-17T02:23:53.855 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-17T02:23:53.911 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:23:53.912 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:23:53.912 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:23:53.912 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:23:53.912 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:23:53.912 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:23:53.912 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:23:53.912 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:23:53.912 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:23:53.912 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:23:53.945 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2024-08-17T02:23:53.949 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2024-08-17T02:23:53.949 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-08-17T02:23:54.034 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-08-17T02:23:54.096 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-08-17T02:23:54.152 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:23:54.152 INFO:tasks.ceph:role: osd.7 2024-08-17T02:23:54.152 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi157.front.sepia.ceph.com 2024-08-17T02:23:54.152 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-17T02:23:54.209 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:23:54.209 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:23:54.209 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:23:54.209 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:23:54.209 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:23:54.209 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:23:54.210 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:23:54.210 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:23:54.210 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:23:54.210 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:23:54.242 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2024-08-17T02:23:54.246 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2024-08-17T02:23:54.247 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-08-17T02:23:54.328 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-08-17T02:23:54.392 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:23:54.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:23:54.517+0000 7fa7b7a312c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-08-17T02:23:54.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:23:54.517+0000 7fa7b7a312c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-08-17T02:23:54.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:23:54.517+0000 7fa7b7a312c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:23:54.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:23:54.517+0000 7fa7b7a312c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:23:54.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:23:54.517+0000 7fa7b7a312c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:23:54.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:23:54.520+0000 7fa7b7a312c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-08-17T02:23:55.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:23:55.084+0000 7fa7b7a312c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:55.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:23:55.859+0000 7fa7b7a312c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:56.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:23:56.631+0000 7fa7b7a312c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:57.462 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-17T02:23:57.520 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:23:57.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:23:57.603+0000 7fee446302c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-08-17T02:23:57.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:23:57.603+0000 7fee446302c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-08-17T02:23:57.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:23:57.603+0000 7fee446302c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:23:57.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:23:57.603+0000 7fee446302c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:23:57.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:23:57.603+0000 7fee446302c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:23:57.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:23:57.605+0000 7fee446302c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-08-17T02:23:58.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:23:58.147+0000 7fee446302c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:58.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:23:58.916+0000 7fee446302c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:59.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:23:59.681+0000 7fee446302c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:24:00.512 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-17T02:24:00.572 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:24:00.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:00.655+0000 7f762ef1e2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-08-17T02:24:00.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:00.656+0000 7f762ef1e2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-08-17T02:24:00.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:00.656+0000 7f762ef1e2c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:24:00.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:00.656+0000 7f762ef1e2c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:24:00.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:00.656+0000 7f762ef1e2c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:24:00.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:00.657+0000 7f762ef1e2c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-08-17T02:24:01.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:01.199+0000 7f762ef1e2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:24:01.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:01.969+0000 7f762ef1e2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:24:02.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:02.735+0000 7f762ef1e2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:24:03.580 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-08-17T02:24:03.637 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:24:03.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:03.720+0000 7fd5f240d2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-08-17T02:24:03.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:03.721+0000 7fd5f240d2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-08-17T02:24:03.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:03.721+0000 7fd5f240d2c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:24:03.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:03.721+0000 7fd5f240d2c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:24:03.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:03.721+0000 7fd5f240d2c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:24:03.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:03.722+0000 7fd5f240d2c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-08-17T02:24:03.868 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:24:03.873 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:24:04.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:04.264+0000 7fd5f240d2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:24:05.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:05.030+0000 7fd5f240d2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:24:05.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:05.801+0000 7fd5f240d2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:24:06.617 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-08-17T02:24:06.674 INFO:tasks.ceph:Reading keys from all nodes... 2024-08-17T02:24:06.674 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:24:06.675 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-08-17T02:24:06.736 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:24:06.736 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-08-17T02:24:06.835 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:24:06.836 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-08-17T02:24:06.931 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:24:06.931 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-08-17T02:24:07.027 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:24:07.027 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-08-17T02:24:07.122 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:24:07.123 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-08-17T02:24:07.217 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:24:07.217 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-08-17T02:24:07.312 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-08-17T02:24:07.312 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-08-17T02:24:07.369 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-08-17T02:24:07.369 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-08-17T02:24:07.464 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-08-17T02:24:07.465 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-08-17T02:24:07.560 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-08-17T02:24:07.560 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-08-17T02:24:07.655 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-08-17T02:24:07.656 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-08-17T02:24:07.751 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-08-17T02:24:07.751 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-08-17T02:24:07.847 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-08-17T02:24:07.847 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-08-17T02:24:07.943 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:24:07.944 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-08-17T02:24:07.979 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:24:07.979 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-08-17T02:24:08.054 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-08-17T02:24:08.054 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-08-17T02:24:08.089 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-08-17T02:24:08.089 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-08-17T02:24:08.164 INFO:tasks.ceph:Adding keys to all mons... 2024-08-17T02:24:08.164 DEBUG:teuthology.orchestra.run.smithi107:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-17T02:24:08.169 DEBUG:teuthology.orchestra.run.smithi157:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-17T02:24:08.216 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr.y] 2024-08-17T02:24:08.216 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCoCcBmXPRqOxAAR9ibILpYy+B7dvqJ7ikXgg== 2024-08-17T02:24:08.217 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.a] 2024-08-17T02:24:08.217 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCpCcBmxPRCDRAAhT78Gnl8jk0XJW0wGCxrfA== 2024-08-17T02:24:08.217 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.c] 2024-08-17T02:24:08.217 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCpCcBmr+mcFhAAKFHlxANodo399NowgZyKhg== 2024-08-17T02:24:08.217 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.0] 2024-08-17T02:24:08.217 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCtCcBm+VcmAhAAtkGTP+l6geE4odiK8RiL9w== 2024-08-17T02:24:08.217 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.1] 2024-08-17T02:24:08.217 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCwCcBm7EGKBhAAgVz+H8m/NKAt4rabJK2n8A== 2024-08-17T02:24:08.217 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.2] 2024-08-17T02:24:08.217 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCzCcBmpApdCRAApp3QoHpsQ6zn/5HDWqj7CQ== 2024-08-17T02:24:08.217 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.3] 2024-08-17T02:24:08.217 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQC2CcBmi5GQDRAA3AIW/HKLm7h2QhhCBfeiSQ== 2024-08-17T02:24:08.217 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr.x] 2024-08-17T02:24:08.218 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCpCcBmBlsHBxAA9Q+VtkQflrNzWt+JFzOk4A== 2024-08-17T02:24:08.218 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.b] 2024-08-17T02:24:08.218 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCpCcBmLnAfIBAAVyO94XU3FmnxBY9RysDzVw== 2024-08-17T02:24:08.218 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.d] 2024-08-17T02:24:08.218 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCpCcBmmqiRKRAA5siSxI57VLYZBbMm3CwjGA== 2024-08-17T02:24:08.218 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.4] 2024-08-17T02:24:08.218 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQC6CcBmvHHrHhAAPjwOr8n7O3uLl4sUZvKevQ== 2024-08-17T02:24:08.218 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.5] 2024-08-17T02:24:08.218 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQC9CcBmEPwNJBAAUOLYp0TLPCSHaqJ2Bh4SMA== 2024-08-17T02:24:08.218 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.6] 2024-08-17T02:24:08.218 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDACcBmXHEtJxAA8yOvl/+o8ENwwOTaMlZfww== 2024-08-17T02:24:08.218 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.7] 2024-08-17T02:24:08.219 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDDCcBmGAUGKxAAwuCBNbKgcBVcAz5rdBgtxw== 2024-08-17T02:24:08.219 INFO:teuthology.orchestra.run.smithi107.stdout:[client.0] 2024-08-17T02:24:08.219 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCpCcBmWtSxMRAArb++PjeYtDeqQLOQqVxZxw== 2024-08-17T02:24:08.219 INFO:teuthology.orchestra.run.smithi107.stdout:[client.2] 2024-08-17T02:24:08.219 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCpCcBmjbS4NxAAe8XtbKcfcmi1loSpHk2/5Q== 2024-08-17T02:24:08.219 INFO:teuthology.orchestra.run.smithi107.stdout:[client.1] 2024-08-17T02:24:08.219 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCqCcBmowBOAxAAZnOJ1GCJDMLGy8u5FxjsWw== 2024-08-17T02:24:08.219 INFO:teuthology.orchestra.run.smithi107.stdout:[client.3] 2024-08-17T02:24:08.219 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCqCcBmXPhnCRAAVN8EdxDnGz/2Pf2yrIwZ6g== 2024-08-17T02:24:08.258 INFO:teuthology.orchestra.run.smithi157.stdout:[mgr.y] 2024-08-17T02:24:08.258 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQCoCcBmXPRqOxAAR9ibILpYy+B7dvqJ7ikXgg== 2024-08-17T02:24:08.258 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.a] 2024-08-17T02:24:08.258 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQCpCcBmxPRCDRAAhT78Gnl8jk0XJW0wGCxrfA== 2024-08-17T02:24:08.258 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.c] 2024-08-17T02:24:08.258 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQCpCcBmr+mcFhAAKFHlxANodo399NowgZyKhg== 2024-08-17T02:24:08.258 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.0] 2024-08-17T02:24:08.258 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQCtCcBm+VcmAhAAtkGTP+l6geE4odiK8RiL9w== 2024-08-17T02:24:08.258 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.1] 2024-08-17T02:24:08.258 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQCwCcBm7EGKBhAAgVz+H8m/NKAt4rabJK2n8A== 2024-08-17T02:24:08.259 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.2] 2024-08-17T02:24:08.259 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQCzCcBmpApdCRAApp3QoHpsQ6zn/5HDWqj7CQ== 2024-08-17T02:24:08.259 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.3] 2024-08-17T02:24:08.259 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQC2CcBmi5GQDRAA3AIW/HKLm7h2QhhCBfeiSQ== 2024-08-17T02:24:08.259 INFO:teuthology.orchestra.run.smithi157.stdout:[mgr.x] 2024-08-17T02:24:08.259 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQCpCcBmBlsHBxAA9Q+VtkQflrNzWt+JFzOk4A== 2024-08-17T02:24:08.259 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.b] 2024-08-17T02:24:08.259 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQCpCcBmLnAfIBAAVyO94XU3FmnxBY9RysDzVw== 2024-08-17T02:24:08.259 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.d] 2024-08-17T02:24:08.259 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQCpCcBmmqiRKRAA5siSxI57VLYZBbMm3CwjGA== 2024-08-17T02:24:08.259 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.4] 2024-08-17T02:24:08.259 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQC6CcBmvHHrHhAAPjwOr8n7O3uLl4sUZvKevQ== 2024-08-17T02:24:08.259 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.5] 2024-08-17T02:24:08.259 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQC9CcBmEPwNJBAAUOLYp0TLPCSHaqJ2Bh4SMA== 2024-08-17T02:24:08.260 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.6] 2024-08-17T02:24:08.260 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDACcBmXHEtJxAA8yOvl/+o8ENwwOTaMlZfww== 2024-08-17T02:24:08.260 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.7] 2024-08-17T02:24:08.260 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDDCcBmGAUGKxAAwuCBNbKgcBVcAz5rdBgtxw== 2024-08-17T02:24:08.260 INFO:teuthology.orchestra.run.smithi157.stdout:[client.0] 2024-08-17T02:24:08.260 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQCpCcBmWtSxMRAArb++PjeYtDeqQLOQqVxZxw== 2024-08-17T02:24:08.260 INFO:teuthology.orchestra.run.smithi157.stdout:[client.2] 2024-08-17T02:24:08.260 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQCpCcBmjbS4NxAAe8XtbKcfcmi1loSpHk2/5Q== 2024-08-17T02:24:08.260 INFO:teuthology.orchestra.run.smithi157.stdout:[client.1] 2024-08-17T02:24:08.260 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQCqCcBmowBOAxAAZnOJ1GCJDMLGy8u5FxjsWw== 2024-08-17T02:24:08.260 INFO:teuthology.orchestra.run.smithi157.stdout:[client.3] 2024-08-17T02:24:08.260 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQCqCcBmXPhnCRAAVN8EdxDnGz/2Pf2yrIwZ6g== 2024-08-17T02:24:08.261 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:24:08.265 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:24:08.389 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:24:08.395 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:24:08.484 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:24:08.488 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:24:08.578 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:08.582 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:08.668 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:08.672 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:08.759 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:08.763 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:08.851 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:08.855 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:08.942 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:24:08.946 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:24:09.033 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:24:09.036 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:24:09.126 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:24:09.130 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:24:09.220 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:09.225 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:09.312 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:09.316 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:09.403 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:09.408 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:09.495 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:09.498 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:09.585 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:24:09.589 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:24:09.679 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:24:09.683 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:24:09.775 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:24:09.779 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:24:09.870 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:24:09.874 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:24:09.964 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-08-17T02:24:09.964 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-08-17T02:24:10.020 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:24:10.120 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-08-17T02:24:10.176 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-08-17T02:24:10.236 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:24:10.336 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-08-17T02:24:10.392 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-08-17T02:24:10.448 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:24:10.547 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-08-17T02:24:10.603 DEBUG:teuthology.orchestra.run.smithi107:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:24:10.608 DEBUG:teuthology.orchestra.run.smithi157:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:24:10.644 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-08-17T02:24:10.645 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-17T02:24:10.645 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-17T02:24:10.683 INFO:tasks.ceph.mon.a:Started 2024-08-17T02:24:10.683 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-17T02:24:10.683 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-17T02:24:10.689 INFO:tasks.ceph.mon.b:Started 2024-08-17T02:24:10.689 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-17T02:24:10.689 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-17T02:24:10.692 INFO:tasks.ceph.mon.c:Started 2024-08-17T02:24:10.692 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-08-17T02:24:10.693 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-08-17T02:24:10.693 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-08-17T02:24:10.698 INFO:tasks.ceph.mgr.y:Started 2024-08-17T02:24:10.698 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-08-17T02:24:10.699 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-08-17T02:24:10.703 INFO:tasks.ceph.mgr.x:Started 2024-08-17T02:24:10.703 INFO:tasks.ceph:Setting crush tunables to default 2024-08-17T02:24:10.703 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd crush tunables default 2024-08-17T02:24:10.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:10.851+0000 7f7aafe00640 1 Processor -- start 2024-08-17T02:24:10.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:10.851+0000 7f7aafe00640 1 -- start start 2024-08-17T02:24:10.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:10.852+0000 7f7aafe00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7aa8156990 0x7f7aa80b05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:10.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:10.853+0000 7f7aafe00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7aa8156d60 0x7f7aa80b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:10.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:10.853+0000 7f7aafe00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aa815b030 con 0x7f7aa80ad7b0 2024-08-17T02:24:10.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:10.853+0000 7f7aafe00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aa80af950 con 0x7f7aa8156d60 2024-08-17T02:24:10.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:10.853+0000 7f7aafe00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aa80cc2e0 con 0x7f7aa8156990 2024-08-17T02:24:10.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:10.853+0000 7f7aad400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7aa8156990 0x7f7aa80b05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:10.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:10.853+0000 7f7aad400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7aa8156990 0x7f7aa80b05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:40176/0 (socket says 172.21.15.107:40176) 2024-08-17T02:24:10.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:10.853+0000 7f7aad400640 1 -- 172.21.15.107:0/2437343545 learned_addr learned my addr 172.21.15.107:0/2437343545 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:10.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:10.853+0000 7f7aad400640 1 -- 172.21.15.107:0/2437343545 >> v2:172.21.15.157:3300/0 conn(0x7f7aa8156990 msgr2=0x7f7aa80b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:24:10.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:10.853+0000 7f7aad400640 1 -- 172.21.15.107:0/2437343545 >> v2:172.21.15.157:3300/0 conn(0x7f7aa8156990 msgr2=0x7f7aa80b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:24:10.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:10.853+0000 7f7aaca00640 1 --2- 172.21.15.107:0/2437343545 >> v2:172.21.15.107:3300/0 conn(0x7f7aa8156d60 0x7f7aa80b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:10.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:10.853+0000 7f7aad400640 1 --2- 172.21.15.107:0/2437343545 >> v2:172.21.15.157:3300/0 conn(0x7f7aa8156990 0x7f7aa80b05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:24:10.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:10.853+0000 7f7aad400640 1 --2- 172.21.15.107:0/2437343545 >> v2:172.21.15.157:3300/0 conn(0x7f7aa8156990 0x7f7aa80b05a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:24:10.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:10.853+0000 7f7aaca00640 1 -- 172.21.15.107:0/2437343545 >> v2:172.21.15.107:3300/0 conn(0x7f7aa8156d60 msgr2=0x7f7aa80b0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:24:10.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:10.853+0000 7f7aaca00640 1 -- 172.21.15.107:0/2437343545 >> v2:172.21.15.107:3300/0 conn(0x7f7aa8156d60 msgr2=0x7f7aa80b0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:24:10.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:10.853+0000 7f7aaca00640 1 --2- 172.21.15.107:0/2437343545 >> v2:172.21.15.107:3300/0 conn(0x7f7aa8156d60 0x7f7aa80b0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:24:10.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:10.853+0000 7f7aaca00640 1 --2- 172.21.15.107:0/2437343545 >> v2:172.21.15.107:3300/0 conn(0x7f7aa8156d60 0x7f7aa80b0ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:24:11.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.049+0000 7f7aa7e00640 1 -- 172.21.15.107:0/2437343545 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2109759068 0 0) 0x7f7aa815b030 con 0x7f7aa80ad7b0 2024-08-17T02:24:11.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.049+0000 7f7aa7e00640 1 -- 172.21.15.107:0/2437343545 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a900034e0 con 0x7f7aa80ad7b0 2024-08-17T02:24:11.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.050+0000 7f7aa7e00640 1 -- 172.21.15.107:0/2437343545 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3709520833 0 0) 0x7f7a900034e0 con 0x7f7aa80ad7b0 2024-08-17T02:24:11.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.050+0000 7f7aa7e00640 1 -- 172.21.15.107:0/2437343545 >> v2:172.21.15.157:3300/0 conn(0x7f7aa8156990 msgr2=0x7f7aa80b05a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:24:11.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.050+0000 7f7aa7e00640 1 --2- 172.21.15.107:0/2437343545 >> v2:172.21.15.157:3300/0 conn(0x7f7aa8156990 0x7f7aa80b05a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.050+0000 7f7aa7e00640 1 -- 172.21.15.107:0/2437343545 >> v2:172.21.15.107:3300/0 conn(0x7f7aa8156d60 msgr2=0x7f7aa80b0ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:24:11.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.050+0000 7f7aa7e00640 1 --2- 172.21.15.107:0/2437343545 >> v2:172.21.15.107:3300/0 conn(0x7f7aa8156d60 0x7f7aa80b0ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.050+0000 7f7aa7e00640 1 -- 172.21.15.107:0/2437343545 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa80b1110 con 0x7f7aa80ad7b0 2024-08-17T02:24:11.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.051+0000 7f7aa7e00640 1 -- 172.21.15.107:0/2437343545 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 537989081 0 0) 0x7f7aa00017f0 con 0x7f7aa80ad7b0 2024-08-17T02:24:11.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.051+0000 7f7aa7e00640 1 -- 172.21.15.107:0/2437343545 >> v1:172.21.15.107:6789/0 conn(0x7f7aa80ad7b0 legacy=0x7f7aa806d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:11.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.051+0000 7f7aa7e00640 1 --2- 172.21.15.107:0/2437343545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a90003aa0 0x7f7a90003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:11.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.051+0000 7f7aa7e00640 1 --2- 172.21.15.107:0/2437343545 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a90004780 0x7f7a90004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:11.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.051+0000 7f7aa7e00640 1 --2- 172.21.15.107:0/2437343545 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a90005250 0x7f7a9000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:11.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.051+0000 7f7aa7e00640 1 -- 172.21.15.107:0/2437343545 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa80af950 con 0x7f7a90003aa0 2024-08-17T02:24:11.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.051+0000 7f7aa7e00640 1 -- 172.21.15.107:0/2437343545 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa80cc2e0 con 0x7f7a90005250 2024-08-17T02:24:11.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.051+0000 7f7aa7e00640 1 -- 172.21.15.107:0/2437343545 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9000c150 con 0x7f7a90004780 2024-08-17T02:24:11.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.051+0000 7f7aad400640 1 --2- 172.21.15.107:0/2437343545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a90003aa0 0x7f7a90003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:11.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.051+0000 7f7aaca00640 1 --2- 172.21.15.107:0/2437343545 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a90004780 0x7f7a90004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:11.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.051+0000 7f7aad400640 1 -- 172.21.15.107:0/2437343545 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a90004780 msgr2=0x7f7a90004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:11.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.051+0000 7f7aad400640 1 --2- 172.21.15.107:0/2437343545 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a90004780 0x7f7a90004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.051+0000 7f7aad400640 1 -- 172.21.15.107:0/2437343545 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a90005250 msgr2=0x7f7a9000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:11.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.051+0000 7f7aade00640 1 --2- 172.21.15.107:0/2437343545 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a90005250 0x7f7a9000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:11.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.051+0000 7f7aad400640 1 --2- 172.21.15.107:0/2437343545 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a90005250 0x7f7a9000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.051+0000 7f7aad400640 1 -- 172.21.15.107:0/2437343545 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a900034e0 con 0x7f7a90003aa0 2024-08-17T02:24:11.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.052+0000 7f7aade00640 1 --2- 172.21.15.107:0/2437343545 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a90005250 0x7f7a9000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:11.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.052+0000 7f7aade00640 1 -- 172.21.15.107:0/2437343545 reap_dead start 2024-08-17T02:24:11.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.052+0000 7f7aaca00640 1 --2- 172.21.15.107:0/2437343545 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a90004780 0x7f7a90004bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:11.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.053+0000 7f7aad400640 1 --2- 172.21.15.107:0/2437343545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a90003aa0 0x7f7a90003eb0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c006fd0 tx=0x7f7a9c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=729da730ce2224fa server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:11.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.053+0000 7f7aa7e00640 1 -- 172.21.15.107:0/2437343545 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c02acb0 con 0x7f7a90003aa0 2024-08-17T02:24:11.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.053+0000 7f7aa7e00640 1 -- 172.21.15.107:0/2437343545 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a9c02ae50 con 0x7f7a90003aa0 2024-08-17T02:24:11.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.053+0000 7f7aa7e00640 1 -- 172.21.15.107:0/2437343545 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c032690 con 0x7f7a90003aa0 2024-08-17T02:24:11.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.054+0000 7f7aafe00640 1 -- 172.21.15.107:0/2437343545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a90003aa0 msgr2=0x7f7a90003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:11.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.054+0000 7f7aafe00640 1 --2- 172.21.15.107:0/2437343545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a90003aa0 0x7f7a90003eb0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c006fd0 tx=0x7f7a9c008040 comp rx=0 tx=0).stop 2024-08-17T02:24:11.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.054+0000 7f7aafe00640 1 -- 172.21.15.107:0/2437343545 shutdown_connections 2024-08-17T02:24:11.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.054+0000 7f7aafe00640 1 --2- 172.21.15.107:0/2437343545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a90003aa0 0x7f7a90003eb0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.054+0000 7f7aafe00640 1 -- 172.21.15.107:0/2437343545 >> 172.21.15.107:0/2437343545 conn(0x7f7aa8067750 msgr2=0x7f7aa80cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:11.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.054+0000 7f7aafe00640 1 -- 172.21.15.107:0/2437343545 shutdown_connections 2024-08-17T02:24:11.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.054+0000 7f7aafe00640 1 -- 172.21.15.107:0/2437343545 wait complete. 2024-08-17T02:24:11.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.056+0000 7f7aafe00640 1 Processor -- start 2024-08-17T02:24:11.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.056+0000 7f7aafe00640 1 -- start start 2024-08-17T02:24:11.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.057+0000 7f7aafe00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a90003aa0 0x7f7aa80ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:11.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.057+0000 7f7aafe00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7aa80ca6a0 0x7f7aa8151500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:11.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.058+0000 7f7aad400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a90003aa0 0x7f7aa80ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:11.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.058+0000 7f7aafe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7aa8069da0 0x7f7aa8151a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:11.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.058+0000 7f7aafe00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa8157130 con 0x7f7aa8069da0 2024-08-17T02:24:11.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.058+0000 7f7aafe00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa81579d0 con 0x7f7aa80ca6a0 2024-08-17T02:24:11.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.058+0000 7f7aafe00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa816d4f0 con 0x7f7a90003aa0 2024-08-17T02:24:11.059 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.058+0000 7f7aad400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a90003aa0 0x7f7aa80ca160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:40196/0 (socket says 172.21.15.107:40196) 2024-08-17T02:24:11.059 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.058+0000 7f7aad400640 1 -- 172.21.15.107:0/3212058819 learned_addr learned my addr 172.21.15.107:0/3212058819 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:11.059 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.058+0000 7f7aade00640 1 --2- 172.21.15.107:0/3212058819 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7aa8069da0 0x7f7aa8151a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:11.059 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.058+0000 7f7aaca00640 1 --2- 172.21.15.107:0/3212058819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7aa80ca6a0 0x7f7aa8151500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:11.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.059+0000 7f7aade00640 1 -- 172.21.15.107:0/3212058819 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a90003aa0 msgr2=0x7f7aa80ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:11.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.059+0000 7f7aade00640 1 --2- 172.21.15.107:0/3212058819 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a90003aa0 0x7f7aa80ca160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.059+0000 7f7aade00640 1 -- 172.21.15.107:0/3212058819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7aa80ca6a0 msgr2=0x7f7aa8151500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:11.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.059+0000 7f7aade00640 1 --2- 172.21.15.107:0/3212058819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7aa80ca6a0 0x7f7aa8151500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.059+0000 7f7aade00640 1 -- 172.21.15.107:0/3212058819 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa8157380 con 0x7f7aa8069da0 2024-08-17T02:24:11.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.059+0000 7f7aade00640 1 --2- 172.21.15.107:0/3212058819 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7aa8069da0 0x7f7aa8151a40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7aa806b910 tx=0x7f7aa0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:11.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.059+0000 7f7aa4c00640 1 -- 172.21.15.107:0/3212058819 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa0006b10 con 0x7f7aa8069da0 2024-08-17T02:24:11.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.059+0000 7f7aa4c00640 1 -- 172.21.15.107:0/3212058819 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa0006c90 con 0x7f7aa8069da0 2024-08-17T02:24:11.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.059+0000 7f7aa4c00640 1 -- 172.21.15.107:0/3212058819 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa0012850 con 0x7f7aa8069da0 2024-08-17T02:24:11.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.059+0000 7f7aafe00640 1 -- 172.21.15.107:0/3212058819 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aa8157660 con 0x7f7aa8069da0 2024-08-17T02:24:11.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.060+0000 7f7aafe00640 1 -- 172.21.15.107:0/3212058819 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aa806a210 con 0x7f7aa8069da0 2024-08-17T02:24:11.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.060+0000 7f7aa4c00640 1 -- 172.21.15.107:0/3212058819 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f7aa0012c00 con 0x7f7aa8069da0 2024-08-17T02:24:11.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.060+0000 7f7aa4c00640 1 -- 172.21.15.107:0/3212058819 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f7aa00076e0 con 0x7f7aa8069da0 2024-08-17T02:24:11.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.061+0000 7f7aafe00640 1 -- 172.21.15.107:0/3212058819 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aa8157b60 con 0x7f7aa8069da0 2024-08-17T02:24:11.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.064+0000 7f7aa4c00640 1 -- 172.21.15.107:0/3212058819 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f7aa0006e00 con 0x7f7aa8069da0 2024-08-17T02:24:11.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.144+0000 7f7aafe00640 1 -- 172.21.15.107:0/3212058819 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f7aa8071050 con 0x7f7aa8069da0 2024-08-17T02:24:11.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.147+0000 7f7aa4c00640 1 -- 172.21.15.107:0/3212058819 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f7aa0025430 con 0x7f7aa8069da0 2024-08-17T02:24:11.147 INFO:teuthology.orchestra.run.smithi107.stderr:adjusted tunables profile to default 2024-08-17T02:24:11.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.148+0000 7f7aafe00640 1 -- 172.21.15.107:0/3212058819 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7aa8069da0 msgr2=0x7f7aa8151a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:11.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.148+0000 7f7aafe00640 1 --2- 172.21.15.107:0/3212058819 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7aa8069da0 0x7f7aa8151a40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7aa806b910 tx=0x7f7aa0009040 comp rx=0 tx=0).stop 2024-08-17T02:24:11.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.148+0000 7f7aafe00640 1 -- 172.21.15.107:0/3212058819 shutdown_connections 2024-08-17T02:24:11.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.148+0000 7f7aafe00640 1 --2- 172.21.15.107:0/3212058819 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7aa8069da0 0x7f7aa8151a40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.148+0000 7f7aafe00640 1 --2- 172.21.15.107:0/3212058819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7aa80ca6a0 0x7f7aa8151500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.148+0000 7f7aafe00640 1 --2- 172.21.15.107:0/3212058819 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a90003aa0 0x7f7aa80ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.148+0000 7f7aafe00640 1 -- 172.21.15.107:0/3212058819 >> 172.21.15.107:0/3212058819 conn(0x7f7aa8067750 msgr2=0x7f7aa8152840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:11.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.148+0000 7f7aafe00640 1 -- 172.21.15.107:0/3212058819 shutdown_connections 2024-08-17T02:24:11.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:11.149+0000 7f7aafe00640 1 -- 172.21.15.107:0/3212058819 wait complete. 2024-08-17T02:24:11.164 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-08-17T02:24:11.164 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:24:11.164 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-08-17T02:24:11.183 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-08-17T02:24:11.182+0000 7f64ac619ec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-17T02:24:11.192 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-08-17T02:24:11.191+0000 7f94cef6bec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-17T02:24:11.220 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:24:11.220 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-08-17T02:24:11.316 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:24:11.316 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-08-17T02:24:11.332 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-08-17T02:24:11.331+0000 7f64ac619ec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:24:11.343 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-08-17T02:24:11.343+0000 7f94cef6bec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:24:11.391 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-08-17T02:24:11.390+0000 7f64ac619ec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-17T02:24:11.398 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:24:11.398 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-08-17T02:24:11.406 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-08-17T02:24:11.406+0000 7f94cef6bec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-17T02:24:11.461 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-08-17T02:24:11.461 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-08-17T02:24:11.517 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-08-17T02:24:11.518 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-08-17T02:24:11.614 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-08-17T02:24:11.614 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-08-17T02:24:11.676 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-08-17T02:24:11.676+0000 7f94cef6bec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-17T02:24:11.693 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-08-17T02:24:11.692+0000 7f64ac619ec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-17T02:24:11.712 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-08-17T02:24:11.712 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-08-17T02:24:11.726 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-08-17T02:24:11.727+0000 7f94cef6bec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-17T02:24:11.747 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-08-17T02:24:11.746+0000 7f64ac619ec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-17T02:24:11.802 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 376363f3-b8bf-4f1e-b691-51cdd39171ce 0 2024-08-17T02:24:11.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.986+0000 7f3cbd000640 1 Processor -- start 2024-08-17T02:24:11.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.986+0000 7f3cbd000640 1 -- start start 2024-08-17T02:24:11.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.987+0000 7f3cbd000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3cb80ca770 0x7f3cb80c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:11.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.987+0000 7f3cbd000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cb806f240 con 0x7f3cb80ca2f0 2024-08-17T02:24:11.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.987+0000 7f3cbd000640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cb80cf410 con 0x7f3cb8158ea0 2024-08-17T02:24:11.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.987+0000 7f3cbd000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb80c6f20 con 0x7f3cb80ca770 2024-08-17T02:24:11.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.987+0000 7f3cb5e00640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f3cb8158ea0 0x7f3cb80d0460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:45158/0 (socket says 172.21.15.157:45158) 2024-08-17T02:24:11.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.987+0000 7f3cb6800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3cb80ca770 0x7f3cb80c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:11.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.987+0000 7f3cb5e00640 1 -- 172.21.15.157:0/2034508329 learned_addr learned my addr 172.21.15.157:0/2034508329 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-08-17T02:24:11.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.988+0000 7f3cb6800640 1 -- 172.21.15.157:0/2034508329 >> v1:172.21.15.157:6789/0 conn(0x7f3cb8158ea0 legacy=0x7f3cb80d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:11.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.988+0000 7f3cb6800640 1 -- 172.21.15.157:0/2034508329 >> v1:172.21.15.107:6789/0 conn(0x7f3cb80ca2f0 legacy=0x7f3cb80c7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:11.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.988+0000 7f3cb4a00640 1 -- 172.21.15.157:0/2034508329 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2318507363 0 0) 0x7f3cb80cf410 con 0x7f3cb8158ea0 2024-08-17T02:24:11.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.988+0000 7f3cb6800640 1 -- 172.21.15.157:0/2034508329 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb80d0b70 con 0x7f3cb80ca770 2024-08-17T02:24:11.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.989+0000 7f3cb6800640 1 --2- 172.21.15.157:0/2034508329 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3cb80ca770 0x7f3cb80c7a80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0009e90 tx=0x7f3cb0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53919b5baa981744 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:11.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.989+0000 7f3cb4a00640 1 -- 172.21.15.157:0/2034508329 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb0007550 con 0x7f3cb80ca770 2024-08-17T02:24:11.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.989+0000 7f3cb4a00640 1 -- 172.21.15.157:0/2034508329 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb002d050 con 0x7f3cb80ca770 2024-08-17T02:24:11.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.989+0000 7f3cb4a00640 1 -- 172.21.15.157:0/2034508329 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb00078e0 con 0x7f3cb80ca770 2024-08-17T02:24:11.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.990+0000 7f3cbd000640 1 -- 172.21.15.157:0/2034508329 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3cb80ca770 msgr2=0x7f3cb80c7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:11.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.990+0000 7f3cbd000640 1 --2- 172.21.15.157:0/2034508329 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3cb80ca770 0x7f3cb80c7a80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0009e90 tx=0x7f3cb0009780 comp rx=0 tx=0).stop 2024-08-17T02:24:11.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.990+0000 7f3cbd000640 1 -- 172.21.15.157:0/2034508329 shutdown_connections 2024-08-17T02:24:11.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.990+0000 7f3cbd000640 1 --2- 172.21.15.157:0/2034508329 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3cb80ca770 0x7f3cb80c7a80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.990+0000 7f3cbd000640 1 -- 172.21.15.157:0/2034508329 >> 172.21.15.157:0/2034508329 conn(0x7f3cb806eb90 msgr2=0x7f3cb80cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:11.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.990+0000 7f3cbd000640 1 -- 172.21.15.157:0/2034508329 shutdown_connections 2024-08-17T02:24:11.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.990+0000 7f3cbd000640 1 -- 172.21.15.157:0/2034508329 wait complete. 2024-08-17T02:24:11.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.991+0000 7f3cbd000640 1 Processor -- start 2024-08-17T02:24:11.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.991+0000 7f3cbd000640 1 -- start start 2024-08-17T02:24:11.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.992+0000 7f3cbd000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3cb80ca2f0 0x7f3cb80b4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:11.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.992+0000 7f3cbd000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cb80ca770 0x7f3cb80b15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:11.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.992+0000 7f3cbd000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3cb8158ea0 0x7f3cb80c5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:11.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.992+0000 7f3cbd000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb80b5630 con 0x7f3cb8158ea0 2024-08-17T02:24:11.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.992+0000 7f3cbd000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb8168d80 con 0x7f3cb80ca770 2024-08-17T02:24:11.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.992+0000 7f3cbd000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb81695e0 con 0x7f3cb80ca2f0 2024-08-17T02:24:11.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.992+0000 7f3cb5400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cb80ca770 0x7f3cb80b15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:11.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.992+0000 7f3cb5e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3cb80ca2f0 0x7f3cb80b4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:11.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.992+0000 7f3cb5400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cb80ca770 0x7f3cb80b15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48446/0 (socket says 172.21.15.157:48446) 2024-08-17T02:24:11.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.992+0000 7f3cb5400640 1 -- 172.21.15.157:0/1951830140 learned_addr learned my addr 172.21.15.157:0/1951830140 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-08-17T02:24:11.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.992+0000 7f3cb5e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3cb80ca2f0 0x7f3cb80b4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:41124/0 (socket says 172.21.15.157:41124) 2024-08-17T02:24:11.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.992+0000 7f3cb6800640 1 --2- 172.21.15.157:0/1951830140 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3cb8158ea0 0x7f3cb80c5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:11.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.993+0000 7f3cb5e00640 1 -- 172.21.15.157:0/1951830140 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cb80ca770 msgr2=0x7f3cb80b15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:11.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.993+0000 7f3cb5e00640 1 --2- 172.21.15.157:0/1951830140 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cb80ca770 0x7f3cb80b15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.993+0000 7f3cb5e00640 1 -- 172.21.15.157:0/1951830140 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3cb8158ea0 msgr2=0x7f3cb80c5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:11.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.993+0000 7f3cb5e00640 1 --2- 172.21.15.157:0/1951830140 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3cb8158ea0 0x7f3cb80c5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:11.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.993+0000 7f3cb5e00640 1 -- 172.21.15.157:0/1951830140 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb0009a20 con 0x7f3cb80ca2f0 2024-08-17T02:24:11.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.993+0000 7f3cb5400640 1 --2- 172.21.15.157:0/1951830140 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cb80ca770 0x7f3cb80b15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:11.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.993+0000 7f3cb5e00640 1 --2- 172.21.15.157:0/1951830140 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3cb80ca2f0 0x7f3cb80b4a50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8000c00 tx=0x7f3ca8007c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:11.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.993+0000 7f3cad600640 1 -- 172.21.15.157:0/1951830140 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8005aa0 con 0x7f3cb80ca2f0 2024-08-17T02:24:11.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.993+0000 7f3cad600640 1 -- 172.21.15.157:0/1951830140 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca8005c20 con 0x7f3cb80ca2f0 2024-08-17T02:24:11.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.993+0000 7f3cad600640 1 -- 172.21.15.157:0/1951830140 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca80070d0 con 0x7f3cb80ca2f0 2024-08-17T02:24:11.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.993+0000 7f3cbd000640 1 -- 172.21.15.157:0/1951830140 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cb80b5350 con 0x7f3cb80ca2f0 2024-08-17T02:24:11.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.994+0000 7f3cbd000640 1 -- 172.21.15.157:0/1951830140 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cb8169270 con 0x7f3cb80ca2f0 2024-08-17T02:24:11.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.994+0000 7f3cad600640 1 -- 172.21.15.157:0/1951830140 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f3ca8007500 con 0x7f3cb80ca2f0 2024-08-17T02:24:11.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.994+0000 7f3cad600640 1 -- 172.21.15.157:0/1951830140 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f3ca801cdf0 con 0x7f3cb80ca2f0 2024-08-17T02:24:11.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.995+0000 7f3cbd000640 1 -- 172.21.15.157:0/1951830140 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cb8071050 con 0x7f3cb80ca2f0 2024-08-17T02:24:11.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:11.997+0000 7f3cad600640 1 -- 172.21.15.157:0/1951830140 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f3ca8017070 con 0x7f3cb80ca2f0 2024-08-17T02:24:12.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.073+0000 7f3cbd000640 1 -- 172.21.15.157:0/1951830140 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd new", "uuid": "376363f3-b8bf-4f1e-b691-51cdd39171ce", "id": 0} v 0) v1 -- 0x7f3cb80cf600 con 0x7f3cb80ca2f0 2024-08-17T02:24:12.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.081+0000 7f3cad600640 1 -- 172.21.15.157:0/1951830140 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "376363f3-b8bf-4f1e-b691-51cdd39171ce", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3ca801c500 con 0x7f3cb80ca2f0 2024-08-17T02:24:12.082 INFO:teuthology.orchestra.run.smithi157.stdout:0 2024-08-17T02:24:12.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.082+0000 7f3cbd000640 1 -- 172.21.15.157:0/1951830140 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3cb80ca2f0 msgr2=0x7f3cb80b4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:12.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.082+0000 7f3cbd000640 1 --2- 172.21.15.157:0/1951830140 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3cb80ca2f0 0x7f3cb80b4a50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8000c00 tx=0x7f3ca8007c80 comp rx=0 tx=0).stop 2024-08-17T02:24:12.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.082+0000 7f3cbd000640 1 -- 172.21.15.157:0/1951830140 shutdown_connections 2024-08-17T02:24:12.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.082+0000 7f3cbd000640 1 --2- 172.21.15.157:0/1951830140 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3cb8158ea0 0x7f3cb80c5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.082+0000 7f3cbd000640 1 --2- 172.21.15.157:0/1951830140 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cb80ca770 0x7f3cb80b15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.082+0000 7f3cbd000640 1 --2- 172.21.15.157:0/1951830140 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3cb80ca2f0 0x7f3cb80b4a50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.082+0000 7f3cbd000640 1 -- 172.21.15.157:0/1951830140 >> 172.21.15.157:0/1951830140 conn(0x7f3cb806eb90 msgr2=0x7f3cb80c7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:12.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.082+0000 7f3cbd000640 1 -- 172.21.15.157:0/1951830140 shutdown_connections 2024-08-17T02:24:12.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.082+0000 7f3cbd000640 1 -- 172.21.15.157:0/1951830140 wait complete. 2024-08-17T02:24:12.097 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new cc6624e3-2ad4-4db4-b377-05dfe57424e7 1 2024-08-17T02:24:12.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.244+0000 7f8f9dc00640 1 Processor -- start 2024-08-17T02:24:12.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.244+0000 7f8f9dc00640 1 -- start start 2024-08-17T02:24:12.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.245+0000 7f8f9dc00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8f980a54d0 0x7f8f98155d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:12.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.245+0000 7f8f9dc00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8f980af580 0x7f8f980af9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:12.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.245+0000 7f8f9dc00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f980aff20 con 0x7f8f98155980 2024-08-17T02:24:12.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.245+0000 7f8f9dc00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f98158400 con 0x7f8f980a54d0 2024-08-17T02:24:12.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.245+0000 7f8f9dc00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f981577f0 con 0x7f8f980af580 2024-08-17T02:24:12.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.245+0000 7f8f96a00640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f8f98155980 0x7f8f98156f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:45164/0 (socket says 172.21.15.157:45164) 2024-08-17T02:24:12.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.245+0000 7f8f97400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8f980af580 0x7f8f980af9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:12.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.246+0000 7f8f96a00640 1 -- 172.21.15.157:0/3099472050 learned_addr learned my addr 172.21.15.157:0/3099472050 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-08-17T02:24:12.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.246+0000 7f8f96000640 1 --2- 172.21.15.157:0/3099472050 >> v2:172.21.15.107:3300/0 conn(0x7f8f980a54d0 0x7f8f98155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:12.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.246+0000 7f8f97400640 1 -- 172.21.15.157:0/3099472050 >> v2:172.21.15.107:3300/0 conn(0x7f8f980a54d0 msgr2=0x7f8f98155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:12.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.246+0000 7f8f97400640 1 --2- 172.21.15.157:0/3099472050 >> v2:172.21.15.107:3300/0 conn(0x7f8f980a54d0 0x7f8f98155d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.246+0000 7f8f97400640 1 -- 172.21.15.157:0/3099472050 >> v1:172.21.15.157:6789/0 conn(0x7f8f98155980 legacy=0x7f8f98156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:12.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.246+0000 7f8f97400640 1 -- 172.21.15.157:0/3099472050 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f98157ad0 con 0x7f8f980af580 2024-08-17T02:24:12.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.246+0000 7f8f96000640 1 --2- 172.21.15.157:0/3099472050 >> v2:172.21.15.107:3300/0 conn(0x7f8f980a54d0 0x7f8f98155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:12.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.247+0000 7f8f97400640 1 --2- 172.21.15.157:0/3099472050 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f980af580 0x7f8f980af9e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8f9806b700 tx=0x7f8f90009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a1fc2a40dc8ee53 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:12.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.247+0000 7f8f95600640 1 -- 172.21.15.157:0/3099472050 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f90032660 con 0x7f8f980af580 2024-08-17T02:24:12.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.247+0000 7f8f95600640 1 -- 172.21.15.157:0/3099472050 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f900327c0 con 0x7f8f980af580 2024-08-17T02:24:12.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.247+0000 7f8f95600640 1 -- 172.21.15.157:0/3099472050 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f90032ba0 con 0x7f8f980af580 2024-08-17T02:24:12.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.248+0000 7f8f9dc00640 1 -- 172.21.15.157:0/3099472050 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f980af580 msgr2=0x7f8f980af9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:12.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.248+0000 7f8f9dc00640 1 --2- 172.21.15.157:0/3099472050 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f980af580 0x7f8f980af9e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8f9806b700 tx=0x7f8f90009780 comp rx=0 tx=0).stop 2024-08-17T02:24:12.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.248+0000 7f8f9dc00640 1 -- 172.21.15.157:0/3099472050 shutdown_connections 2024-08-17T02:24:12.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.248+0000 7f8f9dc00640 1 --2- 172.21.15.157:0/3099472050 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f980af580 0x7f8f980af9e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.248+0000 7f8f9dc00640 1 --2- 172.21.15.157:0/3099472050 >> v2:172.21.15.107:3300/0 conn(0x7f8f980a54d0 0x7f8f98155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.248+0000 7f8f9dc00640 1 -- 172.21.15.157:0/3099472050 >> 172.21.15.157:0/3099472050 conn(0x7f8f98067750 msgr2=0x7f8f980cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:12.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.248+0000 7f8f9dc00640 1 -- 172.21.15.157:0/3099472050 shutdown_connections 2024-08-17T02:24:12.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.248+0000 7f8f9dc00640 1 -- 172.21.15.157:0/3099472050 wait complete. 2024-08-17T02:24:12.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.249+0000 7f8f9dc00640 1 Processor -- start 2024-08-17T02:24:12.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.249+0000 7f8f9dc00640 1 -- start start 2024-08-17T02:24:12.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.250+0000 7f8f9dc00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8f980a54d0 0x7f8f980aae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:12.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.250+0000 7f8f9dc00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f980af580 0x7f8f9814cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:12.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.250+0000 7f8f9dc00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f98155980 0x7f8f980a9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:12.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.250+0000 7f8f9dc00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f980ab370 con 0x7f8f980af580 2024-08-17T02:24:12.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.250+0000 7f8f9dc00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f981690a0 con 0x7f8f98155980 2024-08-17T02:24:12.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.250+0000 7f8f9dc00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f980ad8b0 con 0x7f8f980a54d0 2024-08-17T02:24:12.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.251+0000 7f8f97400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f98155980 0x7f8f980a9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:12.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.251+0000 7f8f96a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8f980a54d0 0x7f8f980aae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:12.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.251+0000 7f8f96000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f980af580 0x7f8f9814cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:12.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.251+0000 7f8f96000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f980af580 0x7f8f9814cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.157:59664/0 (socket says 172.21.15.157:59664) 2024-08-17T02:24:12.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.251+0000 7f8f96000640 1 -- 172.21.15.157:0/4144444927 learned_addr learned my addr 172.21.15.157:0/4144444927 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-08-17T02:24:12.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.251+0000 7f8f96000640 1 -- 172.21.15.157:0/4144444927 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8f980a54d0 msgr2=0x7f8f980aae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:12.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.251+0000 7f8f96000640 1 --2- 172.21.15.157:0/4144444927 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8f980a54d0 0x7f8f980aae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.251+0000 7f8f96000640 1 -- 172.21.15.157:0/4144444927 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f98155980 msgr2=0x7f8f980a9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:12.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.251+0000 7f8f96000640 1 --2- 172.21.15.157:0/4144444927 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f98155980 0x7f8f980a9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.251+0000 7f8f96000640 1 -- 172.21.15.157:0/4144444927 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f90009a20 con 0x7f8f980af580 2024-08-17T02:24:12.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.251+0000 7f8f96000640 1 --2- 172.21.15.157:0/4144444927 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f980af580 0x7f8f9814cb70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8f8400d810 tx=0x7f8f84008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:12.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.252+0000 7f8f8e000640 1 -- 172.21.15.157:0/4144444927 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8400de00 con 0x7f8f980af580 2024-08-17T02:24:12.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.252+0000 7f8f8e000640 1 -- 172.21.15.157:0/4144444927 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f840098b0 con 0x7f8f980af580 2024-08-17T02:24:12.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.252+0000 7f8f8e000640 1 -- 172.21.15.157:0/4144444927 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f84009c70 con 0x7f8f980af580 2024-08-17T02:24:12.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.252+0000 7f8f9dc00640 1 -- 172.21.15.157:0/4144444927 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f980adb90 con 0x7f8f980af580 2024-08-17T02:24:12.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.252+0000 7f8f9dc00640 1 -- 172.21.15.157:0/4144444927 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f980ae150 con 0x7f8f980af580 2024-08-17T02:24:12.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.252+0000 7f8f8e000640 1 -- 172.21.15.157:0/4144444927 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f8f840146c0 con 0x7f8f980af580 2024-08-17T02:24:12.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.252+0000 7f8f8e000640 1 -- 172.21.15.157:0/4144444927 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f8f8401d520 con 0x7f8f980af580 2024-08-17T02:24:12.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.253+0000 7f8f9dc00640 1 -- 172.21.15.157:0/4144444927 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f98071050 con 0x7f8f980af580 2024-08-17T02:24:12.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.255+0000 7f8f8e000640 1 -- 172.21.15.157:0/4144444927 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f8f84014ab0 con 0x7f8f980af580 2024-08-17T02:24:12.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.329+0000 7f8f9dc00640 1 -- 172.21.15.157:0/4144444927 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cc6624e3-2ad4-4db4-b377-05dfe57424e7", "id": 1} v 0) v1 -- 0x7f8f980640d0 con 0x7f8f980af580 2024-08-17T02:24:12.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.336+0000 7f8f8e000640 1 -- 172.21.15.157:0/4144444927 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cc6624e3-2ad4-4db4-b377-05dfe57424e7", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8f84014c50 con 0x7f8f980af580 2024-08-17T02:24:12.338 INFO:teuthology.orchestra.run.smithi157.stdout:1 2024-08-17T02:24:12.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.338+0000 7f8f9dc00640 1 -- 172.21.15.157:0/4144444927 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f980af580 msgr2=0x7f8f9814cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:12.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.338+0000 7f8f9dc00640 1 --2- 172.21.15.157:0/4144444927 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f980af580 0x7f8f9814cb70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8f8400d810 tx=0x7f8f84008040 comp rx=0 tx=0).stop 2024-08-17T02:24:12.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.338+0000 7f8f9dc00640 1 -- 172.21.15.157:0/4144444927 shutdown_connections 2024-08-17T02:24:12.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.338+0000 7f8f9dc00640 1 --2- 172.21.15.157:0/4144444927 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f98155980 0x7f8f980a9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.338+0000 7f8f9dc00640 1 --2- 172.21.15.157:0/4144444927 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f980af580 0x7f8f9814cb70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.338+0000 7f8f9dc00640 1 --2- 172.21.15.157:0/4144444927 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8f980a54d0 0x7f8f980aae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.338+0000 7f8f9dc00640 1 -- 172.21.15.157:0/4144444927 >> 172.21.15.157:0/4144444927 conn(0x7f8f98067750 msgr2=0x7f8f980cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:12.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.338+0000 7f8f9dc00640 1 -- 172.21.15.157:0/4144444927 shutdown_connections 2024-08-17T02:24:12.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.338+0000 7f8f9dc00640 1 -- 172.21.15.157:0/4144444927 wait complete. 2024-08-17T02:24:12.356 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 25229542-29b5-4281-bcb0-798ae0930aa6 2 2024-08-17T02:24:12.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.501+0000 7f0b73200640 1 Processor -- start 2024-08-17T02:24:12.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.501+0000 7f0b73200640 1 -- start start 2024-08-17T02:24:12.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.503+0000 7f0b73200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0b740ce050 0x7f0b740cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:12.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.503+0000 7f0b73200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b740ccd30 0x7f0b741629f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:12.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.503+0000 7f0b73200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b740cad60 con 0x7f0b74159aa0 2024-08-17T02:24:12.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.503+0000 7f0b73200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b740cd1b0 con 0x7f0b740ce050 2024-08-17T02:24:12.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.503+0000 7f0b73200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b740c4b90 con 0x7f0b740ccd30 2024-08-17T02:24:12.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.503+0000 7f0b72800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b740ccd30 0x7f0b741629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:12.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.503+0000 7f0b72800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b740ccd30 0x7f0b741629f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:41134/0 (socket says 172.21.15.157:41134) 2024-08-17T02:24:12.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.503+0000 7f0b72800640 1 -- 172.21.15.157:0/4150054681 learned_addr learned my addr 172.21.15.157:0/4150054681 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-08-17T02:24:12.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.503+0000 7f0b71400640 1 --2- 172.21.15.157:0/4150054681 >> v2:172.21.15.107:3300/0 conn(0x7f0b740ce050 0x7f0b740cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:12.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.503+0000 7f0b72800640 1 -- 172.21.15.157:0/4150054681 >> v2:172.21.15.107:3300/0 conn(0x7f0b740ce050 msgr2=0x7f0b740cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:12.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.503+0000 7f0b72800640 1 --2- 172.21.15.157:0/4150054681 >> v2:172.21.15.107:3300/0 conn(0x7f0b740ce050 0x7f0b740cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.503+0000 7f0b72800640 1 -- 172.21.15.157:0/4150054681 >> v1:172.21.15.107:6789/0 conn(0x7f0b74159aa0 legacy=0x7f0b74159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:12.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.504+0000 7f0b72800640 1 -- 172.21.15.157:0/4150054681 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b7415a580 con 0x7f0b740ccd30 2024-08-17T02:24:12.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.504+0000 7f0b71400640 1 --2- 172.21.15.157:0/4150054681 >> v2:172.21.15.107:3300/0 conn(0x7f0b740ce050 0x7f0b740cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:12.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.504+0000 7f0b72800640 1 --2- 172.21.15.157:0/4150054681 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b740ccd30 0x7f0b741629f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c009f20 tx=0x7f0b6c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1af9e6fdada31e4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:12.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.505+0000 7f0b70a00640 1 -- 172.21.15.157:0/4150054681 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c031400 con 0x7f0b740ccd30 2024-08-17T02:24:12.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.505+0000 7f0b70a00640 1 -- 172.21.15.157:0/4150054681 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6c02d050 con 0x7f0b740ccd30 2024-08-17T02:24:12.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.505+0000 7f0b70a00640 1 -- 172.21.15.157:0/4150054681 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c0317d0 con 0x7f0b740ccd30 2024-08-17T02:24:12.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.505+0000 7f0b73200640 1 -- 172.21.15.157:0/4150054681 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b740ccd30 msgr2=0x7f0b741629f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:12.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.505+0000 7f0b73200640 1 --2- 172.21.15.157:0/4150054681 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b740ccd30 0x7f0b741629f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c009f20 tx=0x7f0b6c009840 comp rx=0 tx=0).stop 2024-08-17T02:24:12.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.505+0000 7f0b73200640 1 -- 172.21.15.157:0/4150054681 shutdown_connections 2024-08-17T02:24:12.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.505+0000 7f0b73200640 1 --2- 172.21.15.157:0/4150054681 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b740ccd30 0x7f0b741629f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.505+0000 7f0b73200640 1 --2- 172.21.15.157:0/4150054681 >> v2:172.21.15.107:3300/0 conn(0x7f0b740ce050 0x7f0b740cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.505+0000 7f0b73200640 1 -- 172.21.15.157:0/4150054681 >> 172.21.15.157:0/4150054681 conn(0x7f0b74099040 msgr2=0x7f0b7406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:12.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.506+0000 7f0b73200640 1 -- 172.21.15.157:0/4150054681 shutdown_connections 2024-08-17T02:24:12.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.506+0000 7f0b73200640 1 -- 172.21.15.157:0/4150054681 wait complete. 2024-08-17T02:24:12.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.507+0000 7f0b73200640 1 Processor -- start 2024-08-17T02:24:12.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.507+0000 7f0b73200640 1 -- start start 2024-08-17T02:24:12.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.508+0000 7f0b73200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b740ccd30 0x7f0b74067720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:12.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.508+0000 7f0b73200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b740ce050 0x7f0b7414a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:12.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.508+0000 7f0b73200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b74159aa0 0x7f0b7414aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:12.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.508+0000 7f0b73200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b740c6ea0 con 0x7f0b74159aa0 2024-08-17T02:24:12.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.508+0000 7f0b73200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b740c7a20 con 0x7f0b740ccd30 2024-08-17T02:24:12.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.508+0000 7f0b73200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b740c70f0 con 0x7f0b740ce050 2024-08-17T02:24:12.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.508+0000 7f0b71400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b740ce050 0x7f0b7414a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:12.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.508+0000 7f0b71e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b740ccd30 0x7f0b74067720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:12.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.508+0000 7f0b71400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b740ce050 0x7f0b7414a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:41136/0 (socket says 172.21.15.157:41136) 2024-08-17T02:24:12.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.508+0000 7f0b71400640 1 -- 172.21.15.157:0/1831374488 learned_addr learned my addr 172.21.15.157:0/1831374488 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-08-17T02:24:12.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.508+0000 7f0b72800640 1 --2- 172.21.15.157:0/1831374488 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b74159aa0 0x7f0b7414aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:12.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.508+0000 7f0b71e00640 1 -- 172.21.15.157:0/1831374488 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b740ce050 msgr2=0x7f0b7414a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:12.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.508+0000 7f0b71e00640 1 --2- 172.21.15.157:0/1831374488 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b740ce050 0x7f0b7414a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.509+0000 7f0b71e00640 1 -- 172.21.15.157:0/1831374488 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b74159aa0 msgr2=0x7f0b7414aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:12.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.509+0000 7f0b71e00640 1 --2- 172.21.15.157:0/1831374488 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b74159aa0 0x7f0b7414aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.509+0000 7f0b71e00640 1 -- 172.21.15.157:0/1831374488 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b60009390 con 0x7f0b740ccd30 2024-08-17T02:24:12.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.509+0000 7f0b71400640 1 --2- 172.21.15.157:0/1831374488 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b740ce050 0x7f0b7414a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:12.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.509+0000 7f0b71e00640 1 --2- 172.21.15.157:0/1831374488 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b740ccd30 0x7f0b74067720 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0b6400c410 tx=0x7f0b64007e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:12.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.509+0000 7f0b69600640 1 -- 172.21.15.157:0/1831374488 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b64011590 con 0x7f0b740ccd30 2024-08-17T02:24:12.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.509+0000 7f0b69600640 1 -- 172.21.15.157:0/1831374488 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b640116f0 con 0x7f0b740ccd30 2024-08-17T02:24:12.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.509+0000 7f0b69600640 1 -- 172.21.15.157:0/1831374488 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b64011ab0 con 0x7f0b740ccd30 2024-08-17T02:24:12.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.509+0000 7f0b73200640 1 -- 172.21.15.157:0/1831374488 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b6c009ae0 con 0x7f0b740ccd30 2024-08-17T02:24:12.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.509+0000 7f0b73200640 1 -- 172.21.15.157:0/1831374488 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b740c76b0 con 0x7f0b740ccd30 2024-08-17T02:24:12.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.509+0000 7f0b69600640 1 -- 172.21.15.157:0/1831374488 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f0b6401c440 con 0x7f0b740ccd30 2024-08-17T02:24:12.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.509+0000 7f0b69600640 1 -- 172.21.15.157:0/1831374488 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f0b64000f90 con 0x7f0b740ccd30 2024-08-17T02:24:12.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.510+0000 7f0b73200640 1 -- 172.21.15.157:0/1831374488 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b74071050 con 0x7f0b740ccd30 2024-08-17T02:24:12.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.513+0000 7f0b69600640 1 -- 172.21.15.157:0/1831374488 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f0b64017070 con 0x7f0b740ccd30 2024-08-17T02:24:12.566 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-08-17T02:24:12.566+0000 7f94cef6bec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-17T02:24:12.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.586+0000 7f0b73200640 1 -- 172.21.15.157:0/1831374488 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd new", "uuid": "25229542-29b5-4281-bcb0-798ae0930aa6", "id": 2} v 0) v1 -- 0x7f0b7406f480 con 0x7f0b740ccd30 2024-08-17T02:24:12.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.595+0000 7f0b69600640 1 -- 172.21.15.157:0/1831374488 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "25229542-29b5-4281-bcb0-798ae0930aa6", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0b6401c750 con 0x7f0b740ccd30 2024-08-17T02:24:12.596 INFO:teuthology.orchestra.run.smithi157.stdout:2 2024-08-17T02:24:12.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.596+0000 7f0b73200640 1 -- 172.21.15.157:0/1831374488 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b740ccd30 msgr2=0x7f0b74067720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:12.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.596+0000 7f0b73200640 1 --2- 172.21.15.157:0/1831374488 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b740ccd30 0x7f0b74067720 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0b6400c410 tx=0x7f0b64007e30 comp rx=0 tx=0).stop 2024-08-17T02:24:12.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.596+0000 7f0b73200640 1 -- 172.21.15.157:0/1831374488 shutdown_connections 2024-08-17T02:24:12.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.596+0000 7f0b73200640 1 --2- 172.21.15.157:0/1831374488 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b74159aa0 0x7f0b7414aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.596+0000 7f0b73200640 1 --2- 172.21.15.157:0/1831374488 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0b740ce050 0x7f0b7414a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.596+0000 7f0b73200640 1 --2- 172.21.15.157:0/1831374488 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b740ccd30 0x7f0b74067720 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.596+0000 7f0b73200640 1 -- 172.21.15.157:0/1831374488 >> 172.21.15.157:0/1831374488 conn(0x7f0b74099040 msgr2=0x7f0b740b1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:12.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.596+0000 7f0b73200640 1 -- 172.21.15.157:0/1831374488 shutdown_connections 2024-08-17T02:24:12.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.596+0000 7f0b73200640 1 -- 172.21.15.157:0/1831374488 wait complete. 2024-08-17T02:24:12.611 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 5f16aee8-8950-4268-a61a-5cf6ebd670e4 3 2024-08-17T02:24:12.650 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-08-17T02:24:12.648+0000 7f64ac619ec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-17T02:24:12.663 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-08-17T02:24:12.663+0000 7f94cef6bec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-17T02:24:12.710 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-08-17T02:24:12.710+0000 7f94cef6bec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-17T02:24:12.755 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-08-17T02:24:12.753+0000 7f64ac619ec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-17T02:24:12.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.754+0000 7fa036a00640 1 Processor -- start 2024-08-17T02:24:12.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.755+0000 7fa036a00640 1 -- start start 2024-08-17T02:24:12.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.756+0000 7fa036a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa0300ca2f0 0x7fa0300ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:12.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.756+0000 7fa036a00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa0300c7370 0x7fa0300c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:12.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.756+0000 7fa036a00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa03006f240 con 0x7fa030158ea0 2024-08-17T02:24:12.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.756+0000 7fa036a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0300c6f20 con 0x7fa0300ca2f0 2024-08-17T02:24:12.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.756+0000 7fa036a00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0300cacb0 con 0x7fa0300c7370 2024-08-17T02:24:12.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.756+0000 7fa034a00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa0300c7370 0x7fa0300c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:12.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.756+0000 7fa034a00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa0300c7370 0x7fa0300c77b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:48480/0 (socket says 172.21.15.157:48480) 2024-08-17T02:24:12.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.756+0000 7fa034a00640 1 -- 172.21.15.157:0/1951362787 learned_addr learned my addr 172.21.15.157:0/1951362787 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-08-17T02:24:12.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.756+0000 7fa02f400640 1 --2- 172.21.15.157:0/1951362787 >> v2:172.21.15.107:3300/0 conn(0x7fa0300ca2f0 0x7fa0300ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:12.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.757+0000 7fa034a00640 1 -- 172.21.15.157:0/1951362787 >> v2:172.21.15.107:3300/0 conn(0x7fa0300ca2f0 msgr2=0x7fa0300ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:12.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.757+0000 7fa034a00640 1 --2- 172.21.15.157:0/1951362787 >> v2:172.21.15.107:3300/0 conn(0x7fa0300ca2f0 0x7fa0300ca770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.757+0000 7fa034a00640 1 -- 172.21.15.157:0/1951362787 >> v1:172.21.15.157:6789/0 conn(0x7fa030158ea0 legacy=0x7fa0300d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:12.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.757+0000 7fa034a00640 1 -- 172.21.15.157:0/1951362787 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0300cf410 con 0x7fa0300c7370 2024-08-17T02:24:12.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.758+0000 7fa034a00640 1 --2- 172.21.15.157:0/1951362787 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0300c7370 0x7fa0300c77b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa030069bb0 tx=0x7fa028009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=130cd839945c4250 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:12.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.758+0000 7fa02ea00640 1 -- 172.21.15.157:0/1951362787 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa028031400 con 0x7fa0300c7370 2024-08-17T02:24:12.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.758+0000 7fa02ea00640 1 -- 172.21.15.157:0/1951362787 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02802d050 con 0x7fa0300c7370 2024-08-17T02:24:12.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.758+0000 7fa02ea00640 1 -- 172.21.15.157:0/1951362787 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0280317d0 con 0x7fa0300c7370 2024-08-17T02:24:12.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.759+0000 7fa036a00640 1 -- 172.21.15.157:0/1951362787 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0300c7370 msgr2=0x7fa0300c77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:12.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.759+0000 7fa036a00640 1 --2- 172.21.15.157:0/1951362787 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0300c7370 0x7fa0300c77b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa030069bb0 tx=0x7fa028009840 comp rx=0 tx=0).stop 2024-08-17T02:24:12.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.759+0000 7fa036a00640 1 -- 172.21.15.157:0/1951362787 shutdown_connections 2024-08-17T02:24:12.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.759+0000 7fa036a00640 1 --2- 172.21.15.157:0/1951362787 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0300c7370 0x7fa0300c77b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.759+0000 7fa036a00640 1 --2- 172.21.15.157:0/1951362787 >> v2:172.21.15.107:3300/0 conn(0x7fa0300ca2f0 0x7fa0300ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.759+0000 7fa036a00640 1 -- 172.21.15.157:0/1951362787 >> 172.21.15.157:0/1951362787 conn(0x7fa03006eb90 msgr2=0x7fa0300cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:12.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.759+0000 7fa036a00640 1 -- 172.21.15.157:0/1951362787 shutdown_connections 2024-08-17T02:24:12.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.759+0000 7fa036a00640 1 -- 172.21.15.157:0/1951362787 wait complete. 2024-08-17T02:24:12.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.761+0000 7fa036a00640 1 Processor -- start 2024-08-17T02:24:12.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.761+0000 7fa036a00640 1 -- start start 2024-08-17T02:24:12.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.762+0000 7fa036a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0300c7370 0x7fa03014a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:12.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.762+0000 7fa036a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa0300ca2f0 0x7fa0300c4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:12.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.762+0000 7fa036a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa030158ea0 0x7fa030067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:12.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.762+0000 7fa036a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03016a6b0 con 0x7fa030158ea0 2024-08-17T02:24:12.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.762+0000 7fa036a00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0300c51d0 con 0x7fa0300c7370 2024-08-17T02:24:12.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.762+0000 7fa036a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0300c54b0 con 0x7fa0300ca2f0 2024-08-17T02:24:12.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.762+0000 7fa02f400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa0300ca2f0 0x7fa0300c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:12.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.762+0000 7fa02fe00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0300c7370 0x7fa03014a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:12.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.762+0000 7fa02f400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa0300ca2f0 0x7fa0300c4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:41150/0 (socket says 172.21.15.157:41150) 2024-08-17T02:24:12.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.762+0000 7fa02f400640 1 -- 172.21.15.157:0/4061382988 learned_addr learned my addr 172.21.15.157:0/4061382988 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-08-17T02:24:12.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.762+0000 7fa034a00640 1 --2- 172.21.15.157:0/4061382988 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa030158ea0 0x7fa030067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:12.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.762+0000 7fa02f400640 1 -- 172.21.15.157:0/4061382988 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0300c7370 msgr2=0x7fa03014a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:12.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.762+0000 7fa02f400640 1 --2- 172.21.15.157:0/4061382988 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0300c7370 0x7fa03014a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.762+0000 7fa02f400640 1 -- 172.21.15.157:0/4061382988 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa030158ea0 msgr2=0x7fa030067fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:12.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.762+0000 7fa02f400640 1 --2- 172.21.15.157:0/4061382988 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa030158ea0 0x7fa030067fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.762+0000 7fa02f400640 1 -- 172.21.15.157:0/4061382988 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa028009ae0 con 0x7fa0300ca2f0 2024-08-17T02:24:12.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.763+0000 7fa02f400640 1 --2- 172.21.15.157:0/4061382988 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa0300ca2f0 0x7fa0300c4780 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa01c00e900 tx=0x7fa01c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:12.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.763+0000 7fa027400640 1 -- 172.21.15.157:0/4061382988 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01c00c8e0 con 0x7fa0300ca2f0 2024-08-17T02:24:12.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.763+0000 7fa027400640 1 -- 172.21.15.157:0/4061382988 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa01c00ca40 con 0x7fa0300ca2f0 2024-08-17T02:24:12.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.763+0000 7fa027400640 1 -- 172.21.15.157:0/4061382988 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01c00cde0 con 0x7fa0300ca2f0 2024-08-17T02:24:12.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.763+0000 7fa036a00640 1 -- 172.21.15.157:0/4061382988 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0300c5790 con 0x7fa0300ca2f0 2024-08-17T02:24:12.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.763+0000 7fa036a00640 1 -- 172.21.15.157:0/4061382988 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa03014a640 con 0x7fa0300ca2f0 2024-08-17T02:24:12.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.763+0000 7fa027400640 1 -- 172.21.15.157:0/4061382988 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fa01c005970 con 0x7fa0300ca2f0 2024-08-17T02:24:12.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.763+0000 7fa027400640 1 -- 172.21.15.157:0/4061382988 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7fa01c013cb0 con 0x7fa0300ca2f0 2024-08-17T02:24:12.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.764+0000 7fa036a00640 1 -- 172.21.15.157:0/4061382988 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa030071050 con 0x7fa0300ca2f0 2024-08-17T02:24:12.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.767+0000 7fa027400640 1 -- 172.21.15.157:0/4061382988 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fa01c021060 con 0x7fa0300ca2f0 2024-08-17T02:24:12.807 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-08-17T02:24:12.806+0000 7f64ac619ec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-17T02:24:12.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.839+0000 7fa036a00640 1 -- 172.21.15.157:0/4061382988 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5f16aee8-8950-4268-a61a-5cf6ebd670e4", "id": 3} v 0) v1 -- 0x7fa0300cf600 con 0x7fa0300ca2f0 2024-08-17T02:24:12.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.847+0000 7fa027400640 1 -- 172.21.15.157:0/4061382988 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5f16aee8-8950-4268-a61a-5cf6ebd670e4", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa01c029020 con 0x7fa0300ca2f0 2024-08-17T02:24:12.848 INFO:teuthology.orchestra.run.smithi157.stdout:3 2024-08-17T02:24:12.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.848+0000 7fa036a00640 1 -- 172.21.15.157:0/4061382988 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa0300ca2f0 msgr2=0x7fa0300c4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:12.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.848+0000 7fa036a00640 1 --2- 172.21.15.157:0/4061382988 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa0300ca2f0 0x7fa0300c4780 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa01c00e900 tx=0x7fa01c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.848+0000 7fa036a00640 1 -- 172.21.15.157:0/4061382988 shutdown_connections 2024-08-17T02:24:12.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.848+0000 7fa036a00640 1 --2- 172.21.15.157:0/4061382988 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa030158ea0 0x7fa030067fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.848+0000 7fa036a00640 1 --2- 172.21.15.157:0/4061382988 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa0300ca2f0 0x7fa0300c4780 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.848+0000 7fa036a00640 1 --2- 172.21.15.157:0/4061382988 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0300c7370 0x7fa03014a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:12.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.848+0000 7fa036a00640 1 -- 172.21.15.157:0/4061382988 >> 172.21.15.157:0/4061382988 conn(0x7fa03006eb90 msgr2=0x7fa0300d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:12.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.848+0000 7fa036a00640 1 -- 172.21.15.157:0/4061382988 shutdown_connections 2024-08-17T02:24:12.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:12.848+0000 7fa036a00640 1 -- 172.21.15.157:0/4061382988 wait complete. 2024-08-17T02:24:12.863 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 23232e28-e23b-4b4e-a531-4939246dbbde 4 2024-08-17T02:24:12.878 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-08-17T02:24:12.878+0000 7f94cef6bec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-17T02:24:12.933 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-08-17T02:24:12.933+0000 7f94cef6bec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-17T02:24:12.992 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-08-17T02:24:12.991+0000 7f64ac619ec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-17T02:24:12.992 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-08-17T02:24:12.992+0000 7f94cef6bec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-17T02:24:13.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.047+0000 7f2147c00640 1 Processor -- start 2024-08-17T02:24:13.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.048+0000 7f2147c00640 1 -- start start 2024-08-17T02:24:13.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.049+0000 7f2147c00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f21400ca2f0 0x7f21400ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:13.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.049+0000 7f2147c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f21400c7370 0x7f21400c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:13.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.049+0000 7f2147c00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f214006f240 con 0x7f2140158ea0 2024-08-17T02:24:13.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.049+0000 7f2147c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21400c6f20 con 0x7f21400c7370 2024-08-17T02:24:13.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.049+0000 7f2147c00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21400cacb0 con 0x7f21400ca2f0 2024-08-17T02:24:13.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.049+0000 7f213fe00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f21400ca2f0 0x7f21400ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:13.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.049+0000 7f213fe00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f21400ca2f0 0x7f21400ca770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:54636/0 (socket says 172.21.15.157:54636) 2024-08-17T02:24:13.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.049+0000 7f213fe00640 1 -- 172.21.15.157:0/3436748735 learned_addr learned my addr 172.21.15.157:0/3436748735 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-08-17T02:24:13.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.049+0000 7f2145c00640 1 --2- 172.21.15.157:0/3436748735 >> v2:172.21.15.107:3300/0 conn(0x7f21400c7370 0x7f21400c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:13.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.049+0000 7f213fe00640 1 -- 172.21.15.157:0/3436748735 >> v2:172.21.15.107:3300/0 conn(0x7f21400c7370 msgr2=0x7f21400c77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:13.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.049+0000 7f213fe00640 1 --2- 172.21.15.157:0/3436748735 >> v2:172.21.15.107:3300/0 conn(0x7f21400c7370 0x7f21400c77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.049+0000 7f213fe00640 1 -- 172.21.15.157:0/3436748735 >> v1:172.21.15.157:6789/0 conn(0x7f2140158ea0 legacy=0x7f21400d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.049+0000 7f213fe00640 1 -- 172.21.15.157:0/3436748735 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21400cf410 con 0x7f21400ca2f0 2024-08-17T02:24:13.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.051+0000 7f213fe00640 1 --2- 172.21.15.157:0/3436748735 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21400ca2f0 0x7f21400ca770 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f214009dc60 tx=0x7f212c0091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=330792faa067638d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:13.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.051+0000 7f213f400640 1 -- 172.21.15.157:0/3436748735 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212c02add0 con 0x7f21400ca2f0 2024-08-17T02:24:13.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.051+0000 7f213f400640 1 -- 172.21.15.157:0/3436748735 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212c032440 con 0x7f21400ca2f0 2024-08-17T02:24:13.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.051+0000 7f213f400640 1 -- 172.21.15.157:0/3436748735 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212c032820 con 0x7f21400ca2f0 2024-08-17T02:24:13.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.052+0000 7f2147c00640 1 -- 172.21.15.157:0/3436748735 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21400ca2f0 msgr2=0x7f21400ca770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.052+0000 7f2147c00640 1 --2- 172.21.15.157:0/3436748735 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21400ca2f0 0x7f21400ca770 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f214009dc60 tx=0x7f212c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.052+0000 7f2147c00640 1 -- 172.21.15.157:0/3436748735 shutdown_connections 2024-08-17T02:24:13.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.052+0000 7f2147c00640 1 --2- 172.21.15.157:0/3436748735 >> v2:172.21.15.107:3300/0 conn(0x7f21400c7370 0x7f21400c77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.052+0000 7f2147c00640 1 --2- 172.21.15.157:0/3436748735 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21400ca2f0 0x7f21400ca770 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.052+0000 7f2147c00640 1 -- 172.21.15.157:0/3436748735 >> 172.21.15.157:0/3436748735 conn(0x7f214006eb90 msgr2=0x7f21400cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:13.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.052+0000 7f2147c00640 1 -- 172.21.15.157:0/3436748735 shutdown_connections 2024-08-17T02:24:13.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.052+0000 7f2147c00640 1 -- 172.21.15.157:0/3436748735 wait complete. 2024-08-17T02:24:13.055 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-08-17T02:24:13.053+0000 7f64ac619ec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-17T02:24:13.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.054+0000 7f2147c00640 1 Processor -- start 2024-08-17T02:24:13.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.054+0000 7f2147c00640 1 -- start start 2024-08-17T02:24:13.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.055+0000 7f2147c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21400c7370 0x7f2140168960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:13.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.055+0000 7f2147c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21400ca2f0 0x7f214016c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:13.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.056+0000 7f2147c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2140158ea0 0x7f214016cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:13.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.056+0000 7f2147c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214009ad60 con 0x7f2140158ea0 2024-08-17T02:24:13.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.056+0000 7f2147c00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214009a150 con 0x7f21400ca2f0 2024-08-17T02:24:13.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.056+0000 7f2147c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f214009a430 con 0x7f21400c7370 2024-08-17T02:24:13.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.056+0000 7f2145200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21400c7370 0x7f2140168960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:13.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.056+0000 7f213fe00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21400ca2f0 0x7f214016c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:13.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.056+0000 7f2145200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21400c7370 0x7f2140168960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:49546/0 (socket says 172.21.15.157:49546) 2024-08-17T02:24:13.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.056+0000 7f2145200640 1 -- 172.21.15.157:0/1065896178 learned_addr learned my addr 172.21.15.157:0/1065896178 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-08-17T02:24:13.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.056+0000 7f213fe00640 1 -- 172.21.15.157:0/1065896178 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21400c7370 msgr2=0x7f2140168960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.056+0000 7f213fe00640 1 --2- 172.21.15.157:0/1065896178 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21400c7370 0x7f2140168960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.056+0000 7f213fe00640 1 -- 172.21.15.157:0/1065896178 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2140158ea0 msgr2=0x7f214016cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.056+0000 7f213fe00640 1 --2- 172.21.15.157:0/1065896178 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2140158ea0 0x7f214016cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.056+0000 7f213fe00640 1 -- 172.21.15.157:0/1065896178 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f212c009450 con 0x7f21400ca2f0 2024-08-17T02:24:13.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.057+0000 7f213fe00640 1 --2- 172.21.15.157:0/1065896178 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21400ca2f0 0x7f214016c830 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f212c031000 tx=0x7f212c032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:13.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.057+0000 7f2133e00640 1 -- 172.21.15.157:0/1065896178 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212c031c80 con 0x7f21400ca2f0 2024-08-17T02:24:13.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.057+0000 7f2133e00640 1 -- 172.21.15.157:0/1065896178 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212c031de0 con 0x7f21400ca2f0 2024-08-17T02:24:13.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.057+0000 7f2133e00640 1 -- 172.21.15.157:0/1065896178 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212c03d690 con 0x7f21400ca2f0 2024-08-17T02:24:13.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.057+0000 7f2147c00640 1 -- 172.21.15.157:0/1065896178 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f214009a710 con 0x7f21400ca2f0 2024-08-17T02:24:13.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.057+0000 7f2147c00640 1 -- 172.21.15.157:0/1065896178 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f214014abf0 con 0x7f21400ca2f0 2024-08-17T02:24:13.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.057+0000 7f2133e00640 1 -- 172.21.15.157:0/1065896178 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f212c039040 con 0x7f21400ca2f0 2024-08-17T02:24:13.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.057+0000 7f2133e00640 1 -- 172.21.15.157:0/1065896178 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f212c03dd50 con 0x7f21400ca2f0 2024-08-17T02:24:13.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.058+0000 7f2147c00640 1 -- 172.21.15.157:0/1065896178 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f214009a570 con 0x7f21400ca2f0 2024-08-17T02:24:13.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.060+0000 7f2133e00640 1 -- 172.21.15.157:0/1065896178 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f214009a570 con 0x7f21400ca2f0 2024-08-17T02:24:13.103 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-08-17T02:24:13.099+0000 7f94cef6bec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:24:13.118 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-08-17T02:24:13.117+0000 7f64ac619ec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-17T02:24:13.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.133+0000 7f2147c00640 1 -- 172.21.15.157:0/1065896178 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd new", "uuid": "23232e28-e23b-4b4e-a531-4939246dbbde", "id": 4} v 0) v1 -- 0x7f214009aed0 con 0x7f21400ca2f0 2024-08-17T02:24:13.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.142+0000 7f2133e00640 1 -- 172.21.15.157:0/1065896178 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "23232e28-e23b-4b4e-a531-4939246dbbde", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f212c037070 con 0x7f21400ca2f0 2024-08-17T02:24:13.143 INFO:teuthology.orchestra.run.smithi157.stdout:4 2024-08-17T02:24:13.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.143+0000 7f2147c00640 1 -- 172.21.15.157:0/1065896178 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21400ca2f0 msgr2=0x7f214016c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.143+0000 7f2147c00640 1 --2- 172.21.15.157:0/1065896178 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21400ca2f0 0x7f214016c830 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f212c031000 tx=0x7f212c032000 comp rx=0 tx=0).stop 2024-08-17T02:24:13.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.143+0000 7f2147c00640 1 -- 172.21.15.157:0/1065896178 shutdown_connections 2024-08-17T02:24:13.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.143+0000 7f2147c00640 1 --2- 172.21.15.157:0/1065896178 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2140158ea0 0x7f214016cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.143+0000 7f2147c00640 1 --2- 172.21.15.157:0/1065896178 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21400ca2f0 0x7f214016c830 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.143+0000 7f2147c00640 1 --2- 172.21.15.157:0/1065896178 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21400c7370 0x7f2140168960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.143+0000 7f2147c00640 1 -- 172.21.15.157:0/1065896178 >> 172.21.15.157:0/1065896178 conn(0x7f214006eb90 msgr2=0x7f21400b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:13.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.143+0000 7f2147c00640 1 -- 172.21.15.157:0/1065896178 shutdown_connections 2024-08-17T02:24:13.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.143+0000 7f2147c00640 1 -- 172.21.15.157:0/1065896178 wait complete. 2024-08-17T02:24:13.158 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new f87ec331-3e59-4886-a317-6f7e26ec8e21 5 2024-08-17T02:24:13.233 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-08-17T02:24:13.232+0000 7f64ac619ec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:24:13.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.302+0000 7fec0d200640 1 Processor -- start 2024-08-17T02:24:13.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.302+0000 7fec0d200640 1 -- start start 2024-08-17T02:24:13.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.303+0000 7fec0d200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fec08159aa0 0x7fec080ce050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:13.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.303+0000 7fec0d200640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fec08159e70 0x7fec080cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:13.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.303+0000 7fec0d200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec080cad60 con 0x7fec0815a2c0 2024-08-17T02:24:13.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.303+0000 7fec0d200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec080c4b90 con 0x7fec08159aa0 2024-08-17T02:24:13.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.303+0000 7fec0d200640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec080ce630 con 0x7fec08159e70 2024-08-17T02:24:13.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.303+0000 7febffe00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fec08159e70 0x7fec080cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:13.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.303+0000 7febffe00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fec08159e70 0x7fec080cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:54652/0 (socket says 172.21.15.157:54652) 2024-08-17T02:24:13.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.303+0000 7febffe00640 1 -- 172.21.15.157:0/1177065575 learned_addr learned my addr 172.21.15.157:0/1177065575 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-08-17T02:24:13.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.304+0000 7fec07400640 1 --2- 172.21.15.157:0/1177065575 >> v2:172.21.15.107:3300/0 conn(0x7fec08159aa0 0x7fec080ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:13.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.304+0000 7febffe00640 1 -- 172.21.15.157:0/1177065575 >> v2:172.21.15.107:3300/0 conn(0x7fec08159aa0 msgr2=0x7fec080ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:13.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.304+0000 7febffe00640 1 --2- 172.21.15.157:0/1177065575 >> v2:172.21.15.107:3300/0 conn(0x7fec08159aa0 0x7fec080ce050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.304+0000 7febffe00640 1 -- 172.21.15.157:0/1177065575 >> v1:172.21.15.107:6789/0 conn(0x7fec0815a2c0 legacy=0x7fec080cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:13.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.304+0000 7febffe00640 1 -- 172.21.15.157:0/1177065575 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec080ce910 con 0x7fec08159e70 2024-08-17T02:24:13.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.305+0000 7febffe00640 1 --2- 172.21.15.157:0/1177065575 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec08159e70 0x7fec080cc7f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fec08099770 tx=0x7febf00091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fabf8e46814aac1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:13.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.305+0000 7fec06a00640 1 -- 172.21.15.157:0/1177065575 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf002ae80 con 0x7fec08159e70 2024-08-17T02:24:13.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.305+0000 7fec06a00640 1 -- 172.21.15.157:0/1177065575 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf0032440 con 0x7fec08159e70 2024-08-17T02:24:13.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.305+0000 7fec06a00640 1 -- 172.21.15.157:0/1177065575 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf0032800 con 0x7fec08159e70 2024-08-17T02:24:13.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.306+0000 7fec0d200640 1 -- 172.21.15.157:0/1177065575 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec08159e70 msgr2=0x7fec080cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.306+0000 7fec0d200640 1 --2- 172.21.15.157:0/1177065575 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec08159e70 0x7fec080cc7f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fec08099770 tx=0x7febf00091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.306+0000 7fec0d200640 1 -- 172.21.15.157:0/1177065575 shutdown_connections 2024-08-17T02:24:13.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.306+0000 7fec0d200640 1 --2- 172.21.15.157:0/1177065575 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec08159e70 0x7fec080cc7f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.306+0000 7fec0d200640 1 --2- 172.21.15.157:0/1177065575 >> v2:172.21.15.107:3300/0 conn(0x7fec08159aa0 0x7fec080ce050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.306+0000 7fec0d200640 1 -- 172.21.15.157:0/1177065575 >> 172.21.15.157:0/1177065575 conn(0x7fec08099040 msgr2=0x7fec0806eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:13.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.306+0000 7fec0d200640 1 -- 172.21.15.157:0/1177065575 shutdown_connections 2024-08-17T02:24:13.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.306+0000 7fec0d200640 1 -- 172.21.15.157:0/1177065575 wait complete. 2024-08-17T02:24:13.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.307+0000 7fec0d200640 1 Processor -- start 2024-08-17T02:24:13.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.307+0000 7fec0d200640 1 -- start start 2024-08-17T02:24:13.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.308+0000 7fec0d200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fec08159aa0 0x7fec08157d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:13.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.308+0000 7fec0d200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec08159e70 0x7fec0815edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:13.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.308+0000 7fec0d200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec0815a2c0 0x7fec081559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:13.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.308+0000 7fec0d200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec080b3b40 con 0x7fec08159aa0 2024-08-17T02:24:13.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.308+0000 7fec0d200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0815f2f0 con 0x7fec0815a2c0 2024-08-17T02:24:13.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.308+0000 7fec0d200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec081583c0 con 0x7fec08159e70 2024-08-17T02:24:13.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.308+0000 7fec07e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec0815a2c0 0x7fec081559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:13.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.309+0000 7febffe00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec08159e70 0x7fec0815edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:13.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.309+0000 7fec07400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fec08159aa0 0x7fec08157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:13.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.309+0000 7fec07e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec0815a2c0 0x7fec081559b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:54660/0 (socket says 172.21.15.157:54660) 2024-08-17T02:24:13.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.309+0000 7fec07e00640 1 -- 172.21.15.157:0/2715558440 learned_addr learned my addr 172.21.15.157:0/2715558440 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-08-17T02:24:13.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.309+0000 7fec07400640 1 -- 172.21.15.157:0/2715558440 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec08159e70 msgr2=0x7fec0815edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.309+0000 7fec07400640 1 --2- 172.21.15.157:0/2715558440 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec08159e70 0x7fec0815edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.309+0000 7fec07400640 1 -- 172.21.15.157:0/2715558440 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec0815a2c0 msgr2=0x7fec081559b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.309+0000 7fec07400640 1 --2- 172.21.15.157:0/2715558440 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec0815a2c0 0x7fec081559b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.309+0000 7fec07400640 1 -- 172.21.15.157:0/2715558440 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf0009450 con 0x7fec08159aa0 2024-08-17T02:24:13.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.309+0000 7febffe00640 1 --2- 172.21.15.157:0/2715558440 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec08159e70 0x7fec0815edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:13.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.309+0000 7fec07400640 1 --2- 172.21.15.157:0/2715558440 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fec08159aa0 0x7fec08157d80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7febf800e960 tx=0x7febf80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:13.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.310+0000 7febfea00640 1 -- 172.21.15.157:0/2715558440 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf800c940 con 0x7fec08159aa0 2024-08-17T02:24:13.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.310+0000 7febfea00640 1 -- 172.21.15.157:0/2715558440 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf800caa0 con 0x7fec08159aa0 2024-08-17T02:24:13.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.310+0000 7fec0d200640 1 -- 172.21.15.157:0/2715558440 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec081586a0 con 0x7fec08159aa0 2024-08-17T02:24:13.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.310+0000 7febfea00640 1 -- 172.21.15.157:0/2715558440 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf800ce20 con 0x7fec08159aa0 2024-08-17T02:24:13.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.310+0000 7fec0d200640 1 -- 172.21.15.157:0/2715558440 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec08158c60 con 0x7fec08159aa0 2024-08-17T02:24:13.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.310+0000 7febfea00640 1 -- 172.21.15.157:0/2715558440 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7febf8005970 con 0x7fec08159aa0 2024-08-17T02:24:13.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.310+0000 7febfea00640 1 -- 172.21.15.157:0/2715558440 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7febf8005c20 con 0x7fec08159aa0 2024-08-17T02:24:13.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.311+0000 7fec0d200640 1 -- 172.21.15.157:0/2715558440 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec08071050 con 0x7fec08159aa0 2024-08-17T02:24:13.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.313+0000 7febfea00640 1 -- 172.21.15.157:0/2715558440 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7febf8021060 con 0x7fec08159aa0 2024-08-17T02:24:13.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.386+0000 7fec0d200640 1 -- 172.21.15.157:0/2715558440 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f87ec331-3e59-4886-a317-6f7e26ec8e21", "id": 5} v 0) v1 -- 0x7fec0806f480 con 0x7fec08159aa0 2024-08-17T02:24:13.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.394+0000 7febfea00640 1 -- 172.21.15.157:0/2715558440 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f87ec331-3e59-4886-a317-6f7e26ec8e21", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7febf8029020 con 0x7fec08159aa0 2024-08-17T02:24:13.395 INFO:teuthology.orchestra.run.smithi157.stdout:5 2024-08-17T02:24:13.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.395+0000 7fec0d200640 1 -- 172.21.15.157:0/2715558440 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fec08159aa0 msgr2=0x7fec08157d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.395+0000 7fec0d200640 1 --2- 172.21.15.157:0/2715558440 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fec08159aa0 0x7fec08157d80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7febf800e960 tx=0x7febf80090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.395+0000 7fec0d200640 1 -- 172.21.15.157:0/2715558440 shutdown_connections 2024-08-17T02:24:13.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.395+0000 7fec0d200640 1 --2- 172.21.15.157:0/2715558440 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec0815a2c0 0x7fec081559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.395+0000 7fec0d200640 1 --2- 172.21.15.157:0/2715558440 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fec08159e70 0x7fec0815edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.395+0000 7fec0d200640 1 --2- 172.21.15.157:0/2715558440 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fec08159aa0 0x7fec08157d80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.395+0000 7fec0d200640 1 -- 172.21.15.157:0/2715558440 >> 172.21.15.157:0/2715558440 conn(0x7fec08099040 msgr2=0x7fec08156330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:13.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.395+0000 7fec0d200640 1 -- 172.21.15.157:0/2715558440 shutdown_connections 2024-08-17T02:24:13.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.395+0000 7fec0d200640 1 -- 172.21.15.157:0/2715558440 wait complete. 2024-08-17T02:24:13.410 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 92852235-ce49-4d96-a940-6f18d97b13ef 6 2024-08-17T02:24:13.545 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-08-17T02:24:13.545+0000 7f94cef6bec0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-17T02:24:13.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.555+0000 7fd183e00640 1 Processor -- start 2024-08-17T02:24:13.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.555+0000 7fd183e00640 1 -- start start 2024-08-17T02:24:13.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.556+0000 7fd183e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd17c158ea0 0x7fd17c0d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:13.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.556+0000 7fd183e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd17c0caa00 0x7fd17c0c7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:13.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.556+0000 7fd183e00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd17c06f240 con 0x7fd17c0d09a0 2024-08-17T02:24:13.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.556+0000 7fd183e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd17c0c6f20 con 0x7fd17c158ea0 2024-08-17T02:24:13.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.556+0000 7fd183e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd17c0cf410 con 0x7fd17c0caa00 2024-08-17T02:24:13.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.556+0000 7fd181e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd17c0caa00 0x7fd17c0c7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:13.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.557+0000 7fd180a00640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fd17c0d09a0 0x7fd17c0ca2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:34960/0 (socket says 172.21.15.157:34960) 2024-08-17T02:24:13.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.557+0000 7fd180a00640 1 -- 172.21.15.157:0/2824662646 learned_addr learned my addr 172.21.15.157:0/2824662646 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-08-17T02:24:13.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.557+0000 7fd181400640 1 --2- 172.21.15.157:0/2824662646 >> v2:172.21.15.107:3300/0 conn(0x7fd17c158ea0 0x7fd17c0d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:13.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.557+0000 7fd181e00640 1 -- 172.21.15.157:0/2824662646 >> v2:172.21.15.107:3300/0 conn(0x7fd17c158ea0 msgr2=0x7fd17c0d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:13.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.557+0000 7fd17be00640 1 -- 172.21.15.157:0/2824662646 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 355366043 0 0) 0x7fd17c06f240 con 0x7fd17c0d09a0 2024-08-17T02:24:13.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.557+0000 7fd181e00640 1 --2- 172.21.15.157:0/2824662646 >> v2:172.21.15.107:3300/0 conn(0x7fd17c158ea0 0x7fd17c0d0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.557+0000 7fd181e00640 1 -- 172.21.15.157:0/2824662646 >> v1:172.21.15.157:6789/0 conn(0x7fd17c0d09a0 legacy=0x7fd17c0ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.557+0000 7fd181e00640 1 -- 172.21.15.157:0/2824662646 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd17c0ceb70 con 0x7fd17c0caa00 2024-08-17T02:24:13.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.558+0000 7fd181e00640 1 --2- 172.21.15.157:0/2824662646 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd17c0caa00 0x7fd17c0c7370 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd174009e60 tx=0x7fd174009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72df648005024b13 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:13.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.558+0000 7fd17be00640 1 -- 172.21.15.157:0/2824662646 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd174007550 con 0x7fd17c0caa00 2024-08-17T02:24:13.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.558+0000 7fd17be00640 1 -- 172.21.15.157:0/2824662646 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17402d050 con 0x7fd17c0caa00 2024-08-17T02:24:13.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.558+0000 7fd17be00640 1 -- 172.21.15.157:0/2824662646 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1740078e0 con 0x7fd17c0caa00 2024-08-17T02:24:13.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.559+0000 7fd183e00640 1 -- 172.21.15.157:0/2824662646 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd17c0caa00 msgr2=0x7fd17c0c7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.559+0000 7fd183e00640 1 --2- 172.21.15.157:0/2824662646 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd17c0caa00 0x7fd17c0c7370 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd174009e60 tx=0x7fd174009780 comp rx=0 tx=0).stop 2024-08-17T02:24:13.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.559+0000 7fd183e00640 1 -- 172.21.15.157:0/2824662646 shutdown_connections 2024-08-17T02:24:13.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.559+0000 7fd183e00640 1 --2- 172.21.15.157:0/2824662646 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd17c0caa00 0x7fd17c0c7370 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.559+0000 7fd183e00640 1 --2- 172.21.15.157:0/2824662646 >> v2:172.21.15.107:3300/0 conn(0x7fd17c158ea0 0x7fd17c0d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.559+0000 7fd183e00640 1 -- 172.21.15.157:0/2824662646 >> 172.21.15.157:0/2824662646 conn(0x7fd17c06eb90 msgr2=0x7fd17c0cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:13.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.559+0000 7fd183e00640 1 -- 172.21.15.157:0/2824662646 shutdown_connections 2024-08-17T02:24:13.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.559+0000 7fd183e00640 1 -- 172.21.15.157:0/2824662646 wait complete. 2024-08-17T02:24:13.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.561+0000 7fd183e00640 1 Processor -- start 2024-08-17T02:24:13.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.561+0000 7fd183e00640 1 -- start start 2024-08-17T02:24:13.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.562+0000 7fd183e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd17c0caa00 0x7fd17c0c29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:13.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.562+0000 7fd183e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd17c0d09a0 0x7fd17c151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:13.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.562+0000 7fd183e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd17c158ea0 0x7fd17c151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:13.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.562+0000 7fd183e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17c1515c0 con 0x7fd17c0d09a0 2024-08-17T02:24:13.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.562+0000 7fd183e00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17c15e220 con 0x7fd17c0caa00 2024-08-17T02:24:13.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.562+0000 7fd183e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd17c15d180 con 0x7fd17c158ea0 2024-08-17T02:24:13.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.562+0000 7fd181e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd17c158ea0 0x7fd17c151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:13.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.562+0000 7fd181400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd17c0caa00 0x7fd17c0c29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:13.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.562+0000 7fd181400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd17c0caa00 0x7fd17c0c29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:54666/0 (socket says 172.21.15.157:54666) 2024-08-17T02:24:13.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.562+0000 7fd181e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd17c158ea0 0x7fd17c151fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:49564/0 (socket says 172.21.15.157:49564) 2024-08-17T02:24:13.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.562+0000 7fd181400640 1 -- 172.21.15.157:0/455039858 learned_addr learned my addr 172.21.15.157:0/455039858 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-08-17T02:24:13.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.562+0000 7fd180a00640 1 --2- 172.21.15.157:0/455039858 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd17c0d09a0 0x7fd17c151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:13.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.562+0000 7fd181400640 1 -- 172.21.15.157:0/455039858 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd17c158ea0 msgr2=0x7fd17c151fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.562+0000 7fd181400640 1 --2- 172.21.15.157:0/455039858 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd17c158ea0 0x7fd17c151fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.562+0000 7fd181400640 1 -- 172.21.15.157:0/455039858 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd17c0d09a0 msgr2=0x7fd17c151aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.562+0000 7fd181400640 1 --2- 172.21.15.157:0/455039858 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd17c0d09a0 0x7fd17c151aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.562+0000 7fd181400640 1 -- 172.21.15.157:0/455039858 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd174009a20 con 0x7fd17c0caa00 2024-08-17T02:24:13.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.563+0000 7fd181400640 1 --2- 172.21.15.157:0/455039858 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd17c0caa00 0x7fd17c0c29a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd17000e900 tx=0x7fd1700090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:13.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.563+0000 7fd178c00640 1 -- 172.21.15.157:0/455039858 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17000c8e0 con 0x7fd17c0caa00 2024-08-17T02:24:13.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.563+0000 7fd178c00640 1 -- 172.21.15.157:0/455039858 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17000ca40 con 0x7fd17c0caa00 2024-08-17T02:24:13.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.563+0000 7fd183e00640 1 -- 172.21.15.157:0/455039858 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd17c15d460 con 0x7fd17c0caa00 2024-08-17T02:24:13.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.563+0000 7fd178c00640 1 -- 172.21.15.157:0/455039858 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17000cde0 con 0x7fd17c0caa00 2024-08-17T02:24:13.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.563+0000 7fd183e00640 1 -- 172.21.15.157:0/455039858 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd17c15dd00 con 0x7fd17c0caa00 2024-08-17T02:24:13.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.564+0000 7fd178c00640 1 -- 172.21.15.157:0/455039858 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fd170005970 con 0x7fd17c0caa00 2024-08-17T02:24:13.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.564+0000 7fd178c00640 1 -- 172.21.15.157:0/455039858 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7fd170013e10 con 0x7fd17c0caa00 2024-08-17T02:24:13.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.564+0000 7fd183e00640 1 -- 172.21.15.157:0/455039858 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd17c071050 con 0x7fd17c0caa00 2024-08-17T02:24:13.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.567+0000 7fd178c00640 1 -- 172.21.15.157:0/455039858 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fd170021060 con 0x7fd17c0caa00 2024-08-17T02:24:13.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.640+0000 7fd183e00640 1 -- 172.21.15.157:0/455039858 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd new", "uuid": "92852235-ce49-4d96-a940-6f18d97b13ef", "id": 6} v 0) v1 -- 0x7fd17c15d5f0 con 0x7fd17c0caa00 2024-08-17T02:24:13.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.646+0000 7fd178c00640 1 -- 172.21.15.157:0/455039858 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "92852235-ce49-4d96-a940-6f18d97b13ef", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd170029020 con 0x7fd17c0caa00 2024-08-17T02:24:13.647 INFO:teuthology.orchestra.run.smithi157.stdout:6 2024-08-17T02:24:13.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.647+0000 7fd183e00640 1 -- 172.21.15.157:0/455039858 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd17c0caa00 msgr2=0x7fd17c0c29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.647+0000 7fd183e00640 1 --2- 172.21.15.157:0/455039858 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd17c0caa00 0x7fd17c0c29a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd17000e900 tx=0x7fd1700090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.647+0000 7fd183e00640 1 -- 172.21.15.157:0/455039858 shutdown_connections 2024-08-17T02:24:13.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.647+0000 7fd183e00640 1 --2- 172.21.15.157:0/455039858 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd17c158ea0 0x7fd17c151fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.647+0000 7fd183e00640 1 --2- 172.21.15.157:0/455039858 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd17c0d09a0 0x7fd17c151aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.647+0000 7fd183e00640 1 --2- 172.21.15.157:0/455039858 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd17c0caa00 0x7fd17c0c29a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.647+0000 7fd183e00640 1 -- 172.21.15.157:0/455039858 >> 172.21.15.157:0/455039858 conn(0x7fd17c06eb90 msgr2=0x7fd17c0c7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:13.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.647+0000 7fd183e00640 1 -- 172.21.15.157:0/455039858 shutdown_connections 2024-08-17T02:24:13.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.647+0000 7fd183e00640 1 -- 172.21.15.157:0/455039858 wait complete. 2024-08-17T02:24:13.662 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 7484a061-723d-4663-b28f-b01766d62f79 7 2024-08-17T02:24:13.716 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-08-17T02:24:13.715+0000 7f64ac619ec0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-17T02:24:13.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.805+0000 7f0799a00640 1 Processor -- start 2024-08-17T02:24:13.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.805+0000 7f0799a00640 1 -- start start 2024-08-17T02:24:13.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.806+0000 7f0799a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0794159b90 0x7f07940ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:13.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.806+0000 7f0799a00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f07940ca8a0 0x7f07940cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:13.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.806+0000 7f0799a00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07940cadc0 con 0x7f0794159f60 2024-08-17T02:24:13.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.806+0000 7f0799a00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07940cb880 con 0x7f07940ca8a0 2024-08-17T02:24:13.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.806+0000 7f0799a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07940cd6e0 con 0x7f0794159b90 2024-08-17T02:24:13.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.806+0000 7f0793e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0794159b90 0x7f07940ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:13.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.806+0000 7f0793400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f07940ca8a0 0x7f07940cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:13.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.807+0000 7f0793e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0794159b90 0x7f07940ca360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:49576/0 (socket says 172.21.15.157:49576) 2024-08-17T02:24:13.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.807+0000 7f0793e00640 1 -- 172.21.15.157:0/1194247520 learned_addr learned my addr 172.21.15.157:0/1194247520 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-08-17T02:24:13.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.807+0000 7f0793e00640 1 -- 172.21.15.157:0/1194247520 >> v2:172.21.15.157:3300/0 conn(0x7f07940ca8a0 msgr2=0x7f07940cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:13.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.807+0000 7f0793e00640 1 --2- 172.21.15.157:0/1194247520 >> v2:172.21.15.157:3300/0 conn(0x7f07940ca8a0 0x7f07940cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.807+0000 7f0793e00640 1 -- 172.21.15.157:0/1194247520 >> v1:172.21.15.157:6789/0 conn(0x7f0794159f60 legacy=0x7f07940cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.807+0000 7f0793e00640 1 -- 172.21.15.157:0/1194247520 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07940cb060 con 0x7f0794159b90 2024-08-17T02:24:13.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.808+0000 7f0793e00640 1 --2- 172.21.15.157:0/1194247520 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0794159b90 0x7f07940ca360 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0784009910 tx=0x7f07840091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b02c081474df9553 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:13.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.808+0000 7f0792a00640 1 -- 172.21.15.157:0/1194247520 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078402ae40 con 0x7f0794159b90 2024-08-17T02:24:13.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.808+0000 7f0792a00640 1 -- 172.21.15.157:0/1194247520 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0784032440 con 0x7f0794159b90 2024-08-17T02:24:13.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.808+0000 7f0792a00640 1 -- 172.21.15.157:0/1194247520 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0784032820 con 0x7f0794159b90 2024-08-17T02:24:13.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.809+0000 7f0799a00640 1 -- 172.21.15.157:0/1194247520 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0794159b90 msgr2=0x7f07940ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.809+0000 7f0799a00640 1 --2- 172.21.15.157:0/1194247520 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0794159b90 0x7f07940ca360 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0784009910 tx=0x7f07840091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.809+0000 7f0799a00640 1 -- 172.21.15.157:0/1194247520 shutdown_connections 2024-08-17T02:24:13.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.809+0000 7f0799a00640 1 --2- 172.21.15.157:0/1194247520 >> v2:172.21.15.157:3300/0 conn(0x7f07940ca8a0 0x7f07940cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.809+0000 7f0799a00640 1 --2- 172.21.15.157:0/1194247520 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0794159b90 0x7f07940ca360 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.809+0000 7f0799a00640 1 -- 172.21.15.157:0/1194247520 >> 172.21.15.157:0/1194247520 conn(0x7f0794098e00 msgr2=0x7f079406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:13.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.809+0000 7f0799a00640 1 -- 172.21.15.157:0/1194247520 shutdown_connections 2024-08-17T02:24:13.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.809+0000 7f0799a00640 1 -- 172.21.15.157:0/1194247520 wait complete. 2024-08-17T02:24:13.812 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-08-17T02:24:13.811+0000 7f94cef6bec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-17T02:24:13.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.810+0000 7f0799a00640 1 Processor -- start 2024-08-17T02:24:13.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.811+0000 7f0799a00640 1 -- start start 2024-08-17T02:24:13.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.811+0000 7f0799a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07940ca8a0 0x7f0794169390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:13.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.811+0000 7f0799a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0794159b90 0x7f07940c6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:13.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.812+0000 7f0799a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0794159f60 0x7f07940c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:13.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.812+0000 7f0799a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0794153d20 con 0x7f0794159b90 2024-08-17T02:24:13.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.812+0000 7f0799a00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07940c9bf0 con 0x7f07940ca8a0 2024-08-17T02:24:13.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.812+0000 7f0799a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07941698d0 con 0x7f0794159f60 2024-08-17T02:24:13.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.812+0000 7f0793e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07940ca8a0 0x7f0794169390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:13.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.812+0000 7f0793e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07940ca8a0 0x7f0794169390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:54686/0 (socket says 172.21.15.157:54686) 2024-08-17T02:24:13.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.812+0000 7f0793e00640 1 -- 172.21.15.157:0/3403497917 learned_addr learned my addr 172.21.15.157:0/3403497917 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-08-17T02:24:13.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.812+0000 7f0799000640 1 --2- 172.21.15.157:0/3403497917 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0794159f60 0x7f07940c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:13.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.812+0000 7f0793400640 1 --2- 172.21.15.157:0/3403497917 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0794159b90 0x7f07940c6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:13.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.812+0000 7f0793e00640 1 -- 172.21.15.157:0/3403497917 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0794159f60 msgr2=0x7f07940c6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.812+0000 7f0793e00640 1 --2- 172.21.15.157:0/3403497917 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0794159f60 0x7f07940c6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.812+0000 7f0793e00640 1 -- 172.21.15.157:0/3403497917 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0794159b90 msgr2=0x7f07940c6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.812+0000 7f0793e00640 1 --2- 172.21.15.157:0/3403497917 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0794159b90 0x7f07940c6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.812+0000 7f0793e00640 1 -- 172.21.15.157:0/3403497917 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0784009450 con 0x7f07940ca8a0 2024-08-17T02:24:13.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.812+0000 7f0793400640 1 --2- 172.21.15.157:0/3403497917 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0794159b90 0x7f07940c6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:13.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.813+0000 7f0793e00640 1 --2- 172.21.15.157:0/3403497917 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07940ca8a0 0x7f0794169390 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0784009970 tx=0x7f0784032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:13.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.813+0000 7f078b400640 1 -- 172.21.15.157:0/3403497917 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0784031bb0 con 0x7f07940ca8a0 2024-08-17T02:24:13.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.813+0000 7f078b400640 1 -- 172.21.15.157:0/3403497917 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0784031d30 con 0x7f07940ca8a0 2024-08-17T02:24:13.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.813+0000 7f078b400640 1 -- 172.21.15.157:0/3403497917 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0784031ea0 con 0x7f07940ca8a0 2024-08-17T02:24:13.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.813+0000 7f0799a00640 1 -- 172.21.15.157:0/3403497917 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07940c6750 con 0x7f07940ca8a0 2024-08-17T02:24:13.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.813+0000 7f0799a00640 1 -- 172.21.15.157:0/3403497917 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07940c92c0 con 0x7f07940ca8a0 2024-08-17T02:24:13.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.813+0000 7f078b400640 1 -- 172.21.15.157:0/3403497917 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f0784039040 con 0x7f07940ca8a0 2024-08-17T02:24:13.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.813+0000 7f078b400640 1 -- 172.21.15.157:0/3403497917 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f078402ae40 con 0x7f07940ca8a0 2024-08-17T02:24:13.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.814+0000 7f0799a00640 1 -- 172.21.15.157:0/3403497917 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0794071050 con 0x7f07940ca8a0 2024-08-17T02:24:13.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.818+0000 7f078b400640 1 -- 172.21.15.157:0/3403497917 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f0784042070 con 0x7f07940ca8a0 2024-08-17T02:24:13.871 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-08-17T02:24:13.871+0000 7f94cef6bec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-17T02:24:13.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.890+0000 7f0799a00640 1 -- 172.21.15.157:0/3403497917 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7484a061-723d-4663-b28f-b01766d62f79", "id": 7} v 0) v1 -- 0x7f079409d590 con 0x7f07940ca8a0 2024-08-17T02:24:13.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.896+0000 7f078b400640 1 -- 172.21.15.157:0/3403497917 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7484a061-723d-4663-b28f-b01766d62f79", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0784037070 con 0x7f07940ca8a0 2024-08-17T02:24:13.897 INFO:teuthology.orchestra.run.smithi157.stdout:7 2024-08-17T02:24:13.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.897+0000 7f0799a00640 1 -- 172.21.15.157:0/3403497917 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07940ca8a0 msgr2=0x7f0794169390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:13.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.897+0000 7f0799a00640 1 --2- 172.21.15.157:0/3403497917 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07940ca8a0 0x7f0794169390 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0784009970 tx=0x7f0784032000 comp rx=0 tx=0).stop 2024-08-17T02:24:13.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.897+0000 7f0799a00640 1 -- 172.21.15.157:0/3403497917 shutdown_connections 2024-08-17T02:24:13.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.897+0000 7f0799a00640 1 --2- 172.21.15.157:0/3403497917 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0794159f60 0x7f07940c6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.897+0000 7f0799a00640 1 --2- 172.21.15.157:0/3403497917 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0794159b90 0x7f07940c6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.897+0000 7f0799a00640 1 --2- 172.21.15.157:0/3403497917 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07940ca8a0 0x7f0794169390 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:13.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.897+0000 7f0799a00640 1 -- 172.21.15.157:0/3403497917 >> 172.21.15.157:0/3403497917 conn(0x7f0794098e00 msgr2=0x7f07940d0290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:13.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.897+0000 7f0799a00640 1 -- 172.21.15.157:0/3403497917 shutdown_connections 2024-08-17T02:24:13.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-08-17T02:24:13.897+0000 7f0799a00640 1 -- 172.21.15.157:0/3403497917 wait complete. 2024-08-17T02:24:13.912 INFO:tasks.ceph.osd.0:Restarting daemon 2024-08-17T02:24:13.913 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-08-17T02:24:13.918 INFO:tasks.ceph.osd.0:Started 2024-08-17T02:24:13.919 INFO:tasks.ceph.osd.1:Restarting daemon 2024-08-17T02:24:13.919 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-08-17T02:24:13.924 INFO:tasks.ceph.osd.1:Started 2024-08-17T02:24:13.924 INFO:tasks.ceph.osd.2:Restarting daemon 2024-08-17T02:24:13.924 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-08-17T02:24:13.928 INFO:tasks.ceph.osd.2:Started 2024-08-17T02:24:13.928 INFO:tasks.ceph.osd.3:Restarting daemon 2024-08-17T02:24:13.928 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-08-17T02:24:13.932 INFO:tasks.ceph.osd.3:Started 2024-08-17T02:24:13.932 INFO:tasks.ceph.osd.4:Restarting daemon 2024-08-17T02:24:13.932 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-08-17T02:24:13.937 INFO:tasks.ceph.osd.4:Started 2024-08-17T02:24:13.937 INFO:tasks.ceph.osd.5:Restarting daemon 2024-08-17T02:24:13.937 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-08-17T02:24:13.942 INFO:tasks.ceph.osd.5:Started 2024-08-17T02:24:13.942 INFO:tasks.ceph.osd.6:Restarting daemon 2024-08-17T02:24:13.942 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-08-17T02:24:13.947 INFO:tasks.ceph.osd.6:Started 2024-08-17T02:24:13.947 INFO:tasks.ceph.osd.7:Restarting daemon 2024-08-17T02:24:13.947 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-08-17T02:24:13.953 INFO:tasks.ceph.osd.7:Started 2024-08-17T02:24:13.953 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:14.004 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-08-17T02:24:14.004+0000 7f94cef6bec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-17T02:24:14.018 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-08-17T02:24:14.017+0000 7f64ac619ec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-17T02:24:14.110 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-08-17T02:24:14.109+0000 7f64ac619ec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-17T02:24:14.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.149+0000 7fa790800640 1 Processor -- start 2024-08-17T02:24:14.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.149+0000 7fa790800640 1 -- start start 2024-08-17T02:24:14.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.150+0000 7fa790800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa7881401b0 0x7fa7880caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:14.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.150+0000 7fa790800640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa788140580 0x7fa7880b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:14.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.150+0000 7fa790800640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7880b16d0 con 0x7fa7880b1270 2024-08-17T02:24:14.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.150+0000 7fa790800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7880cb450 con 0x7fa7881401b0 2024-08-17T02:24:14.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.150+0000 7fa790800640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7880caa80 con 0x7fa788140580 2024-08-17T02:24:14.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.150+0000 7fa78de00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa7881401b0 0x7fa7880caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:14.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.150+0000 7fa78de00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa7881401b0 0x7fa7880caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56370/0 (socket says 172.21.15.107:56370) 2024-08-17T02:24:14.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.150+0000 7fa78de00640 1 -- 172.21.15.107:0/1811004279 learned_addr learned my addr 172.21.15.107:0/1811004279 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:14.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.150+0000 7fa78d400640 1 --2- 172.21.15.107:0/1811004279 >> v2:172.21.15.157:3300/0 conn(0x7fa788140580 0x7fa7880b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:14.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.151+0000 7fa78de00640 1 -- 172.21.15.107:0/1811004279 >> v2:172.21.15.157:3300/0 conn(0x7fa788140580 msgr2=0x7fa7880b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:14.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.151+0000 7fa78de00640 1 --2- 172.21.15.107:0/1811004279 >> v2:172.21.15.157:3300/0 conn(0x7fa788140580 0x7fa7880b0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:14.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.151+0000 7fa78de00640 1 -- 172.21.15.107:0/1811004279 >> v1:172.21.15.157:6789/0 conn(0x7fa7880b1270 legacy=0x7fa7880c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:14.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.151+0000 7fa78de00640 1 -- 172.21.15.107:0/1811004279 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7880c9e70 con 0x7fa7881401b0 2024-08-17T02:24:14.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.152+0000 7fa78de00640 1 --2- 172.21.15.107:0/1811004279 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7881401b0 0x7fa7880caf10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa78806aa80 tx=0x7fa77c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b1ffe3cf6597494 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:14.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.152+0000 7fa78ca00640 1 -- 172.21.15.107:0/1811004279 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77c02add0 con 0x7fa7881401b0 2024-08-17T02:24:14.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.152+0000 7fa78ca00640 1 -- 172.21.15.107:0/1811004279 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa77c032440 con 0x7fa7881401b0 2024-08-17T02:24:14.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.152+0000 7fa78ca00640 1 -- 172.21.15.107:0/1811004279 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77c032820 con 0x7fa7881401b0 2024-08-17T02:24:14.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.152+0000 7fa790800640 1 -- 172.21.15.107:0/1811004279 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7881401b0 msgr2=0x7fa7880caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:14.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.152+0000 7fa790800640 1 --2- 172.21.15.107:0/1811004279 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7881401b0 0x7fa7880caf10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa78806aa80 tx=0x7fa77c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:14.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.153+0000 7fa790800640 1 -- 172.21.15.107:0/1811004279 shutdown_connections 2024-08-17T02:24:14.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.153+0000 7fa790800640 1 --2- 172.21.15.107:0/1811004279 >> v2:172.21.15.157:3300/0 conn(0x7fa788140580 0x7fa7880b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:14.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.153+0000 7fa790800640 1 --2- 172.21.15.107:0/1811004279 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7881401b0 0x7fa7880caf10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:14.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.153+0000 7fa790800640 1 -- 172.21.15.107:0/1811004279 >> 172.21.15.107:0/1811004279 conn(0x7fa7880cb9b0 msgr2=0x7fa7880cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:14.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.153+0000 7fa790800640 1 -- 172.21.15.107:0/1811004279 shutdown_connections 2024-08-17T02:24:14.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.153+0000 7fa790800640 1 -- 172.21.15.107:0/1811004279 wait complete. 2024-08-17T02:24:14.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.154+0000 7fa790800640 1 Processor -- start 2024-08-17T02:24:14.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.154+0000 7fa790800640 1 -- start start 2024-08-17T02:24:14.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.155+0000 7fa790800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7880b1270 0x7fa788169010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:14.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.155+0000 7fa790800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7881401b0 0x7fa78806d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:14.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.155+0000 7fa790800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa788140580 0x7fa78816b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:14.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.155+0000 7fa790800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78815d660 con 0x7fa7881401b0 2024-08-17T02:24:14.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.155+0000 7fa790800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa788169550 con 0x7fa788140580 2024-08-17T02:24:14.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.155+0000 7fa790800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa78815ca50 con 0x7fa7880b1270 2024-08-17T02:24:14.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.155+0000 7fa78d400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7881401b0 0x7fa78806d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:14.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.155+0000 7fa78d400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7881401b0 0x7fa78806d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56382/0 (socket says 172.21.15.107:56382) 2024-08-17T02:24:14.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.155+0000 7fa78d400640 1 -- 172.21.15.107:0/2998529309 learned_addr learned my addr 172.21.15.107:0/2998529309 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:14.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.155+0000 7fa78e800640 1 --2- 172.21.15.107:0/2998529309 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa788140580 0x7fa78816b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:14.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.155+0000 7fa78de00640 1 --2- 172.21.15.107:0/2998529309 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7880b1270 0x7fa788169010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:14.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.156+0000 7fa78d400640 1 -- 172.21.15.107:0/2998529309 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7880b1270 msgr2=0x7fa788169010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:14.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.156+0000 7fa78d400640 1 --2- 172.21.15.107:0/2998529309 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7880b1270 0x7fa788169010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:14.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.156+0000 7fa78d400640 1 -- 172.21.15.107:0/2998529309 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa788140580 msgr2=0x7fa78816b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:14.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.156+0000 7fa78d400640 1 --2- 172.21.15.107:0/2998529309 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa788140580 0x7fa78816b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:14.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.156+0000 7fa78d400640 1 -- 172.21.15.107:0/2998529309 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa77c009450 con 0x7fa7881401b0 2024-08-17T02:24:14.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.156+0000 7fa78de00640 1 --2- 172.21.15.107:0/2998529309 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7880b1270 0x7fa788169010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:14.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.156+0000 7fa78d400640 1 --2- 172.21.15.107:0/2998529309 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7881401b0 0x7fa78806d8e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa77800ea20 tx=0x7fa7780090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:14.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.156+0000 7fa781600640 1 -- 172.21.15.107:0/2998529309 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77800ca10 con 0x7fa7881401b0 2024-08-17T02:24:14.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.156+0000 7fa781600640 1 -- 172.21.15.107:0/2998529309 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa77800cb70 con 0x7fa7881401b0 2024-08-17T02:24:14.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.156+0000 7fa790800640 1 -- 172.21.15.107:0/2998529309 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa78815cd30 con 0x7fa7881401b0 2024-08-17T02:24:14.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.156+0000 7fa781600640 1 -- 172.21.15.107:0/2998529309 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa778013470 con 0x7fa7881401b0 2024-08-17T02:24:14.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.157+0000 7fa790800640 1 -- 172.21.15.107:0/2998529309 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa78815d2f0 con 0x7fa7881401b0 2024-08-17T02:24:14.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.157+0000 7fa781600640 1 -- 172.21.15.107:0/2998529309 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fa778005970 con 0x7fa7881401b0 2024-08-17T02:24:14.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.157+0000 7fa781600640 1 -- 172.21.15.107:0/2998529309 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7fa778006700 con 0x7fa7881401b0 2024-08-17T02:24:14.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.158+0000 7fa790800640 1 -- 172.21.15.107:0/2998529309 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa78815d7d0 con 0x7fa7881401b0 2024-08-17T02:24:14.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.160+0000 7fa781600640 1 -- 172.21.15.107:0/2998529309 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fa778021060 con 0x7fa7881401b0 2024-08-17T02:24:14.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.223+0000 7fa790800640 1 -- 172.21.15.107:0/2998529309 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa788064db0 con 0x7fa7881401b0 2024-08-17T02:24:14.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.224+0000 7fa781600640 1 -- 172.21.15.107:0/2998529309 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fa778029020 con 0x7fa7881401b0 2024-08-17T02:24:14.224 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:24:14.224 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":10,"fsid":"f207b4c0-329d-46b8-b83f-aaf30bdb6ce3","created":"2024-08-17T02:24:11.038049+0000","modified":"2024-08-17T02:24:13.892720+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:24:13.892720+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"376363f3-b8bf-4f1e-b691-51cdd39171ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cc6624e3-2ad4-4db4-b377-05dfe57424e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"25229542-29b5-4281-bcb0-798ae0930aa6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5f16aee8-8950-4268-a61a-5cf6ebd670e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"23232e28-e23b-4b4e-a531-4939246dbbde","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f87ec331-3e59-4886-a317-6f7e26ec8e21","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"92852235-ce49-4d96-a940-6f18d97b13ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7484a061-723d-4663-b28f-b01766d62f79","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:14.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.225+0000 7fa790800640 1 -- 172.21.15.107:0/2998529309 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7881401b0 msgr2=0x7fa78806d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:14.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.225+0000 7fa790800640 1 --2- 172.21.15.107:0/2998529309 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7881401b0 0x7fa78806d8e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa77800ea20 tx=0x7fa7780090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:14.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.225+0000 7fa790800640 1 -- 172.21.15.107:0/2998529309 shutdown_connections 2024-08-17T02:24:14.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.225+0000 7fa790800640 1 --2- 172.21.15.107:0/2998529309 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa788140580 0x7fa78816b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:14.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.225+0000 7fa790800640 1 --2- 172.21.15.107:0/2998529309 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7881401b0 0x7fa78806d8e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:14.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.225+0000 7fa790800640 1 --2- 172.21.15.107:0/2998529309 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7880b1270 0x7fa788169010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:14.226 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.225+0000 7fa790800640 1 -- 172.21.15.107:0/2998529309 >> 172.21.15.107:0/2998529309 conn(0x7fa7880cb9b0 msgr2=0x7fa7880ab8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:14.226 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.225+0000 7fa790800640 1 -- 172.21.15.107:0/2998529309 shutdown_connections 2024-08-17T02:24:14.226 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:14.225+0000 7fa790800640 1 -- 172.21.15.107:0/2998529309 wait complete. 2024-08-17T02:24:14.226 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-08-17T02:24:14.225+0000 7f64ac619ec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-17T02:24:14.239 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-08-17T02:24:14.240 INFO:tasks.ceph:Waiting for OSDs to come up 2024-08-17T02:24:14.327 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-08-17T02:24:14.325+0000 7f94cef6bec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-17T02:24:14.380 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-08-17T02:24:14.380+0000 7f94cef6bec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-17T02:24:14.530 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-08-17T02:24:14.526+0000 7f64ac619ec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-17T02:24:14.554 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-08-17T02:24:14.554+0000 7f94cef6bec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-17T02:24:14.581 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-08-17T02:24:14.580+0000 7f64ac619ec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-17T02:24:14.591 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-08-17T02:24:14.591+0000 7f6c58e8d2c0 -1 Falling back to public interface 2024-08-17T02:24:14.601 INFO:tasks.ceph.osd.5.smithi157.stderr:2024-08-17T02:24:14.600+0000 7ff6390082c0 -1 Falling back to public interface 2024-08-17T02:24:14.602 INFO:tasks.ceph.osd.6.smithi157.stderr:2024-08-17T02:24:14.600+0000 7f6aaad1f2c0 -1 Falling back to public interface 2024-08-17T02:24:14.602 INFO:tasks.ceph.osd.5.smithi157.stderr:2024-08-17T02:24:14.600+0000 7ff636a00640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-08-17T02:24:14.602 INFO:tasks.ceph.osd.5.smithi157.stderr:2024-08-17T02:24:14.601+0000 7ff636a00640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6801/0: (98) Address already in use 2024-08-17T02:24:14.612 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-08-17T02:24:14.612+0000 7f94cef6bec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-17T02:24:14.612 INFO:tasks.ceph.osd.4.smithi157.stderr:2024-08-17T02:24:14.611+0000 7f1e825202c0 -1 Falling back to public interface 2024-08-17T02:24:14.616 INFO:tasks.ceph.osd.3.smithi107.stderr:2024-08-17T02:24:14.616+0000 7fe67c6112c0 -1 Falling back to public interface 2024-08-17T02:24:14.625 INFO:tasks.ceph.osd.2.smithi107.stderr:2024-08-17T02:24:14.626+0000 7f9393b212c0 -1 Falling back to public interface 2024-08-17T02:24:14.630 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-08-17T02:24:14.630+0000 7f1226d1d2c0 -1 Falling back to public interface 2024-08-17T02:24:14.648 INFO:tasks.ceph.osd.7.smithi157.stderr:2024-08-17T02:24:14.647+0000 7f0c8040b2c0 -1 Falling back to public interface 2024-08-17T02:24:14.696 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-08-17T02:24:14.696+0000 7f94cef6bec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-17T02:24:14.747 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-08-17T02:24:14.747+0000 7f94cef6bec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-17T02:24:14.771 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-08-17T02:24:14.770+0000 7f64ac619ec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-17T02:24:14.827 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-08-17T02:24:14.826+0000 7f64ac619ec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-17T02:24:14.909 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-08-17T02:24:14.908+0000 7f64ac619ec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-17T02:24:14.962 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-08-17T02:24:14.961+0000 7f64ac619ec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-17T02:24:15.044 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:15.175 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.174+0000 7f73ad800640 1 Processor -- start 2024-08-17T02:24:15.175 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.174+0000 7f73ad800640 1 -- start start 2024-08-17T02:24:15.176 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.176+0000 7f73ad800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f73a80b0ac0 0x7f73a80b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:15.176 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.176+0000 7f73ad800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73a80af240 con 0x7f73a80ad8e0 2024-08-17T02:24:15.176 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.176+0000 7f73ad800640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73a80afa20 con 0x7f73a80b2c60 2024-08-17T02:24:15.176 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.176+0000 7f73ad800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73a80afd00 con 0x7f73a80b0ac0 2024-08-17T02:24:15.176 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.176+0000 7f73a6000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f73a80b0ac0 0x7f73a80b0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:15.176 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.176+0000 7f73a6a00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f73a80ad8e0 0x7f73a80d04b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:41612/0 (socket says 172.21.15.107:41612) 2024-08-17T02:24:15.176 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.176+0000 7f73a6a00640 1 -- 172.21.15.107:0/92251553 learned_addr learned my addr 172.21.15.107:0/92251553 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:15.177 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.176+0000 7f73a5600640 1 -- 172.21.15.107:0/92251553 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3925139543 0 0) 0x7f73a80af240 con 0x7f73a80ad8e0 2024-08-17T02:24:15.177 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.176+0000 7f73a5600640 1 -- 172.21.15.107:0/92251553 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f738c0034e0 con 0x7f73a80ad8e0 2024-08-17T02:24:15.177 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.176+0000 7f73a6000640 1 -- 172.21.15.107:0/92251553 >> v1:172.21.15.157:6789/0 conn(0x7f73a80b2c60 legacy=0x7f73a80b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:15.177 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.176+0000 7f73a5600640 1 -- 172.21.15.107:0/92251553 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2459063087 0 0) 0x7f73a80afa20 con 0x7f73a80b2c60 2024-08-17T02:24:15.177 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.176+0000 7f73a6000640 1 -- 172.21.15.107:0/92251553 >> v1:172.21.15.107:6789/0 conn(0x7f73a80ad8e0 legacy=0x7f73a80d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:15.178 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.176+0000 7f73a6000640 1 -- 172.21.15.107:0/92251553 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a80affe0 con 0x7f73a80b0ac0 2024-08-17T02:24:15.179 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.177+0000 7f73a6000640 1 --2- 172.21.15.107:0/92251553 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73a80b0ac0 0x7f73a80b0f10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7394009850 tx=0x7f73940090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f1c54487d52de9d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:15.179 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.178+0000 7f73a5600640 1 -- 172.21.15.107:0/92251553 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739402ae20 con 0x7f73a80b0ac0 2024-08-17T02:24:15.179 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.178+0000 7f73a5600640 1 -- 172.21.15.107:0/92251553 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7394032440 con 0x7f73a80b0ac0 2024-08-17T02:24:15.179 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.178+0000 7f73a5600640 1 -- 172.21.15.107:0/92251553 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73940327c0 con 0x7f73a80b0ac0 2024-08-17T02:24:15.179 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.178+0000 7f73ad800640 1 -- 172.21.15.107:0/92251553 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73a80b0ac0 msgr2=0x7f73a80b0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:15.179 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.178+0000 7f73ad800640 1 --2- 172.21.15.107:0/92251553 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73a80b0ac0 0x7f73a80b0f10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7394009850 tx=0x7f73940090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:15.179 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.179+0000 7f73ad800640 1 -- 172.21.15.107:0/92251553 shutdown_connections 2024-08-17T02:24:15.179 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.179+0000 7f73ad800640 1 --2- 172.21.15.107:0/92251553 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73a80b0ac0 0x7f73a80b0f10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:15.179 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.179+0000 7f73ad800640 1 -- 172.21.15.107:0/92251553 >> 172.21.15.107:0/92251553 conn(0x7f73a806ec90 msgr2=0x7f73a80cfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:15.179 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.179+0000 7f73ad800640 1 -- 172.21.15.107:0/92251553 shutdown_connections 2024-08-17T02:24:15.179 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.179+0000 7f73ad800640 1 -- 172.21.15.107:0/92251553 wait complete. 2024-08-17T02:24:15.180 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.180+0000 7f73ad800640 1 Processor -- start 2024-08-17T02:24:15.180 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.180+0000 7f73ad800640 1 -- start start 2024-08-17T02:24:15.183 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.181+0000 7f73ad800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73a80ad8e0 0x7f73a8156870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:15.183 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.181+0000 7f73ad800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73a80b0ac0 0x7f73a80ce720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:15.183 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.181+0000 7f73ad800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f73a80b2c60 0x7f73a809c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:15.184 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.181+0000 7f73ad800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a809b490 con 0x7f73a80ad8e0 2024-08-17T02:24:15.184 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.181+0000 7f73ad800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a809b770 con 0x7f73a80b0ac0 2024-08-17T02:24:15.184 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.181+0000 7f73ad800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a809ba50 con 0x7f73a80b2c60 2024-08-17T02:24:15.184 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.181+0000 7f73a6a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73a80ad8e0 0x7f73a8156870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:15.184 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.181+0000 7f73a6a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73a80ad8e0 0x7f73a8156870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56400/0 (socket says 172.21.15.107:56400) 2024-08-17T02:24:15.184 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.181+0000 7f73a6a00640 1 -- 172.21.15.107:0/1346706935 learned_addr learned my addr 172.21.15.107:0/1346706935 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:15.184 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.181+0000 7f73a6000640 1 --2- 172.21.15.107:0/1346706935 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73a80b0ac0 0x7f73a80ce720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:15.184 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.182+0000 7f73a7400640 1 --2- 172.21.15.107:0/1346706935 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f73a80b2c60 0x7f73a809c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:15.184 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.182+0000 7f73a6a00640 1 -- 172.21.15.107:0/1346706935 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f73a80b2c60 msgr2=0x7f73a809c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:15.184 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.182+0000 7f73a6a00640 1 --2- 172.21.15.107:0/1346706935 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f73a80b2c60 0x7f73a809c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:15.184 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.182+0000 7f73a6a00640 1 -- 172.21.15.107:0/1346706935 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73a80b0ac0 msgr2=0x7f73a80ce720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:15.184 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.182+0000 7f73a6a00640 1 --2- 172.21.15.107:0/1346706935 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73a80b0ac0 0x7f73a80ce720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:15.185 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.182+0000 7f73a6a00640 1 -- 172.21.15.107:0/1346706935 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7394009390 con 0x7f73a80ad8e0 2024-08-17T02:24:15.185 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.182+0000 7f73a6a00640 1 --2- 172.21.15.107:0/1346706935 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73a80ad8e0 0x7f73a8156870 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f739800c4b0 tx=0x7f7398007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:15.185 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.182+0000 7f739e000640 1 -- 172.21.15.107:0/1346706935 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7398005aa0 con 0x7f73a80ad8e0 2024-08-17T02:24:15.185 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.182+0000 7f739e000640 1 -- 172.21.15.107:0/1346706935 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7398005c00 con 0x7f73a80ad8e0 2024-08-17T02:24:15.185 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.182+0000 7f739e000640 1 -- 172.21.15.107:0/1346706935 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73980070d0 con 0x7f73a80ad8e0 2024-08-17T02:24:15.185 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.183+0000 7f73ad800640 1 -- 172.21.15.107:0/1346706935 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73a809bd30 con 0x7f73a80ad8e0 2024-08-17T02:24:15.185 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.183+0000 7f73ad800640 1 -- 172.21.15.107:0/1346706935 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73a8156db0 con 0x7f73a80ad8e0 2024-08-17T02:24:15.185 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.183+0000 7f739e000640 1 -- 172.21.15.107:0/1346706935 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f73980074c0 con 0x7f73a80ad8e0 2024-08-17T02:24:15.185 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.183+0000 7f739e000640 1 -- 172.21.15.107:0/1346706935 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f7398012ae0 con 0x7f73a80ad8e0 2024-08-17T02:24:15.186 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.184+0000 7f73ad800640 1 -- 172.21.15.107:0/1346706935 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73a809c230 con 0x7f73a80ad8e0 2024-08-17T02:24:15.186 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.186+0000 7f739e000640 1 -- 172.21.15.107:0/1346706935 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f7398017070 con 0x7f73a80ad8e0 2024-08-17T02:24:15.249 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.249+0000 7f73ad800640 1 -- 172.21.15.107:0/1346706935 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73a8064a50 con 0x7f73a80ad8e0 2024-08-17T02:24:15.250 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.249+0000 7f739e000640 1 -- 172.21.15.107:0/1346706935 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f739801c5c0 con 0x7f73a80ad8e0 2024-08-17T02:24:15.250 INFO:teuthology.misc.health.smithi107.stdout: 2024-08-17T02:24:15.250 INFO:teuthology.misc.health.smithi107.stdout:{"epoch":10,"fsid":"f207b4c0-329d-46b8-b83f-aaf30bdb6ce3","created":"2024-08-17T02:24:11.038049+0000","modified":"2024-08-17T02:24:13.892720+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:24:13.892720+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"376363f3-b8bf-4f1e-b691-51cdd39171ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cc6624e3-2ad4-4db4-b377-05dfe57424e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"25229542-29b5-4281-bcb0-798ae0930aa6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5f16aee8-8950-4268-a61a-5cf6ebd670e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"23232e28-e23b-4b4e-a531-4939246dbbde","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f87ec331-3e59-4886-a317-6f7e26ec8e21","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"92852235-ce49-4d96-a940-6f18d97b13ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7484a061-723d-4663-b28f-b01766d62f79","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:15.251 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.250+0000 7f73ad800640 1 -- 172.21.15.107:0/1346706935 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73a80ad8e0 msgr2=0x7f73a8156870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:15.251 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.250+0000 7f73ad800640 1 --2- 172.21.15.107:0/1346706935 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73a80ad8e0 0x7f73a8156870 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f739800c4b0 tx=0x7f7398007d60 comp rx=0 tx=0).stop 2024-08-17T02:24:15.251 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.250+0000 7f73ad800640 1 -- 172.21.15.107:0/1346706935 shutdown_connections 2024-08-17T02:24:15.251 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.250+0000 7f73ad800640 1 --2- 172.21.15.107:0/1346706935 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f73a80b2c60 0x7f73a809c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:15.251 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.250+0000 7f73ad800640 1 --2- 172.21.15.107:0/1346706935 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73a80b0ac0 0x7f73a80ce720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:15.251 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.250+0000 7f73ad800640 1 --2- 172.21.15.107:0/1346706935 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73a80ad8e0 0x7f73a8156870 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:15.251 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.250+0000 7f73ad800640 1 -- 172.21.15.107:0/1346706935 >> 172.21.15.107:0/1346706935 conn(0x7f73a806ec90 msgr2=0x7f73a815ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:15.251 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.250+0000 7f73ad800640 1 -- 172.21.15.107:0/1346706935 shutdown_connections 2024-08-17T02:24:15.251 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:15.251+0000 7f73ad800640 1 -- 172.21.15.107:0/1346706935 wait complete. 2024-08-17T02:24:15.262 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-08-17T02:24:15.282 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-08-17T02:24:15.282+0000 7f94cef6bec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-17T02:24:15.389 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-08-17T02:24:15.389+0000 7f94cef6bec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-17T02:24:15.499 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-08-17T02:24:15.498+0000 7f64ac619ec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-17T02:24:15.610 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-08-17T02:24:15.608+0000 7f64ac619ec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-17T02:24:16.407 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-08-17T02:24:16.407+0000 7f94b3200640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-08-17T02:24:16.408 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-08-17T02:24:16.408+0000 7f94b3200640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-08-17T02:24:18.130 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-08-17T02:24:18.130+0000 7f6c58e8d2c0 -1 osd.0 0 log_to_monitors true 2024-08-17T02:24:18.158 INFO:tasks.ceph.osd.5.smithi157.stderr:2024-08-17T02:24:18.157+0000 7ff6390082c0 -1 osd.5 0 log_to_monitors true 2024-08-17T02:24:18.206 INFO:tasks.ceph.osd.6.smithi157.stderr:2024-08-17T02:24:18.205+0000 7f6aaad1f2c0 -1 osd.6 0 log_to_monitors true 2024-08-17T02:24:18.242 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-08-17T02:24:18.242+0000 7f1226d1d2c0 -1 osd.1 0 log_to_monitors true 2024-08-17T02:24:18.245 INFO:tasks.ceph.osd.3.smithi107.stderr:2024-08-17T02:24:18.245+0000 7fe67c6112c0 -1 osd.3 0 log_to_monitors true 2024-08-17T02:24:18.254 INFO:tasks.ceph.osd.2.smithi107.stderr:2024-08-17T02:24:18.254+0000 7f9393b212c0 -1 osd.2 0 log_to_monitors true 2024-08-17T02:24:18.272 INFO:tasks.ceph.osd.4.smithi157.stderr:2024-08-17T02:24:18.271+0000 7f1e825202c0 -1 osd.4 0 log_to_monitors true 2024-08-17T02:24:18.287 INFO:tasks.ceph.osd.7.smithi157.stderr:2024-08-17T02:24:18.286+0000 7f0c8040b2c0 -1 osd.7 0 log_to_monitors true 2024-08-17T02:24:21.042 INFO:tasks.ceph.osd.7.smithi157.stderr:2024-08-17T02:24:21.041+0000 7f0c79800640 -1 osd.7 0 waiting for initial osdmap 2024-08-17T02:24:21.050 INFO:tasks.ceph.osd.7.smithi157.stderr:2024-08-17T02:24:21.050+0000 7f0c70c00640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:24:21.071 INFO:tasks.ceph.osd.6.smithi157.stderr:2024-08-17T02:24:21.071+0000 7f6aa4400640 -1 osd.6 0 waiting for initial osdmap 2024-08-17T02:24:21.079 INFO:tasks.ceph.osd.6.smithi157.stderr:2024-08-17T02:24:21.079+0000 7f6a9b800640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:24:21.102 INFO:tasks.ceph.osd.4.smithi157.stderr:2024-08-17T02:24:21.102+0000 7f1e7bc00640 -1 osd.4 0 waiting for initial osdmap 2024-08-17T02:24:21.108 INFO:tasks.ceph.osd.4.smithi157.stderr:2024-08-17T02:24:21.108+0000 7f1e73000640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:24:21.149 INFO:tasks.ceph.osd.5.smithi157.stderr:2024-08-17T02:24:21.149+0000 7ff632400640 -1 osd.5 0 waiting for initial osdmap 2024-08-17T02:24:21.154 INFO:tasks.ceph.osd.5.smithi157.stderr:2024-08-17T02:24:21.154+0000 7ff629800640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:24:21.679 INFO:tasks.ceph.osd.3.smithi107.stderr:2024-08-17T02:24:21.678+0000 7fe675a00640 -1 osd.3 0 waiting for initial osdmap 2024-08-17T02:24:21.688 INFO:tasks.ceph.osd.3.smithi107.stderr:2024-08-17T02:24:21.687+0000 7fe66ce00640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:24:21.732 INFO:tasks.ceph.osd.2.smithi107.stderr:2024-08-17T02:24:21.730+0000 7f938d200640 -1 osd.2 0 waiting for initial osdmap 2024-08-17T02:24:21.738 INFO:tasks.ceph.osd.2.smithi107.stderr:2024-08-17T02:24:21.737+0000 7f9384600640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:24:21.748 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-08-17T02:24:21.747+0000 7f6c52c00640 -1 osd.0 0 waiting for initial osdmap 2024-08-17T02:24:21.753 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-08-17T02:24:21.752+0000 7f1222200640 -1 osd.1 0 waiting for initial osdmap 2024-08-17T02:24:21.753 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-08-17T02:24:21.752+0000 7f6c4a000640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:24:21.758 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-08-17T02:24:21.757+0000 7f1217800640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:24:22.068 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:22.200 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.199+0000 7f6b8f200640 1 Processor -- start 2024-08-17T02:24:22.200 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.199+0000 7f6b8f200640 1 -- start start 2024-08-17T02:24:22.202 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.200+0000 7f6b8f200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6b900c5d70 0x7f6b900c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.202 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.200+0000 7f6b8f200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b900c58e0 con 0x7f6b900b2180 2024-08-17T02:24:22.202 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.200+0000 7f6b8f200640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b90159350 con 0x7f6b900ca820 2024-08-17T02:24:22.202 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.200+0000 7f6b8f200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b900b2550 con 0x7f6b900c5d70 2024-08-17T02:24:22.202 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.200+0000 7f6b85400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6b900c5d70 0x7f6b900c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.202 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.200+0000 7f6b85400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6b900c5d70 0x7f6b900c61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51480/0 (socket says 172.21.15.107:51480) 2024-08-17T02:24:22.202 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.200+0000 7f6b85400640 1 -- 172.21.15.107:0/2880415522 learned_addr learned my addr 172.21.15.107:0/2880415522 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:22.202 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.200+0000 7f6b8de00640 1 --1- 172.21.15.107:0/2880415522 >> v1:172.21.15.107:6789/0 conn(0x7f6b900b2180 0x7f6b900b29e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:33526/0 (socket says 172.21.15.107:33526) 2024-08-17T02:24:22.202 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.201+0000 7f6b85400640 1 -- 172.21.15.107:0/2880415522 >> v1:172.21.15.157:6789/0 conn(0x7f6b900ca820 legacy=0x7f6b900cac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:22.202 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.201+0000 7f6b85400640 1 -- 172.21.15.107:0/2880415522 >> v1:172.21.15.107:6789/0 conn(0x7f6b900b2180 legacy=0x7f6b900b29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.202 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.201+0000 7f6b85400640 1 -- 172.21.15.107:0/2880415522 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b900c4cd0 con 0x7f6b900c5d70 2024-08-17T02:24:22.203 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.202+0000 7f6b85400640 1 --2- 172.21.15.107:0/2880415522 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b900c5d70 0x7f6b900c61d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6b78009910 tx=0x7f6b780091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c843765669152be server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:22.203 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.202+0000 7f6b8d400640 1 -- 172.21.15.107:0/2880415522 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7802ae70 con 0x7f6b900c5d70 2024-08-17T02:24:22.203 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.202+0000 7f6b8d400640 1 -- 172.21.15.107:0/2880415522 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b78032440 con 0x7f6b900c5d70 2024-08-17T02:24:22.203 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.202+0000 7f6b8d400640 1 -- 172.21.15.107:0/2880415522 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b78032820 con 0x7f6b900c5d70 2024-08-17T02:24:22.204 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.202+0000 7f6b8f200640 1 -- 172.21.15.107:0/2880415522 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b900c5d70 msgr2=0x7f6b900c61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.204 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.202+0000 7f6b8f200640 1 --2- 172.21.15.107:0/2880415522 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b900c5d70 0x7f6b900c61d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6b78009910 tx=0x7f6b780091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.204 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.203+0000 7f6b8f200640 1 -- 172.21.15.107:0/2880415522 shutdown_connections 2024-08-17T02:24:22.204 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.203+0000 7f6b8f200640 1 --2- 172.21.15.107:0/2880415522 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b900c5d70 0x7f6b900c61d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.204 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.203+0000 7f6b8f200640 1 -- 172.21.15.107:0/2880415522 >> 172.21.15.107:0/2880415522 conn(0x7f6b900890d0 msgr2=0x7f6b900cfc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:22.204 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.203+0000 7f6b8f200640 1 -- 172.21.15.107:0/2880415522 shutdown_connections 2024-08-17T02:24:22.205 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.203+0000 7f6b8f200640 1 -- 172.21.15.107:0/2880415522 wait complete. 2024-08-17T02:24:22.205 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.204+0000 7f6b8f200640 1 Processor -- start 2024-08-17T02:24:22.205 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.204+0000 7f6b8f200640 1 -- start start 2024-08-17T02:24:22.206 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.205+0000 7f6b8f200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b900b2180 0x7f6b901550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.206 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.205+0000 7f6b8f200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b900c5d70 0x7f6b900c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.206 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.205+0000 7f6b8f200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b900ca820 0x7f6b900cac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.206 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.205+0000 7f6b8f200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b90156bc0 con 0x7f6b900ca820 2024-08-17T02:24:22.207 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.205+0000 7f6b8f200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b90159630 con 0x7f6b900c5d70 2024-08-17T02:24:22.207 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.205+0000 7f6b8f200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b90155620 con 0x7f6b900b2180 2024-08-17T02:24:22.207 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.205+0000 7f6b8e800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b900ca820 0x7f6b900cac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.207 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.205+0000 7f6b8e800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b900ca820 0x7f6b900cac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51492/0 (socket says 172.21.15.107:51492) 2024-08-17T02:24:22.207 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.205+0000 7f6b8e800640 1 -- 172.21.15.107:0/1098528611 learned_addr learned my addr 172.21.15.107:0/1098528611 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:22.207 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.205+0000 7f6b8de00640 1 --2- 172.21.15.107:0/1098528611 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b900b2180 0x7f6b901550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.207 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.205+0000 7f6b85400640 1 --2- 172.21.15.107:0/1098528611 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b900c5d70 0x7f6b900c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.208 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.206+0000 7f6b8e800640 1 -- 172.21.15.107:0/1098528611 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b900b2180 msgr2=0x7f6b901550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.208 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.206+0000 7f6b8e800640 1 --2- 172.21.15.107:0/1098528611 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b900b2180 0x7f6b901550e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.208 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.206+0000 7f6b8e800640 1 -- 172.21.15.107:0/1098528611 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b900c5d70 msgr2=0x7f6b900c8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.208 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.206+0000 7f6b8e800640 1 --2- 172.21.15.107:0/1098528611 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b900c5d70 0x7f6b900c8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.208 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.206+0000 7f6b8e800640 1 -- 172.21.15.107:0/1098528611 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b78009450 con 0x7f6b900ca820 2024-08-17T02:24:22.209 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.206+0000 7f6b8e800640 1 --2- 172.21.15.107:0/1098528611 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b900ca820 0x7f6b900cac20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6b8800b910 tx=0x7f6b88009400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:22.209 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.206+0000 7f6b86000640 1 -- 172.21.15.107:0/1098528611 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8800c8c0 con 0x7f6b900ca820 2024-08-17T02:24:22.209 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.206+0000 7f6b86000640 1 -- 172.21.15.107:0/1098528611 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b8800c040 con 0x7f6b900ca820 2024-08-17T02:24:22.209 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.206+0000 7f6b86000640 1 -- 172.21.15.107:0/1098528611 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8800cc70 con 0x7f6b900ca820 2024-08-17T02:24:22.209 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.206+0000 7f6b8f200640 1 -- 172.21.15.107:0/1098528611 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b90156320 con 0x7f6b900ca820 2024-08-17T02:24:22.209 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.206+0000 7f6b8f200640 1 -- 172.21.15.107:0/1098528611 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b901568e0 con 0x7f6b900ca820 2024-08-17T02:24:22.210 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.207+0000 7f6b8f200640 1 -- 172.21.15.107:0/1098528611 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b90071100 con 0x7f6b900ca820 2024-08-17T02:24:22.210 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.208+0000 7f6b86000640 1 -- 172.21.15.107:0/1098528611 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f6b88014620 con 0x7f6b900ca820 2024-08-17T02:24:22.210 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.209+0000 7f6b86000640 1 --2- 172.21.15.107:0/1098528611 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6b6c0650c0 0x7f6b6c067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.210 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.209+0000 7f6b86000640 1 -- 172.21.15.107:0/1098528611 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f6b88081860 con 0x7f6b900ca820 2024-08-17T02:24:22.210 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.209+0000 7f6b8de00640 1 --2- 172.21.15.107:0/1098528611 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6b6c0650c0 0x7f6b6c067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.211 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.210+0000 7f6b8de00640 1 --2- 172.21.15.107:0/1098528611 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6b6c0650c0 0x7f6b6c067570 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6b80007800 tx=0x7f6b80007e20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:22.214 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.214+0000 7f6b86000640 1 -- 172.21.15.107:0/1098528611 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6b8804ce40 con 0x7f6b900ca820 2024-08-17T02:24:22.389 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.388+0000 7f6b8f200640 1 -- 172.21.15.107:0/1098528611 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b90159770 con 0x7f6b900ca820 2024-08-17T02:24:22.390 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.389+0000 7f6b86000640 1 -- 172.21.15.107:0/1098528611 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10444 (secure 0 0 0) 0x7f6b8804fee0 con 0x7f6b900ca820 2024-08-17T02:24:22.390 INFO:teuthology.misc.health.smithi107.stdout: 2024-08-17T02:24:22.390 INFO:teuthology.misc.health.smithi107.stdout:{"epoch":13,"fsid":"f207b4c0-329d-46b8-b83f-aaf30bdb6ce3","created":"2024-08-17T02:24:11.038049+0000","modified":"2024-08-17T02:24:22.047790+0000","last_up_change":"2024-08-17T02:24:22.047790+0000","last_in_change":"2024-08-17T02:24:13.892720+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"376363f3-b8bf-4f1e-b691-51cdd39171ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37302},{"type":"v1","addr":"172.21.15.107:6801","nonce":37302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37302},{"type":"v1","addr":"172.21.15.107:6803","nonce":37302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37302},{"type":"v1","addr":"172.21.15.107:6807","nonce":37302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37302},{"type":"v1","addr":"172.21.15.107:6805","nonce":37302}]},"public_addr":"172.21.15.107:6801/37302","cluster_addr":"172.21.15.107:6803/37302","heartbeat_back_addr":"172.21.15.107:6807/37302","heartbeat_front_addr":"172.21.15.107:6805/37302","state":["exists","up"]},{"osd":1,"uuid":"cc6624e3-2ad4-4db4-b377-05dfe57424e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37305},{"type":"v1","addr":"172.21.15.107:6824","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37305},{"type":"v1","addr":"172.21.15.107:6827","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37305},{"type":"v1","addr":"172.21.15.107:6831","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37305},{"type":"v1","addr":"172.21.15.107:6829","nonce":37305}]},"public_addr":"172.21.15.107:6824/37305","cluster_addr":"172.21.15.107:6827/37305","heartbeat_back_addr":"172.21.15.107:6831/37305","heartbeat_front_addr":"172.21.15.107:6829/37305","state":["exists","up"]},{"osd":2,"uuid":"25229542-29b5-4281-bcb0-798ae0930aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37307},{"type":"v1","addr":"172.21.15.107:6817","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37307},{"type":"v1","addr":"172.21.15.107:6819","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6823","nonce":37307},{"type":"v1","addr":"172.21.15.107:6825","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37307},{"type":"v1","addr":"172.21.15.107:6821","nonce":37307}]},"public_addr":"172.21.15.107:6817/37307","cluster_addr":"172.21.15.107:6819/37307","heartbeat_back_addr":"172.21.15.107:6825/37307","heartbeat_front_addr":"172.21.15.107:6821/37307","state":["exists","up"]},{"osd":3,"uuid":"5f16aee8-8950-4268-a61a-5cf6ebd670e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37306},{"type":"v1","addr":"172.21.15.107:6809","nonce":37306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37306},{"type":"v1","addr":"172.21.15.107:6811","nonce":37306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37306},{"type":"v1","addr":"172.21.15.107:6815","nonce":37306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37306},{"type":"v1","addr":"172.21.15.107:6813","nonce":37306}]},"public_addr":"172.21.15.107:6809/37306","cluster_addr":"172.21.15.107:6811/37306","heartbeat_back_addr":"172.21.15.107:6815/37306","heartbeat_front_addr":"172.21.15.107:6813/37306","state":["exists","up"]},{"osd":4,"uuid":"23232e28-e23b-4b4e-a531-4939246dbbde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":37329},{"type":"v1","addr":"172.21.15.157:6817","nonce":37329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":37329},{"type":"v1","addr":"172.21.15.157:6819","nonce":37329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":37329},{"type":"v1","addr":"172.21.15.157:6823","nonce":37329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":37329},{"type":"v1","addr":"172.21.15.157:6821","nonce":37329}]},"public_addr":"172.21.15.157:6817/37329","cluster_addr":"172.21.15.157:6819/37329","heartbeat_back_addr":"172.21.15.157:6823/37329","heartbeat_front_addr":"172.21.15.157:6821/37329","state":["exists","up"]},{"osd":5,"uuid":"f87ec331-3e59-4886-a317-6f7e26ec8e21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":37328},{"type":"v1","addr":"172.21.15.157:6804","nonce":37328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":37328},{"type":"v1","addr":"172.21.15.157:6808","nonce":37328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":37328},{"type":"v1","addr":"172.21.15.157:6815","nonce":37328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":37328},{"type":"v1","addr":"172.21.15.157:6812","nonce":37328}]},"public_addr":"172.21.15.157:6804/37328","cluster_addr":"172.21.15.157:6808/37328","heartbeat_back_addr":"172.21.15.157:6815/37328","heartbeat_front_addr":"172.21.15.157:6812/37328","state":["exists","up"]},{"osd":6,"uuid":"92852235-ce49-4d96-a940-6f18d97b13ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":37330},{"type":"v1","addr":"172.21.15.157:6801","nonce":37330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6803","nonce":37330},{"type":"v1","addr":"172.21.15.157:6805","nonce":37330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":37330},{"type":"v1","addr":"172.21.15.157:6813","nonce":37330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":37330},{"type":"v1","addr":"172.21.15.157:6809","nonce":37330}]},"public_addr":"172.21.15.157:6801/37330","cluster_addr":"172.21.15.157:6805/37330","heartbeat_back_addr":"172.21.15.157:6813/37330","heartbeat_front_addr":"172.21.15.157:6809/37330","state":["exists","up"]},{"osd":7,"uuid":"7484a061-723d-4663-b28f-b01766d62f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":37373},{"type":"v1","addr":"172.21.15.157:6825","nonce":37373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":37373},{"type":"v1","addr":"172.21.15.157:6827","nonce":37373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":37373},{"type":"v1","addr":"172.21.15.157:6831","nonce":37373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":37373},{"type":"v1","addr":"172.21.15.157:6829","nonce":37373}]},"public_addr":"172.21.15.157:6825/37373","cluster_addr":"172.21.15.157:6827/37373","heartbeat_back_addr":"172.21.15.157:6831/37373","heartbeat_front_addr":"172.21.15.157:6829/37373","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:22.392 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.391+0000 7f6b8f200640 1 -- 172.21.15.107:0/1098528611 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6b6c0650c0 msgr2=0x7f6b6c067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.392 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.391+0000 7f6b8f200640 1 --2- 172.21.15.107:0/1098528611 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6b6c0650c0 0x7f6b6c067570 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6b80007800 tx=0x7f6b80007e20 comp rx=0 tx=0).stop 2024-08-17T02:24:22.392 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.391+0000 7f6b8f200640 1 -- 172.21.15.107:0/1098528611 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b900ca820 msgr2=0x7f6b900cac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.392 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.391+0000 7f6b8f200640 1 --2- 172.21.15.107:0/1098528611 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b900ca820 0x7f6b900cac20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6b8800b910 tx=0x7f6b88009400 comp rx=0 tx=0).stop 2024-08-17T02:24:22.392 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.391+0000 7f6b8f200640 1 -- 172.21.15.107:0/1098528611 shutdown_connections 2024-08-17T02:24:22.392 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.391+0000 7f6b8f200640 1 --2- 172.21.15.107:0/1098528611 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6b6c0650c0 0x7f6b6c067570 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.392 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.391+0000 7f6b8f200640 1 --2- 172.21.15.107:0/1098528611 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b900ca820 0x7f6b900cac20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.393 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.391+0000 7f6b8f200640 1 --2- 172.21.15.107:0/1098528611 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b900c5d70 0x7f6b900c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.393 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.391+0000 7f6b8f200640 1 --2- 172.21.15.107:0/1098528611 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b900b2180 0x7f6b901550e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.393 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.391+0000 7f6b8f200640 1 -- 172.21.15.107:0/1098528611 >> 172.21.15.107:0/1098528611 conn(0x7f6b900890d0 msgr2=0x7f6b900b5190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:22.393 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.391+0000 7f6b8f200640 1 -- 172.21.15.107:0/1098528611 shutdown_connections 2024-08-17T02:24:22.393 INFO:teuthology.misc.health.smithi107.stderr:2024-08-17T02:24:22.391+0000 7f6b8f200640 1 -- 172.21.15.107:0/1098528611 wait complete. 2024-08-17T02:24:22.404 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-08-17T02:24:22.405 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-08-17T02:24:22.405 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-17T02:24:22.405 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-17T02:24:22.409 INFO:tasks.ceph.mds.a:Started 2024-08-17T02:24:22.409 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-17T02:24:22.409 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-17T02:24:22.412 INFO:tasks.ceph.mds.c:Started 2024-08-17T02:24:22.412 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-17T02:24:22.413 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-17T02:24:22.417 INFO:tasks.ceph.mds.b:Started 2024-08-17T02:24:22.417 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-17T02:24:22.417 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-17T02:24:22.421 INFO:tasks.ceph.mds.d:Started 2024-08-17T02:24:22.421 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-08-17T02:24:22.422 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:22.538 INFO:tasks.ceph.mds.c.smithi107.stdout:starting mds.c at 2024-08-17T02:24:22.539 INFO:tasks.ceph.mds.a.smithi107.stdout:starting mds.a at 2024-08-17T02:24:22.549 INFO:tasks.ceph.mds.b.smithi157.stdout:starting mds.b at 2024-08-17T02:24:22.550 INFO:tasks.ceph.mds.d.smithi157.stdout:starting mds.d at 2024-08-17T02:24:22.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.582+0000 7f11c6c00640 1 Processor -- start 2024-08-17T02:24:22.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.582+0000 7f11c6c00640 1 -- start start 2024-08-17T02:24:22.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.583+0000 7f11c6c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f11c0158cf0 0x7f11c015a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.583+0000 7f11c6c00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f11c01590c0 0x7f11c01594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.583+0000 7f11c6c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11c015a590 con 0x7f11c0159a00 2024-08-17T02:24:22.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.583+0000 7f11c6c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11c0159e60 con 0x7f11c0158cf0 2024-08-17T02:24:22.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.583+0000 7f11c6c00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11c00cbd90 con 0x7f11c01590c0 2024-08-17T02:24:22.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.583+0000 7f11c5800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f11c0158cf0 0x7f11c015a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.583+0000 7f11c5800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f11c0158cf0 0x7f11c015a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51512/0 (socket says 172.21.15.107:51512) 2024-08-17T02:24:22.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.583+0000 7f11c5800640 1 -- 172.21.15.107:0/2010163558 learned_addr learned my addr 172.21.15.107:0/2010163558 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:22.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.583+0000 7f11c6200640 1 --1- 172.21.15.107:0/2010163558 >> v1:172.21.15.107:6789/0 conn(0x7f11c0159a00 0x7f11c00c4920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:33538/0 (socket says 172.21.15.107:33538) 2024-08-17T02:24:22.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.583+0000 7f11c4e00640 1 --2- 172.21.15.107:0/2010163558 >> v2:172.21.15.157:3300/0 conn(0x7f11c01590c0 0x7f11c01594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.584+0000 7f11c5800640 1 -- 172.21.15.107:0/2010163558 >> v2:172.21.15.157:3300/0 conn(0x7f11c01590c0 msgr2=0x7f11c01594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:22.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.584+0000 7f11c5800640 1 --2- 172.21.15.107:0/2010163558 >> v2:172.21.15.157:3300/0 conn(0x7f11c01590c0 0x7f11c01594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.584+0000 7f11c5800640 1 -- 172.21.15.107:0/2010163558 >> v1:172.21.15.107:6789/0 conn(0x7f11c0159a00 legacy=0x7f11c00c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.584+0000 7f11c5800640 1 -- 172.21.15.107:0/2010163558 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c00cb4d0 con 0x7f11c0158cf0 2024-08-17T02:24:22.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.585+0000 7f11c5800640 1 --2- 172.21.15.107:0/2010163558 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11c0158cf0 0x7f11c015a050 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f11c0088d00 tx=0x7f11b40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b6172a4c7d5f06f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:22.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.585+0000 7f11bfe00640 1 -- 172.21.15.107:0/2010163558 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b402ae80 con 0x7f11c0158cf0 2024-08-17T02:24:22.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.585+0000 7f11bfe00640 1 -- 172.21.15.107:0/2010163558 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b4032440 con 0x7f11c0158cf0 2024-08-17T02:24:22.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.585+0000 7f11c6c00640 1 -- 172.21.15.107:0/2010163558 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11c0158cf0 msgr2=0x7f11c015a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.585+0000 7f11c6c00640 1 --2- 172.21.15.107:0/2010163558 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11c0158cf0 0x7f11c015a050 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f11c0088d00 tx=0x7f11b40091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.585+0000 7f11c6c00640 1 -- 172.21.15.107:0/2010163558 shutdown_connections 2024-08-17T02:24:22.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.585+0000 7f11c6c00640 1 --2- 172.21.15.107:0/2010163558 >> v2:172.21.15.157:3300/0 conn(0x7f11c01590c0 0x7f11c01594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.585+0000 7f11c6c00640 1 --2- 172.21.15.107:0/2010163558 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11c0158cf0 0x7f11c015a050 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.585+0000 7f11c6c00640 1 -- 172.21.15.107:0/2010163558 >> 172.21.15.107:0/2010163558 conn(0x7f11c006eb90 msgr2=0x7f11c00cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:22.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.586+0000 7f11c6c00640 1 -- 172.21.15.107:0/2010163558 shutdown_connections 2024-08-17T02:24:22.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.586+0000 7f11c6c00640 1 -- 172.21.15.107:0/2010163558 wait complete. 2024-08-17T02:24:22.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.587+0000 7f11c6c00640 1 Processor -- start 2024-08-17T02:24:22.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.587+0000 7f11c6c00640 1 -- start start 2024-08-17T02:24:22.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.588+0000 7f11c6c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11c0158cf0 0x7f11c0154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.588+0000 7f11c6c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11c01590c0 0x7f11c01681e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.588+0000 7f11c6c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11c0159a00 0x7f11c00c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.588+0000 7f11c6c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c00b3360 con 0x7f11c01590c0 2024-08-17T02:24:22.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.588+0000 7f11c6c00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c00b5850 con 0x7f11c0159a00 2024-08-17T02:24:22.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.588+0000 7f11c6c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c00b2a30 con 0x7f11c0158cf0 2024-08-17T02:24:22.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.588+0000 7f11c4e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11c01590c0 0x7f11c01681e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.588+0000 7f11c4e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11c01590c0 0x7f11c01681e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51528/0 (socket says 172.21.15.107:51528) 2024-08-17T02:24:22.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.588+0000 7f11c4e00640 1 -- 172.21.15.107:0/3426623312 learned_addr learned my addr 172.21.15.107:0/3426623312 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:22.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.588+0000 7f11c6200640 1 --2- 172.21.15.107:0/3426623312 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11c0159a00 0x7f11c00c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.588+0000 7f11c5800640 1 --2- 172.21.15.107:0/3426623312 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11c0158cf0 0x7f11c0154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.588+0000 7f11c4e00640 1 -- 172.21.15.107:0/3426623312 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11c0158cf0 msgr2=0x7f11c0154c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.588+0000 7f11c4e00640 1 --2- 172.21.15.107:0/3426623312 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11c0158cf0 0x7f11c0154c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.589+0000 7f11c4e00640 1 -- 172.21.15.107:0/3426623312 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11c0159a00 msgr2=0x7f11c00c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.589+0000 7f11c4e00640 1 --2- 172.21.15.107:0/3426623312 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11c0159a00 0x7f11c00c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.589+0000 7f11c4e00640 1 -- 172.21.15.107:0/3426623312 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b4009450 con 0x7f11c01590c0 2024-08-17T02:24:22.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.589+0000 7f11c4e00640 1 --2- 172.21.15.107:0/3426623312 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11c01590c0 0x7f11c01681e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f11ac00d890 tx=0x7f11ac008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:22.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.589+0000 7f11bcc00640 1 -- 172.21.15.107:0/3426623312 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ac00de20 con 0x7f11c01590c0 2024-08-17T02:24:22.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.589+0000 7f11bcc00640 1 -- 172.21.15.107:0/3426623312 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11ac00b8d0 con 0x7f11c01590c0 2024-08-17T02:24:22.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.589+0000 7f11bcc00640 1 -- 172.21.15.107:0/3426623312 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ac00bc70 con 0x7f11c01590c0 2024-08-17T02:24:22.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.589+0000 7f11c6c00640 1 -- 172.21.15.107:0/3426623312 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11c00b2d10 con 0x7f11c01590c0 2024-08-17T02:24:22.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.589+0000 7f11c6c00640 1 -- 172.21.15.107:0/3426623312 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11c0152c50 con 0x7f11c01590c0 2024-08-17T02:24:22.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.590+0000 7f11c6c00640 1 -- 172.21.15.107:0/3426623312 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11c00b3510 con 0x7f11c01590c0 2024-08-17T02:24:22.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.591+0000 7f11bcc00640 1 -- 172.21.15.107:0/3426623312 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f11ac014640 con 0x7f11c01590c0 2024-08-17T02:24:22.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.591+0000 7f11bcc00640 1 --2- 172.21.15.107:0/3426623312 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f11a00650c0 0x7f11a0067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.592+0000 7f11bcc00640 1 -- 172.21.15.107:0/3426623312 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f11ac082490 con 0x7f11c01590c0 2024-08-17T02:24:22.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.592+0000 7f11c5800640 1 --2- 172.21.15.107:0/3426623312 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f11a00650c0 0x7f11a0067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.592+0000 7f11c5800640 1 --2- 172.21.15.107:0/3426623312 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f11a00650c0 0x7f11a0067570 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f11b4034000 tx=0x7f11b4032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:22.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.596+0000 7f11bcc00640 1 -- 172.21.15.107:0/3426623312 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f11c00b3510 con 0x7f11c01590c0 2024-08-17T02:24:22.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.775+0000 7f11c6c00640 1 -- 172.21.15.107:0/3426623312 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11c00b3510 con 0x7f11c01590c0 2024-08-17T02:24:22.777 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.776+0000 7f11bcc00640 1 -- 172.21.15.107:0/3426623312 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10444 (secure 0 0 0) 0x7f11c00b3510 con 0x7f11c01590c0 2024-08-17T02:24:22.777 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:24:22.778 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":13,"fsid":"f207b4c0-329d-46b8-b83f-aaf30bdb6ce3","created":"2024-08-17T02:24:11.038049+0000","modified":"2024-08-17T02:24:22.047790+0000","last_up_change":"2024-08-17T02:24:22.047790+0000","last_in_change":"2024-08-17T02:24:13.892720+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"376363f3-b8bf-4f1e-b691-51cdd39171ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37302},{"type":"v1","addr":"172.21.15.107:6801","nonce":37302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37302},{"type":"v1","addr":"172.21.15.107:6803","nonce":37302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37302},{"type":"v1","addr":"172.21.15.107:6807","nonce":37302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37302},{"type":"v1","addr":"172.21.15.107:6805","nonce":37302}]},"public_addr":"172.21.15.107:6801/37302","cluster_addr":"172.21.15.107:6803/37302","heartbeat_back_addr":"172.21.15.107:6807/37302","heartbeat_front_addr":"172.21.15.107:6805/37302","state":["exists","up"]},{"osd":1,"uuid":"cc6624e3-2ad4-4db4-b377-05dfe57424e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37305},{"type":"v1","addr":"172.21.15.107:6824","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37305},{"type":"v1","addr":"172.21.15.107:6827","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37305},{"type":"v1","addr":"172.21.15.107:6831","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37305},{"type":"v1","addr":"172.21.15.107:6829","nonce":37305}]},"public_addr":"172.21.15.107:6824/37305","cluster_addr":"172.21.15.107:6827/37305","heartbeat_back_addr":"172.21.15.107:6831/37305","heartbeat_front_addr":"172.21.15.107:6829/37305","state":["exists","up"]},{"osd":2,"uuid":"25229542-29b5-4281-bcb0-798ae0930aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37307},{"type":"v1","addr":"172.21.15.107:6817","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37307},{"type":"v1","addr":"172.21.15.107:6819","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6823","nonce":37307},{"type":"v1","addr":"172.21.15.107:6825","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37307},{"type":"v1","addr":"172.21.15.107:6821","nonce":37307}]},"public_addr":"172.21.15.107:6817/37307","cluster_addr":"172.21.15.107:6819/37307","heartbeat_back_addr":"172.21.15.107:6825/37307","heartbeat_front_addr":"172.21.15.107:6821/37307","state":["exists","up"]},{"osd":3,"uuid":"5f16aee8-8950-4268-a61a-5cf6ebd670e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37306},{"type":"v1","addr":"172.21.15.107:6809","nonce":37306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37306},{"type":"v1","addr":"172.21.15.107:6811","nonce":37306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37306},{"type":"v1","addr":"172.21.15.107:6815","nonce":37306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37306},{"type":"v1","addr":"172.21.15.107:6813","nonce":37306}]},"public_addr":"172.21.15.107:6809/37306","cluster_addr":"172.21.15.107:6811/37306","heartbeat_back_addr":"172.21.15.107:6815/37306","heartbeat_front_addr":"172.21.15.107:6813/37306","state":["exists","up"]},{"osd":4,"uuid":"23232e28-e23b-4b4e-a531-4939246dbbde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":37329},{"type":"v1","addr":"172.21.15.157:6817","nonce":37329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":37329},{"type":"v1","addr":"172.21.15.157:6819","nonce":37329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":37329},{"type":"v1","addr":"172.21.15.157:6823","nonce":37329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":37329},{"type":"v1","addr":"172.21.15.157:6821","nonce":37329}]},"public_addr":"172.21.15.157:6817/37329","cluster_addr":"172.21.15.157:6819/37329","heartbeat_back_addr":"172.21.15.157:6823/37329","heartbeat_front_addr":"172.21.15.157:6821/37329","state":["exists","up"]},{"osd":5,"uuid":"f87ec331-3e59-4886-a317-6f7e26ec8e21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":37328},{"type":"v1","addr":"172.21.15.157:6804","nonce":37328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":37328},{"type":"v1","addr":"172.21.15.157:6808","nonce":37328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":37328},{"type":"v1","addr":"172.21.15.157:6815","nonce":37328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":37328},{"type":"v1","addr":"172.21.15.157:6812","nonce":37328}]},"public_addr":"172.21.15.157:6804/37328","cluster_addr":"172.21.15.157:6808/37328","heartbeat_back_addr":"172.21.15.157:6815/37328","heartbeat_front_addr":"172.21.15.157:6812/37328","state":["exists","up"]},{"osd":6,"uuid":"92852235-ce49-4d96-a940-6f18d97b13ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":37330},{"type":"v1","addr":"172.21.15.157:6801","nonce":37330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6803","nonce":37330},{"type":"v1","addr":"172.21.15.157:6805","nonce":37330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":37330},{"type":"v1","addr":"172.21.15.157:6813","nonce":37330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":37330},{"type":"v1","addr":"172.21.15.157:6809","nonce":37330}]},"public_addr":"172.21.15.157:6801/37330","cluster_addr":"172.21.15.157:6805/37330","heartbeat_back_addr":"172.21.15.157:6813/37330","heartbeat_front_addr":"172.21.15.157:6809/37330","state":["exists","up"]},{"osd":7,"uuid":"7484a061-723d-4663-b28f-b01766d62f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":37373},{"type":"v1","addr":"172.21.15.157:6825","nonce":37373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":37373},{"type":"v1","addr":"172.21.15.157:6827","nonce":37373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":37373},{"type":"v1","addr":"172.21.15.157:6831","nonce":37373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":37373},{"type":"v1","addr":"172.21.15.157:6829","nonce":37373}]},"public_addr":"172.21.15.157:6825/37373","cluster_addr":"172.21.15.157:6827/37373","heartbeat_back_addr":"172.21.15.157:6831/37373","heartbeat_front_addr":"172.21.15.157:6829/37373","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:22.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.778+0000 7f11c6c00640 1 -- 172.21.15.107:0/3426623312 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f11a00650c0 msgr2=0x7f11a0067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.778+0000 7f11c6c00640 1 --2- 172.21.15.107:0/3426623312 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f11a00650c0 0x7f11a0067570 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f11b4034000 tx=0x7f11b4032000 comp rx=0 tx=0).stop 2024-08-17T02:24:22.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.778+0000 7f11c6c00640 1 -- 172.21.15.107:0/3426623312 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11c01590c0 msgr2=0x7f11c01681e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.778+0000 7f11c6c00640 1 --2- 172.21.15.107:0/3426623312 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11c01590c0 0x7f11c01681e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f11ac00d890 tx=0x7f11ac008040 comp rx=0 tx=0).stop 2024-08-17T02:24:22.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.778+0000 7f11c6c00640 1 -- 172.21.15.107:0/3426623312 shutdown_connections 2024-08-17T02:24:22.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.778+0000 7f11c6c00640 1 --2- 172.21.15.107:0/3426623312 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f11a00650c0 0x7f11a0067570 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.778+0000 7f11c6c00640 1 --2- 172.21.15.107:0/3426623312 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11c0159a00 0x7f11c00c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.778+0000 7f11c6c00640 1 --2- 172.21.15.107:0/3426623312 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11c01590c0 0x7f11c01681e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.778+0000 7f11c6c00640 1 --2- 172.21.15.107:0/3426623312 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11c0158cf0 0x7f11c0154c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.778+0000 7f11c6c00640 1 -- 172.21.15.107:0/3426623312 >> 172.21.15.107:0/3426623312 conn(0x7f11c006eb90 msgr2=0x7f11c00cc580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:22.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.778+0000 7f11c6c00640 1 -- 172.21.15.107:0/3426623312 shutdown_connections 2024-08-17T02:24:22.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.778+0000 7f11c6c00640 1 -- 172.21.15.107:0/3426623312 wait complete. 2024-08-17T02:24:22.794 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-08-17T02:24:22.795 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:24:22.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.944+0000 7ff054e00640 1 Processor -- start 2024-08-17T02:24:22.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.944+0000 7ff054e00640 1 -- start start 2024-08-17T02:24:22.947 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.945+0000 7ff054e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff050155a20 0x7ff0500adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.947 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.945+0000 7ff054e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff050155df0 0x7ff0500ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.947 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.945+0000 7ff054e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff05006d7f0 0x7ff05006dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.945+0000 7ff054e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0500b0350 con 0x7ff050155a20 2024-08-17T02:24:22.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.945+0000 7ff054e00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff050156670 con 0x7ff050155df0 2024-08-17T02:24:22.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.945+0000 7ff054e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff05006e180 con 0x7ff05006d7f0 2024-08-17T02:24:22.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.946+0000 7ff04de00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff050155a20 0x7ff0500adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.946+0000 7ff04de00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff050155a20 0x7ff0500adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51536/0 (socket says 172.21.15.107:51536) 2024-08-17T02:24:22.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.946+0000 7ff04de00640 1 -- 172.21.15.107:0/3209497254 learned_addr learned my addr 172.21.15.107:0/3209497254 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:22.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.946+0000 7ff04e800640 1 --2- 172.21.15.107:0/3209497254 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff05006d7f0 0x7ff05006dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.946+0000 7ff045400640 1 --2- 172.21.15.107:0/3209497254 >> v2:172.21.15.157:3300/0 conn(0x7ff050155df0 0x7ff0500ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.946+0000 7ff04de00640 1 -- 172.21.15.107:0/3209497254 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff05006d7f0 msgr2=0x7ff05006dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:22.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.946+0000 7ff04de00640 1 --2- 172.21.15.107:0/3209497254 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff05006d7f0 0x7ff05006dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.946+0000 7ff04de00640 1 -- 172.21.15.107:0/3209497254 >> v2:172.21.15.157:3300/0 conn(0x7ff050155df0 msgr2=0x7ff0500ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:22.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.946+0000 7ff04de00640 1 --2- 172.21.15.107:0/3209497254 >> v2:172.21.15.157:3300/0 conn(0x7ff050155df0 0x7ff0500ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.946+0000 7ff04de00640 1 -- 172.21.15.107:0/3209497254 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff05006e5e0 con 0x7ff050155a20 2024-08-17T02:24:22.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.947+0000 7ff04de00640 1 --2- 172.21.15.107:0/3209497254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff050155a20 0x7ff0500adf10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff05006aa10 tx=0x7ff0400091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4eadcb9badaea0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:22.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.947+0000 7ff04d400640 1 -- 172.21.15.107:0/3209497254 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04002add0 con 0x7ff050155a20 2024-08-17T02:24:22.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.947+0000 7ff04d400640 1 -- 172.21.15.107:0/3209497254 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff040032440 con 0x7ff050155a20 2024-08-17T02:24:22.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.947+0000 7ff04d400640 1 -- 172.21.15.107:0/3209497254 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff040032820 con 0x7ff050155a20 2024-08-17T02:24:22.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.948+0000 7ff054e00640 1 -- 172.21.15.107:0/3209497254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff050155a20 msgr2=0x7ff0500adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.948+0000 7ff054e00640 1 --2- 172.21.15.107:0/3209497254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff050155a20 0x7ff0500adf10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff05006aa10 tx=0x7ff0400091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.948+0000 7ff054e00640 1 -- 172.21.15.107:0/3209497254 shutdown_connections 2024-08-17T02:24:22.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.948+0000 7ff054e00640 1 --2- 172.21.15.107:0/3209497254 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff05006d7f0 0x7ff05006dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.948+0000 7ff054e00640 1 --2- 172.21.15.107:0/3209497254 >> v2:172.21.15.157:3300/0 conn(0x7ff050155df0 0x7ff0500ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.948+0000 7ff054e00640 1 --2- 172.21.15.107:0/3209497254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff050155a20 0x7ff0500adf10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.948+0000 7ff054e00640 1 -- 172.21.15.107:0/3209497254 >> 172.21.15.107:0/3209497254 conn(0x7ff0500cb9b0 msgr2=0x7ff0500cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:22.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.948+0000 7ff054e00640 1 -- 172.21.15.107:0/3209497254 shutdown_connections 2024-08-17T02:24:22.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.948+0000 7ff054e00640 1 -- 172.21.15.107:0/3209497254 wait complete. 2024-08-17T02:24:22.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.949+0000 7ff054e00640 1 Processor -- start 2024-08-17T02:24:22.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.949+0000 7ff054e00640 1 -- start start 2024-08-17T02:24:22.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.950+0000 7ff054e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff05006d7f0 0x7ff050166460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.950+0000 7ff054e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff050155a20 0x7ff0500ac3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.950+0000 7ff054e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff050155df0 0x7ff0500aae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.950+0000 7ff054e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0501669a0 con 0x7ff050155a20 2024-08-17T02:24:22.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.950+0000 7ff054e00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0500ac900 con 0x7ff050155df0 2024-08-17T02:24:22.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.950+0000 7ff054e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff050167c50 con 0x7ff05006d7f0 2024-08-17T02:24:22.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.950+0000 7ff045400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff050155a20 0x7ff0500ac3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.951+0000 7ff045400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff050155a20 0x7ff0500ac3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51546/0 (socket says 172.21.15.107:51546) 2024-08-17T02:24:22.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.951+0000 7ff045400640 1 -- 172.21.15.107:0/4233221531 learned_addr learned my addr 172.21.15.107:0/4233221531 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:22.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.951+0000 7ff04de00640 1 --2- 172.21.15.107:0/4233221531 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff05006d7f0 0x7ff050166460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.951+0000 7ff04e800640 1 --2- 172.21.15.107:0/4233221531 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff050155df0 0x7ff0500aae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.951+0000 7ff045400640 1 -- 172.21.15.107:0/4233221531 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff05006d7f0 msgr2=0x7ff050166460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.951+0000 7ff045400640 1 --2- 172.21.15.107:0/4233221531 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff05006d7f0 0x7ff050166460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.951+0000 7ff045400640 1 -- 172.21.15.107:0/4233221531 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff050155df0 msgr2=0x7ff0500aae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.951+0000 7ff045400640 1 --2- 172.21.15.107:0/4233221531 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff050155df0 0x7ff0500aae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.951+0000 7ff045400640 1 -- 172.21.15.107:0/4233221531 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff040009450 con 0x7ff050155a20 2024-08-17T02:24:22.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.951+0000 7ff045400640 1 --2- 172.21.15.107:0/4233221531 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff050155a20 0x7ff0500ac3c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff03800e8d0 tx=0x7ff0380090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:22.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.951+0000 7ff046000640 1 -- 172.21.15.107:0/4233221531 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff038009480 con 0x7ff050155a20 2024-08-17T02:24:22.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.951+0000 7ff046000640 1 -- 172.21.15.107:0/4233221531 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03800c8e0 con 0x7ff050155a20 2024-08-17T02:24:22.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.951+0000 7ff046000640 1 -- 172.21.15.107:0/4233221531 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03800cca0 con 0x7ff050155a20 2024-08-17T02:24:22.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.951+0000 7ff054e00640 1 -- 172.21.15.107:0/4233221531 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff050166bb0 con 0x7ff050155a20 2024-08-17T02:24:22.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.952+0000 7ff054e00640 1 -- 172.21.15.107:0/4233221531 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff050167170 con 0x7ff050155a20 2024-08-17T02:24:22.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.953+0000 7ff054e00640 1 -- 172.21.15.107:0/4233221531 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff050064db0 con 0x7ff050155a20 2024-08-17T02:24:22.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.953+0000 7ff046000640 1 -- 172.21.15.107:0/4233221531 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7ff038013680 con 0x7ff050155a20 2024-08-17T02:24:22.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.954+0000 7ff046000640 1 --2- 172.21.15.107:0/4233221531 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ff02c0650f0 0x7ff02c0675a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.955+0000 7ff046000640 1 -- 172.21.15.107:0/4233221531 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7ff038081ef0 con 0x7ff050155a20 2024-08-17T02:24:22.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.955+0000 7ff04de00640 1 --2- 172.21.15.107:0/4233221531 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ff02c0650f0 0x7ff02c0675a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.955+0000 7ff04de00640 1 --2- 172.21.15.107:0/4233221531 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ff02c0650f0 0x7ff02c0675a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff040034000 tx=0x7ff040032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:22.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:22.959+0000 7ff046000640 1 -- 172.21.15.107:0/4233221531 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff038050570 con 0x7ff050155a20 2024-08-17T02:24:23.171 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:23.169+0000 7ff054e00640 1 -- 172.21.15.107:0/4233221531 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0500ab360 con 0x7ff050155a20 2024-08-17T02:24:23.171 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:23.170+0000 7ff046000640 1 -- 172.21.15.107:0/4233221531 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1259 (secure 0 0 0) 0x7ff038021500 con 0x7ff050155a20 2024-08-17T02:24:23.171 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:24:23.171 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1386798018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1386798018},{"type":"v1","addr":"172.21.15.107:6835","nonce":1386798018}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-08-17T02:24:23.172 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 2 2024-08-17T02:24:23.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:23.172+0000 7ff054e00640 1 -- 172.21.15.107:0/4233221531 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ff02c0650f0 msgr2=0x7ff02c0675a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:23.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:23.172+0000 7ff054e00640 1 --2- 172.21.15.107:0/4233221531 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ff02c0650f0 0x7ff02c0675a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff040034000 tx=0x7ff040032000 comp rx=0 tx=0).stop 2024-08-17T02:24:23.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:23.172+0000 7ff054e00640 1 -- 172.21.15.107:0/4233221531 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff050155a20 msgr2=0x7ff0500ac3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:23.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:23.172+0000 7ff054e00640 1 --2- 172.21.15.107:0/4233221531 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff050155a20 0x7ff0500ac3c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff03800e8d0 tx=0x7ff0380090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:23.172+0000 7ff054e00640 1 -- 172.21.15.107:0/4233221531 shutdown_connections 2024-08-17T02:24:23.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:23.172+0000 7ff054e00640 1 --2- 172.21.15.107:0/4233221531 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ff02c0650f0 0x7ff02c0675a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:23.172+0000 7ff054e00640 1 --2- 172.21.15.107:0/4233221531 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff050155df0 0x7ff0500aae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:23.172+0000 7ff054e00640 1 --2- 172.21.15.107:0/4233221531 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff050155a20 0x7ff0500ac3c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:23.172+0000 7ff054e00640 1 --2- 172.21.15.107:0/4233221531 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff05006d7f0 0x7ff050166460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:23.172+0000 7ff054e00640 1 -- 172.21.15.107:0/4233221531 >> 172.21.15.107:0/4233221531 conn(0x7ff0500cb9b0 msgr2=0x7ff050152440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:23.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:23.172+0000 7ff054e00640 1 -- 172.21.15.107:0/4233221531 shutdown_connections 2024-08-17T02:24:23.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:23.172+0000 7ff054e00640 1 -- 172.21.15.107:0/4233221531 wait complete. 2024-08-17T02:24:25.188 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:24:25.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.341+0000 7fc01b200640 1 Processor -- start 2024-08-17T02:24:25.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.341+0000 7fc01b200640 1 -- start start 2024-08-17T02:24:25.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.342+0000 7fc01b200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc01c0ceb40 0x7fc01c0cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:25.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.342+0000 7fc01b200640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc01c0ccad0 0x7fc01c162860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:25.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.342+0000 7fc01b200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc01c0cadc0 con 0x7fc01c159ca0 2024-08-17T02:24:25.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.342+0000 7fc01b200640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc01c0cd6e0 con 0x7fc01c0ccad0 2024-08-17T02:24:25.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.342+0000 7fc01b200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c0ccf70 con 0x7fc01c0ceb40 2024-08-17T02:24:25.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.342+0000 7fc019e00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fc01c159ca0 0x7fc01c0ca360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:33544/0 (socket says 172.21.15.107:33544) 2024-08-17T02:24:25.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.342+0000 7fc019e00640 1 -- 172.21.15.107:0/388072584 learned_addr learned my addr 172.21.15.107:0/388072584 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:25.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.342+0000 7fc019400640 1 --2- 172.21.15.107:0/388072584 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc01c0ceb40 0x7fc01c0cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:25.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.343+0000 7fc01a800640 1 --2- 172.21.15.107:0/388072584 >> v2:172.21.15.157:3300/0 conn(0x7fc01c0ccad0 0x7fc01c162860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:25.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.343+0000 7fc018a00640 1 -- 172.21.15.107:0/388072584 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3590872425 0 0) 0x7fc01c0cadc0 con 0x7fc01c159ca0 2024-08-17T02:24:25.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.343+0000 7fc018a00640 1 -- 172.21.15.107:0/388072584 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0000034e0 con 0x7fc01c159ca0 2024-08-17T02:24:25.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.343+0000 7fc019400640 1 -- 172.21.15.107:0/388072584 >> v2:172.21.15.157:3300/0 conn(0x7fc01c0ccad0 msgr2=0x7fc01c162860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:25.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.343+0000 7fc019400640 1 --2- 172.21.15.107:0/388072584 >> v2:172.21.15.157:3300/0 conn(0x7fc01c0ccad0 0x7fc01c162860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.343+0000 7fc019400640 1 -- 172.21.15.107:0/388072584 >> v1:172.21.15.107:6789/0 conn(0x7fc01c159ca0 legacy=0x7fc01c0ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:25.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.343+0000 7fc019400640 1 -- 172.21.15.107:0/388072584 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc01c0cb060 con 0x7fc01c0ceb40 2024-08-17T02:24:25.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.344+0000 7fc019400640 1 --2- 172.21.15.107:0/388072584 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc01c0ceb40 0x7fc01c0cc590 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc008009850 tx=0x7fc0080090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95f996fa1269f7a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:25.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.344+0000 7fc018a00640 1 -- 172.21.15.107:0/388072584 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00802ad90 con 0x7fc01c0ceb40 2024-08-17T02:24:25.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.344+0000 7fc018a00640 1 -- 172.21.15.107:0/388072584 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc008032440 con 0x7fc01c0ceb40 2024-08-17T02:24:25.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.344+0000 7fc018a00640 1 -- 172.21.15.107:0/388072584 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc008032820 con 0x7fc01c0ceb40 2024-08-17T02:24:25.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.345+0000 7fc01b200640 1 -- 172.21.15.107:0/388072584 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc01c0ceb40 msgr2=0x7fc01c0cc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:25.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.345+0000 7fc01b200640 1 --2- 172.21.15.107:0/388072584 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc01c0ceb40 0x7fc01c0cc590 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc008009850 tx=0x7fc0080090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.345+0000 7fc01b200640 1 -- 172.21.15.107:0/388072584 shutdown_connections 2024-08-17T02:24:25.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.345+0000 7fc01b200640 1 --2- 172.21.15.107:0/388072584 >> v2:172.21.15.157:3300/0 conn(0x7fc01c0ccad0 0x7fc01c162860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.345+0000 7fc01b200640 1 --2- 172.21.15.107:0/388072584 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc01c0ceb40 0x7fc01c0cc590 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.345+0000 7fc01b200640 1 -- 172.21.15.107:0/388072584 >> 172.21.15.107:0/388072584 conn(0x7fc01c098e00 msgr2=0x7fc01c06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:25.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.345+0000 7fc01b200640 1 -- 172.21.15.107:0/388072584 shutdown_connections 2024-08-17T02:24:25.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.345+0000 7fc01b200640 1 -- 172.21.15.107:0/388072584 wait complete. 2024-08-17T02:24:25.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.346+0000 7fc01b200640 1 Processor -- start 2024-08-17T02:24:25.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.347+0000 7fc01b200640 1 -- start start 2024-08-17T02:24:25.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.347+0000 7fc01b200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc01c0ccad0 0x7fc01c152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:25.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.347+0000 7fc01b200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc01c0ceb40 0x7fc01c0b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:25.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.347+0000 7fc01b200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc01c159ca0 0x7fc01c0c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:25.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.347+0000 7fc01b200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c15c530 con 0x7fc01c159ca0 2024-08-17T02:24:25.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.347+0000 7fc01b200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c1528c0 con 0x7fc01c0ceb40 2024-08-17T02:24:25.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.347+0000 7fc01b200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c15c7a0 con 0x7fc01c0ccad0 2024-08-17T02:24:25.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.348+0000 7fc01a800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc01c159ca0 0x7fc01c0c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:25.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.348+0000 7fc01a800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc01c159ca0 0x7fc01c0c56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51568/0 (socket says 172.21.15.107:51568) 2024-08-17T02:24:25.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.348+0000 7fc01a800640 1 -- 172.21.15.107:0/2770049010 learned_addr learned my addr 172.21.15.107:0/2770049010 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:25.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.348+0000 7fc019e00640 1 --2- 172.21.15.107:0/2770049010 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc01c0ccad0 0x7fc01c152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:25.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.348+0000 7fc019400640 1 --2- 172.21.15.107:0/2770049010 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc01c0ceb40 0x7fc01c0b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:25.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.348+0000 7fc01a800640 1 -- 172.21.15.107:0/2770049010 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc01c0ccad0 msgr2=0x7fc01c152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:25.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.348+0000 7fc01a800640 1 --2- 172.21.15.107:0/2770049010 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc01c0ccad0 0x7fc01c152380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.348+0000 7fc01a800640 1 -- 172.21.15.107:0/2770049010 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc01c0ceb40 msgr2=0x7fc01c0b4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:25.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.348+0000 7fc01a800640 1 --2- 172.21.15.107:0/2770049010 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc01c0ceb40 0x7fc01c0b4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.348+0000 7fc01a800640 1 -- 172.21.15.107:0/2770049010 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc008009390 con 0x7fc01c159ca0 2024-08-17T02:24:25.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.348+0000 7fc019400640 1 --2- 172.21.15.107:0/2770049010 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc01c0ceb40 0x7fc01c0b4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:25.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.348+0000 7fc019e00640 1 --2- 172.21.15.107:0/2770049010 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc01c0ccad0 0x7fc01c152380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:25.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.348+0000 7fc01a800640 1 --2- 172.21.15.107:0/2770049010 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc01c159ca0 0x7fc01c0c56a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc014009e90 tx=0x7fc01400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:25.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.349+0000 7fc011600640 1 -- 172.21.15.107:0/2770049010 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01400cea0 con 0x7fc01c159ca0 2024-08-17T02:24:25.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.349+0000 7fc011600640 1 -- 172.21.15.107:0/2770049010 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc01400f040 con 0x7fc01c159ca0 2024-08-17T02:24:25.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.349+0000 7fc011600640 1 -- 172.21.15.107:0/2770049010 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0140146b0 con 0x7fc01c159ca0 2024-08-17T02:24:25.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.349+0000 7fc01b200640 1 -- 172.21.15.107:0/2770049010 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc01c15ca80 con 0x7fc01c159ca0 2024-08-17T02:24:25.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.349+0000 7fc01b200640 1 -- 172.21.15.107:0/2770049010 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc01c0c6370 con 0x7fc01c159ca0 2024-08-17T02:24:25.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.350+0000 7fc01b200640 1 -- 172.21.15.107:0/2770049010 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc01c071050 con 0x7fc01c159ca0 2024-08-17T02:24:25.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.351+0000 7fc011600640 1 -- 172.21.15.107:0/2770049010 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7fc014014a60 con 0x7fc01c159ca0 2024-08-17T02:24:25.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.352+0000 7fc011600640 1 --2- 172.21.15.107:0/2770049010 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbffc0650c0 0x7fbffc067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:25.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.352+0000 7fc011600640 1 -- 172.21.15.107:0/2770049010 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc014082d50 con 0x7fc01c159ca0 2024-08-17T02:24:25.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.352+0000 7fc019e00640 1 --2- 172.21.15.107:0/2770049010 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbffc0650c0 0x7fbffc067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:25.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.353+0000 7fc019e00640 1 --2- 172.21.15.107:0/2770049010 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbffc0650c0 0x7fbffc067570 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc00c007fd0 tx=0x7fc00c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:25.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.357+0000 7fc011600640 1 -- 172.21.15.107:0/2770049010 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc0140511a0 con 0x7fc01c159ca0 2024-08-17T02:24:25.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.580+0000 7fc01b200640 1 -- 172.21.15.107:0/2770049010 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc01c15cf00 con 0x7fc01c159ca0 2024-08-17T02:24:25.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.581+0000 7fc011600640 1 -- 172.21.15.107:0/2770049010 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3533 (secure 0 0 0) 0x7fc014018de0 con 0x7fc01c159ca0 2024-08-17T02:24:25.582 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:24:25.583 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1386798018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1386798018},{"type":"v1","addr":"172.21.15.107:6835","nonce":1386798018}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6834/287524804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":287524804},{"type":"v1","addr":"172.21.15.157:6834","nonce":287524804}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1183198496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1183198496},{"type":"v1","addr":"172.21.15.107:6837","nonce":1183198496}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/1985555291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6833","nonce":1985555291},{"type":"v1","addr":"172.21.15.157:6835","nonce":1985555291}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-08-17T02:24:25.583 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 3 2024-08-17T02:24:25.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.583+0000 7fc01b200640 1 -- 172.21.15.107:0/2770049010 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbffc0650c0 msgr2=0x7fbffc067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:25.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.583+0000 7fc01b200640 1 --2- 172.21.15.107:0/2770049010 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbffc0650c0 0x7fbffc067570 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc00c007fd0 tx=0x7fc00c009040 comp rx=0 tx=0).stop 2024-08-17T02:24:25.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.583+0000 7fc01b200640 1 -- 172.21.15.107:0/2770049010 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc01c159ca0 msgr2=0x7fc01c0c56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:25.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.583+0000 7fc01b200640 1 --2- 172.21.15.107:0/2770049010 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc01c159ca0 0x7fc01c0c56a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc014009e90 tx=0x7fc01400b040 comp rx=0 tx=0).stop 2024-08-17T02:24:25.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.583+0000 7fc01b200640 1 -- 172.21.15.107:0/2770049010 shutdown_connections 2024-08-17T02:24:25.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.583+0000 7fc01b200640 1 --2- 172.21.15.107:0/2770049010 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbffc0650c0 0x7fbffc067570 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.583+0000 7fc01b200640 1 --2- 172.21.15.107:0/2770049010 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc01c159ca0 0x7fc01c0c56a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.583+0000 7fc01b200640 1 --2- 172.21.15.107:0/2770049010 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc01c0ceb40 0x7fc01c0b4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.583+0000 7fc01b200640 1 --2- 172.21.15.107:0/2770049010 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc01c0ccad0 0x7fc01c152380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.583+0000 7fc01b200640 1 -- 172.21.15.107:0/2770049010 >> 172.21.15.107:0/2770049010 conn(0x7fc01c098e00 msgr2=0x7fc01c06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:25.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.583+0000 7fc01b200640 1 -- 172.21.15.107:0/2770049010 shutdown_connections 2024-08-17T02:24:25.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.583+0000 7fc01b200640 1 -- 172.21.15.107:0/2770049010 wait complete. 2024-08-17T02:24:25.599 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:25.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.751+0000 7f43b0600640 1 Processor -- start 2024-08-17T02:24:25.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.751+0000 7f43b0600640 1 -- start start 2024-08-17T02:24:25.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.753+0000 7f43b0600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43a80cc430 0x7f43a80cc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:25.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.753+0000 7f43b0600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f43a8067ef0 0x7f43a8159820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:25.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.753+0000 7f43b0600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43a80ca700 con 0x7f43a8062da0 2024-08-17T02:24:25.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.753+0000 7f43b0600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43a8159d60 con 0x7f43a8067ef0 2024-08-17T02:24:25.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.753+0000 7f43b0600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a80684f0 con 0x7f43a80cc430 2024-08-17T02:24:25.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.754+0000 7f43ae600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f43a8067ef0 0x7f43a8159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:25.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.754+0000 7f43adc00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43a80cc430 0x7f43a80cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:25.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.754+0000 7f43ad200640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f43a8062da0 0x7f43a80cab90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:33560/0 (socket says 172.21.15.107:33560) 2024-08-17T02:24:25.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.754+0000 7f43adc00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43a80cc430 0x7f43a80cc800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:53986/0 (socket says 172.21.15.107:53986) 2024-08-17T02:24:25.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.754+0000 7f43ad200640 1 -- 172.21.15.107:0/1119998520 learned_addr learned my addr 172.21.15.107:0/1119998520 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:25.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.754+0000 7f43ae600640 1 -- 172.21.15.107:0/1119998520 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43a80cc430 msgr2=0x7f43a80cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:25.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.754+0000 7f43ae600640 1 --2- 172.21.15.107:0/1119998520 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43a80cc430 0x7f43a80cc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.754+0000 7f43ae600640 1 -- 172.21.15.107:0/1119998520 >> v1:172.21.15.107:6789/0 conn(0x7f43a8062da0 legacy=0x7f43a80cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:25.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.754+0000 7f43ae600640 1 -- 172.21.15.107:0/1119998520 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a80c9dd0 con 0x7f43a8067ef0 2024-08-17T02:24:25.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.754+0000 7f43adc00640 1 --2- 172.21.15.107:0/1119998520 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43a80cc430 0x7f43a80cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:25.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.755+0000 7f43ae600640 1 --2- 172.21.15.107:0/1119998520 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f43a8067ef0 0x7f43a8159820 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f43a0009e60 tx=0x7f43a0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeed1ca86638496c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:25.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.756+0000 7f43a7e00640 1 -- 172.21.15.107:0/1119998520 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a0007550 con 0x7f43a8067ef0 2024-08-17T02:24:25.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.756+0000 7f43a7e00640 1 -- 172.21.15.107:0/1119998520 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a002d050 con 0x7f43a8067ef0 2024-08-17T02:24:25.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.756+0000 7f43a7e00640 1 -- 172.21.15.107:0/1119998520 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a0007920 con 0x7f43a8067ef0 2024-08-17T02:24:25.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.756+0000 7f43b0600640 1 -- 172.21.15.107:0/1119998520 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f43a8067ef0 msgr2=0x7f43a8159820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:25.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.756+0000 7f43b0600640 1 --2- 172.21.15.107:0/1119998520 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f43a8067ef0 0x7f43a8159820 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f43a0009e60 tx=0x7f43a0009780 comp rx=0 tx=0).stop 2024-08-17T02:24:25.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.756+0000 7f43b0600640 1 -- 172.21.15.107:0/1119998520 shutdown_connections 2024-08-17T02:24:25.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.756+0000 7f43b0600640 1 --2- 172.21.15.107:0/1119998520 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f43a8067ef0 0x7f43a8159820 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.756+0000 7f43b0600640 1 --2- 172.21.15.107:0/1119998520 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43a80cc430 0x7f43a80cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.756+0000 7f43b0600640 1 -- 172.21.15.107:0/1119998520 >> 172.21.15.107:0/1119998520 conn(0x7f43a80afc30 msgr2=0x7f43a80b1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:25.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.757+0000 7f43b0600640 1 -- 172.21.15.107:0/1119998520 shutdown_connections 2024-08-17T02:24:25.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.757+0000 7f43b0600640 1 -- 172.21.15.107:0/1119998520 wait complete. 2024-08-17T02:24:25.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.758+0000 7f43b0600640 1 Processor -- start 2024-08-17T02:24:25.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.758+0000 7f43b0600640 1 -- start start 2024-08-17T02:24:25.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.759+0000 7f43b0600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f43a8062da0 0x7f43a80c6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:25.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.759+0000 7f43b0600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43a8067ef0 0x7f43a80c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:25.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.759+0000 7f43b0600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43a80cc430 0x7f43a81697a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:25.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.759+0000 7f43b0600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a814f020 con 0x7f43a8062da0 2024-08-17T02:24:25.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.759+0000 7f43b0600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a80c6ca0 con 0x7f43a8067ef0 2024-08-17T02:24:25.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.759+0000 7f43b0600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a80c9bc0 con 0x7f43a80cc430 2024-08-17T02:24:25.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.759+0000 7f43adc00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f43a8062da0 0x7f43a80c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:25.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.759+0000 7f43adc00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f43a8062da0 0x7f43a80c6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51582/0 (socket says 172.21.15.107:51582) 2024-08-17T02:24:25.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.759+0000 7f43adc00640 1 -- 172.21.15.107:0/4181959908 learned_addr learned my addr 172.21.15.107:0/4181959908 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:25.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.760+0000 7f43ae600640 1 --2- 172.21.15.107:0/4181959908 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43a80cc430 0x7f43a81697a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:25.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.760+0000 7f43ad200640 1 --2- 172.21.15.107:0/4181959908 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43a8067ef0 0x7f43a80c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:25.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.760+0000 7f43adc00640 1 -- 172.21.15.107:0/4181959908 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43a80cc430 msgr2=0x7f43a81697a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:25.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.760+0000 7f43adc00640 1 --2- 172.21.15.107:0/4181959908 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43a80cc430 0x7f43a81697a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.760+0000 7f43adc00640 1 -- 172.21.15.107:0/4181959908 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43a8067ef0 msgr2=0x7f43a80c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:25.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.760+0000 7f43adc00640 1 --2- 172.21.15.107:0/4181959908 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43a8067ef0 0x7f43a80c8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.760+0000 7f43adc00640 1 -- 172.21.15.107:0/4181959908 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f439c009390 con 0x7f43a8062da0 2024-08-17T02:24:25.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.760+0000 7f43ad200640 1 --2- 172.21.15.107:0/4181959908 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43a8067ef0 0x7f43a80c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:25.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.760+0000 7f43ae600640 1 --2- 172.21.15.107:0/4181959908 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43a80cc430 0x7f43a81697a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:25.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.760+0000 7f43adc00640 1 --2- 172.21.15.107:0/4181959908 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f43a8062da0 0x7f43a80c6760 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f439c00ec80 tx=0x7f439c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:25.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.760+0000 7f43a4c00640 1 -- 172.21.15.107:0/4181959908 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c00eec0 con 0x7f43a8062da0 2024-08-17T02:24:25.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.760+0000 7f43a4c00640 1 -- 172.21.15.107:0/4181959908 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f439c00cb60 con 0x7f43a8062da0 2024-08-17T02:24:25.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.760+0000 7f43a4c00640 1 -- 172.21.15.107:0/4181959908 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c00cee0 con 0x7f43a8062da0 2024-08-17T02:24:25.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.760+0000 7f43b0600640 1 -- 172.21.15.107:0/4181959908 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43a0009a20 con 0x7f43a8062da0 2024-08-17T02:24:25.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.760+0000 7f43b0600640 1 -- 172.21.15.107:0/4181959908 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43a80c98e0 con 0x7f43a8062da0 2024-08-17T02:24:25.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.762+0000 7f43b0600640 1 -- 172.21.15.107:0/4181959908 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43a8064db0 con 0x7f43a8062da0 2024-08-17T02:24:25.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.762+0000 7f43a4c00640 1 -- 172.21.15.107:0/4181959908 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f439c013680 con 0x7f43a8062da0 2024-08-17T02:24:25.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.763+0000 7f43a4c00640 1 --2- 172.21.15.107:0/4181959908 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f43880650c0 0x7f4388067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:25.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.763+0000 7f43a4c00640 1 -- 172.21.15.107:0/4181959908 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f439c082490 con 0x7f43a8062da0 2024-08-17T02:24:25.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.763+0000 7f43ad200640 1 --2- 172.21.15.107:0/4181959908 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f43880650c0 0x7f4388067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:25.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.764+0000 7f43ad200640 1 --2- 172.21.15.107:0/4181959908 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f43880650c0 0x7f4388067570 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f43a80c7050 tx=0x7f4394009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:25.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.771+0000 7f43a4c00640 1 -- 172.21.15.107:0/4181959908 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f439c0508e0 con 0x7f43a8062da0 2024-08-17T02:24:25.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.951+0000 7f43b0600640 1 -- 172.21.15.107:0/4181959908 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43a8067cd0 con 0x7f43a8062da0 2024-08-17T02:24:25.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.952+0000 7f43a4c00640 1 -- 172.21.15.107:0/4181959908 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12188 (secure 0 0 0) 0x7f439c021090 con 0x7f43a8062da0 2024-08-17T02:24:25.953 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:24:25.954 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":16,"fsid":"f207b4c0-329d-46b8-b83f-aaf30bdb6ce3","created":"2024-08-17T02:24:11.038049+0000","modified":"2024-08-17T02:24:25.060097+0000","last_up_change":"2024-08-17T02:24:22.047790+0000","last_in_change":"2024-08-17T02:24:13.892720+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:23.456166+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"376363f3-b8bf-4f1e-b691-51cdd39171ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37302},{"type":"v1","addr":"172.21.15.107:6801","nonce":37302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37302},{"type":"v1","addr":"172.21.15.107:6803","nonce":37302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37302},{"type":"v1","addr":"172.21.15.107:6807","nonce":37302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37302},{"type":"v1","addr":"172.21.15.107:6805","nonce":37302}]},"public_addr":"172.21.15.107:6801/37302","cluster_addr":"172.21.15.107:6803/37302","heartbeat_back_addr":"172.21.15.107:6807/37302","heartbeat_front_addr":"172.21.15.107:6805/37302","state":["exists","up"]},{"osd":1,"uuid":"cc6624e3-2ad4-4db4-b377-05dfe57424e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37305},{"type":"v1","addr":"172.21.15.107:6824","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37305},{"type":"v1","addr":"172.21.15.107:6827","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37305},{"type":"v1","addr":"172.21.15.107:6831","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37305},{"type":"v1","addr":"172.21.15.107:6829","nonce":37305}]},"public_addr":"172.21.15.107:6824/37305","cluster_addr":"172.21.15.107:6827/37305","heartbeat_back_addr":"172.21.15.107:6831/37305","heartbeat_front_addr":"172.21.15.107:6829/37305","state":["exists","up"]},{"osd":2,"uuid":"25229542-29b5-4281-bcb0-798ae0930aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37307},{"type":"v1","addr":"172.21.15.107:6817","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37307},{"type":"v1","addr":"172.21.15.107:6819","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6823","nonce":37307},{"type":"v1","addr":"172.21.15.107:6825","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37307},{"type":"v1","addr":"172.21.15.107:6821","nonce":37307}]},"public_addr":"172.21.15.107:6817/37307","cluster_addr":"172.21.15.107:6819/37307","heartbeat_back_addr":"172.21.15.107:6825/37307","heartbeat_front_addr":"172.21.15.107:6821/37307","state":["exists","up"]},{"osd":3,"uuid":"5f16aee8-8950-4268-a61a-5cf6ebd670e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37306},{"type":"v1","addr":"172.21.15.107:6809","nonce":37306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37306},{"type":"v1","addr":"172.21.15.107:6811","nonce":37306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37306},{"type":"v1","addr":"172.21.15.107:6815","nonce":37306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37306},{"type":"v1","addr":"172.21.15.107:6813","nonce":37306}]},"public_addr":"172.21.15.107:6809/37306","cluster_addr":"172.21.15.107:6811/37306","heartbeat_back_addr":"172.21.15.107:6815/37306","heartbeat_front_addr":"172.21.15.107:6813/37306","state":["exists","up"]},{"osd":4,"uuid":"23232e28-e23b-4b4e-a531-4939246dbbde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":37329},{"type":"v1","addr":"172.21.15.157:6817","nonce":37329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":37329},{"type":"v1","addr":"172.21.15.157:6819","nonce":37329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":37329},{"type":"v1","addr":"172.21.15.157:6823","nonce":37329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":37329},{"type":"v1","addr":"172.21.15.157:6821","nonce":37329}]},"public_addr":"172.21.15.157:6817/37329","cluster_addr":"172.21.15.157:6819/37329","heartbeat_back_addr":"172.21.15.157:6823/37329","heartbeat_front_addr":"172.21.15.157:6821/37329","state":["exists","up"]},{"osd":5,"uuid":"f87ec331-3e59-4886-a317-6f7e26ec8e21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":37328},{"type":"v1","addr":"172.21.15.157:6804","nonce":37328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":37328},{"type":"v1","addr":"172.21.15.157:6808","nonce":37328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":37328},{"type":"v1","addr":"172.21.15.157:6815","nonce":37328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":37328},{"type":"v1","addr":"172.21.15.157:6812","nonce":37328}]},"public_addr":"172.21.15.157:6804/37328","cluster_addr":"172.21.15.157:6808/37328","heartbeat_back_addr":"172.21.15.157:6815/37328","heartbeat_front_addr":"172.21.15.157:6812/37328","state":["exists","up"]},{"osd":6,"uuid":"92852235-ce49-4d96-a940-6f18d97b13ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":37330},{"type":"v1","addr":"172.21.15.157:6801","nonce":37330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6803","nonce":37330},{"type":"v1","addr":"172.21.15.157:6805","nonce":37330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":37330},{"type":"v1","addr":"172.21.15.157:6813","nonce":37330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":37330},{"type":"v1","addr":"172.21.15.157:6809","nonce":37330}]},"public_addr":"172.21.15.157:6801/37330","cluster_addr":"172.21.15.157:6805/37330","heartbeat_back_addr":"172.21.15.157:6813/37330","heartbeat_front_addr":"172.21.15.157:6809/37330","state":["exists","up"]},{"osd":7,"uuid":"7484a061-723d-4663-b28f-b01766d62f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":37373},{"type":"v1","addr":"172.21.15.157:6825","nonce":37373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":37373},{"type":"v1","addr":"172.21.15.157:6827","nonce":37373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":37373},{"type":"v1","addr":"172.21.15.157:6831","nonce":37373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":37373},{"type":"v1","addr":"172.21.15.157:6829","nonce":37373}]},"public_addr":"172.21.15.157:6825/37373","cluster_addr":"172.21.15.157:6827/37373","heartbeat_back_addr":"172.21.15.157:6831/37373","heartbeat_front_addr":"172.21.15.157:6829/37373","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.110188+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.280265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.252119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.267996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.284582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.144420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.174764+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.308002+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:25.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.954+0000 7f43b0600640 1 -- 172.21.15.107:0/4181959908 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f43880650c0 msgr2=0x7f4388067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:25.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.954+0000 7f43b0600640 1 --2- 172.21.15.107:0/4181959908 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f43880650c0 0x7f4388067570 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f43a80c7050 tx=0x7f4394009040 comp rx=0 tx=0).stop 2024-08-17T02:24:25.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.954+0000 7f43b0600640 1 -- 172.21.15.107:0/4181959908 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f43a8062da0 msgr2=0x7f43a80c6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:25.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.954+0000 7f43b0600640 1 --2- 172.21.15.107:0/4181959908 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f43a8062da0 0x7f43a80c6760 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f439c00ec80 tx=0x7f439c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.954+0000 7f43b0600640 1 -- 172.21.15.107:0/4181959908 shutdown_connections 2024-08-17T02:24:25.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.954+0000 7f43b0600640 1 --2- 172.21.15.107:0/4181959908 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f43880650c0 0x7f4388067570 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.954+0000 7f43b0600640 1 --2- 172.21.15.107:0/4181959908 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43a80cc430 0x7f43a81697a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.954+0000 7f43b0600640 1 --2- 172.21.15.107:0/4181959908 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43a8067ef0 0x7f43a80c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.954+0000 7f43b0600640 1 --2- 172.21.15.107:0/4181959908 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f43a8062da0 0x7f43a80c6760 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:25.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.954+0000 7f43b0600640 1 -- 172.21.15.107:0/4181959908 >> 172.21.15.107:0/4181959908 conn(0x7f43a80afc30 msgr2=0x7f43a80cb8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:25.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.954+0000 7f43b0600640 1 -- 172.21.15.107:0/4181959908 shutdown_connections 2024-08-17T02:24:25.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:25.954+0000 7f43b0600640 1 -- 172.21.15.107:0/4181959908 wait complete. 2024-08-17T02:24:25.970 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:24:23.456166+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:24:25.971 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:24:26.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.126+0000 7efc4ca00640 1 Processor -- start 2024-08-17T02:24:26.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.126+0000 7efc4ca00640 1 -- start start 2024-08-17T02:24:26.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.128+0000 7efc4ca00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7efc48158c20 0x7efc480ac040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:26.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.128+0000 7efc4ca00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc480aeca0 con 0x7efc480ac580 2024-08-17T02:24:26.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.128+0000 7efc4ca00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc480ac9d0 con 0x7efc480696e0 2024-08-17T02:24:26.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.128+0000 7efc4ca00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc48069b20 con 0x7efc48158c20 2024-08-17T02:24:26.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.128+0000 7efc3de00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7efc480ac580 0x7efc48068fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:33574/0 (socket says 172.21.15.107:33574) 2024-08-17T02:24:26.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.128+0000 7efc3de00640 1 -- 172.21.15.107:0/1978118118 learned_addr learned my addr 172.21.15.107:0/1978118118 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:26.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.128+0000 7efc46800640 1 --2- 172.21.15.107:0/1978118118 >> v2:172.21.15.157:3300/0 conn(0x7efc48158c20 0x7efc480ac040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:26.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.128+0000 7efc45e00640 1 -- 172.21.15.107:0/1978118118 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1833137888 0 0) 0x7efc480aeca0 con 0x7efc480ac580 2024-08-17T02:24:26.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.128+0000 7efc45e00640 1 -- 172.21.15.107:0/1978118118 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc2c0034e0 con 0x7efc480ac580 2024-08-17T02:24:26.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.128+0000 7efc45e00640 1 -- 172.21.15.107:0/1978118118 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 285587205 0 0) 0x7efc480ac9d0 con 0x7efc480696e0 2024-08-17T02:24:26.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.128+0000 7efc45e00640 1 -- 172.21.15.107:0/1978118118 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc480aeca0 con 0x7efc480696e0 2024-08-17T02:24:26.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.129+0000 7efc46800640 1 -- 172.21.15.107:0/1978118118 >> v1:172.21.15.157:6789/0 conn(0x7efc480696e0 legacy=0x7efc480af130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:26.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.129+0000 7efc46800640 1 -- 172.21.15.107:0/1978118118 >> v1:172.21.15.107:6789/0 conn(0x7efc480ac580 legacy=0x7efc48068fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:26.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.129+0000 7efc46800640 1 -- 172.21.15.107:0/1978118118 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc480ae3e0 con 0x7efc48158c20 2024-08-17T02:24:26.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.130+0000 7efc46800640 1 --2- 172.21.15.107:0/1978118118 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc48158c20 0x7efc480ac040 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efc38009850 tx=0x7efc380090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ac45eb2193acf56 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:26.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.130+0000 7efc45e00640 1 -- 172.21.15.107:0/1978118118 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3802ad90 con 0x7efc48158c20 2024-08-17T02:24:26.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.130+0000 7efc45e00640 1 -- 172.21.15.107:0/1978118118 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc38032440 con 0x7efc48158c20 2024-08-17T02:24:26.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.130+0000 7efc45e00640 1 -- 172.21.15.107:0/1978118118 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc380327e0 con 0x7efc48158c20 2024-08-17T02:24:26.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.130+0000 7efc4ca00640 1 -- 172.21.15.107:0/1978118118 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc48158c20 msgr2=0x7efc480ac040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:26.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.130+0000 7efc4ca00640 1 --2- 172.21.15.107:0/1978118118 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc48158c20 0x7efc480ac040 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efc38009850 tx=0x7efc380090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.131+0000 7efc4ca00640 1 -- 172.21.15.107:0/1978118118 shutdown_connections 2024-08-17T02:24:26.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.131+0000 7efc4ca00640 1 --2- 172.21.15.107:0/1978118118 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc48158c20 0x7efc480ac040 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.131+0000 7efc4ca00640 1 -- 172.21.15.107:0/1978118118 >> 172.21.15.107:0/1978118118 conn(0x7efc48096a70 msgr2=0x7efc48096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:26.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.131+0000 7efc4ca00640 1 -- 172.21.15.107:0/1978118118 shutdown_connections 2024-08-17T02:24:26.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.131+0000 7efc4ca00640 1 -- 172.21.15.107:0/1978118118 wait complete. 2024-08-17T02:24:26.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.132+0000 7efc4ca00640 1 Processor -- start 2024-08-17T02:24:26.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.132+0000 7efc4ca00640 1 -- start start 2024-08-17T02:24:26.135 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.133+0000 7efc4ca00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc480696e0 0x7efc480b28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:26.135 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.133+0000 7efc4ca00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efc480ac580 0x7efc48158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:26.135 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.133+0000 7efc4ca00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc48158c20 0x7efc48149040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:26.135 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.133+0000 7efc4ca00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc480977c0 con 0x7efc48158c20 2024-08-17T02:24:26.135 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.133+0000 7efc4ca00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc48153ca0 con 0x7efc480696e0 2024-08-17T02:24:26.135 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.133+0000 7efc4ca00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc48159ab0 con 0x7efc480ac580 2024-08-17T02:24:26.135 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.133+0000 7efc47200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc48158c20 0x7efc48149040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:26.135 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.133+0000 7efc46800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc480696e0 0x7efc480b28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:26.136 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.133+0000 7efc47200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc48158c20 0x7efc48149040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51586/0 (socket says 172.21.15.107:51586) 2024-08-17T02:24:26.136 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.133+0000 7efc47200640 1 -- 172.21.15.107:0/3014031227 learned_addr learned my addr 172.21.15.107:0/3014031227 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:26.136 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.133+0000 7efc3de00640 1 --2- 172.21.15.107:0/3014031227 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efc480ac580 0x7efc48158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:26.136 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.134+0000 7efc46800640 1 -- 172.21.15.107:0/3014031227 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efc480ac580 msgr2=0x7efc48158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:26.136 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.134+0000 7efc46800640 1 --2- 172.21.15.107:0/3014031227 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efc480ac580 0x7efc48158ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.136 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.134+0000 7efc46800640 1 -- 172.21.15.107:0/3014031227 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc48158c20 msgr2=0x7efc48149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:26.136 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.134+0000 7efc46800640 1 --2- 172.21.15.107:0/3014031227 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc48158c20 0x7efc48149040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.136 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.134+0000 7efc46800640 1 -- 172.21.15.107:0/3014031227 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc38009390 con 0x7efc480696e0 2024-08-17T02:24:26.136 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.134+0000 7efc46800640 1 --2- 172.21.15.107:0/3014031227 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc480696e0 0x7efc480b28c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efc38031000 tx=0x7efc38032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:26.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.134+0000 7efc3ea00640 1 -- 172.21.15.107:0/3014031227 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc38000c40 con 0x7efc480696e0 2024-08-17T02:24:26.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.134+0000 7efc3ea00640 1 -- 172.21.15.107:0/3014031227 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc38031a60 con 0x7efc480696e0 2024-08-17T02:24:26.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.134+0000 7efc3ea00640 1 -- 172.21.15.107:0/3014031227 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc38031e20 con 0x7efc480696e0 2024-08-17T02:24:26.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.134+0000 7efc4ca00640 1 -- 172.21.15.107:0/3014031227 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc48159d90 con 0x7efc480696e0 2024-08-17T02:24:26.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.134+0000 7efc4ca00640 1 -- 172.21.15.107:0/3014031227 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc48097a10 con 0x7efc480696e0 2024-08-17T02:24:26.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.135+0000 7efc4ca00640 1 -- 172.21.15.107:0/3014031227 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc48071050 con 0x7efc480696e0 2024-08-17T02:24:26.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.136+0000 7efc3ea00640 1 -- 172.21.15.107:0/3014031227 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7efc38039040 con 0x7efc480696e0 2024-08-17T02:24:26.138 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.137+0000 7efc3ea00640 1 --2- 172.21.15.107:0/3014031227 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7efc24065150 0x7efc24067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:26.138 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.137+0000 7efc3ea00640 1 -- 172.21.15.107:0/3014031227 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7efc380a1bc0 con 0x7efc480696e0 2024-08-17T02:24:26.138 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.137+0000 7efc3de00640 1 --2- 172.21.15.107:0/3014031227 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7efc24065150 0x7efc24067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:26.138 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.138+0000 7efc3de00640 1 --2- 172.21.15.107:0/3014031227 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7efc24065150 0x7efc24067600 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efc480ce8f0 tx=0x7efc30009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:26.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.142+0000 7efc3ea00640 1 -- 172.21.15.107:0/3014031227 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7efc3806ffe0 con 0x7efc480696e0 2024-08-17T02:24:26.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.315+0000 7efc4ca00640 1 -- 172.21.15.107:0/3014031227 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efc48069490 con 0x7efc480696e0 2024-08-17T02:24:26.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.316+0000 7efc3ea00640 1 -- 172.21.15.107:0/3014031227 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7efc380370a0 con 0x7efc480696e0 2024-08-17T02:24:26.317 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2024-08-17T02:24:26.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.318+0000 7efc4ca00640 1 -- 172.21.15.107:0/3014031227 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7efc24065150 msgr2=0x7efc24067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:26.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.318+0000 7efc4ca00640 1 --2- 172.21.15.107:0/3014031227 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7efc24065150 0x7efc24067600 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efc480ce8f0 tx=0x7efc30009040 comp rx=0 tx=0).stop 2024-08-17T02:24:26.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.318+0000 7efc4ca00640 1 -- 172.21.15.107:0/3014031227 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc480696e0 msgr2=0x7efc480b28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:26.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.318+0000 7efc4ca00640 1 --2- 172.21.15.107:0/3014031227 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc480696e0 0x7efc480b28c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efc38031000 tx=0x7efc38032000 comp rx=0 tx=0).stop 2024-08-17T02:24:26.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.318+0000 7efc4ca00640 1 -- 172.21.15.107:0/3014031227 shutdown_connections 2024-08-17T02:24:26.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.318+0000 7efc4ca00640 1 --2- 172.21.15.107:0/3014031227 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7efc24065150 0x7efc24067600 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.319+0000 7efc4ca00640 1 --2- 172.21.15.107:0/3014031227 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc48158c20 0x7efc48149040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.319+0000 7efc4ca00640 1 --2- 172.21.15.107:0/3014031227 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efc480ac580 0x7efc48158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.319+0000 7efc4ca00640 1 --2- 172.21.15.107:0/3014031227 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc480696e0 0x7efc480b28c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.319+0000 7efc4ca00640 1 -- 172.21.15.107:0/3014031227 >> 172.21.15.107:0/3014031227 conn(0x7efc48096a70 msgr2=0x7efc48154180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:26.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.319+0000 7efc4ca00640 1 -- 172.21.15.107:0/3014031227 shutdown_connections 2024-08-17T02:24:26.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.319+0000 7efc4ca00640 1 -- 172.21.15.107:0/3014031227 wait complete. 2024-08-17T02:24:26.334 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-17T02:24:26.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.481+0000 7f3c37200640 1 Processor -- start 2024-08-17T02:24:26.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.481+0000 7f3c37200640 1 -- start start 2024-08-17T02:24:26.484 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.482+0000 7f3c37200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c300ca350 0x7f3c300cf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:26.484 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.482+0000 7f3c37200640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3c300ae1b0 0x7f3c300cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:26.484 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.483+0000 7f3c37200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c300cb730 con 0x7f3c300ca720 2024-08-17T02:24:26.484 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.483+0000 7f3c37200640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c300cf9c0 con 0x7f3c300ae1b0 2024-08-17T02:24:26.484 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.483+0000 7f3c37200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c300cb0e0 con 0x7f3c300ca350 2024-08-17T02:24:26.484 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.483+0000 7f3c35400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f3c300ca720 0x7f3c300cd8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:33590/0 (socket says 172.21.15.107:33590) 2024-08-17T02:24:26.484 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.483+0000 7f3c35400640 1 -- 172.21.15.107:0/1848857670 learned_addr learned my addr 172.21.15.107:0/1848857670 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:26.484 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.483+0000 7f3c35e00640 1 --2- 172.21.15.107:0/1848857670 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c300ca350 0x7f3c300cf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:26.484 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.483+0000 7f3c36800640 1 --2- 172.21.15.107:0/1848857670 >> v2:172.21.15.157:3300/0 conn(0x7f3c300ae1b0 0x7f3c300cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:26.486 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.483+0000 7f3c34a00640 1 -- 172.21.15.107:0/1848857670 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 634331768 0 0) 0x7f3c300cb730 con 0x7f3c300ca720 2024-08-17T02:24:26.486 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.483+0000 7f3c34a00640 1 -- 172.21.15.107:0/1848857670 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c180034e0 con 0x7f3c300ca720 2024-08-17T02:24:26.486 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.483+0000 7f3c36800640 1 -- 172.21.15.107:0/1848857670 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c300ca350 msgr2=0x7f3c300cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:26.486 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.483+0000 7f3c36800640 1 --2- 172.21.15.107:0/1848857670 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c300ca350 0x7f3c300cf2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.486 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.483+0000 7f3c36800640 1 -- 172.21.15.107:0/1848857670 >> v1:172.21.15.107:6789/0 conn(0x7f3c300ca720 legacy=0x7f3c300cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:26.486 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.483+0000 7f3c36800640 1 -- 172.21.15.107:0/1848857670 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c300cb3c0 con 0x7f3c300ae1b0 2024-08-17T02:24:26.486 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.484+0000 7f3c36800640 1 --2- 172.21.15.107:0/1848857670 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c300ae1b0 0x7f3c300cdff0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c009e60 tx=0x7f3c2c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f731ff8c0a573f4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:26.486 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.485+0000 7f3c34a00640 1 -- 172.21.15.107:0/1848857670 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c007550 con 0x7f3c300ae1b0 2024-08-17T02:24:26.486 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.485+0000 7f3c34a00640 1 -- 172.21.15.107:0/1848857670 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2c02d050 con 0x7f3c300ae1b0 2024-08-17T02:24:26.486 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.485+0000 7f3c34a00640 1 -- 172.21.15.107:0/1848857670 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c0078c0 con 0x7f3c300ae1b0 2024-08-17T02:24:26.487 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.485+0000 7f3c37200640 1 -- 172.21.15.107:0/1848857670 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c300ae1b0 msgr2=0x7f3c300cdff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:26.487 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.485+0000 7f3c37200640 1 --2- 172.21.15.107:0/1848857670 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c300ae1b0 0x7f3c300cdff0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c009e60 tx=0x7f3c2c009780 comp rx=0 tx=0).stop 2024-08-17T02:24:26.487 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.485+0000 7f3c37200640 1 -- 172.21.15.107:0/1848857670 shutdown_connections 2024-08-17T02:24:26.487 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.485+0000 7f3c37200640 1 --2- 172.21.15.107:0/1848857670 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c300ae1b0 0x7f3c300cdff0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.487 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.485+0000 7f3c37200640 1 --2- 172.21.15.107:0/1848857670 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c300ca350 0x7f3c300cf2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.485+0000 7f3c37200640 1 -- 172.21.15.107:0/1848857670 >> 172.21.15.107:0/1848857670 conn(0x7f3c300cfdb0 msgr2=0x7f3c300d01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:26.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.485+0000 7f3c37200640 1 -- 172.21.15.107:0/1848857670 shutdown_connections 2024-08-17T02:24:26.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.485+0000 7f3c37200640 1 -- 172.21.15.107:0/1848857670 wait complete. 2024-08-17T02:24:26.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.487+0000 7f3c37200640 1 Processor -- start 2024-08-17T02:24:26.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.487+0000 7f3c37200640 1 -- start start 2024-08-17T02:24:26.490 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.488+0000 7f3c37200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c300ae1b0 0x7f3c300af230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:26.490 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.488+0000 7f3c37200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c300ca350 0x7f3c3015bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:26.490 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.488+0000 7f3c37200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c300ca720 0x7f3c301514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:26.490 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.488+0000 7f3c37200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c300b46a0 con 0x7f3c300ca350 2024-08-17T02:24:26.490 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.488+0000 7f3c37200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c300b3d70 con 0x7f3c300ca720 2024-08-17T02:24:26.490 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.488+0000 7f3c37200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c300b4050 con 0x7f3c300ae1b0 2024-08-17T02:24:26.490 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.488+0000 7f3c35400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c300ca350 0x7f3c3015bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:26.490 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.488+0000 7f3c35e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c300ae1b0 0x7f3c300af230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:26.490 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.488+0000 7f3c35400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c300ca350 0x7f3c3015bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51596/0 (socket says 172.21.15.107:51596) 2024-08-17T02:24:26.491 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.488+0000 7f3c35400640 1 -- 172.21.15.107:0/1883461698 learned_addr learned my addr 172.21.15.107:0/1883461698 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:26.491 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.488+0000 7f3c36800640 1 --2- 172.21.15.107:0/1883461698 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c300ca720 0x7f3c301514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:26.491 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.488+0000 7f3c35400640 1 -- 172.21.15.107:0/1883461698 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c300ae1b0 msgr2=0x7f3c300af230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:26.491 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.488+0000 7f3c35400640 1 --2- 172.21.15.107:0/1883461698 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c300ae1b0 0x7f3c300af230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.491 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.488+0000 7f3c35400640 1 -- 172.21.15.107:0/1883461698 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c300ca720 msgr2=0x7f3c301514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:26.491 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.488+0000 7f3c35400640 1 --2- 172.21.15.107:0/1883461698 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c300ca720 0x7f3c301514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.491 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.488+0000 7f3c35400640 1 -- 172.21.15.107:0/1883461698 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c2c009a20 con 0x7f3c300ca350 2024-08-17T02:24:26.491 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.489+0000 7f3c35400640 1 --2- 172.21.15.107:0/1883461698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c300ca350 0x7f3c3015bfb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3c2000c4b0 tx=0x7f3c20007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:26.491 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.489+0000 7f3c29600640 1 -- 172.21.15.107:0/1883461698 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c20005aa0 con 0x7f3c300ca350 2024-08-17T02:24:26.491 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.489+0000 7f3c29600640 1 -- 172.21.15.107:0/1883461698 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c20005c00 con 0x7f3c300ca350 2024-08-17T02:24:26.491 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.489+0000 7f3c37200640 1 -- 172.21.15.107:0/1883461698 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c300b4330 con 0x7f3c300ca350 2024-08-17T02:24:26.491 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.489+0000 7f3c29600640 1 -- 172.21.15.107:0/1883461698 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c200070d0 con 0x7f3c300ca350 2024-08-17T02:24:26.491 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.489+0000 7f3c37200640 1 -- 172.21.15.107:0/1883461698 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c3015c4f0 con 0x7f3c300ca350 2024-08-17T02:24:26.492 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.490+0000 7f3c37200640 1 -- 172.21.15.107:0/1883461698 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c300b4810 con 0x7f3c300ca350 2024-08-17T02:24:26.492 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.491+0000 7f3c29600640 1 -- 172.21.15.107:0/1883461698 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3c200074c0 con 0x7f3c300ca350 2024-08-17T02:24:26.492 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.491+0000 7f3c29600640 1 --2- 172.21.15.107:0/1883461698 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3c14065150 0x7f3c14067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:26.493 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.492+0000 7f3c29600640 1 -- 172.21.15.107:0/1883461698 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3c20081500 con 0x7f3c300ca350 2024-08-17T02:24:26.493 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.492+0000 7f3c35e00640 1 --2- 172.21.15.107:0/1883461698 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3c14065150 0x7f3c14067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:26.493 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.492+0000 7f3c35e00640 1 --2- 172.21.15.107:0/1883461698 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3c14065150 0x7f3c14067600 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3c24009d20 tx=0x7f3c240090f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:26.497 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.496+0000 7f3c29600640 1 -- 172.21.15.107:0/1883461698 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3c2004f9c0 con 0x7f3c300ca350 2024-08-17T02:24:26.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.680+0000 7f3c37200640 1 -- 172.21.15.107:0/1883461698 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3c30071050 con 0x7f3c300ca350 2024-08-17T02:24:26.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.680+0000 7f3c29600640 1 -- 172.21.15.107:0/1883461698 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f3c20017090 con 0x7f3c300ca350 2024-08-17T02:24:26.682 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:24:26.682 INFO:teuthology.orchestra.run.smithi107.stdout:[ 2024-08-17T02:24:26.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-08-17T02:24:26.682 INFO:teuthology.orchestra.run.smithi107.stdout: "poolnum": 1, 2024-08-17T02:24:26.682 INFO:teuthology.orchestra.run.smithi107.stdout: "poolname": ".mgr" 2024-08-17T02:24:26.682 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-08-17T02:24:26.682 INFO:teuthology.orchestra.run.smithi107.stdout:] 2024-08-17T02:24:26.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.682+0000 7f3c37200640 1 -- 172.21.15.107:0/1883461698 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3c14065150 msgr2=0x7f3c14067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:26.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.682+0000 7f3c37200640 1 --2- 172.21.15.107:0/1883461698 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3c14065150 0x7f3c14067600 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3c24009d20 tx=0x7f3c240090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.682+0000 7f3c37200640 1 -- 172.21.15.107:0/1883461698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c300ca350 msgr2=0x7f3c3015bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:26.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.682+0000 7f3c37200640 1 --2- 172.21.15.107:0/1883461698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c300ca350 0x7f3c3015bfb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3c2000c4b0 tx=0x7f3c20007d60 comp rx=0 tx=0).stop 2024-08-17T02:24:26.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.682+0000 7f3c37200640 1 -- 172.21.15.107:0/1883461698 shutdown_connections 2024-08-17T02:24:26.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.682+0000 7f3c37200640 1 --2- 172.21.15.107:0/1883461698 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3c14065150 0x7f3c14067600 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.682+0000 7f3c37200640 1 --2- 172.21.15.107:0/1883461698 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c300ca720 0x7f3c301514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.682+0000 7f3c37200640 1 --2- 172.21.15.107:0/1883461698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c300ca350 0x7f3c3015bfb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.682+0000 7f3c37200640 1 --2- 172.21.15.107:0/1883461698 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c300ae1b0 0x7f3c300af230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.682+0000 7f3c37200640 1 -- 172.21.15.107:0/1883461698 >> 172.21.15.107:0/1883461698 conn(0x7f3c300cfdb0 msgr2=0x7f3c300cc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:26.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.683+0000 7f3c37200640 1 -- 172.21.15.107:0/1883461698 shutdown_connections 2024-08-17T02:24:26.685 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.683+0000 7f3c37200640 1 -- 172.21.15.107:0/1883461698 wait complete. 2024-08-17T02:24:26.698 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-17T02:24:26.698 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-17T02:24:26.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.847+0000 7f92e8a00640 1 Processor -- start 2024-08-17T02:24:26.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.847+0000 7f92e8a00640 1 -- start start 2024-08-17T02:24:26.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.848+0000 7f92e8a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f92e406ed50 0x7f92e415c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:26.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.848+0000 7f92e8a00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f92e40ac250 0x7f92e41584e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:26.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.848+0000 7f92e8a00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92e415d970 con 0x7f92e4159f00 2024-08-17T02:24:26.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.848+0000 7f92e8a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92e415a380 con 0x7f92e406ed50 2024-08-17T02:24:26.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.848+0000 7f92e8a00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92e415d0d0 con 0x7f92e40ac250 2024-08-17T02:24:26.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.849+0000 7f92e1e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f92e406ed50 0x7f92e415c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:26.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.849+0000 7f92e1e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f92e406ed50 0x7f92e415c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37440/0 (socket says 172.21.15.107:37440) 2024-08-17T02:24:26.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.849+0000 7f92e1e00640 1 -- 172.21.15.107:0/1545743658 learned_addr learned my addr 172.21.15.107:0/1545743658 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:26.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.849+0000 7f92e2800640 1 --2- 172.21.15.107:0/1545743658 >> v2:172.21.15.157:3300/0 conn(0x7f92e40ac250 0x7f92e41584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:26.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.849+0000 7f92e1e00640 1 -- 172.21.15.107:0/1545743658 >> v2:172.21.15.157:3300/0 conn(0x7f92e40ac250 msgr2=0x7f92e41584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:26.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.849+0000 7f92e1e00640 1 --2- 172.21.15.107:0/1545743658 >> v2:172.21.15.157:3300/0 conn(0x7f92e40ac250 0x7f92e41584e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.849+0000 7f92e1e00640 1 -- 172.21.15.107:0/1545743658 >> v1:172.21.15.157:6789/0 conn(0x7f92e4159f00 legacy=0x7f92e40abb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:26.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.849+0000 7f92e1e00640 1 -- 172.21.15.107:0/1545743658 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e415d3b0 con 0x7f92e406ed50 2024-08-17T02:24:26.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.850+0000 7f92e1e00640 1 --2- 172.21.15.107:0/1545743658 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f92e406ed50 0x7f92e415c9d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f92e406cfc0 tx=0x7f92d40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92ba4a2abdcfd37b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:26.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.851+0000 7f92e1400640 1 -- 172.21.15.107:0/1545743658 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d402ae80 con 0x7f92e406ed50 2024-08-17T02:24:26.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.851+0000 7f92e1400640 1 -- 172.21.15.107:0/1545743658 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d4032440 con 0x7f92e406ed50 2024-08-17T02:24:26.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.851+0000 7f92e1400640 1 -- 172.21.15.107:0/1545743658 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d4032800 con 0x7f92e406ed50 2024-08-17T02:24:26.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.851+0000 7f92e8a00640 1 -- 172.21.15.107:0/1545743658 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f92e406ed50 msgr2=0x7f92e415c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:26.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.851+0000 7f92e8a00640 1 --2- 172.21.15.107:0/1545743658 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f92e406ed50 0x7f92e415c9d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f92e406cfc0 tx=0x7f92d40091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.852+0000 7f92e8a00640 1 -- 172.21.15.107:0/1545743658 shutdown_connections 2024-08-17T02:24:26.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.852+0000 7f92e8a00640 1 --2- 172.21.15.107:0/1545743658 >> v2:172.21.15.157:3300/0 conn(0x7f92e40ac250 0x7f92e41584e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.852+0000 7f92e8a00640 1 --2- 172.21.15.107:0/1545743658 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f92e406ed50 0x7f92e415c9d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.852+0000 7f92e8a00640 1 -- 172.21.15.107:0/1545743658 >> 172.21.15.107:0/1545743658 conn(0x7f92e40ccc70 msgr2=0x7f92e40a8f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:26.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.852+0000 7f92e8a00640 1 -- 172.21.15.107:0/1545743658 shutdown_connections 2024-08-17T02:24:26.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.852+0000 7f92e8a00640 1 -- 172.21.15.107:0/1545743658 wait complete. 2024-08-17T02:24:26.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.853+0000 7f92e8a00640 1 Processor -- start 2024-08-17T02:24:26.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.853+0000 7f92e8a00640 1 -- start start 2024-08-17T02:24:26.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.854+0000 7f92e8a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f92e406ed50 0x7f92e40ca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:26.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.854+0000 7f92e8a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92e40ac250 0x7f92e40993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:26.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.854+0000 7f92e8a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f92e4159f00 0x7f92e40b0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:26.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.854+0000 7f92e8a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e4096b50 con 0x7f92e4159f00 2024-08-17T02:24:26.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.854+0000 7f92e8a00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e40ca950 con 0x7f92e40ac250 2024-08-17T02:24:26.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.854+0000 7f92e8a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92e40cac30 con 0x7f92e406ed50 2024-08-17T02:24:26.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.854+0000 7f92e2800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f92e4159f00 0x7f92e40b0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:26.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.854+0000 7f92e2800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f92e4159f00 0x7f92e40b0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37454/0 (socket says 172.21.15.107:37454) 2024-08-17T02:24:26.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.854+0000 7f92e2800640 1 -- 172.21.15.107:0/2577812147 learned_addr learned my addr 172.21.15.107:0/2577812147 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:26.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.854+0000 7f92d9400640 1 --2- 172.21.15.107:0/2577812147 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92e40ac250 0x7f92e40993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:26.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.855+0000 7f92e1e00640 1 --2- 172.21.15.107:0/2577812147 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f92e406ed50 0x7f92e40ca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:26.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.855+0000 7f92e2800640 1 -- 172.21.15.107:0/2577812147 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f92e406ed50 msgr2=0x7f92e40ca2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:26.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.855+0000 7f92e2800640 1 --2- 172.21.15.107:0/2577812147 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f92e406ed50 0x7f92e40ca2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.855+0000 7f92e2800640 1 -- 172.21.15.107:0/2577812147 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92e40ac250 msgr2=0x7f92e40993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:26.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.855+0000 7f92e2800640 1 --2- 172.21.15.107:0/2577812147 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92e40ac250 0x7f92e40993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:26.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.855+0000 7f92e2800640 1 -- 172.21.15.107:0/2577812147 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d4009450 con 0x7f92e4159f00 2024-08-17T02:24:26.858 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.855+0000 7f92e2800640 1 --2- 172.21.15.107:0/2577812147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f92e4159f00 0x7f92e40b0390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f92dc009ef0 tx=0x7f92dc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:26.858 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.855+0000 7f92da000640 1 -- 172.21.15.107:0/2577812147 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92dc00ce10 con 0x7f92e4159f00 2024-08-17T02:24:26.858 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.855+0000 7f92da000640 1 -- 172.21.15.107:0/2577812147 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92dc00f040 con 0x7f92e4159f00 2024-08-17T02:24:26.858 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.855+0000 7f92e8a00640 1 -- 172.21.15.107:0/2577812147 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92e40caf10 con 0x7f92e4159f00 2024-08-17T02:24:26.858 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.855+0000 7f92da000640 1 -- 172.21.15.107:0/2577812147 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92dc0146d0 con 0x7f92e4159f00 2024-08-17T02:24:26.858 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.855+0000 7f92e8a00640 1 -- 172.21.15.107:0/2577812147 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92e40cb4d0 con 0x7f92e4159f00 2024-08-17T02:24:26.858 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.857+0000 7f92e8a00640 1 -- 172.21.15.107:0/2577812147 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92e4064db0 con 0x7f92e4159f00 2024-08-17T02:24:26.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.858+0000 7f92da000640 1 -- 172.21.15.107:0/2577812147 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f92dc014a80 con 0x7f92e4159f00 2024-08-17T02:24:26.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.859+0000 7f92da000640 1 --2- 172.21.15.107:0/2577812147 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f92c0065150 0x7f92c0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:26.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.859+0000 7f92da000640 1 -- 172.21.15.107:0/2577812147 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f92dc082fe0 con 0x7f92e4159f00 2024-08-17T02:24:26.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.859+0000 7f92e1e00640 1 --2- 172.21.15.107:0/2577812147 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f92c0065150 0x7f92c0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:26.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.860+0000 7f92e1e00640 1 --2- 172.21.15.107:0/2577812147 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f92c0065150 0x7f92c0067600 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f92d4034000 tx=0x7f92d4032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:26.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:26.863+0000 7f92da000640 1 -- 172.21.15.107:0/2577812147 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f92dc051410 con 0x7f92e4159f00 2024-08-17T02:24:27.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.039+0000 7f92e8a00640 1 -- 172.21.15.107:0/2577812147 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f92e4062ee0 con 0x7f92e4159f00 2024-08-17T02:24:27.406 INFO:teuthology.orchestra.run.smithi107.stderr:pool 'cephfs_metadata' created 2024-08-17T02:24:27.406 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.402+0000 7f92da000640 1 -- 172.21.15.107:0/2577812147 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f92dc0180b0 con 0x7f92e4159f00 2024-08-17T02:24:27.406 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.405+0000 7f92e8a00640 1 -- 172.21.15.107:0/2577812147 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f92c0065150 msgr2=0x7f92c0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:27.406 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.405+0000 7f92e8a00640 1 --2- 172.21.15.107:0/2577812147 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f92c0065150 0x7f92c0067600 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f92d4034000 tx=0x7f92d4032000 comp rx=0 tx=0).stop 2024-08-17T02:24:27.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.405+0000 7f92e8a00640 1 -- 172.21.15.107:0/2577812147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f92e4159f00 msgr2=0x7f92e40b0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:27.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.405+0000 7f92e8a00640 1 --2- 172.21.15.107:0/2577812147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f92e4159f00 0x7f92e40b0390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f92dc009ef0 tx=0x7f92dc00b040 comp rx=0 tx=0).stop 2024-08-17T02:24:27.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.407+0000 7f92e8a00640 1 -- 172.21.15.107:0/2577812147 shutdown_connections 2024-08-17T02:24:27.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.407+0000 7f92e8a00640 1 --2- 172.21.15.107:0/2577812147 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f92c0065150 0x7f92c0067600 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.407+0000 7f92e8a00640 1 --2- 172.21.15.107:0/2577812147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f92e4159f00 0x7f92e40b0390 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.407+0000 7f92e8a00640 1 --2- 172.21.15.107:0/2577812147 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92e40ac250 0x7f92e40993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.407+0000 7f92e8a00640 1 --2- 172.21.15.107:0/2577812147 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f92e406ed50 0x7f92e40ca2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.407+0000 7f92e8a00640 1 -- 172.21.15.107:0/2577812147 >> 172.21.15.107:0/2577812147 conn(0x7f92e40ccc70 msgr2=0x7f92e4158c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:27.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.408+0000 7f92e8a00640 1 -- 172.21.15.107:0/2577812147 shutdown_connections 2024-08-17T02:24:27.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.408+0000 7f92e8a00640 1 -- 172.21.15.107:0/2577812147 wait complete. 2024-08-17T02:24:27.425 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-17T02:24:27.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.578+0000 7f3f53a00640 1 Processor -- start 2024-08-17T02:24:27.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.578+0000 7f3f53a00640 1 -- start start 2024-08-17T02:24:27.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.579+0000 7f3f53a00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3f4c156d40 0x7f3f4c06dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:27.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.579+0000 7f3f53a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f4c06e880 con 0x7f3f4c06e420 2024-08-17T02:24:27.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.579+0000 7f3f53a00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f4c1568b0 con 0x7f3f4c150130 2024-08-17T02:24:27.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.579+0000 7f3f53a00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f4c150500 con 0x7f3f4c156d40 2024-08-17T02:24:27.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.579+0000 7f3f51a00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f3f4c06e420 0x7f3f4c0ab510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:47812/0 (socket says 172.21.15.107:47812) 2024-08-17T02:24:27.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.579+0000 7f3f51a00640 1 -- 172.21.15.107:0/3049783318 learned_addr learned my addr 172.21.15.107:0/3049783318 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:27.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.579+0000 7f3f4be00640 1 --2- 172.21.15.107:0/3049783318 >> v2:172.21.15.157:3300/0 conn(0x7f3f4c156d40 0x7f3f4c06dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:27.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.580+0000 7f3f4b400640 1 -- 172.21.15.107:0/3049783318 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1695188458 0 0) 0x7f3f44001490 con 0x7f3f4c06e420 2024-08-17T02:24:27.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.580+0000 7f3f4b400640 1 -- 172.21.15.107:0/3049783318 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f340034e0 con 0x7f3f4c06e420 2024-08-17T02:24:27.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.580+0000 7f3f4be00640 1 -- 172.21.15.107:0/3049783318 >> v1:172.21.15.157:6789/0 conn(0x7f3f4c150130 legacy=0x7f3f4c0aa730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:27.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.580+0000 7f3f4be00640 1 -- 172.21.15.107:0/3049783318 >> v1:172.21.15.107:6789/0 conn(0x7f3f4c06e420 legacy=0x7f3f4c0ab510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:27.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.580+0000 7f3f4be00640 1 -- 172.21.15.107:0/3049783318 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f4c155fc0 con 0x7f3f4c156d40 2024-08-17T02:24:27.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.581+0000 7f3f4be00640 1 --2- 172.21.15.107:0/3049783318 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f4c156d40 0x7f3f4c06dee0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3f38009850 tx=0x7f3f380090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7adb03279618fb2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:27.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.581+0000 7f3f4b400640 1 -- 172.21.15.107:0/3049783318 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3802ad90 con 0x7f3f4c156d40 2024-08-17T02:24:27.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.581+0000 7f3f4b400640 1 -- 172.21.15.107:0/3049783318 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f38032440 con 0x7f3f4c156d40 2024-08-17T02:24:27.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.581+0000 7f3f4b400640 1 -- 172.21.15.107:0/3049783318 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f380327c0 con 0x7f3f4c156d40 2024-08-17T02:24:27.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.581+0000 7f3f53a00640 1 -- 172.21.15.107:0/3049783318 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f4c156d40 msgr2=0x7f3f4c06dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:27.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.581+0000 7f3f53a00640 1 --2- 172.21.15.107:0/3049783318 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f4c156d40 0x7f3f4c06dee0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3f38009850 tx=0x7f3f380090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.582+0000 7f3f53a00640 1 -- 172.21.15.107:0/3049783318 shutdown_connections 2024-08-17T02:24:27.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.582+0000 7f3f53a00640 1 --2- 172.21.15.107:0/3049783318 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f4c156d40 0x7f3f4c06dee0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.582+0000 7f3f53a00640 1 -- 172.21.15.107:0/3049783318 >> 172.21.15.107:0/3049783318 conn(0x7f3f4c067750 msgr2=0x7f3f4c06c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:27.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.582+0000 7f3f53a00640 1 -- 172.21.15.107:0/3049783318 shutdown_connections 2024-08-17T02:24:27.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.582+0000 7f3f53a00640 1 -- 172.21.15.107:0/3049783318 wait complete. 2024-08-17T02:24:27.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.583+0000 7f3f53a00640 1 Processor -- start 2024-08-17T02:24:27.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.583+0000 7f3f53a00640 1 -- start start 2024-08-17T02:24:27.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.584+0000 7f3f53a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f4c06e420 0x7f3f4c1551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:27.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.584+0000 7f3f53a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f4c150130 0x7f3f4c14ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:27.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.584+0000 7f3f53a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3f4c156d40 0x7f3f4c159510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:27.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.584+0000 7f3f53a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4c151800 con 0x7f3f4c06e420 2024-08-17T02:24:27.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.584+0000 7f3f53a00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4c154d10 con 0x7f3f4c150130 2024-08-17T02:24:27.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.584+0000 7f3f53a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4c14cf50 con 0x7f3f4c156d40 2024-08-17T02:24:27.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.584+0000 7f3f51000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f4c06e420 0x7f3f4c1551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:27.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.584+0000 7f3f51000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f4c06e420 0x7f3f4c1551a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37466/0 (socket says 172.21.15.107:37466) 2024-08-17T02:24:27.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.584+0000 7f3f51000640 1 -- 172.21.15.107:0/2863004205 learned_addr learned my addr 172.21.15.107:0/2863004205 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:27.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.584+0000 7f3f4be00640 1 --2- 172.21.15.107:0/2863004205 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f4c150130 0x7f3f4c14ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:27.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.584+0000 7f3f51a00640 1 --2- 172.21.15.107:0/2863004205 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3f4c156d40 0x7f3f4c159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:27.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.585+0000 7f3f51000640 1 -- 172.21.15.107:0/2863004205 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3f4c156d40 msgr2=0x7f3f4c159510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:27.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.585+0000 7f3f51000640 1 --2- 172.21.15.107:0/2863004205 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3f4c156d40 0x7f3f4c159510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.585+0000 7f3f51000640 1 -- 172.21.15.107:0/2863004205 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f4c150130 msgr2=0x7f3f4c14ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:27.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.585+0000 7f3f51000640 1 --2- 172.21.15.107:0/2863004205 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f4c150130 0x7f3f4c14ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:27.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.585+0000 7f3f51000640 1 -- 172.21.15.107:0/2863004205 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f38009390 con 0x7f3f4c06e420 2024-08-17T02:24:27.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.585+0000 7f3f51000640 1 --2- 172.21.15.107:0/2863004205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f4c06e420 0x7f3f4c1551a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3f4000c560 tx=0x7f3f40007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:27.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.585+0000 7f3f3fe00640 1 -- 172.21.15.107:0/2863004205 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f40011590 con 0x7f3f4c06e420 2024-08-17T02:24:27.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.585+0000 7f3f3fe00640 1 -- 172.21.15.107:0/2863004205 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f40011710 con 0x7f3f4c06e420 2024-08-17T02:24:27.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.585+0000 7f3f53a00640 1 -- 172.21.15.107:0/2863004205 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f4c154460 con 0x7f3f4c06e420 2024-08-17T02:24:27.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.585+0000 7f3f3fe00640 1 -- 172.21.15.107:0/2863004205 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f40011ad0 con 0x7f3f4c06e420 2024-08-17T02:24:27.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.585+0000 7f3f53a00640 1 -- 172.21.15.107:0/2863004205 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f4c151520 con 0x7f3f4c06e420 2024-08-17T02:24:27.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.586+0000 7f3f53a00640 1 -- 172.21.15.107:0/2863004205 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f4c1556e0 con 0x7f3f4c06e420 2024-08-17T02:24:27.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.587+0000 7f3f3fe00640 1 -- 172.21.15.107:0/2863004205 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3f4001b3b0 con 0x7f3f4c06e420 2024-08-17T02:24:27.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.588+0000 7f3f3fe00640 1 --2- 172.21.15.107:0/2863004205 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3f2c065150 0x7f3f2c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:27.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.588+0000 7f3f3fe00640 1 -- 172.21.15.107:0/2863004205 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f3f40081700 con 0x7f3f4c06e420 2024-08-17T02:24:27.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.588+0000 7f3f4be00640 1 --2- 172.21.15.107:0/2863004205 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3f2c065150 0x7f3f2c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:27.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.589+0000 7f3f4be00640 1 --2- 172.21.15.107:0/2863004205 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3f2c065150 0x7f3f2c067600 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3f38034000 tx=0x7f3f38032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:27.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.593+0000 7f3f3fe00640 1 -- 172.21.15.107:0/2863004205 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3f4004fa50 con 0x7f3f4c06e420 2024-08-17T02:24:27.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:27.765+0000 7f3f53a00640 1 -- 172.21.15.107:0/2863004205 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3f4c0710c0 con 0x7f3f4c06e420 2024-08-17T02:24:28.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.408+0000 7f3f3fe00640 1 -- 172.21.15.107:0/2863004205 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3f40017020 con 0x7f3f4c06e420 2024-08-17T02:24:28.410 INFO:teuthology.orchestra.run.smithi107.stderr:pool 'cephfs_data' created 2024-08-17T02:24:28.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.412+0000 7f3f53a00640 1 -- 172.21.15.107:0/2863004205 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3f2c065150 msgr2=0x7f3f2c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:28.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.413+0000 7f3f53a00640 1 --2- 172.21.15.107:0/2863004205 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3f2c065150 0x7f3f2c067600 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3f38034000 tx=0x7f3f38032000 comp rx=0 tx=0).stop 2024-08-17T02:24:28.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.413+0000 7f3f53a00640 1 -- 172.21.15.107:0/2863004205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f4c06e420 msgr2=0x7f3f4c1551a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:28.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.413+0000 7f3f53a00640 1 --2- 172.21.15.107:0/2863004205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f4c06e420 0x7f3f4c1551a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3f4000c560 tx=0x7f3f40007ef0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.413+0000 7f3f53a00640 1 -- 172.21.15.107:0/2863004205 shutdown_connections 2024-08-17T02:24:28.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.413+0000 7f3f53a00640 1 --2- 172.21.15.107:0/2863004205 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3f2c065150 0x7f3f2c067600 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.413+0000 7f3f53a00640 1 --2- 172.21.15.107:0/2863004205 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3f4c156d40 0x7f3f4c159510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.413+0000 7f3f53a00640 1 --2- 172.21.15.107:0/2863004205 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f4c150130 0x7f3f4c14ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.413+0000 7f3f53a00640 1 --2- 172.21.15.107:0/2863004205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f4c06e420 0x7f3f4c1551a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.413+0000 7f3f53a00640 1 -- 172.21.15.107:0/2863004205 >> 172.21.15.107:0/2863004205 conn(0x7f3f4c067750 msgr2=0x7f3f4c0ae9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:28.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.415+0000 7f3f53a00640 1 -- 172.21.15.107:0/2863004205 shutdown_connections 2024-08-17T02:24:28.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.415+0000 7f3f53a00640 1 -- 172.21.15.107:0/2863004205 wait complete. 2024-08-17T02:24:28.442 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-17T02:24:28.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.590+0000 7f0268a00640 1 Processor -- start 2024-08-17T02:24:28.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.590+0000 7f0268a00640 1 -- start start 2024-08-17T02:24:28.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.591+0000 7f0268a00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0264156c50 0x7f02640c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:28.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.591+0000 7f0268a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02640ab130 con 0x7f02640adcf0 2024-08-17T02:24:28.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.591+0000 7f0268a00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02640ae5a0 con 0x7f02640c8bd0 2024-08-17T02:24:28.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.591+0000 7f0268a00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02640ae2c0 con 0x7f0264156c50 2024-08-17T02:24:28.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.592+0000 7f0261400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f02640adcf0 0x7f02640ab5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:47822/0 (socket says 172.21.15.107:47822) 2024-08-17T02:24:28.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.592+0000 7f0261400640 1 -- 172.21.15.107:0/1402447729 learned_addr learned my addr 172.21.15.107:0/1402447729 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:28.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.592+0000 7f0261e00640 1 --2- 172.21.15.107:0/1402447729 >> v2:172.21.15.157:3300/0 conn(0x7f0264156c50 0x7f02640c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:28.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.592+0000 7f0260a00640 1 -- 172.21.15.107:0/1402447729 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 756316065 0 0) 0x7f02640ab130 con 0x7f02640adcf0 2024-08-17T02:24:28.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.592+0000 7f0260a00640 1 -- 172.21.15.107:0/1402447729 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02480034e0 con 0x7f02640adcf0 2024-08-17T02:24:28.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.592+0000 7f0260a00640 1 -- 172.21.15.107:0/1402447729 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2828349596 0 0) 0x7f02640ae5a0 con 0x7f02640c8bd0 2024-08-17T02:24:28.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.592+0000 7f0260a00640 1 -- 172.21.15.107:0/1402447729 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02640ab130 con 0x7f02640c8bd0 2024-08-17T02:24:28.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.592+0000 7f0261e00640 1 -- 172.21.15.107:0/1402447729 >> v1:172.21.15.157:6789/0 conn(0x7f02640c8bd0 legacy=0x7f02640c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:28.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.592+0000 7f0261e00640 1 -- 172.21.15.107:0/1402447729 >> v1:172.21.15.107:6789/0 conn(0x7f02640adcf0 legacy=0x7f02640ab5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:28.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.592+0000 7f0261e00640 1 -- 172.21.15.107:0/1402447729 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02640aaae0 con 0x7f0264156c50 2024-08-17T02:24:28.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.593+0000 7f0261e00640 1 --2- 172.21.15.107:0/1402447729 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0264156c50 0x7f02640c7cf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0254009e60 tx=0x7f0254009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b392c65803ef22d3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:28.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.594+0000 7f0260a00640 1 -- 172.21.15.107:0/1402447729 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0254007550 con 0x7f0264156c50 2024-08-17T02:24:28.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.594+0000 7f0260a00640 1 -- 172.21.15.107:0/1402447729 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025402d050 con 0x7f0264156c50 2024-08-17T02:24:28.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.594+0000 7f0260a00640 1 -- 172.21.15.107:0/1402447729 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02540078e0 con 0x7f0264156c50 2024-08-17T02:24:28.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.594+0000 7f0268a00640 1 -- 172.21.15.107:0/1402447729 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0264156c50 msgr2=0x7f02640c7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:28.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.594+0000 7f0268a00640 1 --2- 172.21.15.107:0/1402447729 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0264156c50 0x7f02640c7cf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0254009e60 tx=0x7f0254009780 comp rx=0 tx=0).stop 2024-08-17T02:24:28.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.594+0000 7f0268a00640 1 -- 172.21.15.107:0/1402447729 shutdown_connections 2024-08-17T02:24:28.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.594+0000 7f0268a00640 1 --2- 172.21.15.107:0/1402447729 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0264156c50 0x7f02640c7cf0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.594+0000 7f0268a00640 1 -- 172.21.15.107:0/1402447729 >> 172.21.15.107:0/1402447729 conn(0x7f0264067750 msgr2=0x7f02640c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:28.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.594+0000 7f0268a00640 1 -- 172.21.15.107:0/1402447729 shutdown_connections 2024-08-17T02:24:28.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.594+0000 7f0268a00640 1 -- 172.21.15.107:0/1402447729 wait complete. 2024-08-17T02:24:28.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.596+0000 7f0268a00640 1 Processor -- start 2024-08-17T02:24:28.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.596+0000 7f0268a00640 1 -- start start 2024-08-17T02:24:28.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.596+0000 7f0268a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f02640adcf0 0x7f0264143500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:28.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.596+0000 7f0268a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02640c8bd0 0x7f0264157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:28.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.596+0000 7f0268a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0264156c50 0x7f02640a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:28.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.596+0000 7f0268a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0264144cf0 con 0x7f02640c8bd0 2024-08-17T02:24:28.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.596+0000 7f0268a00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02641440e0 con 0x7f02640adcf0 2024-08-17T02:24:28.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.596+0000 7f0268a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02641443c0 con 0x7f0264156c50 2024-08-17T02:24:28.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.597+0000 7f0261400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02640c8bd0 0x7f0264157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:28.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.597+0000 7f0261400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02640c8bd0 0x7f0264157500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37474/0 (socket says 172.21.15.107:37474) 2024-08-17T02:24:28.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.597+0000 7f0261400640 1 -- 172.21.15.107:0/3385904029 learned_addr learned my addr 172.21.15.107:0/3385904029 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:28.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.597+0000 7f0261e00640 1 --2- 172.21.15.107:0/3385904029 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f02640adcf0 0x7f0264143500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:28.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.597+0000 7f0262800640 1 --2- 172.21.15.107:0/3385904029 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0264156c50 0x7f02640a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:28.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.597+0000 7f0261400640 1 -- 172.21.15.107:0/3385904029 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0264156c50 msgr2=0x7f02640a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:28.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.597+0000 7f0261400640 1 --2- 172.21.15.107:0/3385904029 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0264156c50 0x7f02640a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.597+0000 7f0261400640 1 -- 172.21.15.107:0/3385904029 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f02640adcf0 msgr2=0x7f0264143500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:28.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.597+0000 7f0261400640 1 --2- 172.21.15.107:0/3385904029 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f02640adcf0 0x7f0264143500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:28.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.597+0000 7f0261400640 1 -- 172.21.15.107:0/3385904029 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0254009a20 con 0x7f02640c8bd0 2024-08-17T02:24:28.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.597+0000 7f0262800640 1 --2- 172.21.15.107:0/3385904029 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0264156c50 0x7f02640a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:28.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.597+0000 7f0261400640 1 --2- 172.21.15.107:0/3385904029 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02640c8bd0 0x7f0264157500 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0250005840 tx=0x7f0250007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:28.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.598+0000 7f0259600640 1 -- 172.21.15.107:0/3385904029 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0250005aa0 con 0x7f02640c8bd0 2024-08-17T02:24:28.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.598+0000 7f0259600640 1 -- 172.21.15.107:0/3385904029 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0250005c00 con 0x7f02640c8bd0 2024-08-17T02:24:28.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.598+0000 7f0259600640 1 -- 172.21.15.107:0/3385904029 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02500070f0 con 0x7f02640c8bd0 2024-08-17T02:24:28.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.598+0000 7f0268a00640 1 -- 172.21.15.107:0/3385904029 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02641446a0 con 0x7f02640c8bd0 2024-08-17T02:24:28.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.598+0000 7f0268a00640 1 -- 172.21.15.107:0/3385904029 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0264143a40 con 0x7f02640c8bd0 2024-08-17T02:24:28.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.599+0000 7f0268a00640 1 -- 172.21.15.107:0/3385904029 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0264144ea0 con 0x7f02640c8bd0 2024-08-17T02:24:28.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.600+0000 7f0259600640 1 -- 172.21.15.107:0/3385904029 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0250007520 con 0x7f02640c8bd0 2024-08-17T02:24:28.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.601+0000 7f0259600640 1 --2- 172.21.15.107:0/3385904029 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f0244065150 0x7f0244067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:28.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.601+0000 7f0259600640 1 -- 172.21.15.107:0/3385904029 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f0250081e80 con 0x7f02640c8bd0 2024-08-17T02:24:28.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.601+0000 7f0261e00640 1 --2- 172.21.15.107:0/3385904029 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f0244065150 0x7f0244067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:28.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.601+0000 7f0261e00640 1 --2- 172.21.15.107:0/3385904029 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f0244065150 0x7f0244067600 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0254034000 tx=0x7f0254037000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:28.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.605+0000 7f0259600640 1 -- 172.21.15.107:0/3385904029 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0264144ea0 con 0x7f02640c8bd0 2024-08-17T02:24:28.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:28.814+0000 7f0268a00640 1 -- 172.21.15.107:0/3385904029 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f0264071050 con 0x7f02640c8bd0 2024-08-17T02:24:29.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.422+0000 7f0259600640 1 -- 172.21.15.107:0/3385904029 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f0250053a10 con 0x7f02640c8bd0 2024-08-17T02:24:29.423 INFO:teuthology.orchestra.run.smithi107.stderr:new fs with metadata pool 2 and data pool 3 2024-08-17T02:24:29.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.425+0000 7f0268a00640 1 -- 172.21.15.107:0/3385904029 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f0244065150 msgr2=0x7f0244067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:29.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.425+0000 7f0268a00640 1 --2- 172.21.15.107:0/3385904029 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f0244065150 0x7f0244067600 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0254034000 tx=0x7f0254037000 comp rx=0 tx=0).stop 2024-08-17T02:24:29.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.425+0000 7f0268a00640 1 -- 172.21.15.107:0/3385904029 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02640c8bd0 msgr2=0x7f0264157500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:29.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.425+0000 7f0268a00640 1 --2- 172.21.15.107:0/3385904029 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02640c8bd0 0x7f0264157500 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0250005840 tx=0x7f0250007e10 comp rx=0 tx=0).stop 2024-08-17T02:24:29.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.426+0000 7f0268a00640 1 -- 172.21.15.107:0/3385904029 shutdown_connections 2024-08-17T02:24:29.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.426+0000 7f0268a00640 1 --2- 172.21.15.107:0/3385904029 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f0244065150 0x7f0244067600 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.426+0000 7f0268a00640 1 --2- 172.21.15.107:0/3385904029 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0264156c50 0x7f02640a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.426+0000 7f0268a00640 1 --2- 172.21.15.107:0/3385904029 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02640c8bd0 0x7f0264157500 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.426+0000 7f0268a00640 1 --2- 172.21.15.107:0/3385904029 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f02640adcf0 0x7f0264143500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.426+0000 7f0268a00640 1 -- 172.21.15.107:0/3385904029 >> 172.21.15.107:0/3385904029 conn(0x7f0264067750 msgr2=0x7f0264068950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:29.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.426+0000 7f0268a00640 1 -- 172.21.15.107:0/3385904029 shutdown_connections 2024-08-17T02:24:29.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.426+0000 7f0268a00640 1 -- 172.21.15.107:0/3385904029 wait complete. 2024-08-17T02:24:29.449 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:29.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.599+0000 7ffbc6400640 1 Processor -- start 2024-08-17T02:24:29.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.599+0000 7ffbc6400640 1 -- start start 2024-08-17T02:24:29.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.600+0000 7ffbc6400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffbc00aed50 0x7ffbc00ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.600+0000 7ffbc6400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ffbc00ce6d0 0x7ffbc00ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.600+0000 7ffbc6400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ffbc00cacf0 0x7ffbc00c4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.600+0000 7ffbc6400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbc00cc890 con 0x7ffbc00ce6d0 2024-08-17T02:24:29.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.600+0000 7ffbc6400640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbc00ceb20 con 0x7ffbc00cacf0 2024-08-17T02:24:29.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.600+0000 7ffbc6400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc00cb4c0 con 0x7ffbc00aed50 2024-08-17T02:24:29.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.600+0000 7ffbb7e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ffbc00ce6d0 0x7ffbc00ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.600+0000 7ffbb7e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ffbc00ce6d0 0x7ffbc00ca7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37476/0 (socket says 172.21.15.107:37476) 2024-08-17T02:24:29.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.600+0000 7ffbb7e00640 1 -- 172.21.15.107:0/750745929 learned_addr learned my addr 172.21.15.107:0/750745929 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:29.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.600+0000 7ffbc5a00640 1 --2- 172.21.15.107:0/750745929 >> v2:172.21.15.157:3300/0 conn(0x7ffbc00cacf0 0x7ffbc00c4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.600+0000 7ffbc5000640 1 --2- 172.21.15.107:0/750745929 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffbc00aed50 0x7ffbc00ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.601+0000 7ffbb7e00640 1 -- 172.21.15.107:0/750745929 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffbc00aed50 msgr2=0x7ffbc00ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:29.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.601+0000 7ffbb7e00640 1 --2- 172.21.15.107:0/750745929 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffbc00aed50 0x7ffbc00ce190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.601+0000 7ffbb7e00640 1 -- 172.21.15.107:0/750745929 >> v2:172.21.15.157:3300/0 conn(0x7ffbc00cacf0 msgr2=0x7ffbc00c4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:29.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.601+0000 7ffbb7e00640 1 --2- 172.21.15.107:0/750745929 >> v2:172.21.15.157:3300/0 conn(0x7ffbc00cacf0 0x7ffbc00c4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.601+0000 7ffbb7e00640 1 -- 172.21.15.107:0/750745929 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc00cb7a0 con 0x7ffbc00ce6d0 2024-08-17T02:24:29.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.601+0000 7ffbc5a00640 1 --2- 172.21.15.107:0/750745929 >> v2:172.21.15.157:3300/0 conn(0x7ffbc00cacf0 0x7ffbc00c4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:29.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.602+0000 7ffbb7e00640 1 --2- 172.21.15.107:0/750745929 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffbc00ce6d0 0x7ffbc00ca7b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ffbc00cfb60 tx=0x7ffba80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=875ae429a30986e1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:29.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.602+0000 7ffbbfe00640 1 -- 172.21.15.107:0/750745929 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba802add0 con 0x7ffbc00ce6d0 2024-08-17T02:24:29.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.602+0000 7ffbbfe00640 1 -- 172.21.15.107:0/750745929 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba8032440 con 0x7ffbc00ce6d0 2024-08-17T02:24:29.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.602+0000 7ffbbfe00640 1 -- 172.21.15.107:0/750745929 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba8032820 con 0x7ffbc00ce6d0 2024-08-17T02:24:29.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.602+0000 7ffbc6400640 1 -- 172.21.15.107:0/750745929 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffbc00ce6d0 msgr2=0x7ffbc00ca7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:29.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.602+0000 7ffbc6400640 1 --2- 172.21.15.107:0/750745929 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffbc00ce6d0 0x7ffbc00ca7b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ffbc00cfb60 tx=0x7ffba80091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.603+0000 7ffbc6400640 1 -- 172.21.15.107:0/750745929 shutdown_connections 2024-08-17T02:24:29.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.603+0000 7ffbc6400640 1 --2- 172.21.15.107:0/750745929 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffbc00ce6d0 0x7ffbc00ca7b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.603+0000 7ffbc6400640 1 --2- 172.21.15.107:0/750745929 >> v2:172.21.15.157:3300/0 conn(0x7ffbc00cacf0 0x7ffbc00c4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.603+0000 7ffbc6400640 1 --2- 172.21.15.107:0/750745929 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffbc00aed50 0x7ffbc00ce190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.603+0000 7ffbc6400640 1 -- 172.21.15.107:0/750745929 >> 172.21.15.107:0/750745929 conn(0x7ffbc0098e30 msgr2=0x7ffbc006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:29.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.603+0000 7ffbc6400640 1 -- 172.21.15.107:0/750745929 shutdown_connections 2024-08-17T02:24:29.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.603+0000 7ffbc6400640 1 -- 172.21.15.107:0/750745929 wait complete. 2024-08-17T02:24:29.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.604+0000 7ffbc6400640 1 Processor -- start 2024-08-17T02:24:29.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.604+0000 7ffbc6400640 1 -- start start 2024-08-17T02:24:29.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.605+0000 7ffbc6400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffbc00aed50 0x7ffbc00c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.605+0000 7ffbc6400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffbc00cacf0 0x7ffbc0147d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.605+0000 7ffbc6400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffbc00ce6d0 0x7ffbc016bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.605+0000 7ffbc6400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc00c7360 con 0x7ffbc00aed50 2024-08-17T02:24:29.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.605+0000 7ffbc6400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc0157a80 con 0x7ffbc00ce6d0 2024-08-17T02:24:29.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.605+0000 7ffbc6400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc00c9d80 con 0x7ffbc00cacf0 2024-08-17T02:24:29.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.605+0000 7ffbc5000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffbc00aed50 0x7ffbc00c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.605+0000 7ffbc5000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffbc00aed50 0x7ffbc00c6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37480/0 (socket says 172.21.15.107:37480) 2024-08-17T02:24:29.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.605+0000 7ffbc5000640 1 -- 172.21.15.107:0/4273879077 learned_addr learned my addr 172.21.15.107:0/4273879077 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:29.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.605+0000 7ffbb7e00640 1 --2- 172.21.15.107:0/4273879077 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffbc00cacf0 0x7ffbc0147d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.605+0000 7ffbc5a00640 1 --2- 172.21.15.107:0/4273879077 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffbc00ce6d0 0x7ffbc016bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.606+0000 7ffbc5000640 1 -- 172.21.15.107:0/4273879077 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffbc00cacf0 msgr2=0x7ffbc0147d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:29.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.606+0000 7ffbc5000640 1 --2- 172.21.15.107:0/4273879077 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffbc00cacf0 0x7ffbc0147d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.606+0000 7ffbc5000640 1 -- 172.21.15.107:0/4273879077 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffbc00ce6d0 msgr2=0x7ffbc016bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:29.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.606+0000 7ffbc5000640 1 --2- 172.21.15.107:0/4273879077 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffbc00ce6d0 0x7ffbc016bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.606+0000 7ffbc5000640 1 -- 172.21.15.107:0/4273879077 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba8009450 con 0x7ffbc00aed50 2024-08-17T02:24:29.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.606+0000 7ffbc5000640 1 --2- 172.21.15.107:0/4273879077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffbc00aed50 0x7ffbc00c6c60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ffbb000d890 tx=0x7ffbb0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:29.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.606+0000 7ffbbcc00640 1 -- 172.21.15.107:0/4273879077 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb000de20 con 0x7ffbc00aed50 2024-08-17T02:24:29.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.606+0000 7ffbbcc00640 1 -- 172.21.15.107:0/4273879077 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb00098b0 con 0x7ffbc00aed50 2024-08-17T02:24:29.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.606+0000 7ffbbcc00640 1 -- 172.21.15.107:0/4273879077 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0009c50 con 0x7ffbc00aed50 2024-08-17T02:24:29.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.606+0000 7ffbc6400640 1 -- 172.21.15.107:0/4273879077 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbc00c9450 con 0x7ffbc00aed50 2024-08-17T02:24:29.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.606+0000 7ffbc6400640 1 -- 172.21.15.107:0/4273879077 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbc00c9a10 con 0x7ffbc00aed50 2024-08-17T02:24:29.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.607+0000 7ffbc6400640 1 -- 172.21.15.107:0/4273879077 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbc0071050 con 0x7ffbc00aed50 2024-08-17T02:24:29.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.608+0000 7ffbbcc00640 1 -- 172.21.15.107:0/4273879077 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ffbb0014620 con 0x7ffbc00aed50 2024-08-17T02:24:29.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.609+0000 7ffbbcc00640 1 --2- 172.21.15.107:0/4273879077 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ffb9c065180 0x7ffb9c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.609+0000 7ffbbcc00640 1 -- 172.21.15.107:0/4273879077 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffbb0082b70 con 0x7ffbc00aed50 2024-08-17T02:24:29.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.609+0000 7ffbb7e00640 1 --2- 172.21.15.107:0/4273879077 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ffb9c065180 0x7ffb9c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.610+0000 7ffbb7e00640 1 --2- 172.21.15.107:0/4273879077 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ffb9c065180 0x7ffb9c067630 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ffba8034000 tx=0x7ffba8032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:29.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.613+0000 7ffbbcc00640 1 -- 172.21.15.107:0/4273879077 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ffbb0050c40 con 0x7ffbc00aed50 2024-08-17T02:24:29.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.785+0000 7ffbc6400640 1 -- 172.21.15.107:0/4273879077 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffbc00c57d0 con 0x7ffbc00aed50 2024-08-17T02:24:29.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.786+0000 7ffbbcc00640 1 -- 172.21.15.107:0/4273879077 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15411 (secure 0 0 0) 0x7ffbb0054260 con 0x7ffbc00aed50 2024-08-17T02:24:29.787 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:24:29.787 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":20,"fsid":"f207b4c0-329d-46b8-b83f-aaf30bdb6ce3","created":"2024-08-17T02:24:11.038049+0000","modified":"2024-08-17T02:24:28.816229+0000","last_up_change":"2024-08-17T02:24:22.047790+0000","last_in_change":"2024-08-17T02:24:13.892720+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:23.456166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:27.078670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:27.804418+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"376363f3-b8bf-4f1e-b691-51cdd39171ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37302},{"type":"v1","addr":"172.21.15.107:6801","nonce":37302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37302},{"type":"v1","addr":"172.21.15.107:6803","nonce":37302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37302},{"type":"v1","addr":"172.21.15.107:6807","nonce":37302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37302},{"type":"v1","addr":"172.21.15.107:6805","nonce":37302}]},"public_addr":"172.21.15.107:6801/37302","cluster_addr":"172.21.15.107:6803/37302","heartbeat_back_addr":"172.21.15.107:6807/37302","heartbeat_front_addr":"172.21.15.107:6805/37302","state":["exists","up"]},{"osd":1,"uuid":"cc6624e3-2ad4-4db4-b377-05dfe57424e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37305},{"type":"v1","addr":"172.21.15.107:6824","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37305},{"type":"v1","addr":"172.21.15.107:6827","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37305},{"type":"v1","addr":"172.21.15.107:6831","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37305},{"type":"v1","addr":"172.21.15.107:6829","nonce":37305}]},"public_addr":"172.21.15.107:6824/37305","cluster_addr":"172.21.15.107:6827/37305","heartbeat_back_addr":"172.21.15.107:6831/37305","heartbeat_front_addr":"172.21.15.107:6829/37305","state":["exists","up"]},{"osd":2,"uuid":"25229542-29b5-4281-bcb0-798ae0930aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37307},{"type":"v1","addr":"172.21.15.107:6817","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37307},{"type":"v1","addr":"172.21.15.107:6819","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6823","nonce":37307},{"type":"v1","addr":"172.21.15.107:6825","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37307},{"type":"v1","addr":"172.21.15.107:6821","nonce":37307}]},"public_addr":"172.21.15.107:6817/37307","cluster_addr":"172.21.15.107:6819/37307","heartbeat_back_addr":"172.21.15.107:6825/37307","heartbeat_front_addr":"172.21.15.107:6821/37307","state":["exists","up"]},{"osd":3,"uuid":"5f16aee8-8950-4268-a61a-5cf6ebd670e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37306},{"type":"v1","addr":"172.21.15.107:6809","nonce":37306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37306},{"type":"v1","addr":"172.21.15.107:6811","nonce":37306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37306},{"type":"v1","addr":"172.21.15.107:6815","nonce":37306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37306},{"type":"v1","addr":"172.21.15.107:6813","nonce":37306}]},"public_addr":"172.21.15.107:6809/37306","cluster_addr":"172.21.15.107:6811/37306","heartbeat_back_addr":"172.21.15.107:6815/37306","heartbeat_front_addr":"172.21.15.107:6813/37306","state":["exists","up"]},{"osd":4,"uuid":"23232e28-e23b-4b4e-a531-4939246dbbde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":37329},{"type":"v1","addr":"172.21.15.157:6817","nonce":37329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":37329},{"type":"v1","addr":"172.21.15.157:6819","nonce":37329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":37329},{"type":"v1","addr":"172.21.15.157:6823","nonce":37329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":37329},{"type":"v1","addr":"172.21.15.157:6821","nonce":37329}]},"public_addr":"172.21.15.157:6817/37329","cluster_addr":"172.21.15.157:6819/37329","heartbeat_back_addr":"172.21.15.157:6823/37329","heartbeat_front_addr":"172.21.15.157:6821/37329","state":["exists","up"]},{"osd":5,"uuid":"f87ec331-3e59-4886-a317-6f7e26ec8e21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":37328},{"type":"v1","addr":"172.21.15.157:6804","nonce":37328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":37328},{"type":"v1","addr":"172.21.15.157:6808","nonce":37328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":37328},{"type":"v1","addr":"172.21.15.157:6815","nonce":37328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":37328},{"type":"v1","addr":"172.21.15.157:6812","nonce":37328}]},"public_addr":"172.21.15.157:6804/37328","cluster_addr":"172.21.15.157:6808/37328","heartbeat_back_addr":"172.21.15.157:6815/37328","heartbeat_front_addr":"172.21.15.157:6812/37328","state":["exists","up"]},{"osd":6,"uuid":"92852235-ce49-4d96-a940-6f18d97b13ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":37330},{"type":"v1","addr":"172.21.15.157:6801","nonce":37330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6803","nonce":37330},{"type":"v1","addr":"172.21.15.157:6805","nonce":37330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":37330},{"type":"v1","addr":"172.21.15.157:6813","nonce":37330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":37330},{"type":"v1","addr":"172.21.15.157:6809","nonce":37330}]},"public_addr":"172.21.15.157:6801/37330","cluster_addr":"172.21.15.157:6805/37330","heartbeat_back_addr":"172.21.15.157:6813/37330","heartbeat_front_addr":"172.21.15.157:6809/37330","state":["exists","up"]},{"osd":7,"uuid":"7484a061-723d-4663-b28f-b01766d62f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":37373},{"type":"v1","addr":"172.21.15.157:6825","nonce":37373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":37373},{"type":"v1","addr":"172.21.15.157:6827","nonce":37373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":37373},{"type":"v1","addr":"172.21.15.157:6831","nonce":37373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":37373},{"type":"v1","addr":"172.21.15.157:6829","nonce":37373}]},"public_addr":"172.21.15.157:6825/37373","cluster_addr":"172.21.15.157:6827/37373","heartbeat_back_addr":"172.21.15.157:6831/37373","heartbeat_front_addr":"172.21.15.157:6829/37373","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.110188+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.280265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.252119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.267996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.284582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.144420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.174764+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.308002+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:29.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.788+0000 7ffbc6400640 1 -- 172.21.15.107:0/4273879077 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ffb9c065180 msgr2=0x7ffb9c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:29.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.788+0000 7ffbc6400640 1 --2- 172.21.15.107:0/4273879077 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ffb9c065180 0x7ffb9c067630 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ffba8034000 tx=0x7ffba8032000 comp rx=0 tx=0).stop 2024-08-17T02:24:29.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.788+0000 7ffbc6400640 1 -- 172.21.15.107:0/4273879077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffbc00aed50 msgr2=0x7ffbc00c6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:29.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.788+0000 7ffbc6400640 1 --2- 172.21.15.107:0/4273879077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffbc00aed50 0x7ffbc00c6c60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ffbb000d890 tx=0x7ffbb0008040 comp rx=0 tx=0).stop 2024-08-17T02:24:29.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.788+0000 7ffbc6400640 1 -- 172.21.15.107:0/4273879077 shutdown_connections 2024-08-17T02:24:29.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.788+0000 7ffbc6400640 1 --2- 172.21.15.107:0/4273879077 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ffb9c065180 0x7ffb9c067630 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.788+0000 7ffbc6400640 1 --2- 172.21.15.107:0/4273879077 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffbc00ce6d0 0x7ffbc016bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.788+0000 7ffbc6400640 1 --2- 172.21.15.107:0/4273879077 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffbc00cacf0 0x7ffbc0147d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.788+0000 7ffbc6400640 1 --2- 172.21.15.107:0/4273879077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffbc00aed50 0x7ffbc00c6c60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.788+0000 7ffbc6400640 1 -- 172.21.15.107:0/4273879077 >> 172.21.15.107:0/4273879077 conn(0x7ffbc0098e30 msgr2=0x7ffbc01591c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:29.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.788+0000 7ffbc6400640 1 -- 172.21.15.107:0/4273879077 shutdown_connections 2024-08-17T02:24:29.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.788+0000 7ffbc6400640 1 -- 172.21.15.107:0/4273879077 wait complete. 2024-08-17T02:24:29.804 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:29.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.949+0000 7f9871800640 1 Processor -- start 2024-08-17T02:24:29.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.949+0000 7f9871800640 1 -- start start 2024-08-17T02:24:29.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.950+0000 7f9871800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f986c0b1440 0x7f986c0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.951+0000 7f9871800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f986c140580 0x7f986c0c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.951+0000 7f9871800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f986c0caa80 con 0x7f986c1401b0 2024-08-17T02:24:29.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.951+0000 7f9871800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f986c0cb450 con 0x7f986c140580 2024-08-17T02:24:29.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.951+0000 7f9871800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f986c0c9e70 con 0x7f986c0b1440 2024-08-17T02:24:29.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.951+0000 7f986aa00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f986c1401b0 0x7f986c0b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:47824/0 (socket says 172.21.15.107:47824) 2024-08-17T02:24:29.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.951+0000 7f986aa00640 1 -- 172.21.15.107:0/2411564326 learned_addr learned my addr 172.21.15.107:0/2411564326 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:29.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.951+0000 7f986b400640 1 --2- 172.21.15.107:0/2411564326 >> v2:172.21.15.107:3300/0 conn(0x7f986c140580 0x7f986c0c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.951+0000 7f9862000640 1 --2- 172.21.15.107:0/2411564326 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f986c0b1440 0x7f986c0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.951+0000 7f986b400640 1 -- 172.21.15.107:0/2411564326 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f986c0b1440 msgr2=0x7f986c0caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:29.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.951+0000 7f986b400640 1 --2- 172.21.15.107:0/2411564326 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f986c0b1440 0x7f986c0caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.951+0000 7f986a000640 1 -- 172.21.15.107:0/2411564326 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 971080650 0 0) 0x7f986c0caa80 con 0x7f986c1401b0 2024-08-17T02:24:29.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.951+0000 7f986b400640 1 -- 172.21.15.107:0/2411564326 >> v1:172.21.15.107:6789/0 conn(0x7f986c1401b0 legacy=0x7f986c0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:29.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.951+0000 7f986b400640 1 -- 172.21.15.107:0/2411564326 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986c0ca150 con 0x7f986c140580 2024-08-17T02:24:29.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.951+0000 7f9862000640 1 --2- 172.21.15.107:0/2411564326 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f986c0b1440 0x7f986c0caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:29.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.952+0000 7f986b400640 1 --2- 172.21.15.107:0/2411564326 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f986c140580 0x7f986c0c9040 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9864009e60 tx=0x7f9864009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87a868c4644d2cff server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:29.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.952+0000 7f986a000640 1 -- 172.21.15.107:0/2411564326 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9864007550 con 0x7f986c140580 2024-08-17T02:24:29.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.952+0000 7f986a000640 1 -- 172.21.15.107:0/2411564326 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986402d050 con 0x7f986c140580 2024-08-17T02:24:29.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.952+0000 7f986a000640 1 -- 172.21.15.107:0/2411564326 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98640078e0 con 0x7f986c140580 2024-08-17T02:24:29.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.953+0000 7f9871800640 1 -- 172.21.15.107:0/2411564326 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f986c140580 msgr2=0x7f986c0c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:29.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.953+0000 7f9871800640 1 --2- 172.21.15.107:0/2411564326 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f986c140580 0x7f986c0c9040 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9864009e60 tx=0x7f9864009780 comp rx=0 tx=0).stop 2024-08-17T02:24:29.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.953+0000 7f9871800640 1 -- 172.21.15.107:0/2411564326 shutdown_connections 2024-08-17T02:24:29.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.953+0000 7f9871800640 1 --2- 172.21.15.107:0/2411564326 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f986c140580 0x7f986c0c9040 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.953+0000 7f9871800640 1 --2- 172.21.15.107:0/2411564326 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f986c0b1440 0x7f986c0caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.953+0000 7f9871800640 1 -- 172.21.15.107:0/2411564326 >> 172.21.15.107:0/2411564326 conn(0x7f986c0cb9b0 msgr2=0x7f986c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:29.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.953+0000 7f9871800640 1 -- 172.21.15.107:0/2411564326 shutdown_connections 2024-08-17T02:24:29.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.953+0000 7f9871800640 1 -- 172.21.15.107:0/2411564326 wait complete. 2024-08-17T02:24:29.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.955+0000 7f9871800640 1 Processor -- start 2024-08-17T02:24:29.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.955+0000 7f9871800640 1 -- start start 2024-08-17T02:24:29.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.955+0000 7f9871800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f986c0b1440 0x7f986c13c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.956+0000 7f9871800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f986c1401b0 0x7f986c159870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.956+0000 7f9871800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f986c140580 0x7f986c15bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.956+0000 7f9871800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c15b670 con 0x7f986c0b1440 2024-08-17T02:24:29.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.956+0000 7f9871800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c15ae60 con 0x7f986c140580 2024-08-17T02:24:29.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.956+0000 7f9871800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f986c1593e0 con 0x7f986c1401b0 2024-08-17T02:24:29.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.956+0000 7f986aa00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f986c0b1440 0x7f986c13c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.956+0000 7f986aa00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f986c0b1440 0x7f986c13c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37490/0 (socket says 172.21.15.107:37490) 2024-08-17T02:24:29.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.956+0000 7f986aa00640 1 -- 172.21.15.107:0/2688737339 learned_addr learned my addr 172.21.15.107:0/2688737339 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:29.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.956+0000 7f9862000640 1 --2- 172.21.15.107:0/2688737339 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f986c1401b0 0x7f986c159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.956+0000 7f986b400640 1 --2- 172.21.15.107:0/2688737339 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f986c140580 0x7f986c15bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.956+0000 7f986aa00640 1 -- 172.21.15.107:0/2688737339 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f986c1401b0 msgr2=0x7f986c159870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:29.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.956+0000 7f986aa00640 1 --2- 172.21.15.107:0/2688737339 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f986c1401b0 0x7f986c159870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.956+0000 7f986aa00640 1 -- 172.21.15.107:0/2688737339 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f986c140580 msgr2=0x7f986c15bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:29.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.956+0000 7f986aa00640 1 --2- 172.21.15.107:0/2688737339 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f986c140580 0x7f986c15bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:29.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.956+0000 7f986aa00640 1 -- 172.21.15.107:0/2688737339 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9864009a20 con 0x7f986c0b1440 2024-08-17T02:24:29.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.956+0000 7f986b400640 1 --2- 172.21.15.107:0/2688737339 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f986c140580 0x7f986c15bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:29.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.956+0000 7f986aa00640 1 --2- 172.21.15.107:0/2688737339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f986c0b1440 0x7f986c13c6d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f985c00c610 tx=0x7f985c007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:29.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.957+0000 7f9862a00640 1 -- 172.21.15.107:0/2688737339 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c005aa0 con 0x7f986c0b1440 2024-08-17T02:24:29.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.957+0000 7f9862a00640 1 -- 172.21.15.107:0/2688737339 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985c005c00 con 0x7f986c0b1440 2024-08-17T02:24:29.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.957+0000 7f9871800640 1 -- 172.21.15.107:0/2688737339 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f986c13cc10 con 0x7f986c0b1440 2024-08-17T02:24:29.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.957+0000 7f9862a00640 1 -- 172.21.15.107:0/2688737339 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c0070f0 con 0x7f986c0b1440 2024-08-17T02:24:29.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.957+0000 7f9871800640 1 -- 172.21.15.107:0/2688737339 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f986c15b0b0 con 0x7f986c0b1440 2024-08-17T02:24:29.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.958+0000 7f9871800640 1 -- 172.21.15.107:0/2688737339 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f986c064db0 con 0x7f986c0b1440 2024-08-17T02:24:29.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.958+0000 7f9862a00640 1 -- 172.21.15.107:0/2688737339 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f985c0074e0 con 0x7f986c0b1440 2024-08-17T02:24:29.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.959+0000 7f9862a00640 1 --2- 172.21.15.107:0/2688737339 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f9848065150 0x7f9848067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:29.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.959+0000 7f9862a00640 1 -- 172.21.15.107:0/2688737339 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f985c081fd0 con 0x7f986c0b1440 2024-08-17T02:24:29.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.959+0000 7f9862000640 1 --2- 172.21.15.107:0/2688737339 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f9848065150 0x7f9848067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:29.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.960+0000 7f9862000640 1 --2- 172.21.15.107:0/2688737339 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f9848065150 0x7f9848067600 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f986c15a4f0 tx=0x7f9854008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:29.964 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:29.963+0000 7f9862a00640 1 -- 172.21.15.107:0/2688737339 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f985c050070 con 0x7f986c0b1440 2024-08-17T02:24:30.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.138+0000 7f9871800640 1 -- 172.21.15.107:0/2688737339 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f986c0b0dd0 con 0x7f986c0b1440 2024-08-17T02:24:30.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.139+0000 7f9862a00640 1 -- 172.21.15.107:0/2688737339 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15411 (secure 0 0 0) 0x7f985c053690 con 0x7f986c0b1440 2024-08-17T02:24:30.140 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:24:30.141 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":20,"fsid":"f207b4c0-329d-46b8-b83f-aaf30bdb6ce3","created":"2024-08-17T02:24:11.038049+0000","modified":"2024-08-17T02:24:28.816229+0000","last_up_change":"2024-08-17T02:24:22.047790+0000","last_in_change":"2024-08-17T02:24:13.892720+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:23.456166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:27.078670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:27.804418+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"376363f3-b8bf-4f1e-b691-51cdd39171ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37302},{"type":"v1","addr":"172.21.15.107:6801","nonce":37302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37302},{"type":"v1","addr":"172.21.15.107:6803","nonce":37302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37302},{"type":"v1","addr":"172.21.15.107:6807","nonce":37302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37302},{"type":"v1","addr":"172.21.15.107:6805","nonce":37302}]},"public_addr":"172.21.15.107:6801/37302","cluster_addr":"172.21.15.107:6803/37302","heartbeat_back_addr":"172.21.15.107:6807/37302","heartbeat_front_addr":"172.21.15.107:6805/37302","state":["exists","up"]},{"osd":1,"uuid":"cc6624e3-2ad4-4db4-b377-05dfe57424e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37305},{"type":"v1","addr":"172.21.15.107:6824","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37305},{"type":"v1","addr":"172.21.15.107:6827","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37305},{"type":"v1","addr":"172.21.15.107:6831","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37305},{"type":"v1","addr":"172.21.15.107:6829","nonce":37305}]},"public_addr":"172.21.15.107:6824/37305","cluster_addr":"172.21.15.107:6827/37305","heartbeat_back_addr":"172.21.15.107:6831/37305","heartbeat_front_addr":"172.21.15.107:6829/37305","state":["exists","up"]},{"osd":2,"uuid":"25229542-29b5-4281-bcb0-798ae0930aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37307},{"type":"v1","addr":"172.21.15.107:6817","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37307},{"type":"v1","addr":"172.21.15.107:6819","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6823","nonce":37307},{"type":"v1","addr":"172.21.15.107:6825","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37307},{"type":"v1","addr":"172.21.15.107:6821","nonce":37307}]},"public_addr":"172.21.15.107:6817/37307","cluster_addr":"172.21.15.107:6819/37307","heartbeat_back_addr":"172.21.15.107:6825/37307","heartbeat_front_addr":"172.21.15.107:6821/37307","state":["exists","up"]},{"osd":3,"uuid":"5f16aee8-8950-4268-a61a-5cf6ebd670e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37306},{"type":"v1","addr":"172.21.15.107:6809","nonce":37306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37306},{"type":"v1","addr":"172.21.15.107:6811","nonce":37306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37306},{"type":"v1","addr":"172.21.15.107:6815","nonce":37306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37306},{"type":"v1","addr":"172.21.15.107:6813","nonce":37306}]},"public_addr":"172.21.15.107:6809/37306","cluster_addr":"172.21.15.107:6811/37306","heartbeat_back_addr":"172.21.15.107:6815/37306","heartbeat_front_addr":"172.21.15.107:6813/37306","state":["exists","up"]},{"osd":4,"uuid":"23232e28-e23b-4b4e-a531-4939246dbbde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":37329},{"type":"v1","addr":"172.21.15.157:6817","nonce":37329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":37329},{"type":"v1","addr":"172.21.15.157:6819","nonce":37329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":37329},{"type":"v1","addr":"172.21.15.157:6823","nonce":37329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":37329},{"type":"v1","addr":"172.21.15.157:6821","nonce":37329}]},"public_addr":"172.21.15.157:6817/37329","cluster_addr":"172.21.15.157:6819/37329","heartbeat_back_addr":"172.21.15.157:6823/37329","heartbeat_front_addr":"172.21.15.157:6821/37329","state":["exists","up"]},{"osd":5,"uuid":"f87ec331-3e59-4886-a317-6f7e26ec8e21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":37328},{"type":"v1","addr":"172.21.15.157:6804","nonce":37328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":37328},{"type":"v1","addr":"172.21.15.157:6808","nonce":37328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":37328},{"type":"v1","addr":"172.21.15.157:6815","nonce":37328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":37328},{"type":"v1","addr":"172.21.15.157:6812","nonce":37328}]},"public_addr":"172.21.15.157:6804/37328","cluster_addr":"172.21.15.157:6808/37328","heartbeat_back_addr":"172.21.15.157:6815/37328","heartbeat_front_addr":"172.21.15.157:6812/37328","state":["exists","up"]},{"osd":6,"uuid":"92852235-ce49-4d96-a940-6f18d97b13ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":37330},{"type":"v1","addr":"172.21.15.157:6801","nonce":37330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6803","nonce":37330},{"type":"v1","addr":"172.21.15.157:6805","nonce":37330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":37330},{"type":"v1","addr":"172.21.15.157:6813","nonce":37330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":37330},{"type":"v1","addr":"172.21.15.157:6809","nonce":37330}]},"public_addr":"172.21.15.157:6801/37330","cluster_addr":"172.21.15.157:6805/37330","heartbeat_back_addr":"172.21.15.157:6813/37330","heartbeat_front_addr":"172.21.15.157:6809/37330","state":["exists","up"]},{"osd":7,"uuid":"7484a061-723d-4663-b28f-b01766d62f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":37373},{"type":"v1","addr":"172.21.15.157:6825","nonce":37373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":37373},{"type":"v1","addr":"172.21.15.157:6827","nonce":37373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":37373},{"type":"v1","addr":"172.21.15.157:6831","nonce":37373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":37373},{"type":"v1","addr":"172.21.15.157:6829","nonce":37373}]},"public_addr":"172.21.15.157:6825/37373","cluster_addr":"172.21.15.157:6827/37373","heartbeat_back_addr":"172.21.15.157:6831/37373","heartbeat_front_addr":"172.21.15.157:6829/37373","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.110188+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.280265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.252119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.267996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.284582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.144420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.174764+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.308002+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:30.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.141+0000 7f9871800640 1 -- 172.21.15.107:0/2688737339 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f9848065150 msgr2=0x7f9848067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:30.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.141+0000 7f9871800640 1 --2- 172.21.15.107:0/2688737339 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f9848065150 0x7f9848067600 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f986c15a4f0 tx=0x7f9854008040 comp rx=0 tx=0).stop 2024-08-17T02:24:30.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.141+0000 7f9871800640 1 -- 172.21.15.107:0/2688737339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f986c0b1440 msgr2=0x7f986c13c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:30.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.141+0000 7f9871800640 1 --2- 172.21.15.107:0/2688737339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f986c0b1440 0x7f986c13c6d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f985c00c610 tx=0x7f985c007d60 comp rx=0 tx=0).stop 2024-08-17T02:24:30.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.141+0000 7f9871800640 1 -- 172.21.15.107:0/2688737339 shutdown_connections 2024-08-17T02:24:30.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.141+0000 7f9871800640 1 --2- 172.21.15.107:0/2688737339 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f9848065150 0x7f9848067600 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:30.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.141+0000 7f9871800640 1 --2- 172.21.15.107:0/2688737339 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f986c140580 0x7f986c15bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:30.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.141+0000 7f9871800640 1 --2- 172.21.15.107:0/2688737339 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f986c1401b0 0x7f986c159870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:30.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.141+0000 7f9871800640 1 --2- 172.21.15.107:0/2688737339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f986c0b1440 0x7f986c13c6d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:30.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.141+0000 7f9871800640 1 -- 172.21.15.107:0/2688737339 >> 172.21.15.107:0/2688737339 conn(0x7f986c0cb9b0 msgr2=0x7f986c0c0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:30.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.141+0000 7f9871800640 1 -- 172.21.15.107:0/2688737339 shutdown_connections 2024-08-17T02:24:30.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.142+0000 7f9871800640 1 -- 172.21.15.107:0/2688737339 wait complete. 2024-08-17T02:24:30.157 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-17T02:24:30.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.306+0000 7f229a200640 1 Processor -- start 2024-08-17T02:24:30.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.306+0000 7f229a200640 1 -- start start 2024-08-17T02:24:30.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.307+0000 7f229a200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2294155550 0x7f2294069e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:30.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.307+0000 7f229a200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f22940c7e50 0x7f229406a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:30.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.307+0000 7f229a200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22940c8270 con 0x7f2294069a60 2024-08-17T02:24:30.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.307+0000 7f229a200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f229406d470 con 0x7f22940c7e50 2024-08-17T02:24:30.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.307+0000 7f229a200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22940aec60 con 0x7f2294155550 2024-08-17T02:24:30.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.307+0000 7f2293e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f22940c7e50 0x7f229406a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:30.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.307+0000 7f2293400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f2294069a60 0x7f2294154e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:47838/0 (socket says 172.21.15.107:47838) 2024-08-17T02:24:30.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.307+0000 7f2293400640 1 -- 172.21.15.107:0/484559681 learned_addr learned my addr 172.21.15.107:0/484559681 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:30.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.307+0000 7f228be00640 1 --2- 172.21.15.107:0/484559681 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2294155550 0x7f2294069e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:30.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.308+0000 7f2293e00640 1 -- 172.21.15.107:0/484559681 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2294155550 msgr2=0x7f2294069e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:30.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.308+0000 7f2293e00640 1 --2- 172.21.15.107:0/484559681 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2294155550 0x7f2294069e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:30.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.308+0000 7f2293e00640 1 -- 172.21.15.107:0/484559681 >> v1:172.21.15.107:6789/0 conn(0x7f2294069a60 legacy=0x7f2294154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:30.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.308+0000 7f2293e00640 1 -- 172.21.15.107:0/484559681 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f229406c860 con 0x7f22940c7e50 2024-08-17T02:24:30.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.308+0000 7f2292a00640 1 -- 172.21.15.107:0/484559681 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1176745974 0 0) 0x7f22940c8270 con 0x7f2294069a60 2024-08-17T02:24:30.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.309+0000 7f2293e00640 1 --2- 172.21.15.107:0/484559681 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22940c7e50 0x7f229406a590 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f228c009e60 tx=0x7f228c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5001f0359e7c28a1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:30.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.309+0000 7f2292a00640 1 -- 172.21.15.107:0/484559681 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c007550 con 0x7f22940c7e50 2024-08-17T02:24:30.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.309+0000 7f2292a00640 1 -- 172.21.15.107:0/484559681 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228c02d050 con 0x7f22940c7e50 2024-08-17T02:24:30.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.309+0000 7f2292a00640 1 -- 172.21.15.107:0/484559681 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c0078e0 con 0x7f22940c7e50 2024-08-17T02:24:30.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.309+0000 7f229a200640 1 -- 172.21.15.107:0/484559681 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22940c7e50 msgr2=0x7f229406a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:30.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.309+0000 7f229a200640 1 --2- 172.21.15.107:0/484559681 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22940c7e50 0x7f229406a590 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f228c009e60 tx=0x7f228c009780 comp rx=0 tx=0).stop 2024-08-17T02:24:30.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.310+0000 7f229a200640 1 -- 172.21.15.107:0/484559681 shutdown_connections 2024-08-17T02:24:30.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.310+0000 7f229a200640 1 --2- 172.21.15.107:0/484559681 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22940c7e50 0x7f229406a590 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:30.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.310+0000 7f229a200640 1 --2- 172.21.15.107:0/484559681 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2294155550 0x7f2294069e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:30.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.310+0000 7f229a200640 1 -- 172.21.15.107:0/484559681 >> 172.21.15.107:0/484559681 conn(0x7f2294067750 msgr2=0x7f22940c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:30.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.310+0000 7f229a200640 1 -- 172.21.15.107:0/484559681 shutdown_connections 2024-08-17T02:24:30.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.310+0000 7f229a200640 1 -- 172.21.15.107:0/484559681 wait complete. 2024-08-17T02:24:30.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.311+0000 7f229a200640 1 Processor -- start 2024-08-17T02:24:30.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.311+0000 7f229a200640 1 -- start start 2024-08-17T02:24:30.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.312+0000 7f229a200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2294069a60 0x7f2294169540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:30.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.312+0000 7f229a200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22940c7e50 0x7f2294152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:30.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.312+0000 7f229a200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2294155550 0x7f2294147340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:30.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.312+0000 7f229a200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2294153460 con 0x7f2294155550 2024-08-17T02:24:30.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.312+0000 7f229a200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2294153690 con 0x7f2294069a60 2024-08-17T02:24:30.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.312+0000 7f229a200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2294153970 con 0x7f22940c7e50 2024-08-17T02:24:30.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.312+0000 7f2293e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2294155550 0x7f2294147340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:30.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.312+0000 7f2293e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2294155550 0x7f2294147340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37500/0 (socket says 172.21.15.107:37500) 2024-08-17T02:24:30.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.312+0000 7f2293e00640 1 -- 172.21.15.107:0/2853306343 learned_addr learned my addr 172.21.15.107:0/2853306343 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:30.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.313+0000 7f228be00640 1 --2- 172.21.15.107:0/2853306343 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22940c7e50 0x7f2294152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:30.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.313+0000 7f2293400640 1 --2- 172.21.15.107:0/2853306343 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2294069a60 0x7f2294169540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:30.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.313+0000 7f2293e00640 1 -- 172.21.15.107:0/2853306343 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22940c7e50 msgr2=0x7f2294152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:30.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.313+0000 7f2293e00640 1 --2- 172.21.15.107:0/2853306343 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22940c7e50 0x7f2294152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:30.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.313+0000 7f2293e00640 1 -- 172.21.15.107:0/2853306343 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2294069a60 msgr2=0x7f2294169540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:30.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.313+0000 7f2293e00640 1 --2- 172.21.15.107:0/2853306343 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2294069a60 0x7f2294169540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:30.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.313+0000 7f2293e00640 1 -- 172.21.15.107:0/2853306343 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f228c009a20 con 0x7f2294155550 2024-08-17T02:24:30.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.313+0000 7f2293e00640 1 --2- 172.21.15.107:0/2853306343 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2294155550 0x7f2294147340 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f228c009e60 tx=0x7f228c037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:30.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.313+0000 7f228aa00640 1 -- 172.21.15.107:0/2853306343 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c0319e0 con 0x7f2294155550 2024-08-17T02:24:30.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.313+0000 7f228aa00640 1 -- 172.21.15.107:0/2853306343 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228c040070 con 0x7f2294155550 2024-08-17T02:24:30.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.313+0000 7f228aa00640 1 -- 172.21.15.107:0/2853306343 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c031d50 con 0x7f2294155550 2024-08-17T02:24:30.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.313+0000 7f229a200640 1 -- 172.21.15.107:0/2853306343 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2294153c50 con 0x7f2294155550 2024-08-17T02:24:30.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.314+0000 7f229a200640 1 -- 172.21.15.107:0/2853306343 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2294154210 con 0x7f2294155550 2024-08-17T02:24:30.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.315+0000 7f229a200640 1 -- 172.21.15.107:0/2853306343 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2294071050 con 0x7f2294155550 2024-08-17T02:24:30.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.315+0000 7f228aa00640 1 -- 172.21.15.107:0/2853306343 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f228c042030 con 0x7f2294155550 2024-08-17T02:24:30.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.316+0000 7f228aa00640 1 --2- 172.21.15.107:0/2853306343 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f2270065150 0x7f2270067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:30.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.316+0000 7f228aa00640 1 -- 172.21.15.107:0/2853306343 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f228c0a3d10 con 0x7f2294155550 2024-08-17T02:24:30.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.316+0000 7f2293400640 1 --2- 172.21.15.107:0/2853306343 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f2270065150 0x7f2270067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:30.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.317+0000 7f2293400640 1 --2- 172.21.15.107:0/2853306343 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f2270065150 0x7f2270067600 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f229406cdf0 tx=0x7f2284007ca0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:30.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.320+0000 7f228aa00640 1 -- 172.21.15.107:0/2853306343 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f228c071e80 con 0x7f2294155550 2024-08-17T02:24:30.532 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:30.530+0000 7f229a200640 1 -- 172.21.15.107:0/2853306343 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f229406a370 con 0x7f2294155550 2024-08-17T02:24:31.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.431+0000 7f228aa00640 1 -- 172.21.15.107:0/2853306343 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f228c0754a0 con 0x7f2294155550 2024-08-17T02:24:31.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.434+0000 7f229a200640 1 -- 172.21.15.107:0/2853306343 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f2270065150 msgr2=0x7f2270067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:31.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.434+0000 7f229a200640 1 --2- 172.21.15.107:0/2853306343 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f2270065150 0x7f2270067600 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f229406cdf0 tx=0x7f2284007ca0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.434+0000 7f229a200640 1 -- 172.21.15.107:0/2853306343 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2294155550 msgr2=0x7f2294147340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:31.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.434+0000 7f229a200640 1 --2- 172.21.15.107:0/2853306343 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2294155550 0x7f2294147340 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f228c009e60 tx=0x7f228c037000 comp rx=0 tx=0).stop 2024-08-17T02:24:31.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.434+0000 7f229a200640 1 -- 172.21.15.107:0/2853306343 shutdown_connections 2024-08-17T02:24:31.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.434+0000 7f229a200640 1 --2- 172.21.15.107:0/2853306343 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f2270065150 0x7f2270067600 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.434+0000 7f229a200640 1 --2- 172.21.15.107:0/2853306343 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2294155550 0x7f2294147340 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.434+0000 7f229a200640 1 --2- 172.21.15.107:0/2853306343 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22940c7e50 0x7f2294152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.434+0000 7f229a200640 1 --2- 172.21.15.107:0/2853306343 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2294069a60 0x7f2294169540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.434+0000 7f229a200640 1 -- 172.21.15.107:0/2853306343 >> 172.21.15.107:0/2853306343 conn(0x7f2294067750 msgr2=0x7f22940caff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:31.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.434+0000 7f229a200640 1 -- 172.21.15.107:0/2853306343 shutdown_connections 2024-08-17T02:24:31.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.434+0000 7f229a200640 1 -- 172.21.15.107:0/2853306343 wait complete. 2024-08-17T02:24:31.452 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-17T02:24:31.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.606+0000 7f6f8c000640 1 Processor -- start 2024-08-17T02:24:31.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.606+0000 7f6f8c000640 1 -- start start 2024-08-17T02:24:31.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.607+0000 7f6f8c000640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6f8406d7d0 0x7f6f8406ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:31.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.607+0000 7f6f8c000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6f8406dba0 0x7f6f84169810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:31.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.607+0000 7f6f8c000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6f84169d50 0x7f6f8416a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:31.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.607+0000 7f6f8c000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f8416a6d0 con 0x7f6f8406dba0 2024-08-17T02:24:31.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.607+0000 7f6f8c000640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f8406e4b0 con 0x7f6f8406d7d0 2024-08-17T02:24:31.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.607+0000 7f6f8c000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f840b09c0 con 0x7f6f84169d50 2024-08-17T02:24:31.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.608+0000 7f6f88c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6f8406dba0 0x7f6f84169810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:31.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.608+0000 7f6f88c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6f8406dba0 0x7f6f84169810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37512/0 (socket says 172.21.15.107:37512) 2024-08-17T02:24:31.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.608+0000 7f6f88c00640 1 -- 172.21.15.107:0/604755090 learned_addr learned my addr 172.21.15.107:0/604755090 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:31.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.608+0000 7f6f89600640 1 --2- 172.21.15.107:0/604755090 >> v2:172.21.15.157:3300/0 conn(0x7f6f8406d7d0 0x7f6f8406ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:31.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.608+0000 7f6f8a000640 1 --2- 172.21.15.107:0/604755090 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6f84169d50 0x7f6f8416a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:31.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.659+0000 7f6f88c00640 1 -- 172.21.15.107:0/604755090 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6f84169d50 msgr2=0x7f6f8416a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:31.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.659+0000 7f6f88c00640 1 --2- 172.21.15.107:0/604755090 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6f84169d50 0x7f6f8416a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.659+0000 7f6f88c00640 1 -- 172.21.15.107:0/604755090 >> v2:172.21.15.157:3300/0 conn(0x7f6f8406d7d0 msgr2=0x7f6f8406ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:31.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.659+0000 7f6f88c00640 1 --2- 172.21.15.107:0/604755090 >> v2:172.21.15.157:3300/0 conn(0x7f6f8406d7d0 0x7f6f8406ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.659+0000 7f6f88c00640 1 -- 172.21.15.107:0/604755090 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f84068820 con 0x7f6f8406dba0 2024-08-17T02:24:31.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.660+0000 7f6f88c00640 1 --2- 172.21.15.107:0/604755090 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6f8406dba0 0x7f6f84169810 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6f84063be0 tx=0x7f6f7000c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77e6a985316e1453 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:31.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.660+0000 7f6f83e00640 1 -- 172.21.15.107:0/604755090 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7002ad30 con 0x7f6f8406dba0 2024-08-17T02:24:31.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.660+0000 7f6f83e00640 1 -- 172.21.15.107:0/604755090 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f7002ae90 con 0x7f6f8406dba0 2024-08-17T02:24:31.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.660+0000 7f6f83e00640 1 -- 172.21.15.107:0/604755090 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f70008c10 con 0x7f6f8406dba0 2024-08-17T02:24:31.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.660+0000 7f6f8c000640 1 -- 172.21.15.107:0/604755090 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6f8406dba0 msgr2=0x7f6f84169810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:31.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.660+0000 7f6f8c000640 1 --2- 172.21.15.107:0/604755090 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6f8406dba0 0x7f6f84169810 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6f84063be0 tx=0x7f6f7000c040 comp rx=0 tx=0).stop 2024-08-17T02:24:31.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.661+0000 7f6f8c000640 1 -- 172.21.15.107:0/604755090 shutdown_connections 2024-08-17T02:24:31.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.661+0000 7f6f8c000640 1 --2- 172.21.15.107:0/604755090 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6f8406dba0 0x7f6f84169810 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.661+0000 7f6f8c000640 1 --2- 172.21.15.107:0/604755090 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6f84169d50 0x7f6f8416a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.661+0000 7f6f8c000640 1 --2- 172.21.15.107:0/604755090 >> v2:172.21.15.157:3300/0 conn(0x7f6f8406d7d0 0x7f6f8406ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.661+0000 7f6f8c000640 1 -- 172.21.15.107:0/604755090 >> 172.21.15.107:0/604755090 conn(0x7f6f840c84c0 msgr2=0x7f6f840c8890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:31.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.661+0000 7f6f8c000640 1 -- 172.21.15.107:0/604755090 shutdown_connections 2024-08-17T02:24:31.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.661+0000 7f6f8c000640 1 -- 172.21.15.107:0/604755090 wait complete. 2024-08-17T02:24:31.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.662+0000 7f6f8c000640 1 Processor -- start 2024-08-17T02:24:31.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.662+0000 7f6f8c000640 1 -- start start 2024-08-17T02:24:31.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.663+0000 7f6f8c000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f8406d7d0 0x7f6f840ad4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:31.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.663+0000 7f6f8c000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6f8406dba0 0x7f6f840aa360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:31.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.663+0000 7f6f8c000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6f84169d50 0x7f6f84178fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:31.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.663+0000 7f6f8c000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f84179c00 con 0x7f6f84169d50 2024-08-17T02:24:31.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.663+0000 7f6f8c000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f840a9ed0 con 0x7f6f8406d7d0 2024-08-17T02:24:31.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.663+0000 7f6f8c000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f840a7e30 con 0x7f6f8406dba0 2024-08-17T02:24:31.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.663+0000 7f6f8a000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6f84169d50 0x7f6f84178fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:31.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.663+0000 7f6f8a000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6f84169d50 0x7f6f84178fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37526/0 (socket says 172.21.15.107:37526) 2024-08-17T02:24:31.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.664+0000 7f6f8a000640 1 -- 172.21.15.107:0/4022088698 learned_addr learned my addr 172.21.15.107:0/4022088698 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:31.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.664+0000 7f6f89600640 1 --2- 172.21.15.107:0/4022088698 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f8406d7d0 0x7f6f840ad4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:31.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.664+0000 7f6f88c00640 1 --2- 172.21.15.107:0/4022088698 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6f8406dba0 0x7f6f840aa360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:31.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.664+0000 7f6f8a000640 1 -- 172.21.15.107:0/4022088698 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6f8406dba0 msgr2=0x7f6f840aa360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:31.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.664+0000 7f6f8a000640 1 --2- 172.21.15.107:0/4022088698 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6f8406dba0 0x7f6f840aa360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.664+0000 7f6f8a000640 1 -- 172.21.15.107:0/4022088698 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f8406d7d0 msgr2=0x7f6f840ad4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:31.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.664+0000 7f6f8a000640 1 --2- 172.21.15.107:0/4022088698 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f8406d7d0 0x7f6f840ad4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.664+0000 7f6f8a000640 1 -- 172.21.15.107:0/4022088698 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f70008050 con 0x7f6f84169d50 2024-08-17T02:24:31.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.664+0000 7f6f8a000640 1 --2- 172.21.15.107:0/4022088698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6f84169d50 0x7f6f84178fb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c00fa60 tx=0x7f6f7c008f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:31.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.664+0000 7f6f80c00640 1 -- 172.21.15.107:0/4022088698 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c00daa0 con 0x7f6f84169d50 2024-08-17T02:24:31.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.664+0000 7f6f80c00640 1 -- 172.21.15.107:0/4022088698 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f7c00dc00 con 0x7f6f84169d50 2024-08-17T02:24:31.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.664+0000 7f6f8c000640 1 -- 172.21.15.107:0/4022088698 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f840a9880 con 0x7f6f84169d50 2024-08-17T02:24:31.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.665+0000 7f6f80c00640 1 -- 172.21.15.107:0/4022088698 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c013440 con 0x7f6f84169d50 2024-08-17T02:24:31.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.665+0000 7f6f8c000640 1 -- 172.21.15.107:0/4022088698 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f840ada30 con 0x7f6f84169d50 2024-08-17T02:24:31.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.666+0000 7f6f8c000640 1 -- 172.21.15.107:0/4022088698 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f840aa060 con 0x7f6f84169d50 2024-08-17T02:24:31.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.666+0000 7f6f80c00640 1 -- 172.21.15.107:0/4022088698 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6f7c013830 con 0x7f6f84169d50 2024-08-17T02:24:31.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.667+0000 7f6f80c00640 1 --2- 172.21.15.107:0/4022088698 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6f64065150 0x7f6f64067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:31.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.667+0000 7f6f80c00640 1 -- 172.21.15.107:0/4022088698 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6f7c082a20 con 0x7f6f84169d50 2024-08-17T02:24:31.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.667+0000 7f6f89600640 1 --2- 172.21.15.107:0/4022088698 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6f64065150 0x7f6f64067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:31.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.668+0000 7f6f89600640 1 --2- 172.21.15.107:0/4022088698 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6f64065150 0x7f6f64067600 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6f78015510 tx=0x7f6f7800f040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:31.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.672+0000 7f6f80c00640 1 -- 172.21.15.107:0/4022088698 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6f7c050b90 con 0x7f6f84169d50 2024-08-17T02:24:31.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:31.879+0000 7f6f8c000640 1 -- 172.21.15.107:0/4022088698 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6f84071050 con 0x7f6f84169d50 2024-08-17T02:24:32.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.432+0000 7f6f80c00640 1 -- 172.21.15.107:0/4022088698 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6f7c021020 con 0x7f6f84169d50 2024-08-17T02:24:32.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.434+0000 7f6f8c000640 1 -- 172.21.15.107:0/4022088698 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6f64065150 msgr2=0x7f6f64067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:32.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.434+0000 7f6f8c000640 1 --2- 172.21.15.107:0/4022088698 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6f64065150 0x7f6f64067600 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6f78015510 tx=0x7f6f7800f040 comp rx=0 tx=0).stop 2024-08-17T02:24:32.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.434+0000 7f6f8c000640 1 -- 172.21.15.107:0/4022088698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6f84169d50 msgr2=0x7f6f84178fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:32.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.434+0000 7f6f8c000640 1 --2- 172.21.15.107:0/4022088698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6f84169d50 0x7f6f84178fb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c00fa60 tx=0x7f6f7c008f90 comp rx=0 tx=0).stop 2024-08-17T02:24:32.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.434+0000 7f6f8c000640 1 -- 172.21.15.107:0/4022088698 shutdown_connections 2024-08-17T02:24:32.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.434+0000 7f6f8c000640 1 --2- 172.21.15.107:0/4022088698 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6f64065150 0x7f6f64067600 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.434+0000 7f6f8c000640 1 --2- 172.21.15.107:0/4022088698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6f84169d50 0x7f6f84178fb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.434+0000 7f6f8c000640 1 --2- 172.21.15.107:0/4022088698 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6f8406dba0 0x7f6f840aa360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.434+0000 7f6f8c000640 1 --2- 172.21.15.107:0/4022088698 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f8406d7d0 0x7f6f840ad4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.434+0000 7f6f8c000640 1 -- 172.21.15.107:0/4022088698 >> 172.21.15.107:0/4022088698 conn(0x7f6f840c84c0 msgr2=0x7f6f84068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:32.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.434+0000 7f6f8c000640 1 -- 172.21.15.107:0/4022088698 shutdown_connections 2024-08-17T02:24:32.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.434+0000 7f6f8c000640 1 -- 172.21.15.107:0/4022088698 wait complete. 2024-08-17T02:24:32.451 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:24:32.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.597+0000 7f6764000640 1 Processor -- start 2024-08-17T02:24:32.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.597+0000 7f6764000640 1 -- start start 2024-08-17T02:24:32.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.598+0000 7f6764000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f675c0c68c0 0x7f675c0cb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:32.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.598+0000 7f6764000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f675c0ceb20 con 0x7f675c0d08d0 2024-08-17T02:24:32.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.598+0000 7f6764000640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f675c0cede0 con 0x7f675c158ce0 2024-08-17T02:24:32.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.598+0000 7f6764000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f675c0cf0c0 con 0x7f675c0c68c0 2024-08-17T02:24:32.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.598+0000 7f6760c00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f675c0d08d0 0x7f675c0c5520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:47840/0 (socket says 172.21.15.107:47840) 2024-08-17T02:24:32.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.598+0000 7f6760c00640 1 -- 172.21.15.107:0/3898293096 learned_addr learned my addr 172.21.15.107:0/3898293096 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:32.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.599+0000 7f6762000640 1 --2- 172.21.15.107:0/3898293096 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f675c0c68c0 0x7f675c0cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:32.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.599+0000 7f675be00640 1 -- 172.21.15.107:0/3898293096 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1726664107 0 0) 0x7f675c0ceb20 con 0x7f675c0d08d0 2024-08-17T02:24:32.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.599+0000 7f675be00640 1 -- 172.21.15.107:0/3898293096 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67440034e0 con 0x7f675c0d08d0 2024-08-17T02:24:32.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.599+0000 7f675be00640 1 -- 172.21.15.107:0/3898293096 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2565196854 0 0) 0x7f675c0cede0 con 0x7f675c158ce0 2024-08-17T02:24:32.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.599+0000 7f675be00640 1 -- 172.21.15.107:0/3898293096 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f675c0ceb20 con 0x7f675c158ce0 2024-08-17T02:24:32.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.599+0000 7f675be00640 1 -- 172.21.15.107:0/3898293096 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3375267580 0 0) 0x7f67440034e0 con 0x7f675c0d08d0 2024-08-17T02:24:32.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.599+0000 7f675be00640 1 -- 172.21.15.107:0/3898293096 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f675c0c68c0 msgr2=0x7f675c0cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:32.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.599+0000 7f675be00640 1 --2- 172.21.15.107:0/3898293096 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f675c0c68c0 0x7f675c0cb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.599+0000 7f675be00640 1 -- 172.21.15.107:0/3898293096 >> v1:172.21.15.157:6789/0 conn(0x7f675c158ce0 legacy=0x7f675c0cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:32.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.599+0000 7f675be00640 1 -- 172.21.15.107:0/3898293096 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f675c0cba10 con 0x7f675c0d08d0 2024-08-17T02:24:32.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.599+0000 7f675be00640 1 -- 172.21.15.107:0/3898293096 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 537989081 0 0) 0x7f6748001470 con 0x7f675c0d08d0 2024-08-17T02:24:32.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.599+0000 7f6762000640 1 --2- 172.21.15.107:0/3898293096 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f675c0c68c0 0x7f675c0cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:32.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.599+0000 7f675be00640 1 -- 172.21.15.107:0/3898293096 >> v1:172.21.15.107:6789/0 conn(0x7f675c0d08d0 legacy=0x7f675c0c5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:32.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.599+0000 7f675be00640 1 --2- 172.21.15.107:0/3898293096 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f675c0c68c0 0x7f6744003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:32.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.599+0000 7f675be00640 1 --2- 172.21.15.107:0/3898293096 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6744004120 0x7f6744004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:32.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.599+0000 7f675be00640 1 --2- 172.21.15.107:0/3898293096 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6744004cc0 0x7f6744005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:32.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.599+0000 7f675be00640 1 -- 172.21.15.107:0/3898293096 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f675c0cf0c0 con 0x7f6744004120 2024-08-17T02:24:32.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.599+0000 7f675be00640 1 -- 172.21.15.107:0/3898293096 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f674400bb60 con 0x7f6744004cc0 2024-08-17T02:24:32.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.599+0000 7f675be00640 1 -- 172.21.15.107:0/3898293096 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f674400bd20 con 0x7f675c0c68c0 2024-08-17T02:24:32.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.600+0000 7f6760c00640 1 --2- 172.21.15.107:0/3898293096 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6744004120 0x7f6744004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:32.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.600+0000 7f6761600640 1 --2- 172.21.15.107:0/3898293096 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f675c0c68c0 0x7f6744003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:32.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.600+0000 7f6762000640 1 --2- 172.21.15.107:0/3898293096 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6744004cc0 0x7f6744005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:32.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.600+0000 7f6760c00640 1 -- 172.21.15.107:0/3898293096 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f675c0c68c0 msgr2=0x7f6744003b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:32.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.600+0000 7f6760c00640 1 --2- 172.21.15.107:0/3898293096 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f675c0c68c0 0x7f6744003b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.600+0000 7f6760c00640 1 -- 172.21.15.107:0/3898293096 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6744004cc0 msgr2=0x7f6744005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:32.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.600+0000 7f6760c00640 1 --2- 172.21.15.107:0/3898293096 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6744004cc0 0x7f6744005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.600+0000 7f6760c00640 1 -- 172.21.15.107:0/3898293096 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6754009a20 con 0x7f6744004120 2024-08-17T02:24:32.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.600+0000 7f6762000640 1 --2- 172.21.15.107:0/3898293096 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6744004cc0 0x7f6744005130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:32.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.601+0000 7f6760c00640 1 --2- 172.21.15.107:0/3898293096 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6744004120 0x7f6744004780 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f674800c190 tx=0x7f6748001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=634f2811b66437ab server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:32.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.601+0000 7f675be00640 1 -- 172.21.15.107:0/3898293096 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6748005960 con 0x7f6744004120 2024-08-17T02:24:32.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.601+0000 7f675be00640 1 -- 172.21.15.107:0/3898293096 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674802d070 con 0x7f6744004120 2024-08-17T02:24:32.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.601+0000 7f675be00640 1 -- 172.21.15.107:0/3898293096 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6748005b20 con 0x7f6744004120 2024-08-17T02:24:32.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.602+0000 7f6764000640 1 -- 172.21.15.107:0/3898293096 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6744004120 msgr2=0x7f6744004780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:32.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.602+0000 7f6764000640 1 --2- 172.21.15.107:0/3898293096 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6744004120 0x7f6744004780 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f674800c190 tx=0x7f6748001d40 comp rx=0 tx=0).stop 2024-08-17T02:24:32.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.602+0000 7f6762000640 1 -- 172.21.15.107:0/3898293096 reap_dead start 2024-08-17T02:24:32.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.602+0000 7f6764000640 1 -- 172.21.15.107:0/3898293096 shutdown_connections 2024-08-17T02:24:32.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.602+0000 7f6764000640 1 -- 172.21.15.107:0/3898293096 >> 172.21.15.107:0/3898293096 conn(0x7f675c0cfdc0 msgr2=0x7f675c0d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:32.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.602+0000 7f6764000640 1 -- 172.21.15.107:0/3898293096 shutdown_connections 2024-08-17T02:24:32.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.602+0000 7f6764000640 1 -- 172.21.15.107:0/3898293096 wait complete. 2024-08-17T02:24:32.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.603+0000 7f6764000640 1 Processor -- start 2024-08-17T02:24:32.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.603+0000 7f6764000640 1 -- start start 2024-08-17T02:24:32.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.604+0000 7f6764000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6744004120 0x7f675c15d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:32.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.604+0000 7f6764000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f675c169780 0x7f675c0b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:32.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.604+0000 7f6764000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f675c0b51f0 0x7f675c16c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:32.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.604+0000 7f6764000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f675c0b5670 con 0x7f675c0b51f0 2024-08-17T02:24:32.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.604+0000 7f6764000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f675c1692f0 con 0x7f6744004120 2024-08-17T02:24:32.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.604+0000 7f6764000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f675c1689e0 con 0x7f675c169780 2024-08-17T02:24:32.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.604+0000 7f6762000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f675c0b51f0 0x7f675c16c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:32.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.605+0000 7f6762000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f675c0b51f0 0x7f675c16c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37546/0 (socket says 172.21.15.107:37546) 2024-08-17T02:24:32.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.605+0000 7f6762000640 1 -- 172.21.15.107:0/4264140891 learned_addr learned my addr 172.21.15.107:0/4264140891 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:32.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.605+0000 7f6761600640 1 --2- 172.21.15.107:0/4264140891 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6744004120 0x7f675c15d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:32.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.605+0000 7f6760c00640 1 --2- 172.21.15.107:0/4264140891 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f675c169780 0x7f675c0b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:32.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.605+0000 7f6762000640 1 -- 172.21.15.107:0/4264140891 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f675c169780 msgr2=0x7f675c0b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:32.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.605+0000 7f6762000640 1 --2- 172.21.15.107:0/4264140891 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f675c169780 0x7f675c0b4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.605+0000 7f6762000640 1 -- 172.21.15.107:0/4264140891 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6744004120 msgr2=0x7f675c15d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:32.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.605+0000 7f6762000640 1 --2- 172.21.15.107:0/4264140891 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6744004120 0x7f675c15d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.605+0000 7f6762000640 1 -- 172.21.15.107:0/4264140891 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f675c15e310 con 0x7f675c0b51f0 2024-08-17T02:24:32.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.605+0000 7f6760c00640 1 --2- 172.21.15.107:0/4264140891 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f675c169780 0x7f675c0b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:32.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.605+0000 7f6762000640 1 --2- 172.21.15.107:0/4264140891 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f675c0b51f0 0x7f675c16c3b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f675c064490 tx=0x7f675400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:32.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.605+0000 7f6758c00640 1 -- 172.21.15.107:0/4264140891 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675400f750 con 0x7f675c0b51f0 2024-08-17T02:24:32.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.605+0000 7f6758c00640 1 -- 172.21.15.107:0/4264140891 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f675400f8b0 con 0x7f675c0b51f0 2024-08-17T02:24:32.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.605+0000 7f6758c00640 1 -- 172.21.15.107:0/4264140891 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675400fc70 con 0x7f675c0b51f0 2024-08-17T02:24:32.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.605+0000 7f6764000640 1 -- 172.21.15.107:0/4264140891 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f675c168ca0 con 0x7f675c0b51f0 2024-08-17T02:24:32.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.606+0000 7f6764000640 1 -- 172.21.15.107:0/4264140891 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f675c15deb0 con 0x7f675c0b51f0 2024-08-17T02:24:32.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.607+0000 7f6764000640 1 -- 172.21.15.107:0/4264140891 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f675c169480 con 0x7f675c0b51f0 2024-08-17T02:24:32.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.607+0000 7f6758c00640 1 -- 172.21.15.107:0/4264140891 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6754014410 con 0x7f675c0b51f0 2024-08-17T02:24:32.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.608+0000 7f6758c00640 1 --2- 172.21.15.107:0/4264140891 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f673c065180 0x7f673c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:32.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.608+0000 7f6758c00640 1 -- 172.21.15.107:0/4264140891 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6754082870 con 0x7f675c0b51f0 2024-08-17T02:24:32.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.608+0000 7f6761600640 1 --2- 172.21.15.107:0/4264140891 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f673c065180 0x7f673c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:32.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.609+0000 7f6761600640 1 --2- 172.21.15.107:0/4264140891 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f673c065180 0x7f673c067630 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6750007fd0 tx=0x7f6750009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:32.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.612+0000 7f6758c00640 1 -- 172.21.15.107:0/4264140891 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f67540509e0 con 0x7f675c0b51f0 2024-08-17T02:24:32.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.819+0000 7f6764000640 1 -- 172.21.15.107:0/4264140891 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f675c064db0 con 0x7f675c0b51f0 2024-08-17T02:24:32.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.820+0000 7f6758c00640 1 -- 172.21.15.107:0/4264140891 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f675401c020 con 0x7f675c0b51f0 2024-08-17T02:24:32.821 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:24:32.821 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1386798018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1386798018},{"type":"v1","addr":"172.21.15.107:6835","nonce":1386798018}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6834/287524804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":287524804},{"type":"v1","addr":"172.21.15.157:6834","nonce":287524804}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1183198496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1183198496},{"type":"v1","addr":"172.21.15.107:6837","nonce":1183198496}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:28.816556+0000","modified":"2024-08-17T02:24:32.431137+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6835/1985555291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6833","nonce":1985555291},{"type":"v1","addr":"172.21.15.157:6835","nonce":1985555291}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:24:32.821 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 8 2024-08-17T02:24:32.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.822+0000 7f6764000640 1 -- 172.21.15.107:0/4264140891 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f673c065180 msgr2=0x7f673c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:32.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.822+0000 7f6764000640 1 --2- 172.21.15.107:0/4264140891 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f673c065180 0x7f673c067630 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6750007fd0 tx=0x7f6750009040 comp rx=0 tx=0).stop 2024-08-17T02:24:32.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.822+0000 7f6764000640 1 -- 172.21.15.107:0/4264140891 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f675c0b51f0 msgr2=0x7f675c16c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:32.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.822+0000 7f6764000640 1 --2- 172.21.15.107:0/4264140891 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f675c0b51f0 0x7f675c16c3b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f675c064490 tx=0x7f675400b040 comp rx=0 tx=0).stop 2024-08-17T02:24:32.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.822+0000 7f6764000640 1 -- 172.21.15.107:0/4264140891 shutdown_connections 2024-08-17T02:24:32.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.822+0000 7f6764000640 1 --2- 172.21.15.107:0/4264140891 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f673c065180 0x7f673c067630 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.822+0000 7f6764000640 1 --2- 172.21.15.107:0/4264140891 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f675c0b51f0 0x7f675c16c3b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.822+0000 7f6764000640 1 --2- 172.21.15.107:0/4264140891 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f675c169780 0x7f675c0b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.822+0000 7f6764000640 1 --2- 172.21.15.107:0/4264140891 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6744004120 0x7f675c15d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.822+0000 7f6764000640 1 -- 172.21.15.107:0/4264140891 >> 172.21.15.107:0/4264140891 conn(0x7f675c0cfdc0 msgr2=0x7f675c0c61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:32.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.822+0000 7f6764000640 1 -- 172.21.15.107:0/4264140891 shutdown_connections 2024-08-17T02:24:32.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.822+0000 7f6764000640 1 -- 172.21.15.107:0/4264140891 wait complete. 2024-08-17T02:24:32.839 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:32.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.984+0000 7fc021e00640 1 Processor -- start 2024-08-17T02:24:32.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.984+0000 7fc021e00640 1 -- start start 2024-08-17T02:24:32.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.986+0000 7fc021e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc01c06df00 0x7fc01c0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:32.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.986+0000 7fc021e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc01c156670 con 0x7fc01c155a20 2024-08-17T02:24:32.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.986+0000 7fc021e00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc01c06e5e0 con 0x7fc01c155df0 2024-08-17T02:24:32.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.986+0000 7fc021e00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc01c0b0350 con 0x7fc01c06df00 2024-08-17T02:24:32.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.986+0000 7fc01aa00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fc01c155a20 0x7fc01c06d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:47850/0 (socket says 172.21.15.107:47850) 2024-08-17T02:24:32.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.986+0000 7fc01aa00640 1 -- 172.21.15.107:0/284359643 learned_addr learned my addr 172.21.15.107:0/284359643 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:32.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.986+0000 7fc012000640 1 --2- 172.21.15.107:0/284359643 >> v2:172.21.15.157:3300/0 conn(0x7fc01c06df00 0x7fc01c0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:32.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.986+0000 7fc01a000640 1 -- 172.21.15.107:0/284359643 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 394291627 0 0) 0x7fc01c156670 con 0x7fc01c155a20 2024-08-17T02:24:32.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.986+0000 7fc01a000640 1 -- 172.21.15.107:0/284359643 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0000034e0 con 0x7fc01c155a20 2024-08-17T02:24:32.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.986+0000 7fc012000640 1 -- 172.21.15.107:0/284359643 >> v1:172.21.15.157:6789/0 conn(0x7fc01c155df0 legacy=0x7fc01c156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:32.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.987+0000 7fc012000640 1 -- 172.21.15.107:0/284359643 >> v1:172.21.15.107:6789/0 conn(0x7fc01c155a20 legacy=0x7fc01c06d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:32.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.987+0000 7fc012000640 1 -- 172.21.15.107:0/284359643 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc01c06e8c0 con 0x7fc01c06df00 2024-08-17T02:24:32.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.988+0000 7fc012000640 1 --2- 172.21.15.107:0/284359643 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc01c06df00 0x7fc01c0adf10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc004009850 tx=0x7fc0040090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=741af3e4da9a6e89 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:32.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.988+0000 7fc01a000640 1 -- 172.21.15.107:0/284359643 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00402ad90 con 0x7fc01c06df00 2024-08-17T02:24:32.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.988+0000 7fc01a000640 1 -- 172.21.15.107:0/284359643 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc004032440 con 0x7fc01c06df00 2024-08-17T02:24:32.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.988+0000 7fc01a000640 1 -- 172.21.15.107:0/284359643 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0040327c0 con 0x7fc01c06df00 2024-08-17T02:24:32.990 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.988+0000 7fc021e00640 1 -- 172.21.15.107:0/284359643 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc01c06df00 msgr2=0x7fc01c0adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:32.990 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.988+0000 7fc021e00640 1 --2- 172.21.15.107:0/284359643 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc01c06df00 0x7fc01c0adf10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc004009850 tx=0x7fc0040090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.990 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.989+0000 7fc021e00640 1 -- 172.21.15.107:0/284359643 shutdown_connections 2024-08-17T02:24:32.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.989+0000 7fc021e00640 1 --2- 172.21.15.107:0/284359643 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc01c06df00 0x7fc01c0adf10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.989+0000 7fc021e00640 1 -- 172.21.15.107:0/284359643 >> 172.21.15.107:0/284359643 conn(0x7fc01c0cb9b0 msgr2=0x7fc01c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:32.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.989+0000 7fc021e00640 1 -- 172.21.15.107:0/284359643 shutdown_connections 2024-08-17T02:24:32.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.989+0000 7fc021e00640 1 -- 172.21.15.107:0/284359643 wait complete. 2024-08-17T02:24:32.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.990+0000 7fc021e00640 1 Processor -- start 2024-08-17T02:24:32.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.990+0000 7fc021e00640 1 -- start start 2024-08-17T02:24:32.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.991+0000 7fc021e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc01c06df00 0x7fc01c151790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:32.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.991+0000 7fc021e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc01c155a20 0x7fc01c15cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:32.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.991+0000 7fc021e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc01c155df0 0x7fc01c152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:32.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.991+0000 7fc021e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c15d390 con 0x7fc01c06df00 2024-08-17T02:24:32.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.991+0000 7fc021e00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c16a570 con 0x7fc01c155df0 2024-08-17T02:24:32.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.991+0000 7fc021e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c151cd0 con 0x7fc01c155a20 2024-08-17T02:24:32.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.991+0000 7fc01aa00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc01c06df00 0x7fc01c151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:32.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.991+0000 7fc01aa00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc01c06df00 0x7fc01c151790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37556/0 (socket says 172.21.15.107:37556) 2024-08-17T02:24:32.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.991+0000 7fc01aa00640 1 -- 172.21.15.107:0/2340338664 learned_addr learned my addr 172.21.15.107:0/2340338664 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:32.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.992+0000 7fc01b400640 1 --2- 172.21.15.107:0/2340338664 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc01c155df0 0x7fc01c152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:32.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.992+0000 7fc012000640 1 --2- 172.21.15.107:0/2340338664 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc01c155a20 0x7fc01c15cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:32.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.992+0000 7fc01aa00640 1 -- 172.21.15.107:0/2340338664 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc01c155a20 msgr2=0x7fc01c15cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:32.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.992+0000 7fc01aa00640 1 --2- 172.21.15.107:0/2340338664 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc01c155a20 0x7fc01c15cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.992+0000 7fc01aa00640 1 -- 172.21.15.107:0/2340338664 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc01c155df0 msgr2=0x7fc01c152110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:32.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.992+0000 7fc01aa00640 1 --2- 172.21.15.107:0/2340338664 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc01c155df0 0x7fc01c152110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:32.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.992+0000 7fc01aa00640 1 -- 172.21.15.107:0/2340338664 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc004009390 con 0x7fc01c06df00 2024-08-17T02:24:32.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.992+0000 7fc01aa00640 1 --2- 172.21.15.107:0/2340338664 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc01c06df00 0x7fc01c151790 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc00c00c5e0 tx=0x7fc00c007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:32.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.992+0000 7fc012a00640 1 -- 172.21.15.107:0/2340338664 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00c005b70 con 0x7fc01c06df00 2024-08-17T02:24:32.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.992+0000 7fc012a00640 1 -- 172.21.15.107:0/2340338664 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00c005cf0 con 0x7fc01c06df00 2024-08-17T02:24:32.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.992+0000 7fc012a00640 1 -- 172.21.15.107:0/2340338664 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00c005ea0 con 0x7fc01c06df00 2024-08-17T02:24:32.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.992+0000 7fc021e00640 1 -- 172.21.15.107:0/2340338664 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc01c16a0e0 con 0x7fc01c06df00 2024-08-17T02:24:32.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.992+0000 7fc021e00640 1 -- 172.21.15.107:0/2340338664 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc01c169a90 con 0x7fc01c06df00 2024-08-17T02:24:32.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.993+0000 7fc021e00640 1 -- 172.21.15.107:0/2340338664 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc01c064db0 con 0x7fc01c06df00 2024-08-17T02:24:32.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.994+0000 7fc012a00640 1 -- 172.21.15.107:0/2340338664 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc00c01b400 con 0x7fc01c06df00 2024-08-17T02:24:32.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.995+0000 7fc012a00640 1 --2- 172.21.15.107:0/2340338664 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbff8065150 0x7fbff8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:32.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.995+0000 7fc012a00640 1 -- 172.21.15.107:0/2340338664 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc00c081f40 con 0x7fc01c06df00 2024-08-17T02:24:32.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.995+0000 7fc012000640 1 --2- 172.21.15.107:0/2340338664 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbff8065150 0x7fbff8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:32.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.996+0000 7fc012000640 1 --2- 172.21.15.107:0/2340338664 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbff8065150 0x7fbff8067600 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc004034000 tx=0x7fc004032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:33.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:32.999+0000 7fc012a00640 1 -- 172.21.15.107:0/2340338664 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc00c04ffe0 con 0x7fc01c06df00 2024-08-17T02:24:33.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.171+0000 7fc021e00640 1 -- 172.21.15.107:0/2340338664 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc01c06d6f0 con 0x7fc01c06df00 2024-08-17T02:24:33.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.172+0000 7fc012a00640 1 -- 172.21.15.107:0/2340338664 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fc00c053600 con 0x7fc01c06df00 2024-08-17T02:24:33.174 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:24:33.174 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":21,"fsid":"f207b4c0-329d-46b8-b83f-aaf30bdb6ce3","created":"2024-08-17T02:24:11.038049+0000","modified":"2024-08-17T02:24:30.420018+0000","last_up_change":"2024-08-17T02:24:22.047790+0000","last_in_change":"2024-08-17T02:24:13.892720+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:23.456166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:27.078670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:27.804418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"376363f3-b8bf-4f1e-b691-51cdd39171ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37302},{"type":"v1","addr":"172.21.15.107:6801","nonce":37302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37302},{"type":"v1","addr":"172.21.15.107:6803","nonce":37302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37302},{"type":"v1","addr":"172.21.15.107:6807","nonce":37302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37302},{"type":"v1","addr":"172.21.15.107:6805","nonce":37302}]},"public_addr":"172.21.15.107:6801/37302","cluster_addr":"172.21.15.107:6803/37302","heartbeat_back_addr":"172.21.15.107:6807/37302","heartbeat_front_addr":"172.21.15.107:6805/37302","state":["exists","up"]},{"osd":1,"uuid":"cc6624e3-2ad4-4db4-b377-05dfe57424e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37305},{"type":"v1","addr":"172.21.15.107:6824","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37305},{"type":"v1","addr":"172.21.15.107:6827","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37305},{"type":"v1","addr":"172.21.15.107:6831","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37305},{"type":"v1","addr":"172.21.15.107:6829","nonce":37305}]},"public_addr":"172.21.15.107:6824/37305","cluster_addr":"172.21.15.107:6827/37305","heartbeat_back_addr":"172.21.15.107:6831/37305","heartbeat_front_addr":"172.21.15.107:6829/37305","state":["exists","up"]},{"osd":2,"uuid":"25229542-29b5-4281-bcb0-798ae0930aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37307},{"type":"v1","addr":"172.21.15.107:6817","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37307},{"type":"v1","addr":"172.21.15.107:6819","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6823","nonce":37307},{"type":"v1","addr":"172.21.15.107:6825","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37307},{"type":"v1","addr":"172.21.15.107:6821","nonce":37307}]},"public_addr":"172.21.15.107:6817/37307","cluster_addr":"172.21.15.107:6819/37307","heartbeat_back_addr":"172.21.15.107:6825/37307","heartbeat_front_addr":"172.21.15.107:6821/37307","state":["exists","up"]},{"osd":3,"uuid":"5f16aee8-8950-4268-a61a-5cf6ebd670e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37306},{"type":"v1","addr":"172.21.15.107:6809","nonce":37306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37306},{"type":"v1","addr":"172.21.15.107:6811","nonce":37306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37306},{"type":"v1","addr":"172.21.15.107:6815","nonce":37306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37306},{"type":"v1","addr":"172.21.15.107:6813","nonce":37306}]},"public_addr":"172.21.15.107:6809/37306","cluster_addr":"172.21.15.107:6811/37306","heartbeat_back_addr":"172.21.15.107:6815/37306","heartbeat_front_addr":"172.21.15.107:6813/37306","state":["exists","up"]},{"osd":4,"uuid":"23232e28-e23b-4b4e-a531-4939246dbbde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":37329},{"type":"v1","addr":"172.21.15.157:6817","nonce":37329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":37329},{"type":"v1","addr":"172.21.15.157:6819","nonce":37329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":37329},{"type":"v1","addr":"172.21.15.157:6823","nonce":37329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":37329},{"type":"v1","addr":"172.21.15.157:6821","nonce":37329}]},"public_addr":"172.21.15.157:6817/37329","cluster_addr":"172.21.15.157:6819/37329","heartbeat_back_addr":"172.21.15.157:6823/37329","heartbeat_front_addr":"172.21.15.157:6821/37329","state":["exists","up"]},{"osd":5,"uuid":"f87ec331-3e59-4886-a317-6f7e26ec8e21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":37328},{"type":"v1","addr":"172.21.15.157:6804","nonce":37328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":37328},{"type":"v1","addr":"172.21.15.157:6808","nonce":37328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":37328},{"type":"v1","addr":"172.21.15.157:6815","nonce":37328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":37328},{"type":"v1","addr":"172.21.15.157:6812","nonce":37328}]},"public_addr":"172.21.15.157:6804/37328","cluster_addr":"172.21.15.157:6808/37328","heartbeat_back_addr":"172.21.15.157:6815/37328","heartbeat_front_addr":"172.21.15.157:6812/37328","state":["exists","up"]},{"osd":6,"uuid":"92852235-ce49-4d96-a940-6f18d97b13ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":37330},{"type":"v1","addr":"172.21.15.157:6801","nonce":37330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6803","nonce":37330},{"type":"v1","addr":"172.21.15.157:6805","nonce":37330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":37330},{"type":"v1","addr":"172.21.15.157:6813","nonce":37330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":37330},{"type":"v1","addr":"172.21.15.157:6809","nonce":37330}]},"public_addr":"172.21.15.157:6801/37330","cluster_addr":"172.21.15.157:6805/37330","heartbeat_back_addr":"172.21.15.157:6813/37330","heartbeat_front_addr":"172.21.15.157:6809/37330","state":["exists","up"]},{"osd":7,"uuid":"7484a061-723d-4663-b28f-b01766d62f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":37373},{"type":"v1","addr":"172.21.15.157:6825","nonce":37373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":37373},{"type":"v1","addr":"172.21.15.157:6827","nonce":37373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":37373},{"type":"v1","addr":"172.21.15.157:6831","nonce":37373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":37373},{"type":"v1","addr":"172.21.15.157:6829","nonce":37373}]},"public_addr":"172.21.15.157:6825/37373","cluster_addr":"172.21.15.157:6827/37373","heartbeat_back_addr":"172.21.15.157:6831/37373","heartbeat_front_addr":"172.21.15.157:6829/37373","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.110188+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.280265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.252119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.267996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.284582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.144420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.174764+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.308002+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:33.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.174+0000 7fc021e00640 1 -- 172.21.15.107:0/2340338664 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbff8065150 msgr2=0x7fbff8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:33.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.174+0000 7fc021e00640 1 --2- 172.21.15.107:0/2340338664 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbff8065150 0x7fbff8067600 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc004034000 tx=0x7fc004032000 comp rx=0 tx=0).stop 2024-08-17T02:24:33.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.174+0000 7fc021e00640 1 -- 172.21.15.107:0/2340338664 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc01c06df00 msgr2=0x7fc01c151790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:33.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.174+0000 7fc021e00640 1 --2- 172.21.15.107:0/2340338664 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc01c06df00 0x7fc01c151790 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc00c00c5e0 tx=0x7fc00c007d70 comp rx=0 tx=0).stop 2024-08-17T02:24:33.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.175+0000 7fc021e00640 1 -- 172.21.15.107:0/2340338664 shutdown_connections 2024-08-17T02:24:33.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.175+0000 7fc021e00640 1 --2- 172.21.15.107:0/2340338664 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbff8065150 0x7fbff8067600 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.175+0000 7fc021e00640 1 --2- 172.21.15.107:0/2340338664 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc01c155df0 0x7fc01c152110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.175+0000 7fc021e00640 1 --2- 172.21.15.107:0/2340338664 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc01c155a20 0x7fc01c15cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.175+0000 7fc021e00640 1 --2- 172.21.15.107:0/2340338664 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc01c06df00 0x7fc01c151790 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.175+0000 7fc021e00640 1 -- 172.21.15.107:0/2340338664 >> 172.21.15.107:0/2340338664 conn(0x7fc01c0cb9b0 msgr2=0x7fc01c1571e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:33.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.175+0000 7fc021e00640 1 -- 172.21.15.107:0/2340338664 shutdown_connections 2024-08-17T02:24:33.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.175+0000 7fc021e00640 1 -- 172.21.15.107:0/2340338664 wait complete. 2024-08-17T02:24:33.191 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-08-17T02:24:33.191 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:24:33.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.336+0000 7f3871000640 1 Processor -- start 2024-08-17T02:24:33.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.337+0000 7f3871000640 1 -- start start 2024-08-17T02:24:33.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.338+0000 7f3871000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f386c156ad0 0x7f386c0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:33.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.338+0000 7f3871000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f386c156ea0 0x7f386c06d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:33.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.338+0000 7f3871000640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f386c0caaf0 con 0x7f386c06dab0 2024-08-17T02:24:33.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.338+0000 7f3871000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f386c0ca900 con 0x7f386c156ea0 2024-08-17T02:24:33.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.338+0000 7f3871000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f386c0cc560 con 0x7f386c156ad0 2024-08-17T02:24:33.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.338+0000 7f3862a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f386c156ea0 0x7f386c06d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:33.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.338+0000 7f3862a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f386c156ea0 0x7f386c06d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37560/0 (socket says 172.21.15.107:37560) 2024-08-17T02:24:33.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.338+0000 7f3862a00640 1 -- 172.21.15.107:0/1390157878 learned_addr learned my addr 172.21.15.107:0/1390157878 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:33.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.338+0000 7f386b400640 1 --2- 172.21.15.107:0/1390157878 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f386c156ad0 0x7f386c0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:33.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.338+0000 7f3862a00640 1 -- 172.21.15.107:0/1390157878 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f386c156ad0 msgr2=0x7f386c0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:33.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.338+0000 7f3862a00640 1 --2- 172.21.15.107:0/1390157878 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f386c156ad0 0x7f386c0cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.339+0000 7f3862a00640 1 -- 172.21.15.107:0/1390157878 >> v1:172.21.15.157:6789/0 conn(0x7f386c06dab0 legacy=0x7f386c0c8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:33.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.339+0000 7f3862a00640 1 -- 172.21.15.107:0/1390157878 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f386c0cad90 con 0x7f386c156ea0 2024-08-17T02:24:33.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.339+0000 7f3862a00640 1 --2- 172.21.15.107:0/1390157878 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f386c156ea0 0x7f386c06d570 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3854009940 tx=0x7f38540091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e99d9bd12e54a52 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:33.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.340+0000 7f386aa00640 1 -- 172.21.15.107:0/1390157878 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385402ade0 con 0x7f386c156ea0 2024-08-17T02:24:33.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.340+0000 7f386aa00640 1 -- 172.21.15.107:0/1390157878 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3854032440 con 0x7f386c156ea0 2024-08-17T02:24:33.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.340+0000 7f386aa00640 1 -- 172.21.15.107:0/1390157878 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38540327e0 con 0x7f386c156ea0 2024-08-17T02:24:33.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.340+0000 7f3871000640 1 -- 172.21.15.107:0/1390157878 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f386c156ea0 msgr2=0x7f386c06d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:33.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.340+0000 7f3871000640 1 --2- 172.21.15.107:0/1390157878 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f386c156ea0 0x7f386c06d570 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3854009940 tx=0x7f38540091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.340+0000 7f3871000640 1 -- 172.21.15.107:0/1390157878 shutdown_connections 2024-08-17T02:24:33.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.340+0000 7f3871000640 1 --2- 172.21.15.107:0/1390157878 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f386c156ea0 0x7f386c06d570 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.340+0000 7f3871000640 1 --2- 172.21.15.107:0/1390157878 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f386c156ad0 0x7f386c0cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.340+0000 7f3871000640 1 -- 172.21.15.107:0/1390157878 >> 172.21.15.107:0/1390157878 conn(0x7f386c067750 msgr2=0x7f386c0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:33.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.340+0000 7f3871000640 1 -- 172.21.15.107:0/1390157878 shutdown_connections 2024-08-17T02:24:33.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.340+0000 7f3871000640 1 -- 172.21.15.107:0/1390157878 wait complete. 2024-08-17T02:24:33.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.342+0000 7f3871000640 1 Processor -- start 2024-08-17T02:24:33.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.342+0000 7f3871000640 1 -- start start 2024-08-17T02:24:33.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.343+0000 7f3871000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f386c06dab0 0x7f386c0a5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:33.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.343+0000 7f3871000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f386c156ad0 0x7f386c1437f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:33.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.343+0000 7f3871000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f386c156ea0 0x7f386c16c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:33.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.343+0000 7f3871000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386c143d30 con 0x7f386c06dab0 2024-08-17T02:24:33.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.343+0000 7f3871000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386c16c960 con 0x7f386c156ea0 2024-08-17T02:24:33.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.343+0000 7f3871000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f386c0c5230 con 0x7f386c156ad0 2024-08-17T02:24:33.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.343+0000 7f386b400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f386c06dab0 0x7f386c0a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:33.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.343+0000 7f386b400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f386c06dab0 0x7f386c0a5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37562/0 (socket says 172.21.15.107:37562) 2024-08-17T02:24:33.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.343+0000 7f386b400640 1 -- 172.21.15.107:0/2091807696 learned_addr learned my addr 172.21.15.107:0/2091807696 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:33.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.343+0000 7f3862a00640 1 --2- 172.21.15.107:0/2091807696 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f386c156ad0 0x7f386c1437f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:33.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.343+0000 7f386be00640 1 --2- 172.21.15.107:0/2091807696 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f386c156ea0 0x7f386c16c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:33.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.343+0000 7f386b400640 1 -- 172.21.15.107:0/2091807696 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f386c156ad0 msgr2=0x7f386c1437f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:33.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.343+0000 7f386b400640 1 --2- 172.21.15.107:0/2091807696 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f386c156ad0 0x7f386c1437f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.343+0000 7f386b400640 1 -- 172.21.15.107:0/2091807696 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f386c156ea0 msgr2=0x7f386c16c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:33.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.343+0000 7f386b400640 1 --2- 172.21.15.107:0/2091807696 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f386c156ea0 0x7f386c16c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.343+0000 7f386b400640 1 -- 172.21.15.107:0/2091807696 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3854009450 con 0x7f386c06dab0 2024-08-17T02:24:33.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.343+0000 7f386be00640 1 --2- 172.21.15.107:0/2091807696 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f386c156ea0 0x7f386c16c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:33.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.344+0000 7f386b400640 1 --2- 172.21.15.107:0/2091807696 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f386c06dab0 0x7f386c0a5940 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f385c00d890 tx=0x7f385c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:33.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.344+0000 7f3863400640 1 -- 172.21.15.107:0/2091807696 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c00de20 con 0x7f386c06dab0 2024-08-17T02:24:33.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.344+0000 7f3863400640 1 -- 172.21.15.107:0/2091807696 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385c00b8d0 con 0x7f386c06dab0 2024-08-17T02:24:33.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.344+0000 7f3863400640 1 -- 172.21.15.107:0/2091807696 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c00bc70 con 0x7f386c06dab0 2024-08-17T02:24:33.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.344+0000 7f3871000640 1 -- 172.21.15.107:0/2091807696 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f386c0c5510 con 0x7f386c06dab0 2024-08-17T02:24:33.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.344+0000 7f3871000640 1 -- 172.21.15.107:0/2091807696 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f386c0c5ad0 con 0x7f386c06dab0 2024-08-17T02:24:33.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.345+0000 7f3871000640 1 -- 172.21.15.107:0/2091807696 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f386c071050 con 0x7f386c06dab0 2024-08-17T02:24:33.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.346+0000 7f3863400640 1 -- 172.21.15.107:0/2091807696 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f385c014640 con 0x7f386c06dab0 2024-08-17T02:24:33.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.346+0000 7f3863400640 1 --2- 172.21.15.107:0/2091807696 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3848065150 0x7f3848067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:33.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.346+0000 7f3863400640 1 -- 172.21.15.107:0/2091807696 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f385c082ab0 con 0x7f386c06dab0 2024-08-17T02:24:33.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.347+0000 7f3862a00640 1 --2- 172.21.15.107:0/2091807696 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3848065150 0x7f3848067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:33.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.347+0000 7f3862a00640 1 --2- 172.21.15.107:0/2091807696 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3848065150 0x7f3848067600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3854034000 tx=0x7f3854032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:33.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.350+0000 7f3863400640 1 -- 172.21.15.107:0/2091807696 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f385c050b90 con 0x7f386c06dab0 2024-08-17T02:24:33.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.522+0000 7f3871000640 1 -- 172.21.15.107:0/2091807696 --> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f386c0c86f0 con 0x7f3848065150 2024-08-17T02:24:33.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.530+0000 7f3863400640 1 -- 172.21.15.107:0/2091807696 <== mgr.4110 v2:172.21.15.107:6832/37039 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264647 (secure 0 0 0) 0x7f386c0c86f0 con 0x7f3848065150 2024-08-17T02:24:33.535 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:24:33.536 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-08-17T02:24:33.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.534+0000 7f3871000640 1 -- 172.21.15.107:0/2091807696 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3848065150 msgr2=0x7f3848067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:33.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.534+0000 7f3871000640 1 --2- 172.21.15.107:0/2091807696 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3848065150 0x7f3848067600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3854034000 tx=0x7f3854032000 comp rx=0 tx=0).stop 2024-08-17T02:24:33.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.534+0000 7f3871000640 1 -- 172.21.15.107:0/2091807696 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f386c06dab0 msgr2=0x7f386c0a5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:33.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.534+0000 7f3871000640 1 --2- 172.21.15.107:0/2091807696 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f386c06dab0 0x7f386c0a5940 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f385c00d890 tx=0x7f385c008040 comp rx=0 tx=0).stop 2024-08-17T02:24:33.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.534+0000 7f3871000640 1 -- 172.21.15.107:0/2091807696 shutdown_connections 2024-08-17T02:24:33.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.534+0000 7f3871000640 1 --2- 172.21.15.107:0/2091807696 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3848065150 0x7f3848067600 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.534+0000 7f3871000640 1 --2- 172.21.15.107:0/2091807696 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f386c156ea0 0x7f386c16c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.534+0000 7f3871000640 1 --2- 172.21.15.107:0/2091807696 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f386c156ad0 0x7f386c1437f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.534+0000 7f3871000640 1 --2- 172.21.15.107:0/2091807696 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f386c06dab0 0x7f386c0a5940 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.535+0000 7f3871000640 1 -- 172.21.15.107:0/2091807696 >> 172.21.15.107:0/2091807696 conn(0x7f386c067750 msgr2=0x7f386c0699d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:33.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.535+0000 7f3871000640 1 -- 172.21.15.107:0/2091807696 shutdown_connections 2024-08-17T02:24:33.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.535+0000 7f3871000640 1 -- 172.21.15.107:0/2091807696 wait complete. 2024-08-17T02:24:33.550 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-08-17T02:24:33.405324+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":147,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2398432,"kb_used_data":2920,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752576288,"statfs":{"total":773094113280,"available":770638118912,"internally_reserved":0,"allocated":2990080,"data_stored":1787916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.997591"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.452250+0000","last_change":"2024-08-17T02:24:29.448867+0000","last_active":"2024-08-17T02:24:29.452250+0000","last_peered":"2024-08-17T02:24:29.452250+0000","last_clean":"2024-08-17T02:24:29.452250+0000","last_became_active":"2024-08-17T02:24:29.448338+0000","last_became_peered":"2024-08-17T02:24:29.448338+0000","last_unstale":"2024-08-17T02:24:29.452250+0000","last_undegraded":"2024-08-17T02:24:29.452250+0000","last_fullsized":"2024-08-17T02:24:29.452250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:48:33.196839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.435860+0000","last_change":"2024-08-17T02:24:29.429588+0000","last_active":"2024-08-17T02:24:29.435860+0000","last_peered":"2024-08-17T02:24:29.435860+0000","last_clean":"2024-08-17T02:24:29.435860+0000","last_became_active":"2024-08-17T02:24:29.429300+0000","last_became_peered":"2024-08-17T02:24:29.429300+0000","last_unstale":"2024-08-17T02:24:29.435860+0000","last_undegraded":"2024-08-17T02:24:29.435860+0000","last_fullsized":"2024-08-17T02:24:29.435860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:40:05.110498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.435639+0000","last_change":"2024-08-17T02:24:29.428604+0000","last_active":"2024-08-17T02:24:29.435639+0000","last_peered":"2024-08-17T02:24:29.435639+0000","last_clean":"2024-08-17T02:24:29.435639+0000","last_became_active":"2024-08-17T02:24:29.428271+0000","last_became_peered":"2024-08-17T02:24:29.428271+0000","last_unstale":"2024-08-17T02:24:29.435639+0000","last_undegraded":"2024-08-17T02:24:29.435639+0000","last_fullsized":"2024-08-17T02:24:29.435639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:33.180306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.438068+0000","last_change":"2024-08-17T02:24:29.433468+0000","last_active":"2024-08-17T02:24:29.438068+0000","last_peered":"2024-08-17T02:24:29.438068+0000","last_clean":"2024-08-17T02:24:29.438068+0000","last_became_active":"2024-08-17T02:24:29.433248+0000","last_became_peered":"2024-08-17T02:24:29.433248+0000","last_unstale":"2024-08-17T02:24:29.438068+0000","last_undegraded":"2024-08-17T02:24:29.438068+0000","last_fullsized":"2024-08-17T02:24:29.438068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:46:58.314470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.451041+0000","last_change":"2024-08-17T02:24:29.444891+0000","last_active":"2024-08-17T02:24:29.451041+0000","last_peered":"2024-08-17T02:24:29.451041+0000","last_clean":"2024-08-17T02:24:29.451041+0000","last_became_active":"2024-08-17T02:24:29.444620+0000","last_became_peered":"2024-08-17T02:24:29.444620+0000","last_unstale":"2024-08-17T02:24:29.451041+0000","last_undegraded":"2024-08-17T02:24:29.451041+0000","last_fullsized":"2024-08-17T02:24:29.451041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:25:24.514567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450224+0000","last_change":"2024-08-17T02:24:29.438699+0000","last_active":"2024-08-17T02:24:29.450224+0000","last_peered":"2024-08-17T02:24:29.450224+0000","last_clean":"2024-08-17T02:24:29.450224+0000","last_became_active":"2024-08-17T02:24:29.438076+0000","last_became_peered":"2024-08-17T02:24:29.438076+0000","last_unstale":"2024-08-17T02:24:29.450224+0000","last_undegraded":"2024-08-17T02:24:29.450224+0000","last_fullsized":"2024-08-17T02:24:29.450224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:07:03.379300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.441450+0000","last_change":"2024-08-17T02:24:29.437568+0000","last_active":"2024-08-17T02:24:29.441450+0000","last_peered":"2024-08-17T02:24:29.441450+0000","last_clean":"2024-08-17T02:24:29.441450+0000","last_became_active":"2024-08-17T02:24:29.436316+0000","last_became_peered":"2024-08-17T02:24:29.436316+0000","last_unstale":"2024-08-17T02:24:29.441450+0000","last_undegraded":"2024-08-17T02:24:29.441450+0000","last_fullsized":"2024-08-17T02:24:29.441450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:46:58.314470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.442072+0000","last_change":"2024-08-17T02:24:29.438349+0000","last_active":"2024-08-17T02:24:29.442072+0000","last_peered":"2024-08-17T02:24:29.442072+0000","last_clean":"2024-08-17T02:24:29.442072+0000","last_became_active":"2024-08-17T02:24:29.438073+0000","last_became_peered":"2024-08-17T02:24:29.438073+0000","last_unstale":"2024-08-17T02:24:29.442072+0000","last_undegraded":"2024-08-17T02:24:29.442072+0000","last_fullsized":"2024-08-17T02:24:29.442072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:18.512619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.455304+0000","last_change":"2024-08-17T02:24:29.452166+0000","last_active":"2024-08-17T02:24:29.455304+0000","last_peered":"2024-08-17T02:24:29.455304+0000","last_clean":"2024-08-17T02:24:29.455304+0000","last_became_active":"2024-08-17T02:24:29.451022+0000","last_became_peered":"2024-08-17T02:24:29.451022+0000","last_unstale":"2024-08-17T02:24:29.455304+0000","last_undegraded":"2024-08-17T02:24:29.455304+0000","last_fullsized":"2024-08-17T02:24:29.455304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:29:30.041751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.447924+0000","last_change":"2024-08-17T02:24:29.443056+0000","last_active":"2024-08-17T02:24:29.447924+0000","last_peered":"2024-08-17T02:24:29.447924+0000","last_clean":"2024-08-17T02:24:29.447924+0000","last_became_active":"2024-08-17T02:24:29.442485+0000","last_became_peered":"2024-08-17T02:24:29.442485+0000","last_unstale":"2024-08-17T02:24:29.447924+0000","last_undegraded":"2024-08-17T02:24:29.447924+0000","last_fullsized":"2024-08-17T02:24:29.447924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:04:59.407311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.446564+0000","last_change":"2024-08-17T02:24:29.439275+0000","last_active":"2024-08-17T02:24:29.446564+0000","last_peered":"2024-08-17T02:24:29.446564+0000","last_clean":"2024-08-17T02:24:29.446564+0000","last_became_active":"2024-08-17T02:24:29.439101+0000","last_became_peered":"2024-08-17T02:24:29.439101+0000","last_unstale":"2024-08-17T02:24:29.446564+0000","last_undegraded":"2024-08-17T02:24:29.446564+0000","last_fullsized":"2024-08-17T02:24:29.446564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:58:14.241277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.436614+0000","last_change":"2024-08-17T02:24:29.430279+0000","last_active":"2024-08-17T02:24:29.436614+0000","last_peered":"2024-08-17T02:24:29.436614+0000","last_clean":"2024-08-17T02:24:29.436614+0000","last_became_active":"2024-08-17T02:24:29.430012+0000","last_became_peered":"2024-08-17T02:24:29.430012+0000","last_unstale":"2024-08-17T02:24:29.436614+0000","last_undegraded":"2024-08-17T02:24:29.436614+0000","last_fullsized":"2024-08-17T02:24:29.436614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:18:31.217481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.433404+0000","last_change":"2024-08-17T02:24:29.430879+0000","last_active":"2024-08-17T02:24:29.433404+0000","last_peered":"2024-08-17T02:24:29.433404+0000","last_clean":"2024-08-17T02:24:29.433404+0000","last_became_active":"2024-08-17T02:24:29.429162+0000","last_became_peered":"2024-08-17T02:24:29.429162+0000","last_unstale":"2024-08-17T02:24:29.433404+0000","last_undegraded":"2024-08-17T02:24:29.433404+0000","last_fullsized":"2024-08-17T02:24:29.433404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:59:44.626213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.442159+0000","last_change":"2024-08-17T02:24:29.438804+0000","last_active":"2024-08-17T02:24:29.442159+0000","last_peered":"2024-08-17T02:24:29.442159+0000","last_clean":"2024-08-17T02:24:29.442159+0000","last_became_active":"2024-08-17T02:24:29.438130+0000","last_became_peered":"2024-08-17T02:24:29.438130+0000","last_unstale":"2024-08-17T02:24:29.442159+0000","last_undegraded":"2024-08-17T02:24:29.442159+0000","last_fullsized":"2024-08-17T02:24:29.442159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:07:03.379300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.435960+0000","last_change":"2024-08-17T02:24:29.432494+0000","last_active":"2024-08-17T02:24:29.435960+0000","last_peered":"2024-08-17T02:24:29.435960+0000","last_clean":"2024-08-17T02:24:29.435960+0000","last_became_active":"2024-08-17T02:24:29.432128+0000","last_became_peered":"2024-08-17T02:24:29.432128+0000","last_unstale":"2024-08-17T02:24:29.435960+0000","last_undegraded":"2024-08-17T02:24:29.435960+0000","last_fullsized":"2024-08-17T02:24:29.435960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:18:37.161695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.432600+0000","last_change":"2024-08-17T02:24:29.431128+0000","last_active":"2024-08-17T02:24:29.432600+0000","last_peered":"2024-08-17T02:24:29.432600+0000","last_clean":"2024-08-17T02:24:29.432600+0000","last_became_active":"2024-08-17T02:24:29.428894+0000","last_became_peered":"2024-08-17T02:24:29.428894+0000","last_unstale":"2024-08-17T02:24:29.432600+0000","last_undegraded":"2024-08-17T02:24:29.432600+0000","last_fullsized":"2024-08-17T02:24:29.432600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:16.005540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450981+0000","last_change":"2024-08-17T02:24:29.444351+0000","last_active":"2024-08-17T02:24:29.450981+0000","last_peered":"2024-08-17T02:24:29.450981+0000","last_clean":"2024-08-17T02:24:29.450981+0000","last_became_active":"2024-08-17T02:24:29.443980+0000","last_became_peered":"2024-08-17T02:24:29.443980+0000","last_unstale":"2024-08-17T02:24:29.450981+0000","last_undegraded":"2024-08-17T02:24:29.450981+0000","last_fullsized":"2024-08-17T02:24:29.450981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:04:59.407311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.427120+0000","last_change":"2024-08-17T02:24:29.424479+0000","last_active":"2024-08-17T02:24:29.427120+0000","last_peered":"2024-08-17T02:24:29.427120+0000","last_clean":"2024-08-17T02:24:29.427120+0000","last_became_active":"2024-08-17T02:24:29.424027+0000","last_became_peered":"2024-08-17T02:24:29.424027+0000","last_unstale":"2024-08-17T02:24:29.427120+0000","last_undegraded":"2024-08-17T02:24:29.427120+0000","last_fullsized":"2024-08-17T02:24:29.427120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:18:31.217481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450896+0000","last_change":"2024-08-17T02:24:29.443271+0000","last_active":"2024-08-17T02:24:29.450896+0000","last_peered":"2024-08-17T02:24:29.450896+0000","last_clean":"2024-08-17T02:24:29.450896+0000","last_became_active":"2024-08-17T02:24:29.443006+0000","last_became_peered":"2024-08-17T02:24:29.443006+0000","last_unstale":"2024-08-17T02:24:29.450896+0000","last_undegraded":"2024-08-17T02:24:29.450896+0000","last_fullsized":"2024-08-17T02:24:29.450896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:26:09.573683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.435546+0000","last_change":"2024-08-17T02:24:29.434616+0000","last_active":"2024-08-17T02:24:29.435546+0000","last_peered":"2024-08-17T02:24:29.435546+0000","last_clean":"2024-08-17T02:24:29.435546+0000","last_became_active":"2024-08-17T02:24:29.434357+0000","last_became_peered":"2024-08-17T02:24:29.434357+0000","last_unstale":"2024-08-17T02:24:29.435546+0000","last_undegraded":"2024-08-17T02:24:29.435546+0000","last_fullsized":"2024-08-17T02:24:29.435546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:07:03.379300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.445449+0000","last_change":"2024-08-17T02:24:29.440294+0000","last_active":"2024-08-17T02:24:29.445449+0000","last_peered":"2024-08-17T02:24:29.445449+0000","last_clean":"2024-08-17T02:24:29.445449+0000","last_became_active":"2024-08-17T02:24:29.440044+0000","last_became_peered":"2024-08-17T02:24:29.440044+0000","last_unstale":"2024-08-17T02:24:29.445449+0000","last_undegraded":"2024-08-17T02:24:29.445449+0000","last_fullsized":"2024-08-17T02:24:29.445449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:18:37.161695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450245+0000","last_change":"2024-08-17T02:24:29.438981+0000","last_active":"2024-08-17T02:24:29.450245+0000","last_peered":"2024-08-17T02:24:29.450245+0000","last_clean":"2024-08-17T02:24:29.450245+0000","last_became_active":"2024-08-17T02:24:29.438545+0000","last_became_peered":"2024-08-17T02:24:29.438545+0000","last_unstale":"2024-08-17T02:24:29.450245+0000","last_undegraded":"2024-08-17T02:24:29.450245+0000","last_fullsized":"2024-08-17T02:24:29.450245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:26:09.573683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.441910+0000","last_change":"2024-08-17T02:24:29.437857+0000","last_active":"2024-08-17T02:24:29.441910+0000","last_peered":"2024-08-17T02:24:29.441910+0000","last_clean":"2024-08-17T02:24:29.441910+0000","last_became_active":"2024-08-17T02:24:29.437607+0000","last_became_peered":"2024-08-17T02:24:29.437607+0000","last_unstale":"2024-08-17T02:24:29.441910+0000","last_undegraded":"2024-08-17T02:24:29.441910+0000","last_fullsized":"2024-08-17T02:24:29.441910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:40:05.110498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.432619+0000","last_change":"2024-08-17T02:24:29.431695+0000","last_active":"2024-08-17T02:24:29.432619+0000","last_peered":"2024-08-17T02:24:29.432619+0000","last_clean":"2024-08-17T02:24:29.432619+0000","last_became_active":"2024-08-17T02:24:29.431435+0000","last_became_peered":"2024-08-17T02:24:29.431435+0000","last_unstale":"2024-08-17T02:24:29.432619+0000","last_undegraded":"2024-08-17T02:24:29.432619+0000","last_fullsized":"2024-08-17T02:24:29.432619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:39:33.176250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.437197+0000","last_change":"2024-08-17T02:24:29.435746+0000","last_active":"2024-08-17T02:24:29.437197+0000","last_peered":"2024-08-17T02:24:29.437197+0000","last_clean":"2024-08-17T02:24:29.437197+0000","last_became_active":"2024-08-17T02:24:29.435359+0000","last_became_peered":"2024-08-17T02:24:29.435359+0000","last_unstale":"2024-08-17T02:24:29.437197+0000","last_undegraded":"2024-08-17T02:24:29.437197+0000","last_fullsized":"2024-08-17T02:24:29.437197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:16.005540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.448489+0000","last_change":"2024-08-17T02:24:29.443168+0000","last_active":"2024-08-17T02:24:29.448489+0000","last_peered":"2024-08-17T02:24:29.448489+0000","last_clean":"2024-08-17T02:24:29.448489+0000","last_became_active":"2024-08-17T02:24:29.442833+0000","last_became_peered":"2024-08-17T02:24:29.442833+0000","last_unstale":"2024-08-17T02:24:29.448489+0000","last_undegraded":"2024-08-17T02:24:29.448489+0000","last_fullsized":"2024-08-17T02:24:29.448489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:48.171179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.435841+0000","last_change":"2024-08-17T02:24:29.429618+0000","last_active":"2024-08-17T02:24:29.435841+0000","last_peered":"2024-08-17T02:24:29.435841+0000","last_clean":"2024-08-17T02:24:29.435841+0000","last_became_active":"2024-08-17T02:24:29.429267+0000","last_became_peered":"2024-08-17T02:24:29.429267+0000","last_unstale":"2024-08-17T02:24:29.435841+0000","last_undegraded":"2024-08-17T02:24:29.435841+0000","last_fullsized":"2024-08-17T02:24:29.435841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:07:03.379300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.437177+0000","last_change":"2024-08-17T02:24:29.435512+0000","last_active":"2024-08-17T02:24:29.437177+0000","last_peered":"2024-08-17T02:24:29.437177+0000","last_clean":"2024-08-17T02:24:29.437177+0000","last_became_active":"2024-08-17T02:24:29.434546+0000","last_became_peered":"2024-08-17T02:24:29.434546+0000","last_unstale":"2024-08-17T02:24:29.437177+0000","last_undegraded":"2024-08-17T02:24:29.437177+0000","last_fullsized":"2024-08-17T02:24:29.437177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:23:46.771394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.437350+0000","last_change":"2024-08-17T02:24:29.434096+0000","last_active":"2024-08-17T02:24:29.437350+0000","last_peered":"2024-08-17T02:24:29.437350+0000","last_clean":"2024-08-17T02:24:29.437350+0000","last_became_active":"2024-08-17T02:24:29.432111+0000","last_became_peered":"2024-08-17T02:24:29.432111+0000","last_unstale":"2024-08-17T02:24:29.437350+0000","last_undegraded":"2024-08-17T02:24:29.437350+0000","last_fullsized":"2024-08-17T02:24:29.437350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:59:44.626213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450204+0000","last_change":"2024-08-17T02:24:29.438474+0000","last_active":"2024-08-17T02:24:29.450204+0000","last_peered":"2024-08-17T02:24:29.450204+0000","last_clean":"2024-08-17T02:24:29.450204+0000","last_became_active":"2024-08-17T02:24:29.434276+0000","last_became_peered":"2024-08-17T02:24:29.434276+0000","last_unstale":"2024-08-17T02:24:29.450204+0000","last_undegraded":"2024-08-17T02:24:29.450204+0000","last_fullsized":"2024-08-17T02:24:29.450204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:09:30.631732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.426340+0000","last_change":"2024-08-17T02:24:29.423201+0000","last_active":"2024-08-17T02:24:29.426340+0000","last_peered":"2024-08-17T02:24:29.426340+0000","last_clean":"2024-08-17T02:24:29.426340+0000","last_became_active":"2024-08-17T02:24:29.422912+0000","last_became_peered":"2024-08-17T02:24:29.422912+0000","last_unstale":"2024-08-17T02:24:29.426340+0000","last_undegraded":"2024-08-17T02:24:29.426340+0000","last_fullsized":"2024-08-17T02:24:29.426340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:52.792632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.432747+0000","last_change":"2024-08-17T02:24:29.431883+0000","last_active":"2024-08-17T02:24:29.432747+0000","last_peered":"2024-08-17T02:24:29.432747+0000","last_clean":"2024-08-17T02:24:29.432747+0000","last_became_active":"2024-08-17T02:24:29.431617+0000","last_became_peered":"2024-08-17T02:24:29.431617+0000","last_unstale":"2024-08-17T02:24:29.432747+0000","last_undegraded":"2024-08-17T02:24:29.432747+0000","last_fullsized":"2024-08-17T02:24:29.432747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:33.180306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.429731+0000","last_change":"2024-08-17T02:24:29.420479+0000","last_active":"2024-08-17T02:24:29.429731+0000","last_peered":"2024-08-17T02:24:29.429731+0000","last_clean":"2024-08-17T02:24:29.429731+0000","last_became_active":"2024-08-17T02:24:29.420224+0000","last_became_peered":"2024-08-17T02:24:29.420224+0000","last_unstale":"2024-08-17T02:24:29.429731+0000","last_undegraded":"2024-08-17T02:24:29.429731+0000","last_fullsized":"2024-08-17T02:24:29.429731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:02.260531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.457859+0000","last_change":"2024-08-17T02:24:28.436881+0000","last_active":"2024-08-17T02:24:29.457859+0000","last_peered":"2024-08-17T02:24:29.457859+0000","last_clean":"2024-08-17T02:24:29.457859+0000","last_became_active":"2024-08-17T02:24:28.436557+0000","last_became_peered":"2024-08-17T02:24:28.436557+0000","last_unstale":"2024-08-17T02:24:29.457859+0000","last_undegraded":"2024-08-17T02:24:29.457859+0000","last_fullsized":"2024-08-17T02:24:29.457859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:46:41.928641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.441803+0000","last_change":"2024-08-17T02:24:29.436940+0000","last_active":"2024-08-17T02:24:29.441803+0000","last_peered":"2024-08-17T02:24:29.441803+0000","last_clean":"2024-08-17T02:24:29.441803+0000","last_became_active":"2024-08-17T02:24:29.436582+0000","last_became_peered":"2024-08-17T02:24:29.436582+0000","last_unstale":"2024-08-17T02:24:29.441803+0000","last_undegraded":"2024-08-17T02:24:29.441803+0000","last_fullsized":"2024-08-17T02:24:29.441803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:22:20.026814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.456848+0000","last_change":"2024-08-17T02:24:28.438875+0000","last_active":"2024-08-17T02:24:29.456848+0000","last_peered":"2024-08-17T02:24:29.456848+0000","last_clean":"2024-08-17T02:24:29.456848+0000","last_became_active":"2024-08-17T02:24:28.438051+0000","last_became_peered":"2024-08-17T02:24:28.438051+0000","last_unstale":"2024-08-17T02:24:29.456848+0000","last_undegraded":"2024-08-17T02:24:29.456848+0000","last_fullsized":"2024-08-17T02:24:29.456848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:01.258133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.423658+0000","last_change":"2024-08-17T02:24:28.432912+0000","last_active":"2024-08-17T02:24:29.423658+0000","last_peered":"2024-08-17T02:24:29.423658+0000","last_clean":"2024-08-17T02:24:29.423658+0000","last_became_active":"2024-08-17T02:24:28.432676+0000","last_became_peered":"2024-08-17T02:24:28.432676+0000","last_unstale":"2024-08-17T02:24:29.423658+0000","last_undegraded":"2024-08-17T02:24:29.423658+0000","last_fullsized":"2024-08-17T02:24:29.423658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:18.717365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.433669+0000","last_change":"2024-08-17T02:24:29.431474+0000","last_active":"2024-08-17T02:24:29.433669+0000","last_peered":"2024-08-17T02:24:29.433669+0000","last_clean":"2024-08-17T02:24:29.433669+0000","last_became_active":"2024-08-17T02:24:29.429133+0000","last_became_peered":"2024-08-17T02:24:29.429133+0000","last_unstale":"2024-08-17T02:24:29.433669+0000","last_undegraded":"2024-08-17T02:24:29.433669+0000","last_fullsized":"2024-08-17T02:24:29.433669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:18:37.161695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.420882+0000","last_change":"2024-08-17T02:24:28.423819+0000","last_active":"2024-08-17T02:24:29.420882+0000","last_peered":"2024-08-17T02:24:29.420882+0000","last_clean":"2024-08-17T02:24:29.420882+0000","last_became_active":"2024-08-17T02:24:28.423549+0000","last_became_peered":"2024-08-17T02:24:28.423549+0000","last_unstale":"2024-08-17T02:24:29.420882+0000","last_undegraded":"2024-08-17T02:24:29.420882+0000","last_fullsized":"2024-08-17T02:24:29.420882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:34.991199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.435925+0000","last_change":"2024-08-17T02:24:29.432048+0000","last_active":"2024-08-17T02:24:29.435925+0000","last_peered":"2024-08-17T02:24:29.435925+0000","last_clean":"2024-08-17T02:24:29.435925+0000","last_became_active":"2024-08-17T02:24:29.431772+0000","last_became_peered":"2024-08-17T02:24:29.431772+0000","last_unstale":"2024-08-17T02:24:29.435925+0000","last_undegraded":"2024-08-17T02:24:29.435925+0000","last_fullsized":"2024-08-17T02:24:29.435925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:59:44.626213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.429707+0000","last_change":"2024-08-17T02:24:28.443065+0000","last_active":"2024-08-17T02:24:29.429707+0000","last_peered":"2024-08-17T02:24:29.429707+0000","last_clean":"2024-08-17T02:24:29.429707+0000","last_became_active":"2024-08-17T02:24:28.442641+0000","last_became_peered":"2024-08-17T02:24:28.442641+0000","last_unstale":"2024-08-17T02:24:29.429707+0000","last_undegraded":"2024-08-17T02:24:29.429707+0000","last_fullsized":"2024-08-17T02:24:29.429707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:55:38.492426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450640+0000","last_change":"2024-08-17T02:24:29.441379+0000","last_active":"2024-08-17T02:24:29.450640+0000","last_peered":"2024-08-17T02:24:29.450640+0000","last_clean":"2024-08-17T02:24:29.450640+0000","last_became_active":"2024-08-17T02:24:29.441099+0000","last_became_peered":"2024-08-17T02:24:29.441099+0000","last_unstale":"2024-08-17T02:24:29.450640+0000","last_undegraded":"2024-08-17T02:24:29.450640+0000","last_fullsized":"2024-08-17T02:24:29.450640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:18.512619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.423197+0000","last_change":"2024-08-17T02:24:28.440516+0000","last_active":"2024-08-17T02:24:29.423197+0000","last_peered":"2024-08-17T02:24:29.423197+0000","last_clean":"2024-08-17T02:24:29.423197+0000","last_became_active":"2024-08-17T02:24:28.440243+0000","last_became_peered":"2024-08-17T02:24:28.440243+0000","last_unstale":"2024-08-17T02:24:29.423197+0000","last_undegraded":"2024-08-17T02:24:29.423197+0000","last_fullsized":"2024-08-17T02:24:29.423197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:01.258133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.437435+0000","last_change":"2024-08-17T02:24:29.434837+0000","last_active":"2024-08-17T02:24:29.437435+0000","last_peered":"2024-08-17T02:24:29.437435+0000","last_clean":"2024-08-17T02:24:29.437435+0000","last_became_active":"2024-08-17T02:24:29.434528+0000","last_became_peered":"2024-08-17T02:24:29.434528+0000","last_unstale":"2024-08-17T02:24:29.437435+0000","last_undegraded":"2024-08-17T02:24:29.437435+0000","last_fullsized":"2024-08-17T02:24:29.437435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:23:46.771394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.461505+0000","last_change":"2024-08-17T02:24:28.434795+0000","last_active":"2024-08-17T02:24:29.461505+0000","last_peered":"2024-08-17T02:24:29.461505+0000","last_clean":"2024-08-17T02:24:29.461505+0000","last_became_active":"2024-08-17T02:24:28.434522+0000","last_became_peered":"2024-08-17T02:24:28.434522+0000","last_unstale":"2024-08-17T02:24:29.461505+0000","last_undegraded":"2024-08-17T02:24:29.461505+0000","last_fullsized":"2024-08-17T02:24:29.461505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:28:41.706792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450003+0000","last_change":"2024-08-17T02:24:29.443910+0000","last_active":"2024-08-17T02:24:29.450003+0000","last_peered":"2024-08-17T02:24:29.450003+0000","last_clean":"2024-08-17T02:24:29.450003+0000","last_became_active":"2024-08-17T02:24:29.443621+0000","last_became_peered":"2024-08-17T02:24:29.443621+0000","last_unstale":"2024-08-17T02:24:29.450003+0000","last_undegraded":"2024-08-17T02:24:29.450003+0000","last_fullsized":"2024-08-17T02:24:29.450003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:55:39.494824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.461687+0000","last_change":"2024-08-17T02:24:28.439962+0000","last_active":"2024-08-17T02:24:29.461687+0000","last_peered":"2024-08-17T02:24:29.461687+0000","last_clean":"2024-08-17T02:24:29.461687+0000","last_became_active":"2024-08-17T02:24:28.439277+0000","last_became_peered":"2024-08-17T02:24:28.439277+0000","last_unstale":"2024-08-17T02:24:29.461687+0000","last_undegraded":"2024-08-17T02:24:29.461687+0000","last_fullsized":"2024-08-17T02:24:29.461687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:28:41.706792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450874+0000","last_change":"2024-08-17T02:24:29.442682+0000","last_active":"2024-08-17T02:24:29.450874+0000","last_peered":"2024-08-17T02:24:29.450874+0000","last_clean":"2024-08-17T02:24:29.450874+0000","last_became_active":"2024-08-17T02:24:29.441913+0000","last_became_peered":"2024-08-17T02:24:29.441913+0000","last_unstale":"2024-08-17T02:24:29.450874+0000","last_undegraded":"2024-08-17T02:24:29.450874+0000","last_fullsized":"2024-08-17T02:24:29.450874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:26:38.223253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.457160+0000","last_change":"2024-08-17T02:24:28.423349+0000","last_active":"2024-08-17T02:24:29.457160+0000","last_peered":"2024-08-17T02:24:29.457160+0000","last_clean":"2024-08-17T02:24:29.457160+0000","last_became_active":"2024-08-17T02:24:28.423068+0000","last_became_peered":"2024-08-17T02:24:28.423068+0000","last_unstale":"2024-08-17T02:24:29.457160+0000","last_undegraded":"2024-08-17T02:24:29.457160+0000","last_fullsized":"2024-08-17T02:24:29.457160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:59.126938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.445464+0000","last_change":"2024-08-17T02:24:29.440328+0000","last_active":"2024-08-17T02:24:29.445464+0000","last_peered":"2024-08-17T02:24:29.445464+0000","last_clean":"2024-08-17T02:24:29.445464+0000","last_became_active":"2024-08-17T02:24:29.440057+0000","last_became_peered":"2024-08-17T02:24:29.440057+0000","last_unstale":"2024-08-17T02:24:29.445464+0000","last_undegraded":"2024-08-17T02:24:29.445464+0000","last_fullsized":"2024-08-17T02:24:29.445464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:16.005540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.421193+0000","last_change":"2024-08-17T02:24:28.435098+0000","last_active":"2024-08-17T02:24:29.421193+0000","last_peered":"2024-08-17T02:24:29.421193+0000","last_clean":"2024-08-17T02:24:29.421193+0000","last_became_active":"2024-08-17T02:24:28.434834+0000","last_became_peered":"2024-08-17T02:24:28.434834+0000","last_unstale":"2024-08-17T02:24:29.421193+0000","last_undegraded":"2024-08-17T02:24:29.421193+0000","last_fullsized":"2024-08-17T02:24:29.421193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:18.717365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.451653+0000","last_change":"2024-08-17T02:24:29.449862+0000","last_active":"2024-08-17T02:24:29.451653+0000","last_peered":"2024-08-17T02:24:29.451653+0000","last_clean":"2024-08-17T02:24:29.451653+0000","last_became_active":"2024-08-17T02:24:29.449560+0000","last_became_peered":"2024-08-17T02:24:29.449560+0000","last_unstale":"2024-08-17T02:24:29.451653+0000","last_undegraded":"2024-08-17T02:24:29.451653+0000","last_fullsized":"2024-08-17T02:24:29.451653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:48.171179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.420175+0000","last_change":"2024-08-17T02:24:28.438842+0000","last_active":"2024-08-17T02:24:29.420175+0000","last_peered":"2024-08-17T02:24:29.420175+0000","last_clean":"2024-08-17T02:24:29.420175+0000","last_became_active":"2024-08-17T02:24:28.438244+0000","last_became_peered":"2024-08-17T02:24:28.438244+0000","last_unstale":"2024-08-17T02:24:29.420175+0000","last_undegraded":"2024-08-17T02:24:29.420175+0000","last_fullsized":"2024-08-17T02:24:29.420175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:51.790234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.432534+0000","last_change":"2024-08-17T02:24:29.426910+0000","last_active":"2024-08-17T02:24:29.432534+0000","last_peered":"2024-08-17T02:24:29.432534+0000","last_clean":"2024-08-17T02:24:29.432534+0000","last_became_active":"2024-08-17T02:24:29.426608+0000","last_became_peered":"2024-08-17T02:24:29.426608+0000","last_unstale":"2024-08-17T02:24:29.432534+0000","last_undegraded":"2024-08-17T02:24:29.432534+0000","last_fullsized":"2024-08-17T02:24:29.432534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:02:43.252296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.460256+0000","last_change":"2024-08-17T02:24:28.426073+0000","last_active":"2024-08-17T02:24:29.460256+0000","last_peered":"2024-08-17T02:24:29.460256+0000","last_clean":"2024-08-17T02:24:29.460256+0000","last_became_active":"2024-08-17T02:24:28.425822+0000","last_became_peered":"2024-08-17T02:24:28.425822+0000","last_unstale":"2024-08-17T02:24:29.460256+0000","last_undegraded":"2024-08-17T02:24:29.460256+0000","last_fullsized":"2024-08-17T02:24:29.460256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:34.991199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.447515+0000","last_change":"2024-08-17T02:24:29.441566+0000","last_active":"2024-08-17T02:24:29.447515+0000","last_peered":"2024-08-17T02:24:29.447515+0000","last_clean":"2024-08-17T02:24:29.447515+0000","last_became_active":"2024-08-17T02:24:29.441269+0000","last_became_peered":"2024-08-17T02:24:29.441269+0000","last_unstale":"2024-08-17T02:24:29.447515+0000","last_undegraded":"2024-08-17T02:24:29.447515+0000","last_fullsized":"2024-08-17T02:24:29.447515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:39:33.176250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.460590+0000","last_change":"2024-08-17T02:24:28.423469+0000","last_active":"2024-08-17T02:24:29.460590+0000","last_peered":"2024-08-17T02:24:29.460590+0000","last_clean":"2024-08-17T02:24:29.460590+0000","last_became_active":"2024-08-17T02:24:28.423205+0000","last_became_peered":"2024-08-17T02:24:28.423205+0000","last_unstale":"2024-08-17T02:24:29.460590+0000","last_undegraded":"2024-08-17T02:24:29.460590+0000","last_fullsized":"2024-08-17T02:24:29.460590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:03:42.063288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.454737+0000","last_change":"2024-08-17T02:24:29.452111+0000","last_active":"2024-08-17T02:24:29.454737+0000","last_peered":"2024-08-17T02:24:29.454737+0000","last_clean":"2024-08-17T02:24:29.454737+0000","last_became_active":"2024-08-17T02:24:29.451873+0000","last_became_peered":"2024-08-17T02:24:29.451873+0000","last_unstale":"2024-08-17T02:24:29.454737+0000","last_undegraded":"2024-08-17T02:24:29.454737+0000","last_fullsized":"2024-08-17T02:24:29.454737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:18.512619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.459157+0000","last_change":"2024-08-17T02:24:28.436576+0000","last_active":"2024-08-17T02:24:29.459157+0000","last_peered":"2024-08-17T02:24:29.459157+0000","last_clean":"2024-08-17T02:24:29.459157+0000","last_became_active":"2024-08-17T02:24:28.436045+0000","last_became_peered":"2024-08-17T02:24:28.436045+0000","last_unstale":"2024-08-17T02:24:29.459157+0000","last_undegraded":"2024-08-17T02:24:29.459157+0000","last_fullsized":"2024-08-17T02:24:29.459157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:18.717365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.452269+0000","last_change":"2024-08-17T02:24:29.448760+0000","last_active":"2024-08-17T02:24:29.452269+0000","last_peered":"2024-08-17T02:24:29.452269+0000","last_clean":"2024-08-17T02:24:29.452269+0000","last_became_active":"2024-08-17T02:24:29.447419+0000","last_became_peered":"2024-08-17T02:24:29.447419+0000","last_unstale":"2024-08-17T02:24:29.452269+0000","last_undegraded":"2024-08-17T02:24:29.452269+0000","last_fullsized":"2024-08-17T02:24:29.452269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:09:30.631732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.460572+0000","last_change":"2024-08-17T02:24:28.423802+0000","last_active":"2024-08-17T02:24:29.460572+0000","last_peered":"2024-08-17T02:24:29.460572+0000","last_clean":"2024-08-17T02:24:29.460572+0000","last_became_active":"2024-08-17T02:24:28.423537+0000","last_became_peered":"2024-08-17T02:24:28.423537+0000","last_unstale":"2024-08-17T02:24:29.460572+0000","last_undegraded":"2024-08-17T02:24:29.460572+0000","last_fullsized":"2024-08-17T02:24:29.460572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:34.991199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.434226+0000","last_change":"2024-08-17T02:24:29.433363+0000","last_active":"2024-08-17T02:24:29.434226+0000","last_peered":"2024-08-17T02:24:29.434226+0000","last_clean":"2024-08-17T02:24:29.434226+0000","last_became_active":"2024-08-17T02:24:29.432999+0000","last_became_peered":"2024-08-17T02:24:29.432999+0000","last_unstale":"2024-08-17T02:24:29.434226+0000","last_undegraded":"2024-08-17T02:24:29.434226+0000","last_fullsized":"2024-08-17T02:24:29.434226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:48.171179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.412490+0000","last_change":"2024-08-17T02:24:28.435566+0000","last_active":"2024-08-17T02:24:29.412490+0000","last_peered":"2024-08-17T02:24:29.412490+0000","last_clean":"2024-08-17T02:24:29.412490+0000","last_became_active":"2024-08-17T02:24:28.434652+0000","last_became_peered":"2024-08-17T02:24:28.434652+0000","last_unstale":"2024-08-17T02:24:29.412490+0000","last_undegraded":"2024-08-17T02:24:29.412490+0000","last_fullsized":"2024-08-17T02:24:29.412490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:33:27.420267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.458174+0000","last_change":"2024-08-17T02:24:29.452901+0000","last_active":"2024-08-17T02:24:29.458174+0000","last_peered":"2024-08-17T02:24:29.458174+0000","last_clean":"2024-08-17T02:24:29.458174+0000","last_became_active":"2024-08-17T02:24:29.452427+0000","last_became_peered":"2024-08-17T02:24:29.452427+0000","last_unstale":"2024-08-17T02:24:29.458174+0000","last_undegraded":"2024-08-17T02:24:29.458174+0000","last_fullsized":"2024-08-17T02:24:29.458174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:51:44.570714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.423410+0000","last_change":"2024-08-17T02:24:25.092772+0000","last_active":"2024-08-17T02:24:29.423410+0000","last_peered":"2024-08-17T02:24:29.423410+0000","last_clean":"2024-08-17T02:24:29.423410+0000","last_became_active":"2024-08-17T02:24:25.091788+0000","last_became_peered":"2024-08-17T02:24:25.091788+0000","last_unstale":"2024-08-17T02:24:29.423410+0000","last_undegraded":"2024-08-17T02:24:29.423410+0000","last_fullsized":"2024-08-17T02:24:29.423410+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:24.051996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:24.051996+0000","last_clean_scrub_stamp":"2024-08-17T02:24:24.051996+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:31:45.454480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.420969+0000","last_change":"2024-08-17T02:24:28.429533+0000","last_active":"2024-08-17T02:24:29.420969+0000","last_peered":"2024-08-17T02:24:29.420969+0000","last_clean":"2024-08-17T02:24:29.420969+0000","last_became_active":"2024-08-17T02:24:28.429243+0000","last_became_peered":"2024-08-17T02:24:28.429243+0000","last_unstale":"2024-08-17T02:24:29.420969+0000","last_undegraded":"2024-08-17T02:24:29.420969+0000","last_fullsized":"2024-08-17T02:24:29.420969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:33:27.420267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.442042+0000","last_change":"2024-08-17T02:24:29.438354+0000","last_active":"2024-08-17T02:24:29.442042+0000","last_peered":"2024-08-17T02:24:29.442042+0000","last_clean":"2024-08-17T02:24:29.442042+0000","last_became_active":"2024-08-17T02:24:29.438160+0000","last_became_peered":"2024-08-17T02:24:29.438160+0000","last_unstale":"2024-08-17T02:24:29.442042+0000","last_undegraded":"2024-08-17T02:24:29.442042+0000","last_fullsized":"2024-08-17T02:24:29.442042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:26:09.573683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.423279+0000","last_change":"2024-08-17T02:24:28.438117+0000","last_active":"2024-08-17T02:24:29.423279+0000","last_peered":"2024-08-17T02:24:29.423279+0000","last_clean":"2024-08-17T02:24:29.423279+0000","last_became_active":"2024-08-17T02:24:28.437884+0000","last_became_peered":"2024-08-17T02:24:28.437884+0000","last_unstale":"2024-08-17T02:24:29.423279+0000","last_undegraded":"2024-08-17T02:24:29.423279+0000","last_fullsized":"2024-08-17T02:24:29.423279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:55:38.492426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.445436+0000","last_change":"2024-08-17T02:24:29.440285+0000","last_active":"2024-08-17T02:24:29.445436+0000","last_peered":"2024-08-17T02:24:29.445436+0000","last_clean":"2024-08-17T02:24:29.445436+0000","last_became_active":"2024-08-17T02:24:29.440027+0000","last_became_peered":"2024-08-17T02:24:29.440027+0000","last_unstale":"2024-08-17T02:24:29.445436+0000","last_undegraded":"2024-08-17T02:24:29.445436+0000","last_fullsized":"2024-08-17T02:24:29.445436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:40:05.110498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.412751+0000","last_change":"2024-08-17T02:24:28.434066+0000","last_active":"2024-08-17T02:24:29.412751+0000","last_peered":"2024-08-17T02:24:29.412751+0000","last_clean":"2024-08-17T02:24:29.412751+0000","last_became_active":"2024-08-17T02:24:28.433660+0000","last_became_peered":"2024-08-17T02:24:28.433660+0000","last_unstale":"2024-08-17T02:24:29.412751+0000","last_undegraded":"2024-08-17T02:24:29.412751+0000","last_fullsized":"2024-08-17T02:24:29.412751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:46:41.928641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.435766+0000","last_change":"2024-08-17T02:24:29.426088+0000","last_active":"2024-08-17T02:24:29.435766+0000","last_peered":"2024-08-17T02:24:29.435766+0000","last_clean":"2024-08-17T02:24:29.435766+0000","last_became_active":"2024-08-17T02:24:29.422286+0000","last_became_peered":"2024-08-17T02:24:29.422286+0000","last_unstale":"2024-08-17T02:24:29.435766+0000","last_undegraded":"2024-08-17T02:24:29.435766+0000","last_fullsized":"2024-08-17T02:24:29.435766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:58:14.241277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.421206+0000","last_change":"2024-08-17T02:24:28.431969+0000","last_active":"2024-08-17T02:24:29.421206+0000","last_peered":"2024-08-17T02:24:29.421206+0000","last_clean":"2024-08-17T02:24:29.421206+0000","last_became_active":"2024-08-17T02:24:28.431732+0000","last_became_peered":"2024-08-17T02:24:28.431732+0000","last_unstale":"2024-08-17T02:24:29.421206+0000","last_undegraded":"2024-08-17T02:24:29.421206+0000","last_fullsized":"2024-08-17T02:24:29.421206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:46:41.928641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.438785+0000","last_change":"2024-08-17T02:24:29.428834+0000","last_active":"2024-08-17T02:24:29.438785+0000","last_peered":"2024-08-17T02:24:29.438785+0000","last_clean":"2024-08-17T02:24:29.438785+0000","last_became_active":"2024-08-17T02:24:29.428548+0000","last_became_peered":"2024-08-17T02:24:29.428548+0000","last_unstale":"2024-08-17T02:24:29.438785+0000","last_undegraded":"2024-08-17T02:24:29.438785+0000","last_fullsized":"2024-08-17T02:24:29.438785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:28:42.709190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.415880+0000","last_change":"2024-08-17T02:24:28.427384+0000","last_active":"2024-08-17T02:24:29.415880+0000","last_peered":"2024-08-17T02:24:29.415880+0000","last_clean":"2024-08-17T02:24:29.415880+0000","last_became_active":"2024-08-17T02:24:28.426523+0000","last_became_peered":"2024-08-17T02:24:28.426523+0000","last_unstale":"2024-08-17T02:24:29.415880+0000","last_undegraded":"2024-08-17T02:24:29.415880+0000","last_fullsized":"2024-08-17T02:24:29.415880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:46:41.928641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450676+0000","last_change":"2024-08-17T02:24:29.441536+0000","last_active":"2024-08-17T02:24:29.450676+0000","last_peered":"2024-08-17T02:24:29.450676+0000","last_clean":"2024-08-17T02:24:29.450676+0000","last_became_active":"2024-08-17T02:24:29.440862+0000","last_became_peered":"2024-08-17T02:24:29.440862+0000","last_unstale":"2024-08-17T02:24:29.450676+0000","last_undegraded":"2024-08-17T02:24:29.450676+0000","last_fullsized":"2024-08-17T02:24:29.450676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:59:44.626213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.424591+0000","last_change":"2024-08-17T02:24:28.441139+0000","last_active":"2024-08-17T02:24:29.424591+0000","last_peered":"2024-08-17T02:24:29.424591+0000","last_clean":"2024-08-17T02:24:29.424591+0000","last_became_active":"2024-08-17T02:24:28.440867+0000","last_became_peered":"2024-08-17T02:24:28.440867+0000","last_unstale":"2024-08-17T02:24:29.424591+0000","last_undegraded":"2024-08-17T02:24:29.424591+0000","last_fullsized":"2024-08-17T02:24:29.424591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:51.790234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.435355+0000","last_change":"2024-08-17T02:24:29.421360+0000","last_active":"2024-08-17T02:24:29.435355+0000","last_peered":"2024-08-17T02:24:29.435355+0000","last_clean":"2024-08-17T02:24:29.435355+0000","last_became_active":"2024-08-17T02:24:29.421136+0000","last_became_peered":"2024-08-17T02:24:29.421136+0000","last_unstale":"2024-08-17T02:24:29.435355+0000","last_undegraded":"2024-08-17T02:24:29.435355+0000","last_fullsized":"2024-08-17T02:24:29.435355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:16.005540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.417024+0000","last_change":"2024-08-17T02:24:28.435491+0000","last_active":"2024-08-17T02:24:29.417024+0000","last_peered":"2024-08-17T02:24:29.417024+0000","last_clean":"2024-08-17T02:24:29.417024+0000","last_became_active":"2024-08-17T02:24:28.435238+0000","last_became_peered":"2024-08-17T02:24:28.435238+0000","last_unstale":"2024-08-17T02:24:29.417024+0000","last_undegraded":"2024-08-17T02:24:29.417024+0000","last_fullsized":"2024-08-17T02:24:29.417024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:18:30.215083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.433516+0000","last_change":"2024-08-17T02:24:29.431357+0000","last_active":"2024-08-17T02:24:29.433516+0000","last_peered":"2024-08-17T02:24:29.433516+0000","last_clean":"2024-08-17T02:24:29.433516+0000","last_became_active":"2024-08-17T02:24:29.430069+0000","last_became_peered":"2024-08-17T02:24:29.430069+0000","last_unstale":"2024-08-17T02:24:29.433516+0000","last_undegraded":"2024-08-17T02:24:29.433516+0000","last_fullsized":"2024-08-17T02:24:29.433516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:04:59.407311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.459511+0000","last_change":"2024-08-17T02:24:28.438397+0000","last_active":"2024-08-17T02:24:29.459511+0000","last_peered":"2024-08-17T02:24:29.459511+0000","last_clean":"2024-08-17T02:24:29.459511+0000","last_became_active":"2024-08-17T02:24:28.438086+0000","last_became_peered":"2024-08-17T02:24:28.438086+0000","last_unstale":"2024-08-17T02:24:29.459511+0000","last_undegraded":"2024-08-17T02:24:29.459511+0000","last_fullsized":"2024-08-17T02:24:29.459511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:18:30.215083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.441878+0000","last_change":"2024-08-17T02:24:29.437242+0000","last_active":"2024-08-17T02:24:29.441878+0000","last_peered":"2024-08-17T02:24:29.441878+0000","last_clean":"2024-08-17T02:24:29.441878+0000","last_became_active":"2024-08-17T02:24:29.436992+0000","last_became_peered":"2024-08-17T02:24:29.436992+0000","last_unstale":"2024-08-17T02:24:29.441878+0000","last_undegraded":"2024-08-17T02:24:29.441878+0000","last_fullsized":"2024-08-17T02:24:29.441878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:18:31.217481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.423166+0000","last_change":"2024-08-17T02:24:28.432643+0000","last_active":"2024-08-17T02:24:29.423166+0000","last_peered":"2024-08-17T02:24:29.423166+0000","last_clean":"2024-08-17T02:24:29.423166+0000","last_became_active":"2024-08-17T02:24:28.432360+0000","last_became_peered":"2024-08-17T02:24:28.432360+0000","last_unstale":"2024-08-17T02:24:29.423166+0000","last_undegraded":"2024-08-17T02:24:29.423166+0000","last_fullsized":"2024-08-17T02:24:29.423166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:17:58.120433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.429296+0000","last_change":"2024-08-17T02:24:29.419416+0000","last_active":"2024-08-17T02:24:29.429296+0000","last_peered":"2024-08-17T02:24:29.429296+0000","last_clean":"2024-08-17T02:24:29.429296+0000","last_became_active":"2024-08-17T02:24:29.419140+0000","last_became_peered":"2024-08-17T02:24:29.419140+0000","last_unstale":"2024-08-17T02:24:29.429296+0000","last_undegraded":"2024-08-17T02:24:29.429296+0000","last_fullsized":"2024-08-17T02:24:29.429296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:52.792632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.415080+0000","last_change":"2024-08-17T02:24:28.428331+0000","last_active":"2024-08-17T02:24:29.415080+0000","last_peered":"2024-08-17T02:24:29.415080+0000","last_clean":"2024-08-17T02:24:29.415080+0000","last_became_active":"2024-08-17T02:24:28.428035+0000","last_became_peered":"2024-08-17T02:24:28.428035+0000","last_unstale":"2024-08-17T02:24:29.415080+0000","last_undegraded":"2024-08-17T02:24:29.415080+0000","last_fullsized":"2024-08-17T02:24:29.415080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:51.790234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.433690+0000","last_change":"2024-08-17T02:24:29.431775+0000","last_active":"2024-08-17T02:24:29.433690+0000","last_peered":"2024-08-17T02:24:29.433690+0000","last_clean":"2024-08-17T02:24:29.433690+0000","last_became_active":"2024-08-17T02:24:29.431512+0000","last_became_peered":"2024-08-17T02:24:29.431512+0000","last_unstale":"2024-08-17T02:24:29.433690+0000","last_undegraded":"2024-08-17T02:24:29.433690+0000","last_fullsized":"2024-08-17T02:24:29.433690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:58:14.241277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.415638+0000","last_change":"2024-08-17T02:24:28.431932+0000","last_active":"2024-08-17T02:24:29.415638+0000","last_peered":"2024-08-17T02:24:29.415638+0000","last_clean":"2024-08-17T02:24:29.415638+0000","last_became_active":"2024-08-17T02:24:28.431664+0000","last_became_peered":"2024-08-17T02:24:28.431664+0000","last_unstale":"2024-08-17T02:24:29.415638+0000","last_undegraded":"2024-08-17T02:24:29.415638+0000","last_fullsized":"2024-08-17T02:24:29.415638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:55:38.492426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.431119+0000","last_change":"2024-08-17T02:24:29.429444+0000","last_active":"2024-08-17T02:24:29.431119+0000","last_peered":"2024-08-17T02:24:29.431119+0000","last_clean":"2024-08-17T02:24:29.431119+0000","last_became_active":"2024-08-17T02:24:29.429091+0000","last_became_peered":"2024-08-17T02:24:29.429091+0000","last_unstale":"2024-08-17T02:24:29.431119+0000","last_undegraded":"2024-08-17T02:24:29.431119+0000","last_fullsized":"2024-08-17T02:24:29.431119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:07:03.379300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.460868+0000","last_change":"2024-08-17T02:24:28.437430+0000","last_active":"2024-08-17T02:24:29.460868+0000","last_peered":"2024-08-17T02:24:29.460868+0000","last_clean":"2024-08-17T02:24:29.460868+0000","last_became_active":"2024-08-17T02:24:28.437238+0000","last_became_peered":"2024-08-17T02:24:28.437238+0000","last_unstale":"2024-08-17T02:24:29.460868+0000","last_undegraded":"2024-08-17T02:24:29.460868+0000","last_fullsized":"2024-08-17T02:24:29.460868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:28:41.706792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.432294+0000","last_change":"2024-08-17T02:24:29.430603+0000","last_active":"2024-08-17T02:24:29.432294+0000","last_peered":"2024-08-17T02:24:29.432294+0000","last_clean":"2024-08-17T02:24:29.432294+0000","last_became_active":"2024-08-17T02:24:29.430340+0000","last_became_peered":"2024-08-17T02:24:29.430340+0000","last_unstale":"2024-08-17T02:24:29.432294+0000","last_undegraded":"2024-08-17T02:24:29.432294+0000","last_fullsized":"2024-08-17T02:24:29.432294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:23:46.771394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450807+0000","last_change":"2024-08-17T02:24:29.441738+0000","last_active":"2024-08-17T02:24:29.450807+0000","last_peered":"2024-08-17T02:24:29.450807+0000","last_clean":"2024-08-17T02:24:29.450807+0000","last_became_active":"2024-08-17T02:24:29.441181+0000","last_became_peered":"2024-08-17T02:24:29.441181+0000","last_unstale":"2024-08-17T02:24:29.450807+0000","last_undegraded":"2024-08-17T02:24:29.450807+0000","last_fullsized":"2024-08-17T02:24:29.450807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:18:37.161695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.460138+0000","last_change":"2024-08-17T02:24:28.436783+0000","last_active":"2024-08-17T02:24:29.460138+0000","last_peered":"2024-08-17T02:24:29.460138+0000","last_clean":"2024-08-17T02:24:29.460138+0000","last_became_active":"2024-08-17T02:24:28.436552+0000","last_became_peered":"2024-08-17T02:24:28.436552+0000","last_unstale":"2024-08-17T02:24:29.460138+0000","last_undegraded":"2024-08-17T02:24:29.460138+0000","last_fullsized":"2024-08-17T02:24:29.460138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:18:30.215083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450243+0000","last_change":"2024-08-17T02:24:29.440059+0000","last_active":"2024-08-17T02:24:29.450243+0000","last_peered":"2024-08-17T02:24:29.450243+0000","last_clean":"2024-08-17T02:24:29.450243+0000","last_became_active":"2024-08-17T02:24:29.439878+0000","last_became_peered":"2024-08-17T02:24:29.439878+0000","last_unstale":"2024-08-17T02:24:29.450243+0000","last_undegraded":"2024-08-17T02:24:29.450243+0000","last_fullsized":"2024-08-17T02:24:29.450243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:23:46.771394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.461971+0000","last_change":"2024-08-17T02:24:28.435398+0000","last_active":"2024-08-17T02:24:29.461971+0000","last_peered":"2024-08-17T02:24:29.461971+0000","last_clean":"2024-08-17T02:24:29.461971+0000","last_became_active":"2024-08-17T02:24:28.435119+0000","last_became_peered":"2024-08-17T02:24:28.435119+0000","last_unstale":"2024-08-17T02:24:29.461971+0000","last_undegraded":"2024-08-17T02:24:29.461971+0000","last_fullsized":"2024-08-17T02:24:29.461971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:18:02.165697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.437418+0000","last_change":"2024-08-17T02:24:29.434467+0000","last_active":"2024-08-17T02:24:29.437418+0000","last_peered":"2024-08-17T02:24:29.437418+0000","last_clean":"2024-08-17T02:24:29.437418+0000","last_became_active":"2024-08-17T02:24:29.434160+0000","last_became_peered":"2024-08-17T02:24:29.434160+0000","last_unstale":"2024-08-17T02:24:29.437418+0000","last_undegraded":"2024-08-17T02:24:29.437418+0000","last_fullsized":"2024-08-17T02:24:29.437418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:58:14.241277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.457800+0000","last_change":"2024-08-17T02:24:28.431371+0000","last_active":"2024-08-17T02:24:29.457800+0000","last_peered":"2024-08-17T02:24:29.457800+0000","last_clean":"2024-08-17T02:24:29.457800+0000","last_became_active":"2024-08-17T02:24:28.431097+0000","last_became_peered":"2024-08-17T02:24:28.431097+0000","last_unstale":"2024-08-17T02:24:29.457800+0000","last_undegraded":"2024-08-17T02:24:29.457800+0000","last_fullsized":"2024-08-17T02:24:29.457800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:34.991199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.441162+0000","last_change":"2024-08-17T02:24:29.436845+0000","last_active":"2024-08-17T02:24:29.441162+0000","last_peered":"2024-08-17T02:24:29.441162+0000","last_clean":"2024-08-17T02:24:29.441162+0000","last_became_active":"2024-08-17T02:24:29.436419+0000","last_became_peered":"2024-08-17T02:24:29.436419+0000","last_unstale":"2024-08-17T02:24:29.441162+0000","last_undegraded":"2024-08-17T02:24:29.441162+0000","last_fullsized":"2024-08-17T02:24:29.441162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:48.171179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.457139+0000","last_change":"2024-08-17T02:24:28.428299+0000","last_active":"2024-08-17T02:24:29.457139+0000","last_peered":"2024-08-17T02:24:29.457139+0000","last_clean":"2024-08-17T02:24:29.457139+0000","last_became_active":"2024-08-17T02:24:28.428067+0000","last_became_peered":"2024-08-17T02:24:28.428067+0000","last_unstale":"2024-08-17T02:24:29.457139+0000","last_undegraded":"2024-08-17T02:24:29.457139+0000","last_fullsized":"2024-08-17T02:24:29.457139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:33:27.420267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302312,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069528,"statfs":{"total":96636764160,"available":96327196672,"internally_reserved":0,"allocated":815104,"data_stored":666251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301744,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070096,"statfs":{"total":96636764160,"available":96327778304,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301736,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070104,"statfs":{"total":96636764160,"available":96327786496,"internally_reserved":0,"allocated":221184,"data_stored":75403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301744,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070096,"statfs":{"total":96636764160,"available":96327778304,"internally_reserved":0,"allocated":229376,"data_stored":75439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":217088,"data_stored":75313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":225280,"data_stored":75473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298160,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073680,"statfs":{"total":96636764160,"available":96331448320,"internally_reserved":0,"allocated":823296,"data_stored":666307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:24:33.557 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:24:33.558 INFO:tasks.ceph.mds.d.smithi157.stderr:2024-08-17T02:24:33.554+0000 7f48f4600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:24:33.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.737+0000 7f870ca00640 1 Processor -- start 2024-08-17T02:24:33.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.737+0000 7f870ca00640 1 -- start start 2024-08-17T02:24:33.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.738+0000 7f870ca00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8708155a20 0x7f87080adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:33.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.738+0000 7f870ca00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8708156670 con 0x7f8708155df0 2024-08-17T02:24:33.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.738+0000 7f870ca00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f870806e5e0 con 0x7f870806df00 2024-08-17T02:24:33.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.738+0000 7f870ca00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87080b0350 con 0x7f8708155a20 2024-08-17T02:24:33.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.739+0000 7f8705400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f8708155df0 0x7f870806d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:47854/0 (socket says 172.21.15.107:47854) 2024-08-17T02:24:33.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.739+0000 7f8705400640 1 -- 172.21.15.107:0/3172949426 learned_addr learned my addr 172.21.15.107:0/3172949426 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:33.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.739+0000 7f8705e00640 1 --2- 172.21.15.107:0/3172949426 >> v2:172.21.15.157:3300/0 conn(0x7f8708155a20 0x7f87080adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:33.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.739+0000 7f8704a00640 1 -- 172.21.15.107:0/3172949426 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3529456498 0 0) 0x7f8708156670 con 0x7f8708155df0 2024-08-17T02:24:33.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.739+0000 7f8704a00640 1 -- 172.21.15.107:0/3172949426 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86ec0034e0 con 0x7f8708155df0 2024-08-17T02:24:33.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.739+0000 7f8705e00640 1 -- 172.21.15.107:0/3172949426 >> v1:172.21.15.157:6789/0 conn(0x7f870806df00 legacy=0x7f8708156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:33.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.739+0000 7f8705e00640 1 -- 172.21.15.107:0/3172949426 >> v1:172.21.15.107:6789/0 conn(0x7f8708155df0 legacy=0x7f870806d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:33.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.739+0000 7f8705e00640 1 -- 172.21.15.107:0/3172949426 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870806e8c0 con 0x7f8708155a20 2024-08-17T02:24:33.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.740+0000 7f8705e00640 1 --2- 172.21.15.107:0/3172949426 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8708155a20 0x7f87080adf10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f86f8009850 tx=0x7f86f80090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7c6f659ef97144f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:33.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.741+0000 7f8704a00640 1 -- 172.21.15.107:0/3172949426 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f802ad90 con 0x7f8708155a20 2024-08-17T02:24:33.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.741+0000 7f8704a00640 1 -- 172.21.15.107:0/3172949426 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f8032440 con 0x7f8708155a20 2024-08-17T02:24:33.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.741+0000 7f8704a00640 1 -- 172.21.15.107:0/3172949426 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f80327e0 con 0x7f8708155a20 2024-08-17T02:24:33.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.741+0000 7f870ca00640 1 -- 172.21.15.107:0/3172949426 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8708155a20 msgr2=0x7f87080adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:33.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.741+0000 7f870ca00640 1 --2- 172.21.15.107:0/3172949426 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8708155a20 0x7f87080adf10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f86f8009850 tx=0x7f86f80090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.741+0000 7f870ca00640 1 -- 172.21.15.107:0/3172949426 shutdown_connections 2024-08-17T02:24:33.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.741+0000 7f870ca00640 1 --2- 172.21.15.107:0/3172949426 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8708155a20 0x7f87080adf10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.741+0000 7f870ca00640 1 -- 172.21.15.107:0/3172949426 >> 172.21.15.107:0/3172949426 conn(0x7f87080cb9b0 msgr2=0x7f87080cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:33.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.741+0000 7f870ca00640 1 -- 172.21.15.107:0/3172949426 shutdown_connections 2024-08-17T02:24:33.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.741+0000 7f870ca00640 1 -- 172.21.15.107:0/3172949426 wait complete. 2024-08-17T02:24:33.744 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.743+0000 7f870ca00640 1 Processor -- start 2024-08-17T02:24:33.744 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.743+0000 7f870ca00640 1 -- start start 2024-08-17T02:24:33.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.744+0000 7f870ca00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f870806df00 0x7f8708145760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:33.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.744+0000 7f870ca00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8708155a20 0x7f870814d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:33.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.744+0000 7f870ca00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8708155df0 0x7f870814de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:33.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.744+0000 7f870ca00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8708163a00 con 0x7f870806df00 2024-08-17T02:24:33.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.744+0000 7f870ca00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870814b240 con 0x7f8708155df0 2024-08-17T02:24:33.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.744+0000 7f870ca00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f870814b520 con 0x7f8708155a20 2024-08-17T02:24:33.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.744+0000 7f8705e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f870806df00 0x7f8708145760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:33.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.744+0000 7f8705e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f870806df00 0x7f8708145760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37570/0 (socket says 172.21.15.107:37570) 2024-08-17T02:24:33.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.744+0000 7f8705e00640 1 -- 172.21.15.107:0/1638103168 learned_addr learned my addr 172.21.15.107:0/1638103168 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:33.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.744+0000 7f8705400640 1 --2- 172.21.15.107:0/1638103168 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8708155a20 0x7f870814d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:33.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.744+0000 7f8706800640 1 --2- 172.21.15.107:0/1638103168 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8708155df0 0x7f870814de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:33.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.744+0000 7f8705e00640 1 -- 172.21.15.107:0/1638103168 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8708155a20 msgr2=0x7f870814d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:33.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.744+0000 7f8705e00640 1 --2- 172.21.15.107:0/1638103168 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8708155a20 0x7f870814d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.744+0000 7f8705e00640 1 -- 172.21.15.107:0/1638103168 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8708155df0 msgr2=0x7f870814de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:33.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.744+0000 7f8705e00640 1 --2- 172.21.15.107:0/1638103168 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8708155df0 0x7f870814de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.744+0000 7f8705e00640 1 -- 172.21.15.107:0/1638103168 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f8009390 con 0x7f870806df00 2024-08-17T02:24:33.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.745+0000 7f8705e00640 1 --2- 172.21.15.107:0/1638103168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f870806df00 0x7f8708145760 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f86f8009850 tx=0x7f86f8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:33.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.745+0000 7f86fd600640 1 -- 172.21.15.107:0/1638103168 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f8031de0 con 0x7f870806df00 2024-08-17T02:24:33.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.745+0000 7f86fd600640 1 -- 172.21.15.107:0/1638103168 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f803d420 con 0x7f870806df00 2024-08-17T02:24:33.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.745+0000 7f86fd600640 1 -- 172.21.15.107:0/1638103168 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f803d800 con 0x7f870806df00 2024-08-17T02:24:33.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.745+0000 7f870ca00640 1 -- 172.21.15.107:0/1638103168 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f870814b800 con 0x7f870806df00 2024-08-17T02:24:33.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.745+0000 7f870ca00640 1 -- 172.21.15.107:0/1638103168 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8708145ca0 con 0x7f870806df00 2024-08-17T02:24:33.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.746+0000 7f870ca00640 1 -- 172.21.15.107:0/1638103168 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8708064db0 con 0x7f870806df00 2024-08-17T02:24:33.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.747+0000 7f86fd600640 1 -- 172.21.15.107:0/1638103168 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f86f8039040 con 0x7f870806df00 2024-08-17T02:24:33.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.749+0000 7f86fd600640 1 --2- 172.21.15.107:0/1638103168 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f86e8065150 0x7f86e8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:33.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.749+0000 7f86fd600640 1 -- 172.21.15.107:0/1638103168 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f86f80a2750 con 0x7f870806df00 2024-08-17T02:24:33.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.749+0000 7f8705400640 1 --2- 172.21.15.107:0/1638103168 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f86e8065150 0x7f86e8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:33.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.749+0000 7f8705400640 1 --2- 172.21.15.107:0/1638103168 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f86e8065150 0x7f86e8067600 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8708155020 tx=0x7f86f4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:33.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.752+0000 7f86fd600640 1 -- 172.21.15.107:0/1638103168 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f86f8070980 con 0x7f870806df00 2024-08-17T02:24:33.924 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.923+0000 7f870ca00640 1 -- 172.21.15.107:0/1638103168 --> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8708163b40 con 0x7f86e8065150 2024-08-17T02:24:33.931 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.930+0000 7f86fd600640 1 -- 172.21.15.107:0/1638103168 <== mgr.4110 v2:172.21.15.107:6832/37039 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264647 (secure 0 0 0) 0x7f86f400f7b0 con 0x7f86e8065150 2024-08-17T02:24:33.934 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:24:33.935 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-08-17T02:24:33.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.934+0000 7f870ca00640 1 -- 172.21.15.107:0/1638103168 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f86e8065150 msgr2=0x7f86e8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:33.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.934+0000 7f870ca00640 1 --2- 172.21.15.107:0/1638103168 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f86e8065150 0x7f86e8067600 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8708155020 tx=0x7f86f4009040 comp rx=0 tx=0).stop 2024-08-17T02:24:33.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.934+0000 7f870ca00640 1 -- 172.21.15.107:0/1638103168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f870806df00 msgr2=0x7f8708145760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:33.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.934+0000 7f870ca00640 1 --2- 172.21.15.107:0/1638103168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f870806df00 0x7f8708145760 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f86f8009850 tx=0x7f86f8032000 comp rx=0 tx=0).stop 2024-08-17T02:24:33.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.934+0000 7f870ca00640 1 -- 172.21.15.107:0/1638103168 shutdown_connections 2024-08-17T02:24:33.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.934+0000 7f870ca00640 1 --2- 172.21.15.107:0/1638103168 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f86e8065150 0x7f86e8067600 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.934+0000 7f870ca00640 1 --2- 172.21.15.107:0/1638103168 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8708155df0 0x7f870814de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.934+0000 7f870ca00640 1 --2- 172.21.15.107:0/1638103168 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8708155a20 0x7f870814d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.934+0000 7f870ca00640 1 --2- 172.21.15.107:0/1638103168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f870806df00 0x7f8708145760 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:33.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.934+0000 7f870ca00640 1 -- 172.21.15.107:0/1638103168 >> 172.21.15.107:0/1638103168 conn(0x7f87080cb9b0 msgr2=0x7f87081586f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:33.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.934+0000 7f870ca00640 1 -- 172.21.15.107:0/1638103168 shutdown_connections 2024-08-17T02:24:33.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:33.934+0000 7f870ca00640 1 -- 172.21.15.107:0/1638103168 wait complete. 2024-08-17T02:24:33.949 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-08-17T02:24:33.405324+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":147,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2398432,"kb_used_data":2920,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752576288,"statfs":{"total":773094113280,"available":770638118912,"internally_reserved":0,"allocated":2990080,"data_stored":1787916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.997591"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.452250+0000","last_change":"2024-08-17T02:24:29.448867+0000","last_active":"2024-08-17T02:24:29.452250+0000","last_peered":"2024-08-17T02:24:29.452250+0000","last_clean":"2024-08-17T02:24:29.452250+0000","last_became_active":"2024-08-17T02:24:29.448338+0000","last_became_peered":"2024-08-17T02:24:29.448338+0000","last_unstale":"2024-08-17T02:24:29.452250+0000","last_undegraded":"2024-08-17T02:24:29.452250+0000","last_fullsized":"2024-08-17T02:24:29.452250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:48:33.196839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.435860+0000","last_change":"2024-08-17T02:24:29.429588+0000","last_active":"2024-08-17T02:24:29.435860+0000","last_peered":"2024-08-17T02:24:29.435860+0000","last_clean":"2024-08-17T02:24:29.435860+0000","last_became_active":"2024-08-17T02:24:29.429300+0000","last_became_peered":"2024-08-17T02:24:29.429300+0000","last_unstale":"2024-08-17T02:24:29.435860+0000","last_undegraded":"2024-08-17T02:24:29.435860+0000","last_fullsized":"2024-08-17T02:24:29.435860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:40:05.110498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.435639+0000","last_change":"2024-08-17T02:24:29.428604+0000","last_active":"2024-08-17T02:24:29.435639+0000","last_peered":"2024-08-17T02:24:29.435639+0000","last_clean":"2024-08-17T02:24:29.435639+0000","last_became_active":"2024-08-17T02:24:29.428271+0000","last_became_peered":"2024-08-17T02:24:29.428271+0000","last_unstale":"2024-08-17T02:24:29.435639+0000","last_undegraded":"2024-08-17T02:24:29.435639+0000","last_fullsized":"2024-08-17T02:24:29.435639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:33.180306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.438068+0000","last_change":"2024-08-17T02:24:29.433468+0000","last_active":"2024-08-17T02:24:29.438068+0000","last_peered":"2024-08-17T02:24:29.438068+0000","last_clean":"2024-08-17T02:24:29.438068+0000","last_became_active":"2024-08-17T02:24:29.433248+0000","last_became_peered":"2024-08-17T02:24:29.433248+0000","last_unstale":"2024-08-17T02:24:29.438068+0000","last_undegraded":"2024-08-17T02:24:29.438068+0000","last_fullsized":"2024-08-17T02:24:29.438068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:46:58.314470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.451041+0000","last_change":"2024-08-17T02:24:29.444891+0000","last_active":"2024-08-17T02:24:29.451041+0000","last_peered":"2024-08-17T02:24:29.451041+0000","last_clean":"2024-08-17T02:24:29.451041+0000","last_became_active":"2024-08-17T02:24:29.444620+0000","last_became_peered":"2024-08-17T02:24:29.444620+0000","last_unstale":"2024-08-17T02:24:29.451041+0000","last_undegraded":"2024-08-17T02:24:29.451041+0000","last_fullsized":"2024-08-17T02:24:29.451041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:25:24.514567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450224+0000","last_change":"2024-08-17T02:24:29.438699+0000","last_active":"2024-08-17T02:24:29.450224+0000","last_peered":"2024-08-17T02:24:29.450224+0000","last_clean":"2024-08-17T02:24:29.450224+0000","last_became_active":"2024-08-17T02:24:29.438076+0000","last_became_peered":"2024-08-17T02:24:29.438076+0000","last_unstale":"2024-08-17T02:24:29.450224+0000","last_undegraded":"2024-08-17T02:24:29.450224+0000","last_fullsized":"2024-08-17T02:24:29.450224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:07:03.379300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.441450+0000","last_change":"2024-08-17T02:24:29.437568+0000","last_active":"2024-08-17T02:24:29.441450+0000","last_peered":"2024-08-17T02:24:29.441450+0000","last_clean":"2024-08-17T02:24:29.441450+0000","last_became_active":"2024-08-17T02:24:29.436316+0000","last_became_peered":"2024-08-17T02:24:29.436316+0000","last_unstale":"2024-08-17T02:24:29.441450+0000","last_undegraded":"2024-08-17T02:24:29.441450+0000","last_fullsized":"2024-08-17T02:24:29.441450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:46:58.314470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.442072+0000","last_change":"2024-08-17T02:24:29.438349+0000","last_active":"2024-08-17T02:24:29.442072+0000","last_peered":"2024-08-17T02:24:29.442072+0000","last_clean":"2024-08-17T02:24:29.442072+0000","last_became_active":"2024-08-17T02:24:29.438073+0000","last_became_peered":"2024-08-17T02:24:29.438073+0000","last_unstale":"2024-08-17T02:24:29.442072+0000","last_undegraded":"2024-08-17T02:24:29.442072+0000","last_fullsized":"2024-08-17T02:24:29.442072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:18.512619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.455304+0000","last_change":"2024-08-17T02:24:29.452166+0000","last_active":"2024-08-17T02:24:29.455304+0000","last_peered":"2024-08-17T02:24:29.455304+0000","last_clean":"2024-08-17T02:24:29.455304+0000","last_became_active":"2024-08-17T02:24:29.451022+0000","last_became_peered":"2024-08-17T02:24:29.451022+0000","last_unstale":"2024-08-17T02:24:29.455304+0000","last_undegraded":"2024-08-17T02:24:29.455304+0000","last_fullsized":"2024-08-17T02:24:29.455304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:29:30.041751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.447924+0000","last_change":"2024-08-17T02:24:29.443056+0000","last_active":"2024-08-17T02:24:29.447924+0000","last_peered":"2024-08-17T02:24:29.447924+0000","last_clean":"2024-08-17T02:24:29.447924+0000","last_became_active":"2024-08-17T02:24:29.442485+0000","last_became_peered":"2024-08-17T02:24:29.442485+0000","last_unstale":"2024-08-17T02:24:29.447924+0000","last_undegraded":"2024-08-17T02:24:29.447924+0000","last_fullsized":"2024-08-17T02:24:29.447924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:04:59.407311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.446564+0000","last_change":"2024-08-17T02:24:29.439275+0000","last_active":"2024-08-17T02:24:29.446564+0000","last_peered":"2024-08-17T02:24:29.446564+0000","last_clean":"2024-08-17T02:24:29.446564+0000","last_became_active":"2024-08-17T02:24:29.439101+0000","last_became_peered":"2024-08-17T02:24:29.439101+0000","last_unstale":"2024-08-17T02:24:29.446564+0000","last_undegraded":"2024-08-17T02:24:29.446564+0000","last_fullsized":"2024-08-17T02:24:29.446564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:58:14.241277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.436614+0000","last_change":"2024-08-17T02:24:29.430279+0000","last_active":"2024-08-17T02:24:29.436614+0000","last_peered":"2024-08-17T02:24:29.436614+0000","last_clean":"2024-08-17T02:24:29.436614+0000","last_became_active":"2024-08-17T02:24:29.430012+0000","last_became_peered":"2024-08-17T02:24:29.430012+0000","last_unstale":"2024-08-17T02:24:29.436614+0000","last_undegraded":"2024-08-17T02:24:29.436614+0000","last_fullsized":"2024-08-17T02:24:29.436614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:18:31.217481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.433404+0000","last_change":"2024-08-17T02:24:29.430879+0000","last_active":"2024-08-17T02:24:29.433404+0000","last_peered":"2024-08-17T02:24:29.433404+0000","last_clean":"2024-08-17T02:24:29.433404+0000","last_became_active":"2024-08-17T02:24:29.429162+0000","last_became_peered":"2024-08-17T02:24:29.429162+0000","last_unstale":"2024-08-17T02:24:29.433404+0000","last_undegraded":"2024-08-17T02:24:29.433404+0000","last_fullsized":"2024-08-17T02:24:29.433404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:59:44.626213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.442159+0000","last_change":"2024-08-17T02:24:29.438804+0000","last_active":"2024-08-17T02:24:29.442159+0000","last_peered":"2024-08-17T02:24:29.442159+0000","last_clean":"2024-08-17T02:24:29.442159+0000","last_became_active":"2024-08-17T02:24:29.438130+0000","last_became_peered":"2024-08-17T02:24:29.438130+0000","last_unstale":"2024-08-17T02:24:29.442159+0000","last_undegraded":"2024-08-17T02:24:29.442159+0000","last_fullsized":"2024-08-17T02:24:29.442159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:07:03.379300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.435960+0000","last_change":"2024-08-17T02:24:29.432494+0000","last_active":"2024-08-17T02:24:29.435960+0000","last_peered":"2024-08-17T02:24:29.435960+0000","last_clean":"2024-08-17T02:24:29.435960+0000","last_became_active":"2024-08-17T02:24:29.432128+0000","last_became_peered":"2024-08-17T02:24:29.432128+0000","last_unstale":"2024-08-17T02:24:29.435960+0000","last_undegraded":"2024-08-17T02:24:29.435960+0000","last_fullsized":"2024-08-17T02:24:29.435960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:18:37.161695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.432600+0000","last_change":"2024-08-17T02:24:29.431128+0000","last_active":"2024-08-17T02:24:29.432600+0000","last_peered":"2024-08-17T02:24:29.432600+0000","last_clean":"2024-08-17T02:24:29.432600+0000","last_became_active":"2024-08-17T02:24:29.428894+0000","last_became_peered":"2024-08-17T02:24:29.428894+0000","last_unstale":"2024-08-17T02:24:29.432600+0000","last_undegraded":"2024-08-17T02:24:29.432600+0000","last_fullsized":"2024-08-17T02:24:29.432600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:16.005540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450981+0000","last_change":"2024-08-17T02:24:29.444351+0000","last_active":"2024-08-17T02:24:29.450981+0000","last_peered":"2024-08-17T02:24:29.450981+0000","last_clean":"2024-08-17T02:24:29.450981+0000","last_became_active":"2024-08-17T02:24:29.443980+0000","last_became_peered":"2024-08-17T02:24:29.443980+0000","last_unstale":"2024-08-17T02:24:29.450981+0000","last_undegraded":"2024-08-17T02:24:29.450981+0000","last_fullsized":"2024-08-17T02:24:29.450981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:04:59.407311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.427120+0000","last_change":"2024-08-17T02:24:29.424479+0000","last_active":"2024-08-17T02:24:29.427120+0000","last_peered":"2024-08-17T02:24:29.427120+0000","last_clean":"2024-08-17T02:24:29.427120+0000","last_became_active":"2024-08-17T02:24:29.424027+0000","last_became_peered":"2024-08-17T02:24:29.424027+0000","last_unstale":"2024-08-17T02:24:29.427120+0000","last_undegraded":"2024-08-17T02:24:29.427120+0000","last_fullsized":"2024-08-17T02:24:29.427120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:18:31.217481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450896+0000","last_change":"2024-08-17T02:24:29.443271+0000","last_active":"2024-08-17T02:24:29.450896+0000","last_peered":"2024-08-17T02:24:29.450896+0000","last_clean":"2024-08-17T02:24:29.450896+0000","last_became_active":"2024-08-17T02:24:29.443006+0000","last_became_peered":"2024-08-17T02:24:29.443006+0000","last_unstale":"2024-08-17T02:24:29.450896+0000","last_undegraded":"2024-08-17T02:24:29.450896+0000","last_fullsized":"2024-08-17T02:24:29.450896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:26:09.573683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.435546+0000","last_change":"2024-08-17T02:24:29.434616+0000","last_active":"2024-08-17T02:24:29.435546+0000","last_peered":"2024-08-17T02:24:29.435546+0000","last_clean":"2024-08-17T02:24:29.435546+0000","last_became_active":"2024-08-17T02:24:29.434357+0000","last_became_peered":"2024-08-17T02:24:29.434357+0000","last_unstale":"2024-08-17T02:24:29.435546+0000","last_undegraded":"2024-08-17T02:24:29.435546+0000","last_fullsized":"2024-08-17T02:24:29.435546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:07:03.379300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.445449+0000","last_change":"2024-08-17T02:24:29.440294+0000","last_active":"2024-08-17T02:24:29.445449+0000","last_peered":"2024-08-17T02:24:29.445449+0000","last_clean":"2024-08-17T02:24:29.445449+0000","last_became_active":"2024-08-17T02:24:29.440044+0000","last_became_peered":"2024-08-17T02:24:29.440044+0000","last_unstale":"2024-08-17T02:24:29.445449+0000","last_undegraded":"2024-08-17T02:24:29.445449+0000","last_fullsized":"2024-08-17T02:24:29.445449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:18:37.161695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450245+0000","last_change":"2024-08-17T02:24:29.438981+0000","last_active":"2024-08-17T02:24:29.450245+0000","last_peered":"2024-08-17T02:24:29.450245+0000","last_clean":"2024-08-17T02:24:29.450245+0000","last_became_active":"2024-08-17T02:24:29.438545+0000","last_became_peered":"2024-08-17T02:24:29.438545+0000","last_unstale":"2024-08-17T02:24:29.450245+0000","last_undegraded":"2024-08-17T02:24:29.450245+0000","last_fullsized":"2024-08-17T02:24:29.450245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:26:09.573683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.441910+0000","last_change":"2024-08-17T02:24:29.437857+0000","last_active":"2024-08-17T02:24:29.441910+0000","last_peered":"2024-08-17T02:24:29.441910+0000","last_clean":"2024-08-17T02:24:29.441910+0000","last_became_active":"2024-08-17T02:24:29.437607+0000","last_became_peered":"2024-08-17T02:24:29.437607+0000","last_unstale":"2024-08-17T02:24:29.441910+0000","last_undegraded":"2024-08-17T02:24:29.441910+0000","last_fullsized":"2024-08-17T02:24:29.441910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:40:05.110498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.432619+0000","last_change":"2024-08-17T02:24:29.431695+0000","last_active":"2024-08-17T02:24:29.432619+0000","last_peered":"2024-08-17T02:24:29.432619+0000","last_clean":"2024-08-17T02:24:29.432619+0000","last_became_active":"2024-08-17T02:24:29.431435+0000","last_became_peered":"2024-08-17T02:24:29.431435+0000","last_unstale":"2024-08-17T02:24:29.432619+0000","last_undegraded":"2024-08-17T02:24:29.432619+0000","last_fullsized":"2024-08-17T02:24:29.432619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:39:33.176250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.437197+0000","last_change":"2024-08-17T02:24:29.435746+0000","last_active":"2024-08-17T02:24:29.437197+0000","last_peered":"2024-08-17T02:24:29.437197+0000","last_clean":"2024-08-17T02:24:29.437197+0000","last_became_active":"2024-08-17T02:24:29.435359+0000","last_became_peered":"2024-08-17T02:24:29.435359+0000","last_unstale":"2024-08-17T02:24:29.437197+0000","last_undegraded":"2024-08-17T02:24:29.437197+0000","last_fullsized":"2024-08-17T02:24:29.437197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:16.005540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.448489+0000","last_change":"2024-08-17T02:24:29.443168+0000","last_active":"2024-08-17T02:24:29.448489+0000","last_peered":"2024-08-17T02:24:29.448489+0000","last_clean":"2024-08-17T02:24:29.448489+0000","last_became_active":"2024-08-17T02:24:29.442833+0000","last_became_peered":"2024-08-17T02:24:29.442833+0000","last_unstale":"2024-08-17T02:24:29.448489+0000","last_undegraded":"2024-08-17T02:24:29.448489+0000","last_fullsized":"2024-08-17T02:24:29.448489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:48.171179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.435841+0000","last_change":"2024-08-17T02:24:29.429618+0000","last_active":"2024-08-17T02:24:29.435841+0000","last_peered":"2024-08-17T02:24:29.435841+0000","last_clean":"2024-08-17T02:24:29.435841+0000","last_became_active":"2024-08-17T02:24:29.429267+0000","last_became_peered":"2024-08-17T02:24:29.429267+0000","last_unstale":"2024-08-17T02:24:29.435841+0000","last_undegraded":"2024-08-17T02:24:29.435841+0000","last_fullsized":"2024-08-17T02:24:29.435841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:07:03.379300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.437177+0000","last_change":"2024-08-17T02:24:29.435512+0000","last_active":"2024-08-17T02:24:29.437177+0000","last_peered":"2024-08-17T02:24:29.437177+0000","last_clean":"2024-08-17T02:24:29.437177+0000","last_became_active":"2024-08-17T02:24:29.434546+0000","last_became_peered":"2024-08-17T02:24:29.434546+0000","last_unstale":"2024-08-17T02:24:29.437177+0000","last_undegraded":"2024-08-17T02:24:29.437177+0000","last_fullsized":"2024-08-17T02:24:29.437177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:23:46.771394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.437350+0000","last_change":"2024-08-17T02:24:29.434096+0000","last_active":"2024-08-17T02:24:29.437350+0000","last_peered":"2024-08-17T02:24:29.437350+0000","last_clean":"2024-08-17T02:24:29.437350+0000","last_became_active":"2024-08-17T02:24:29.432111+0000","last_became_peered":"2024-08-17T02:24:29.432111+0000","last_unstale":"2024-08-17T02:24:29.437350+0000","last_undegraded":"2024-08-17T02:24:29.437350+0000","last_fullsized":"2024-08-17T02:24:29.437350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:59:44.626213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450204+0000","last_change":"2024-08-17T02:24:29.438474+0000","last_active":"2024-08-17T02:24:29.450204+0000","last_peered":"2024-08-17T02:24:29.450204+0000","last_clean":"2024-08-17T02:24:29.450204+0000","last_became_active":"2024-08-17T02:24:29.434276+0000","last_became_peered":"2024-08-17T02:24:29.434276+0000","last_unstale":"2024-08-17T02:24:29.450204+0000","last_undegraded":"2024-08-17T02:24:29.450204+0000","last_fullsized":"2024-08-17T02:24:29.450204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:09:30.631732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.426340+0000","last_change":"2024-08-17T02:24:29.423201+0000","last_active":"2024-08-17T02:24:29.426340+0000","last_peered":"2024-08-17T02:24:29.426340+0000","last_clean":"2024-08-17T02:24:29.426340+0000","last_became_active":"2024-08-17T02:24:29.422912+0000","last_became_peered":"2024-08-17T02:24:29.422912+0000","last_unstale":"2024-08-17T02:24:29.426340+0000","last_undegraded":"2024-08-17T02:24:29.426340+0000","last_fullsized":"2024-08-17T02:24:29.426340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:52.792632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.432747+0000","last_change":"2024-08-17T02:24:29.431883+0000","last_active":"2024-08-17T02:24:29.432747+0000","last_peered":"2024-08-17T02:24:29.432747+0000","last_clean":"2024-08-17T02:24:29.432747+0000","last_became_active":"2024-08-17T02:24:29.431617+0000","last_became_peered":"2024-08-17T02:24:29.431617+0000","last_unstale":"2024-08-17T02:24:29.432747+0000","last_undegraded":"2024-08-17T02:24:29.432747+0000","last_fullsized":"2024-08-17T02:24:29.432747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:33.180306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.429731+0000","last_change":"2024-08-17T02:24:29.420479+0000","last_active":"2024-08-17T02:24:29.429731+0000","last_peered":"2024-08-17T02:24:29.429731+0000","last_clean":"2024-08-17T02:24:29.429731+0000","last_became_active":"2024-08-17T02:24:29.420224+0000","last_became_peered":"2024-08-17T02:24:29.420224+0000","last_unstale":"2024-08-17T02:24:29.429731+0000","last_undegraded":"2024-08-17T02:24:29.429731+0000","last_fullsized":"2024-08-17T02:24:29.429731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:02.260531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.457859+0000","last_change":"2024-08-17T02:24:28.436881+0000","last_active":"2024-08-17T02:24:29.457859+0000","last_peered":"2024-08-17T02:24:29.457859+0000","last_clean":"2024-08-17T02:24:29.457859+0000","last_became_active":"2024-08-17T02:24:28.436557+0000","last_became_peered":"2024-08-17T02:24:28.436557+0000","last_unstale":"2024-08-17T02:24:29.457859+0000","last_undegraded":"2024-08-17T02:24:29.457859+0000","last_fullsized":"2024-08-17T02:24:29.457859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:46:41.928641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.441803+0000","last_change":"2024-08-17T02:24:29.436940+0000","last_active":"2024-08-17T02:24:29.441803+0000","last_peered":"2024-08-17T02:24:29.441803+0000","last_clean":"2024-08-17T02:24:29.441803+0000","last_became_active":"2024-08-17T02:24:29.436582+0000","last_became_peered":"2024-08-17T02:24:29.436582+0000","last_unstale":"2024-08-17T02:24:29.441803+0000","last_undegraded":"2024-08-17T02:24:29.441803+0000","last_fullsized":"2024-08-17T02:24:29.441803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:22:20.026814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.456848+0000","last_change":"2024-08-17T02:24:28.438875+0000","last_active":"2024-08-17T02:24:29.456848+0000","last_peered":"2024-08-17T02:24:29.456848+0000","last_clean":"2024-08-17T02:24:29.456848+0000","last_became_active":"2024-08-17T02:24:28.438051+0000","last_became_peered":"2024-08-17T02:24:28.438051+0000","last_unstale":"2024-08-17T02:24:29.456848+0000","last_undegraded":"2024-08-17T02:24:29.456848+0000","last_fullsized":"2024-08-17T02:24:29.456848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:01.258133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.423658+0000","last_change":"2024-08-17T02:24:28.432912+0000","last_active":"2024-08-17T02:24:29.423658+0000","last_peered":"2024-08-17T02:24:29.423658+0000","last_clean":"2024-08-17T02:24:29.423658+0000","last_became_active":"2024-08-17T02:24:28.432676+0000","last_became_peered":"2024-08-17T02:24:28.432676+0000","last_unstale":"2024-08-17T02:24:29.423658+0000","last_undegraded":"2024-08-17T02:24:29.423658+0000","last_fullsized":"2024-08-17T02:24:29.423658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:18.717365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.433669+0000","last_change":"2024-08-17T02:24:29.431474+0000","last_active":"2024-08-17T02:24:29.433669+0000","last_peered":"2024-08-17T02:24:29.433669+0000","last_clean":"2024-08-17T02:24:29.433669+0000","last_became_active":"2024-08-17T02:24:29.429133+0000","last_became_peered":"2024-08-17T02:24:29.429133+0000","last_unstale":"2024-08-17T02:24:29.433669+0000","last_undegraded":"2024-08-17T02:24:29.433669+0000","last_fullsized":"2024-08-17T02:24:29.433669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:18:37.161695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.420882+0000","last_change":"2024-08-17T02:24:28.423819+0000","last_active":"2024-08-17T02:24:29.420882+0000","last_peered":"2024-08-17T02:24:29.420882+0000","last_clean":"2024-08-17T02:24:29.420882+0000","last_became_active":"2024-08-17T02:24:28.423549+0000","last_became_peered":"2024-08-17T02:24:28.423549+0000","last_unstale":"2024-08-17T02:24:29.420882+0000","last_undegraded":"2024-08-17T02:24:29.420882+0000","last_fullsized":"2024-08-17T02:24:29.420882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:34.991199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.435925+0000","last_change":"2024-08-17T02:24:29.432048+0000","last_active":"2024-08-17T02:24:29.435925+0000","last_peered":"2024-08-17T02:24:29.435925+0000","last_clean":"2024-08-17T02:24:29.435925+0000","last_became_active":"2024-08-17T02:24:29.431772+0000","last_became_peered":"2024-08-17T02:24:29.431772+0000","last_unstale":"2024-08-17T02:24:29.435925+0000","last_undegraded":"2024-08-17T02:24:29.435925+0000","last_fullsized":"2024-08-17T02:24:29.435925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:59:44.626213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.429707+0000","last_change":"2024-08-17T02:24:28.443065+0000","last_active":"2024-08-17T02:24:29.429707+0000","last_peered":"2024-08-17T02:24:29.429707+0000","last_clean":"2024-08-17T02:24:29.429707+0000","last_became_active":"2024-08-17T02:24:28.442641+0000","last_became_peered":"2024-08-17T02:24:28.442641+0000","last_unstale":"2024-08-17T02:24:29.429707+0000","last_undegraded":"2024-08-17T02:24:29.429707+0000","last_fullsized":"2024-08-17T02:24:29.429707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:55:38.492426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450640+0000","last_change":"2024-08-17T02:24:29.441379+0000","last_active":"2024-08-17T02:24:29.450640+0000","last_peered":"2024-08-17T02:24:29.450640+0000","last_clean":"2024-08-17T02:24:29.450640+0000","last_became_active":"2024-08-17T02:24:29.441099+0000","last_became_peered":"2024-08-17T02:24:29.441099+0000","last_unstale":"2024-08-17T02:24:29.450640+0000","last_undegraded":"2024-08-17T02:24:29.450640+0000","last_fullsized":"2024-08-17T02:24:29.450640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:18.512619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.423197+0000","last_change":"2024-08-17T02:24:28.440516+0000","last_active":"2024-08-17T02:24:29.423197+0000","last_peered":"2024-08-17T02:24:29.423197+0000","last_clean":"2024-08-17T02:24:29.423197+0000","last_became_active":"2024-08-17T02:24:28.440243+0000","last_became_peered":"2024-08-17T02:24:28.440243+0000","last_unstale":"2024-08-17T02:24:29.423197+0000","last_undegraded":"2024-08-17T02:24:29.423197+0000","last_fullsized":"2024-08-17T02:24:29.423197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:01.258133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.437435+0000","last_change":"2024-08-17T02:24:29.434837+0000","last_active":"2024-08-17T02:24:29.437435+0000","last_peered":"2024-08-17T02:24:29.437435+0000","last_clean":"2024-08-17T02:24:29.437435+0000","last_became_active":"2024-08-17T02:24:29.434528+0000","last_became_peered":"2024-08-17T02:24:29.434528+0000","last_unstale":"2024-08-17T02:24:29.437435+0000","last_undegraded":"2024-08-17T02:24:29.437435+0000","last_fullsized":"2024-08-17T02:24:29.437435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:23:46.771394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.461505+0000","last_change":"2024-08-17T02:24:28.434795+0000","last_active":"2024-08-17T02:24:29.461505+0000","last_peered":"2024-08-17T02:24:29.461505+0000","last_clean":"2024-08-17T02:24:29.461505+0000","last_became_active":"2024-08-17T02:24:28.434522+0000","last_became_peered":"2024-08-17T02:24:28.434522+0000","last_unstale":"2024-08-17T02:24:29.461505+0000","last_undegraded":"2024-08-17T02:24:29.461505+0000","last_fullsized":"2024-08-17T02:24:29.461505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:28:41.706792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450003+0000","last_change":"2024-08-17T02:24:29.443910+0000","last_active":"2024-08-17T02:24:29.450003+0000","last_peered":"2024-08-17T02:24:29.450003+0000","last_clean":"2024-08-17T02:24:29.450003+0000","last_became_active":"2024-08-17T02:24:29.443621+0000","last_became_peered":"2024-08-17T02:24:29.443621+0000","last_unstale":"2024-08-17T02:24:29.450003+0000","last_undegraded":"2024-08-17T02:24:29.450003+0000","last_fullsized":"2024-08-17T02:24:29.450003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:55:39.494824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.461687+0000","last_change":"2024-08-17T02:24:28.439962+0000","last_active":"2024-08-17T02:24:29.461687+0000","last_peered":"2024-08-17T02:24:29.461687+0000","last_clean":"2024-08-17T02:24:29.461687+0000","last_became_active":"2024-08-17T02:24:28.439277+0000","last_became_peered":"2024-08-17T02:24:28.439277+0000","last_unstale":"2024-08-17T02:24:29.461687+0000","last_undegraded":"2024-08-17T02:24:29.461687+0000","last_fullsized":"2024-08-17T02:24:29.461687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:28:41.706792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450874+0000","last_change":"2024-08-17T02:24:29.442682+0000","last_active":"2024-08-17T02:24:29.450874+0000","last_peered":"2024-08-17T02:24:29.450874+0000","last_clean":"2024-08-17T02:24:29.450874+0000","last_became_active":"2024-08-17T02:24:29.441913+0000","last_became_peered":"2024-08-17T02:24:29.441913+0000","last_unstale":"2024-08-17T02:24:29.450874+0000","last_undegraded":"2024-08-17T02:24:29.450874+0000","last_fullsized":"2024-08-17T02:24:29.450874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:26:38.223253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.457160+0000","last_change":"2024-08-17T02:24:28.423349+0000","last_active":"2024-08-17T02:24:29.457160+0000","last_peered":"2024-08-17T02:24:29.457160+0000","last_clean":"2024-08-17T02:24:29.457160+0000","last_became_active":"2024-08-17T02:24:28.423068+0000","last_became_peered":"2024-08-17T02:24:28.423068+0000","last_unstale":"2024-08-17T02:24:29.457160+0000","last_undegraded":"2024-08-17T02:24:29.457160+0000","last_fullsized":"2024-08-17T02:24:29.457160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:59.126938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.445464+0000","last_change":"2024-08-17T02:24:29.440328+0000","last_active":"2024-08-17T02:24:29.445464+0000","last_peered":"2024-08-17T02:24:29.445464+0000","last_clean":"2024-08-17T02:24:29.445464+0000","last_became_active":"2024-08-17T02:24:29.440057+0000","last_became_peered":"2024-08-17T02:24:29.440057+0000","last_unstale":"2024-08-17T02:24:29.445464+0000","last_undegraded":"2024-08-17T02:24:29.445464+0000","last_fullsized":"2024-08-17T02:24:29.445464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:16.005540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.421193+0000","last_change":"2024-08-17T02:24:28.435098+0000","last_active":"2024-08-17T02:24:29.421193+0000","last_peered":"2024-08-17T02:24:29.421193+0000","last_clean":"2024-08-17T02:24:29.421193+0000","last_became_active":"2024-08-17T02:24:28.434834+0000","last_became_peered":"2024-08-17T02:24:28.434834+0000","last_unstale":"2024-08-17T02:24:29.421193+0000","last_undegraded":"2024-08-17T02:24:29.421193+0000","last_fullsized":"2024-08-17T02:24:29.421193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:18.717365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.451653+0000","last_change":"2024-08-17T02:24:29.449862+0000","last_active":"2024-08-17T02:24:29.451653+0000","last_peered":"2024-08-17T02:24:29.451653+0000","last_clean":"2024-08-17T02:24:29.451653+0000","last_became_active":"2024-08-17T02:24:29.449560+0000","last_became_peered":"2024-08-17T02:24:29.449560+0000","last_unstale":"2024-08-17T02:24:29.451653+0000","last_undegraded":"2024-08-17T02:24:29.451653+0000","last_fullsized":"2024-08-17T02:24:29.451653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:48.171179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.420175+0000","last_change":"2024-08-17T02:24:28.438842+0000","last_active":"2024-08-17T02:24:29.420175+0000","last_peered":"2024-08-17T02:24:29.420175+0000","last_clean":"2024-08-17T02:24:29.420175+0000","last_became_active":"2024-08-17T02:24:28.438244+0000","last_became_peered":"2024-08-17T02:24:28.438244+0000","last_unstale":"2024-08-17T02:24:29.420175+0000","last_undegraded":"2024-08-17T02:24:29.420175+0000","last_fullsized":"2024-08-17T02:24:29.420175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:51.790234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.432534+0000","last_change":"2024-08-17T02:24:29.426910+0000","last_active":"2024-08-17T02:24:29.432534+0000","last_peered":"2024-08-17T02:24:29.432534+0000","last_clean":"2024-08-17T02:24:29.432534+0000","last_became_active":"2024-08-17T02:24:29.426608+0000","last_became_peered":"2024-08-17T02:24:29.426608+0000","last_unstale":"2024-08-17T02:24:29.432534+0000","last_undegraded":"2024-08-17T02:24:29.432534+0000","last_fullsized":"2024-08-17T02:24:29.432534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:02:43.252296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.460256+0000","last_change":"2024-08-17T02:24:28.426073+0000","last_active":"2024-08-17T02:24:29.460256+0000","last_peered":"2024-08-17T02:24:29.460256+0000","last_clean":"2024-08-17T02:24:29.460256+0000","last_became_active":"2024-08-17T02:24:28.425822+0000","last_became_peered":"2024-08-17T02:24:28.425822+0000","last_unstale":"2024-08-17T02:24:29.460256+0000","last_undegraded":"2024-08-17T02:24:29.460256+0000","last_fullsized":"2024-08-17T02:24:29.460256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:34.991199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.447515+0000","last_change":"2024-08-17T02:24:29.441566+0000","last_active":"2024-08-17T02:24:29.447515+0000","last_peered":"2024-08-17T02:24:29.447515+0000","last_clean":"2024-08-17T02:24:29.447515+0000","last_became_active":"2024-08-17T02:24:29.441269+0000","last_became_peered":"2024-08-17T02:24:29.441269+0000","last_unstale":"2024-08-17T02:24:29.447515+0000","last_undegraded":"2024-08-17T02:24:29.447515+0000","last_fullsized":"2024-08-17T02:24:29.447515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:39:33.176250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.460590+0000","last_change":"2024-08-17T02:24:28.423469+0000","last_active":"2024-08-17T02:24:29.460590+0000","last_peered":"2024-08-17T02:24:29.460590+0000","last_clean":"2024-08-17T02:24:29.460590+0000","last_became_active":"2024-08-17T02:24:28.423205+0000","last_became_peered":"2024-08-17T02:24:28.423205+0000","last_unstale":"2024-08-17T02:24:29.460590+0000","last_undegraded":"2024-08-17T02:24:29.460590+0000","last_fullsized":"2024-08-17T02:24:29.460590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:03:42.063288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.454737+0000","last_change":"2024-08-17T02:24:29.452111+0000","last_active":"2024-08-17T02:24:29.454737+0000","last_peered":"2024-08-17T02:24:29.454737+0000","last_clean":"2024-08-17T02:24:29.454737+0000","last_became_active":"2024-08-17T02:24:29.451873+0000","last_became_peered":"2024-08-17T02:24:29.451873+0000","last_unstale":"2024-08-17T02:24:29.454737+0000","last_undegraded":"2024-08-17T02:24:29.454737+0000","last_fullsized":"2024-08-17T02:24:29.454737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:18.512619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.459157+0000","last_change":"2024-08-17T02:24:28.436576+0000","last_active":"2024-08-17T02:24:29.459157+0000","last_peered":"2024-08-17T02:24:29.459157+0000","last_clean":"2024-08-17T02:24:29.459157+0000","last_became_active":"2024-08-17T02:24:28.436045+0000","last_became_peered":"2024-08-17T02:24:28.436045+0000","last_unstale":"2024-08-17T02:24:29.459157+0000","last_undegraded":"2024-08-17T02:24:29.459157+0000","last_fullsized":"2024-08-17T02:24:29.459157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:18.717365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.452269+0000","last_change":"2024-08-17T02:24:29.448760+0000","last_active":"2024-08-17T02:24:29.452269+0000","last_peered":"2024-08-17T02:24:29.452269+0000","last_clean":"2024-08-17T02:24:29.452269+0000","last_became_active":"2024-08-17T02:24:29.447419+0000","last_became_peered":"2024-08-17T02:24:29.447419+0000","last_unstale":"2024-08-17T02:24:29.452269+0000","last_undegraded":"2024-08-17T02:24:29.452269+0000","last_fullsized":"2024-08-17T02:24:29.452269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:09:30.631732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.460572+0000","last_change":"2024-08-17T02:24:28.423802+0000","last_active":"2024-08-17T02:24:29.460572+0000","last_peered":"2024-08-17T02:24:29.460572+0000","last_clean":"2024-08-17T02:24:29.460572+0000","last_became_active":"2024-08-17T02:24:28.423537+0000","last_became_peered":"2024-08-17T02:24:28.423537+0000","last_unstale":"2024-08-17T02:24:29.460572+0000","last_undegraded":"2024-08-17T02:24:29.460572+0000","last_fullsized":"2024-08-17T02:24:29.460572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:34.991199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.434226+0000","last_change":"2024-08-17T02:24:29.433363+0000","last_active":"2024-08-17T02:24:29.434226+0000","last_peered":"2024-08-17T02:24:29.434226+0000","last_clean":"2024-08-17T02:24:29.434226+0000","last_became_active":"2024-08-17T02:24:29.432999+0000","last_became_peered":"2024-08-17T02:24:29.432999+0000","last_unstale":"2024-08-17T02:24:29.434226+0000","last_undegraded":"2024-08-17T02:24:29.434226+0000","last_fullsized":"2024-08-17T02:24:29.434226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:48.171179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.412490+0000","last_change":"2024-08-17T02:24:28.435566+0000","last_active":"2024-08-17T02:24:29.412490+0000","last_peered":"2024-08-17T02:24:29.412490+0000","last_clean":"2024-08-17T02:24:29.412490+0000","last_became_active":"2024-08-17T02:24:28.434652+0000","last_became_peered":"2024-08-17T02:24:28.434652+0000","last_unstale":"2024-08-17T02:24:29.412490+0000","last_undegraded":"2024-08-17T02:24:29.412490+0000","last_fullsized":"2024-08-17T02:24:29.412490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:33:27.420267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.458174+0000","last_change":"2024-08-17T02:24:29.452901+0000","last_active":"2024-08-17T02:24:29.458174+0000","last_peered":"2024-08-17T02:24:29.458174+0000","last_clean":"2024-08-17T02:24:29.458174+0000","last_became_active":"2024-08-17T02:24:29.452427+0000","last_became_peered":"2024-08-17T02:24:29.452427+0000","last_unstale":"2024-08-17T02:24:29.458174+0000","last_undegraded":"2024-08-17T02:24:29.458174+0000","last_fullsized":"2024-08-17T02:24:29.458174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:51:44.570714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.423410+0000","last_change":"2024-08-17T02:24:25.092772+0000","last_active":"2024-08-17T02:24:29.423410+0000","last_peered":"2024-08-17T02:24:29.423410+0000","last_clean":"2024-08-17T02:24:29.423410+0000","last_became_active":"2024-08-17T02:24:25.091788+0000","last_became_peered":"2024-08-17T02:24:25.091788+0000","last_unstale":"2024-08-17T02:24:29.423410+0000","last_undegraded":"2024-08-17T02:24:29.423410+0000","last_fullsized":"2024-08-17T02:24:29.423410+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:24.051996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:24.051996+0000","last_clean_scrub_stamp":"2024-08-17T02:24:24.051996+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:31:45.454480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.420969+0000","last_change":"2024-08-17T02:24:28.429533+0000","last_active":"2024-08-17T02:24:29.420969+0000","last_peered":"2024-08-17T02:24:29.420969+0000","last_clean":"2024-08-17T02:24:29.420969+0000","last_became_active":"2024-08-17T02:24:28.429243+0000","last_became_peered":"2024-08-17T02:24:28.429243+0000","last_unstale":"2024-08-17T02:24:29.420969+0000","last_undegraded":"2024-08-17T02:24:29.420969+0000","last_fullsized":"2024-08-17T02:24:29.420969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:33:27.420267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.442042+0000","last_change":"2024-08-17T02:24:29.438354+0000","last_active":"2024-08-17T02:24:29.442042+0000","last_peered":"2024-08-17T02:24:29.442042+0000","last_clean":"2024-08-17T02:24:29.442042+0000","last_became_active":"2024-08-17T02:24:29.438160+0000","last_became_peered":"2024-08-17T02:24:29.438160+0000","last_unstale":"2024-08-17T02:24:29.442042+0000","last_undegraded":"2024-08-17T02:24:29.442042+0000","last_fullsized":"2024-08-17T02:24:29.442042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:26:09.573683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.423279+0000","last_change":"2024-08-17T02:24:28.438117+0000","last_active":"2024-08-17T02:24:29.423279+0000","last_peered":"2024-08-17T02:24:29.423279+0000","last_clean":"2024-08-17T02:24:29.423279+0000","last_became_active":"2024-08-17T02:24:28.437884+0000","last_became_peered":"2024-08-17T02:24:28.437884+0000","last_unstale":"2024-08-17T02:24:29.423279+0000","last_undegraded":"2024-08-17T02:24:29.423279+0000","last_fullsized":"2024-08-17T02:24:29.423279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:55:38.492426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.445436+0000","last_change":"2024-08-17T02:24:29.440285+0000","last_active":"2024-08-17T02:24:29.445436+0000","last_peered":"2024-08-17T02:24:29.445436+0000","last_clean":"2024-08-17T02:24:29.445436+0000","last_became_active":"2024-08-17T02:24:29.440027+0000","last_became_peered":"2024-08-17T02:24:29.440027+0000","last_unstale":"2024-08-17T02:24:29.445436+0000","last_undegraded":"2024-08-17T02:24:29.445436+0000","last_fullsized":"2024-08-17T02:24:29.445436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:40:05.110498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.412751+0000","last_change":"2024-08-17T02:24:28.434066+0000","last_active":"2024-08-17T02:24:29.412751+0000","last_peered":"2024-08-17T02:24:29.412751+0000","last_clean":"2024-08-17T02:24:29.412751+0000","last_became_active":"2024-08-17T02:24:28.433660+0000","last_became_peered":"2024-08-17T02:24:28.433660+0000","last_unstale":"2024-08-17T02:24:29.412751+0000","last_undegraded":"2024-08-17T02:24:29.412751+0000","last_fullsized":"2024-08-17T02:24:29.412751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:46:41.928641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.435766+0000","last_change":"2024-08-17T02:24:29.426088+0000","last_active":"2024-08-17T02:24:29.435766+0000","last_peered":"2024-08-17T02:24:29.435766+0000","last_clean":"2024-08-17T02:24:29.435766+0000","last_became_active":"2024-08-17T02:24:29.422286+0000","last_became_peered":"2024-08-17T02:24:29.422286+0000","last_unstale":"2024-08-17T02:24:29.435766+0000","last_undegraded":"2024-08-17T02:24:29.435766+0000","last_fullsized":"2024-08-17T02:24:29.435766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:58:14.241277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.421206+0000","last_change":"2024-08-17T02:24:28.431969+0000","last_active":"2024-08-17T02:24:29.421206+0000","last_peered":"2024-08-17T02:24:29.421206+0000","last_clean":"2024-08-17T02:24:29.421206+0000","last_became_active":"2024-08-17T02:24:28.431732+0000","last_became_peered":"2024-08-17T02:24:28.431732+0000","last_unstale":"2024-08-17T02:24:29.421206+0000","last_undegraded":"2024-08-17T02:24:29.421206+0000","last_fullsized":"2024-08-17T02:24:29.421206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:46:41.928641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.438785+0000","last_change":"2024-08-17T02:24:29.428834+0000","last_active":"2024-08-17T02:24:29.438785+0000","last_peered":"2024-08-17T02:24:29.438785+0000","last_clean":"2024-08-17T02:24:29.438785+0000","last_became_active":"2024-08-17T02:24:29.428548+0000","last_became_peered":"2024-08-17T02:24:29.428548+0000","last_unstale":"2024-08-17T02:24:29.438785+0000","last_undegraded":"2024-08-17T02:24:29.438785+0000","last_fullsized":"2024-08-17T02:24:29.438785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:28:42.709190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.415880+0000","last_change":"2024-08-17T02:24:28.427384+0000","last_active":"2024-08-17T02:24:29.415880+0000","last_peered":"2024-08-17T02:24:29.415880+0000","last_clean":"2024-08-17T02:24:29.415880+0000","last_became_active":"2024-08-17T02:24:28.426523+0000","last_became_peered":"2024-08-17T02:24:28.426523+0000","last_unstale":"2024-08-17T02:24:29.415880+0000","last_undegraded":"2024-08-17T02:24:29.415880+0000","last_fullsized":"2024-08-17T02:24:29.415880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:46:41.928641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450676+0000","last_change":"2024-08-17T02:24:29.441536+0000","last_active":"2024-08-17T02:24:29.450676+0000","last_peered":"2024-08-17T02:24:29.450676+0000","last_clean":"2024-08-17T02:24:29.450676+0000","last_became_active":"2024-08-17T02:24:29.440862+0000","last_became_peered":"2024-08-17T02:24:29.440862+0000","last_unstale":"2024-08-17T02:24:29.450676+0000","last_undegraded":"2024-08-17T02:24:29.450676+0000","last_fullsized":"2024-08-17T02:24:29.450676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:59:44.626213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.424591+0000","last_change":"2024-08-17T02:24:28.441139+0000","last_active":"2024-08-17T02:24:29.424591+0000","last_peered":"2024-08-17T02:24:29.424591+0000","last_clean":"2024-08-17T02:24:29.424591+0000","last_became_active":"2024-08-17T02:24:28.440867+0000","last_became_peered":"2024-08-17T02:24:28.440867+0000","last_unstale":"2024-08-17T02:24:29.424591+0000","last_undegraded":"2024-08-17T02:24:29.424591+0000","last_fullsized":"2024-08-17T02:24:29.424591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:51.790234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.435355+0000","last_change":"2024-08-17T02:24:29.421360+0000","last_active":"2024-08-17T02:24:29.435355+0000","last_peered":"2024-08-17T02:24:29.435355+0000","last_clean":"2024-08-17T02:24:29.435355+0000","last_became_active":"2024-08-17T02:24:29.421136+0000","last_became_peered":"2024-08-17T02:24:29.421136+0000","last_unstale":"2024-08-17T02:24:29.435355+0000","last_undegraded":"2024-08-17T02:24:29.435355+0000","last_fullsized":"2024-08-17T02:24:29.435355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:16.005540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.417024+0000","last_change":"2024-08-17T02:24:28.435491+0000","last_active":"2024-08-17T02:24:29.417024+0000","last_peered":"2024-08-17T02:24:29.417024+0000","last_clean":"2024-08-17T02:24:29.417024+0000","last_became_active":"2024-08-17T02:24:28.435238+0000","last_became_peered":"2024-08-17T02:24:28.435238+0000","last_unstale":"2024-08-17T02:24:29.417024+0000","last_undegraded":"2024-08-17T02:24:29.417024+0000","last_fullsized":"2024-08-17T02:24:29.417024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:18:30.215083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.433516+0000","last_change":"2024-08-17T02:24:29.431357+0000","last_active":"2024-08-17T02:24:29.433516+0000","last_peered":"2024-08-17T02:24:29.433516+0000","last_clean":"2024-08-17T02:24:29.433516+0000","last_became_active":"2024-08-17T02:24:29.430069+0000","last_became_peered":"2024-08-17T02:24:29.430069+0000","last_unstale":"2024-08-17T02:24:29.433516+0000","last_undegraded":"2024-08-17T02:24:29.433516+0000","last_fullsized":"2024-08-17T02:24:29.433516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:04:59.407311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.459511+0000","last_change":"2024-08-17T02:24:28.438397+0000","last_active":"2024-08-17T02:24:29.459511+0000","last_peered":"2024-08-17T02:24:29.459511+0000","last_clean":"2024-08-17T02:24:29.459511+0000","last_became_active":"2024-08-17T02:24:28.438086+0000","last_became_peered":"2024-08-17T02:24:28.438086+0000","last_unstale":"2024-08-17T02:24:29.459511+0000","last_undegraded":"2024-08-17T02:24:29.459511+0000","last_fullsized":"2024-08-17T02:24:29.459511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:18:30.215083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.441878+0000","last_change":"2024-08-17T02:24:29.437242+0000","last_active":"2024-08-17T02:24:29.441878+0000","last_peered":"2024-08-17T02:24:29.441878+0000","last_clean":"2024-08-17T02:24:29.441878+0000","last_became_active":"2024-08-17T02:24:29.436992+0000","last_became_peered":"2024-08-17T02:24:29.436992+0000","last_unstale":"2024-08-17T02:24:29.441878+0000","last_undegraded":"2024-08-17T02:24:29.441878+0000","last_fullsized":"2024-08-17T02:24:29.441878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:18:31.217481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.423166+0000","last_change":"2024-08-17T02:24:28.432643+0000","last_active":"2024-08-17T02:24:29.423166+0000","last_peered":"2024-08-17T02:24:29.423166+0000","last_clean":"2024-08-17T02:24:29.423166+0000","last_became_active":"2024-08-17T02:24:28.432360+0000","last_became_peered":"2024-08-17T02:24:28.432360+0000","last_unstale":"2024-08-17T02:24:29.423166+0000","last_undegraded":"2024-08-17T02:24:29.423166+0000","last_fullsized":"2024-08-17T02:24:29.423166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:17:58.120433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.429296+0000","last_change":"2024-08-17T02:24:29.419416+0000","last_active":"2024-08-17T02:24:29.429296+0000","last_peered":"2024-08-17T02:24:29.429296+0000","last_clean":"2024-08-17T02:24:29.429296+0000","last_became_active":"2024-08-17T02:24:29.419140+0000","last_became_peered":"2024-08-17T02:24:29.419140+0000","last_unstale":"2024-08-17T02:24:29.429296+0000","last_undegraded":"2024-08-17T02:24:29.429296+0000","last_fullsized":"2024-08-17T02:24:29.429296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:52.792632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.415080+0000","last_change":"2024-08-17T02:24:28.428331+0000","last_active":"2024-08-17T02:24:29.415080+0000","last_peered":"2024-08-17T02:24:29.415080+0000","last_clean":"2024-08-17T02:24:29.415080+0000","last_became_active":"2024-08-17T02:24:28.428035+0000","last_became_peered":"2024-08-17T02:24:28.428035+0000","last_unstale":"2024-08-17T02:24:29.415080+0000","last_undegraded":"2024-08-17T02:24:29.415080+0000","last_fullsized":"2024-08-17T02:24:29.415080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:51.790234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.433690+0000","last_change":"2024-08-17T02:24:29.431775+0000","last_active":"2024-08-17T02:24:29.433690+0000","last_peered":"2024-08-17T02:24:29.433690+0000","last_clean":"2024-08-17T02:24:29.433690+0000","last_became_active":"2024-08-17T02:24:29.431512+0000","last_became_peered":"2024-08-17T02:24:29.431512+0000","last_unstale":"2024-08-17T02:24:29.433690+0000","last_undegraded":"2024-08-17T02:24:29.433690+0000","last_fullsized":"2024-08-17T02:24:29.433690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:58:14.241277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.415638+0000","last_change":"2024-08-17T02:24:28.431932+0000","last_active":"2024-08-17T02:24:29.415638+0000","last_peered":"2024-08-17T02:24:29.415638+0000","last_clean":"2024-08-17T02:24:29.415638+0000","last_became_active":"2024-08-17T02:24:28.431664+0000","last_became_peered":"2024-08-17T02:24:28.431664+0000","last_unstale":"2024-08-17T02:24:29.415638+0000","last_undegraded":"2024-08-17T02:24:29.415638+0000","last_fullsized":"2024-08-17T02:24:29.415638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:55:38.492426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.431119+0000","last_change":"2024-08-17T02:24:29.429444+0000","last_active":"2024-08-17T02:24:29.431119+0000","last_peered":"2024-08-17T02:24:29.431119+0000","last_clean":"2024-08-17T02:24:29.431119+0000","last_became_active":"2024-08-17T02:24:29.429091+0000","last_became_peered":"2024-08-17T02:24:29.429091+0000","last_unstale":"2024-08-17T02:24:29.431119+0000","last_undegraded":"2024-08-17T02:24:29.431119+0000","last_fullsized":"2024-08-17T02:24:29.431119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:07:03.379300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.460868+0000","last_change":"2024-08-17T02:24:28.437430+0000","last_active":"2024-08-17T02:24:29.460868+0000","last_peered":"2024-08-17T02:24:29.460868+0000","last_clean":"2024-08-17T02:24:29.460868+0000","last_became_active":"2024-08-17T02:24:28.437238+0000","last_became_peered":"2024-08-17T02:24:28.437238+0000","last_unstale":"2024-08-17T02:24:29.460868+0000","last_undegraded":"2024-08-17T02:24:29.460868+0000","last_fullsized":"2024-08-17T02:24:29.460868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:28:41.706792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.432294+0000","last_change":"2024-08-17T02:24:29.430603+0000","last_active":"2024-08-17T02:24:29.432294+0000","last_peered":"2024-08-17T02:24:29.432294+0000","last_clean":"2024-08-17T02:24:29.432294+0000","last_became_active":"2024-08-17T02:24:29.430340+0000","last_became_peered":"2024-08-17T02:24:29.430340+0000","last_unstale":"2024-08-17T02:24:29.432294+0000","last_undegraded":"2024-08-17T02:24:29.432294+0000","last_fullsized":"2024-08-17T02:24:29.432294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:23:46.771394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450807+0000","last_change":"2024-08-17T02:24:29.441738+0000","last_active":"2024-08-17T02:24:29.450807+0000","last_peered":"2024-08-17T02:24:29.450807+0000","last_clean":"2024-08-17T02:24:29.450807+0000","last_became_active":"2024-08-17T02:24:29.441181+0000","last_became_peered":"2024-08-17T02:24:29.441181+0000","last_unstale":"2024-08-17T02:24:29.450807+0000","last_undegraded":"2024-08-17T02:24:29.450807+0000","last_fullsized":"2024-08-17T02:24:29.450807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:18:37.161695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.460138+0000","last_change":"2024-08-17T02:24:28.436783+0000","last_active":"2024-08-17T02:24:29.460138+0000","last_peered":"2024-08-17T02:24:29.460138+0000","last_clean":"2024-08-17T02:24:29.460138+0000","last_became_active":"2024-08-17T02:24:28.436552+0000","last_became_peered":"2024-08-17T02:24:28.436552+0000","last_unstale":"2024-08-17T02:24:29.460138+0000","last_undegraded":"2024-08-17T02:24:29.460138+0000","last_fullsized":"2024-08-17T02:24:29.460138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:18:30.215083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450243+0000","last_change":"2024-08-17T02:24:29.440059+0000","last_active":"2024-08-17T02:24:29.450243+0000","last_peered":"2024-08-17T02:24:29.450243+0000","last_clean":"2024-08-17T02:24:29.450243+0000","last_became_active":"2024-08-17T02:24:29.439878+0000","last_became_peered":"2024-08-17T02:24:29.439878+0000","last_unstale":"2024-08-17T02:24:29.450243+0000","last_undegraded":"2024-08-17T02:24:29.450243+0000","last_fullsized":"2024-08-17T02:24:29.450243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:23:46.771394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.461971+0000","last_change":"2024-08-17T02:24:28.435398+0000","last_active":"2024-08-17T02:24:29.461971+0000","last_peered":"2024-08-17T02:24:29.461971+0000","last_clean":"2024-08-17T02:24:29.461971+0000","last_became_active":"2024-08-17T02:24:28.435119+0000","last_became_peered":"2024-08-17T02:24:28.435119+0000","last_unstale":"2024-08-17T02:24:29.461971+0000","last_undegraded":"2024-08-17T02:24:29.461971+0000","last_fullsized":"2024-08-17T02:24:29.461971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:18:02.165697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.437418+0000","last_change":"2024-08-17T02:24:29.434467+0000","last_active":"2024-08-17T02:24:29.437418+0000","last_peered":"2024-08-17T02:24:29.437418+0000","last_clean":"2024-08-17T02:24:29.437418+0000","last_became_active":"2024-08-17T02:24:29.434160+0000","last_became_peered":"2024-08-17T02:24:29.434160+0000","last_unstale":"2024-08-17T02:24:29.437418+0000","last_undegraded":"2024-08-17T02:24:29.437418+0000","last_fullsized":"2024-08-17T02:24:29.437418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:58:14.241277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.457800+0000","last_change":"2024-08-17T02:24:28.431371+0000","last_active":"2024-08-17T02:24:29.457800+0000","last_peered":"2024-08-17T02:24:29.457800+0000","last_clean":"2024-08-17T02:24:29.457800+0000","last_became_active":"2024-08-17T02:24:28.431097+0000","last_became_peered":"2024-08-17T02:24:28.431097+0000","last_unstale":"2024-08-17T02:24:29.457800+0000","last_undegraded":"2024-08-17T02:24:29.457800+0000","last_fullsized":"2024-08-17T02:24:29.457800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:34.991199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.441162+0000","last_change":"2024-08-17T02:24:29.436845+0000","last_active":"2024-08-17T02:24:29.441162+0000","last_peered":"2024-08-17T02:24:29.441162+0000","last_clean":"2024-08-17T02:24:29.441162+0000","last_became_active":"2024-08-17T02:24:29.436419+0000","last_became_peered":"2024-08-17T02:24:29.436419+0000","last_unstale":"2024-08-17T02:24:29.441162+0000","last_undegraded":"2024-08-17T02:24:29.441162+0000","last_fullsized":"2024-08-17T02:24:29.441162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:48.171179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.457139+0000","last_change":"2024-08-17T02:24:28.428299+0000","last_active":"2024-08-17T02:24:29.457139+0000","last_peered":"2024-08-17T02:24:29.457139+0000","last_clean":"2024-08-17T02:24:29.457139+0000","last_became_active":"2024-08-17T02:24:28.428067+0000","last_became_peered":"2024-08-17T02:24:28.428067+0000","last_unstale":"2024-08-17T02:24:29.457139+0000","last_undegraded":"2024-08-17T02:24:29.457139+0000","last_fullsized":"2024-08-17T02:24:29.457139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:33:27.420267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302312,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069528,"statfs":{"total":96636764160,"available":96327196672,"internally_reserved":0,"allocated":815104,"data_stored":666251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301744,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070096,"statfs":{"total":96636764160,"available":96327778304,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301736,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070104,"statfs":{"total":96636764160,"available":96327786496,"internally_reserved":0,"allocated":221184,"data_stored":75403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301744,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070096,"statfs":{"total":96636764160,"available":96327778304,"internally_reserved":0,"allocated":229376,"data_stored":75439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":217088,"data_stored":75313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":225280,"data_stored":75473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298160,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073680,"statfs":{"total":96636764160,"available":96331448320,"internally_reserved":0,"allocated":823296,"data_stored":666307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:24:33.953 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-08-17T02:24:33.954 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-17T02:24:33.954 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-08-17T02:24:33.954 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-08-17T02:24:33.954 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-08-17T02:24:33.987 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:24:33.996 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:24:34.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.138+0000 7f8ecc400640 1 Processor -- start 2024-08-17T02:24:34.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.138+0000 7f8ecc400640 1 -- start start 2024-08-17T02:24:34.141 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.139+0000 7f8ecc400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8ec41401b0 0x7f8ec40caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:34.141 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.139+0000 7f8ecc400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8ec40b1440 0x7f8ec40c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:34.141 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.139+0000 7f8ecc400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ec40caa80 con 0x7f8ec4140580 2024-08-17T02:24:34.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.139+0000 7f8ecc400640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ec40cb450 con 0x7f8ec41401b0 2024-08-17T02:24:34.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.139+0000 7f8ecc400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec40c9e70 con 0x7f8ec40b1440 2024-08-17T02:24:34.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.140+0000 7f8ec9000640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f8ec4140580 0x7f8ec40b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:47864/0 (socket says 172.21.15.107:47864) 2024-08-17T02:24:34.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.140+0000 7f8ec9000640 1 -- 172.21.15.107:0/2429789549 learned_addr learned my addr 172.21.15.107:0/2429789549 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:34.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.140+0000 7f8ec9a00640 1 --2- 172.21.15.107:0/2429789549 >> v2:172.21.15.157:3300/0 conn(0x7f8ec41401b0 0x7f8ec40caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:34.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.140+0000 7f8eca400640 1 --2- 172.21.15.107:0/2429789549 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8ec40b1440 0x7f8ec40c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:34.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.140+0000 7f8ec3e00640 1 -- 172.21.15.107:0/2429789549 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1333983178 0 0) 0x7f8ec40caa80 con 0x7f8ec4140580 2024-08-17T02:24:34.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.140+0000 7f8ec3e00640 1 -- 172.21.15.107:0/2429789549 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8eac0034e0 con 0x7f8ec4140580 2024-08-17T02:24:34.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.140+0000 7f8ec9a00640 1 -- 172.21.15.107:0/2429789549 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8ec40b1440 msgr2=0x7f8ec40c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:34.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.140+0000 7f8ec9a00640 1 --2- 172.21.15.107:0/2429789549 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8ec40b1440 0x7f8ec40c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:34.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.140+0000 7f8ec9a00640 1 -- 172.21.15.107:0/2429789549 >> v1:172.21.15.107:6789/0 conn(0x7f8ec4140580 legacy=0x7f8ec40b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:34.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.140+0000 7f8ec9a00640 1 -- 172.21.15.107:0/2429789549 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec40ca150 con 0x7f8ec41401b0 2024-08-17T02:24:34.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.141+0000 7f8ec9a00640 1 --2- 172.21.15.107:0/2429789549 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ec41401b0 0x7f8ec40caf10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8009850 tx=0x7f8eb80090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da0a4c014be22d14 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:34.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.142+0000 7f8ec3e00640 1 -- 172.21.15.107:0/2429789549 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb802ad00 con 0x7f8ec41401b0 2024-08-17T02:24:34.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.142+0000 7f8ec3e00640 1 -- 172.21.15.107:0/2429789549 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb802ae60 con 0x7f8ec41401b0 2024-08-17T02:24:34.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.142+0000 7f8ec3e00640 1 -- 172.21.15.107:0/2429789549 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb8032670 con 0x7f8ec41401b0 2024-08-17T02:24:34.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.142+0000 7f8ecc400640 1 -- 172.21.15.107:0/2429789549 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ec41401b0 msgr2=0x7f8ec40caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:34.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.142+0000 7f8ecc400640 1 --2- 172.21.15.107:0/2429789549 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ec41401b0 0x7f8ec40caf10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8009850 tx=0x7f8eb80090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:34.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.142+0000 7f8ecc400640 1 -- 172.21.15.107:0/2429789549 shutdown_connections 2024-08-17T02:24:34.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.142+0000 7f8ecc400640 1 --2- 172.21.15.107:0/2429789549 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8ec40b1440 0x7f8ec40c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:34.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.142+0000 7f8ecc400640 1 --2- 172.21.15.107:0/2429789549 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ec41401b0 0x7f8ec40caf10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:34.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.142+0000 7f8ecc400640 1 -- 172.21.15.107:0/2429789549 >> 172.21.15.107:0/2429789549 conn(0x7f8ec40cb9b0 msgr2=0x7f8ec40cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:34.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.142+0000 7f8ecc400640 1 -- 172.21.15.107:0/2429789549 shutdown_connections 2024-08-17T02:24:34.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.142+0000 7f8ecc400640 1 -- 172.21.15.107:0/2429789549 wait complete. 2024-08-17T02:24:34.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.144+0000 7f8ecc400640 1 Processor -- start 2024-08-17T02:24:34.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.144+0000 7f8ecc400640 1 -- start start 2024-08-17T02:24:34.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.145+0000 7f8ecc400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8ec40b1440 0x7f8ec40ab830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:34.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.145+0000 7f8ecc400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ec41401b0 0x7f8ec40c7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:34.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.145+0000 7f8ecc400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8ec4140580 0x7f8ec4168650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:34.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.145+0000 7f8ecc400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec40c74d0 con 0x7f8ec40b1440 2024-08-17T02:24:34.148 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.145+0000 7f8ecc400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec40c68c0 con 0x7f8ec41401b0 2024-08-17T02:24:34.148 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.145+0000 7f8ecc400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec40c6ba0 con 0x7f8ec4140580 2024-08-17T02:24:34.148 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.145+0000 7f8ec9a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8ec40b1440 0x7f8ec40ab830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:34.148 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.145+0000 7f8ec9a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8ec40b1440 0x7f8ec40ab830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37578/0 (socket says 172.21.15.107:37578) 2024-08-17T02:24:34.148 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.145+0000 7f8ec9a00640 1 -- 172.21.15.107:0/3756018105 learned_addr learned my addr 172.21.15.107:0/3756018105 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:34.148 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.145+0000 7f8ec9000640 1 --2- 172.21.15.107:0/3756018105 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ec41401b0 0x7f8ec40c7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:34.148 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.145+0000 7f8eca400640 1 --2- 172.21.15.107:0/3756018105 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8ec4140580 0x7f8ec4168650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:34.148 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.145+0000 7f8ec9a00640 1 -- 172.21.15.107:0/3756018105 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8ec4140580 msgr2=0x7f8ec4168650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:34.148 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.145+0000 7f8ec9a00640 1 --2- 172.21.15.107:0/3756018105 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8ec4140580 0x7f8ec4168650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:34.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.145+0000 7f8ec9a00640 1 -- 172.21.15.107:0/3756018105 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ec41401b0 msgr2=0x7f8ec40c7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:34.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.145+0000 7f8ec9a00640 1 --2- 172.21.15.107:0/3756018105 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ec41401b0 0x7f8ec40c7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:34.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.145+0000 7f8ec9a00640 1 -- 172.21.15.107:0/3756018105 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb8009390 con 0x7f8ec40b1440 2024-08-17T02:24:34.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.145+0000 7f8ec9000640 1 --2- 172.21.15.107:0/3756018105 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ec41401b0 0x7f8ec40c7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:34.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.146+0000 7f8ec9a00640 1 --2- 172.21.15.107:0/3756018105 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8ec40b1440 0x7f8ec40ab830 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8009360 tx=0x7f8eb8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:34.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.146+0000 7f8ec0c00640 1 -- 172.21.15.107:0/3756018105 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb803b6e0 con 0x7f8ec40b1440 2024-08-17T02:24:34.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.146+0000 7f8ec0c00640 1 -- 172.21.15.107:0/3756018105 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb803b840 con 0x7f8ec40b1440 2024-08-17T02:24:34.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.146+0000 7f8ecc400640 1 -- 172.21.15.107:0/3756018105 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ec40c6e80 con 0x7f8ec40b1440 2024-08-17T02:24:34.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.146+0000 7f8ec0c00640 1 -- 172.21.15.107:0/3756018105 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb803bc00 con 0x7f8ec40b1440 2024-08-17T02:24:34.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.146+0000 7f8ecc400640 1 -- 172.21.15.107:0/3756018105 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ec40a9050 con 0x7f8ec40b1440 2024-08-17T02:24:34.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.147+0000 7f8ecc400640 1 -- 172.21.15.107:0/3756018105 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ec4064db0 con 0x7f8ec40b1440 2024-08-17T02:24:34.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.148+0000 7f8ec0c00640 1 -- 172.21.15.107:0/3756018105 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8eb8043030 con 0x7f8ec40b1440 2024-08-17T02:24:34.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.149+0000 7f8ec0c00640 1 --2- 172.21.15.107:0/3756018105 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f8ea4065150 0x7f8ea4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:34.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.149+0000 7f8ec0c00640 1 -- 172.21.15.107:0/3756018105 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8eb8041070 con 0x7f8ec40b1440 2024-08-17T02:24:34.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.149+0000 7f8ec9000640 1 --2- 172.21.15.107:0/3756018105 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f8ea4065150 0x7f8ea4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:34.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.150+0000 7f8ec9000640 1 --2- 172.21.15.107:0/3756018105 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f8ea4065150 0x7f8ea4067600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8ec416d800 tx=0x7f8eb0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:34.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.153+0000 7f8ec0c00640 1 -- 172.21.15.107:0/3756018105 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8eb80709d0 con 0x7f8ec40b1440 2024-08-17T02:24:34.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.370+0000 7f8ecc400640 1 -- 172.21.15.107:0/3756018105 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f8ec40c7010 con 0x7f8ec40b1440 2024-08-17T02:24:34.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.373+0000 7f8ec0c00640 1 -- 172.21.15.107:0/3756018105 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+161037 (secure 0 0 0) 0x7f8eb8037090 con 0x7f8ec40b1440 2024-08-17T02:24:34.376 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:24:34.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.375+0000 7f8ecc400640 1 -- 172.21.15.107:0/3756018105 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f8ea4065150 msgr2=0x7f8ea4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:34.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.375+0000 7f8ecc400640 1 --2- 172.21.15.107:0/3756018105 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f8ea4065150 0x7f8ea4067600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8ec416d800 tx=0x7f8eb0009040 comp rx=0 tx=0).stop 2024-08-17T02:24:34.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.375+0000 7f8ecc400640 1 -- 172.21.15.107:0/3756018105 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8ec40b1440 msgr2=0x7f8ec40ab830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:34.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.375+0000 7f8ecc400640 1 --2- 172.21.15.107:0/3756018105 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8ec40b1440 0x7f8ec40ab830 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8009360 tx=0x7f8eb8032000 comp rx=0 tx=0).stop 2024-08-17T02:24:34.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.376+0000 7f8ecc400640 1 -- 172.21.15.107:0/3756018105 shutdown_connections 2024-08-17T02:24:34.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.376+0000 7f8ecc400640 1 --2- 172.21.15.107:0/3756018105 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f8ea4065150 0x7f8ea4067600 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:34.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.376+0000 7f8ecc400640 1 --2- 172.21.15.107:0/3756018105 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8ec4140580 0x7f8ec4168650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:34.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.376+0000 7f8ecc400640 1 --2- 172.21.15.107:0/3756018105 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ec41401b0 0x7f8ec40c7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:34.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.376+0000 7f8ecc400640 1 --2- 172.21.15.107:0/3756018105 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8ec40b1440 0x7f8ec40ab830 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:34.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.376+0000 7f8ecc400640 1 -- 172.21.15.107:0/3756018105 >> 172.21.15.107:0/3756018105 conn(0x7f8ec40cb9b0 msgr2=0x7f8ec413f070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:34.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.376+0000 7f8ecc400640 1 -- 172.21.15.107:0/3756018105 shutdown_connections 2024-08-17T02:24:34.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.376+0000 7f8ecc400640 1 -- 172.21.15.107:0/3756018105 wait complete. 2024-08-17T02:24:34.391 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":5,"flags":0,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":37039},{"type":"v1","addr":"172.21.15.107:6833","nonce":37039}]},"active_addr":"172.21.15.107:6833/37039","active_change":"2024-08-17T02:24:15.391599+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":1095960110}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":3424141395}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":691046248}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":2120270931}]}]} 2024-08-17T02:24:34.395 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-08-17T02:24:34.395 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-08-17T02:24:34.395 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:34.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.541+0000 7f4a46c00640 1 Processor -- start 2024-08-17T02:24:34.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.541+0000 7f4a46c00640 1 -- start start 2024-08-17T02:24:34.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.543+0000 7f4a46c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4a400ada10 0x7f4a400b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:34.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.543+0000 7f4a46c00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4a400b38b0 0x7f4a400aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:34.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.543+0000 7f4a46c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a400d0ab0 con 0x7f4a400b1120 2024-08-17T02:24:34.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.543+0000 7f4a46c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a400b00c0 con 0x7f4a400ada10 2024-08-17T02:24:34.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.543+0000 7f4a46c00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a400af330 con 0x7f4a400b38b0 2024-08-17T02:24:34.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.543+0000 7f4a3fe00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4a400ada10 0x7f4a400b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:34.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.543+0000 7f4a3fe00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4a400ada10 0x7f4a400b2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37590/0 (socket says 172.21.15.107:37590) 2024-08-17T02:24:34.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.543+0000 7f4a37400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f4a400b1120 0x7f4a400b31a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:47866/0 (socket says 172.21.15.107:47866) 2024-08-17T02:24:34.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.543+0000 7f4a3fe00640 1 -- 172.21.15.107:0/2226723829 learned_addr learned my addr 172.21.15.107:0/2226723829 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:34.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.543+0000 7f4a44c00640 1 --2- 172.21.15.107:0/2226723829 >> v2:172.21.15.157:3300/0 conn(0x7f4a400b38b0 0x7f4a400aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:34.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.543+0000 7f4a3fe00640 1 -- 172.21.15.107:0/2226723829 >> v2:172.21.15.157:3300/0 conn(0x7f4a400b38b0 msgr2=0x7f4a400aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:34.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.543+0000 7f4a3fe00640 1 --2- 172.21.15.107:0/2226723829 >> v2:172.21.15.157:3300/0 conn(0x7f4a400b38b0 0x7f4a400aedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:34.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.543+0000 7f4a3fe00640 1 -- 172.21.15.107:0/2226723829 >> v1:172.21.15.107:6789/0 conn(0x7f4a400b1120 legacy=0x7f4a400b31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:34.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.543+0000 7f4a3fe00640 1 -- 172.21.15.107:0/2226723829 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a400b0360 con 0x7f4a400ada10 2024-08-17T02:24:34.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.543+0000 7f4a3f400640 1 -- 172.21.15.107:0/2226723829 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 32209114 0 0) 0x7f4a400d0ab0 con 0x7f4a400b1120 2024-08-17T02:24:34.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.544+0000 7f4a3fe00640 1 --2- 172.21.15.107:0/2226723829 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a400ada10 0x7f4a400b2c60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4a400d0dd0 tx=0x7f4a300091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c35008ea6c2e0c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:34.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.545+0000 7f4a3f400640 1 -- 172.21.15.107:0/2226723829 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a30032440 con 0x7f4a400ada10 2024-08-17T02:24:34.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.545+0000 7f4a3f400640 1 -- 172.21.15.107:0/2226723829 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a300325a0 con 0x7f4a400ada10 2024-08-17T02:24:34.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.545+0000 7f4a3f400640 1 -- 172.21.15.107:0/2226723829 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a30032940 con 0x7f4a400ada10 2024-08-17T02:24:34.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.545+0000 7f4a46c00640 1 -- 172.21.15.107:0/2226723829 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a400ada10 msgr2=0x7f4a400b2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:34.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.545+0000 7f4a46c00640 1 --2- 172.21.15.107:0/2226723829 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a400ada10 0x7f4a400b2c60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4a400d0dd0 tx=0x7f4a300091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:34.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.545+0000 7f4a46c00640 1 -- 172.21.15.107:0/2226723829 shutdown_connections 2024-08-17T02:24:34.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.545+0000 7f4a46c00640 1 --2- 172.21.15.107:0/2226723829 >> v2:172.21.15.157:3300/0 conn(0x7f4a400b38b0 0x7f4a400aedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:34.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.545+0000 7f4a46c00640 1 --2- 172.21.15.107:0/2226723829 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a400ada10 0x7f4a400b2c60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:34.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.545+0000 7f4a46c00640 1 -- 172.21.15.107:0/2226723829 >> 172.21.15.107:0/2226723829 conn(0x7f4a400cfdf0 msgr2=0x7f4a400d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:34.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.545+0000 7f4a46c00640 1 -- 172.21.15.107:0/2226723829 shutdown_connections 2024-08-17T02:24:34.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.545+0000 7f4a46c00640 1 -- 172.21.15.107:0/2226723829 wait complete. 2024-08-17T02:24:34.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.547+0000 7f4a46c00640 1 Processor -- start 2024-08-17T02:24:34.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.547+0000 7f4a46c00640 1 -- start start 2024-08-17T02:24:34.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.548+0000 7f4a46c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a400ada10 0x7f4a4009c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:34.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.548+0000 7f4a46c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a400b1120 0x7f4a40143820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:34.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.548+0000 7f4a46c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a400b38b0 0x7f4a400adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:34.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.548+0000 7f4a46c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4009d860 con 0x7f4a400b1120 2024-08-17T02:24:34.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.548+0000 7f4a46c00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4009ca00 con 0x7f4a400ada10 2024-08-17T02:24:34.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.548+0000 7f4a46c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a40143d60 con 0x7f4a400b38b0 2024-08-17T02:24:34.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.548+0000 7f4a37400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a400b1120 0x7f4a40143820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:34.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.548+0000 7f4a37400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a400b1120 0x7f4a40143820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37592/0 (socket says 172.21.15.107:37592) 2024-08-17T02:24:34.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.548+0000 7f4a37400640 1 -- 172.21.15.107:0/1588477395 learned_addr learned my addr 172.21.15.107:0/1588477395 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:34.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.548+0000 7f4a3fe00640 1 --2- 172.21.15.107:0/1588477395 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a400ada10 0x7f4a4009c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:34.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.548+0000 7f4a44c00640 1 --2- 172.21.15.107:0/1588477395 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a400b38b0 0x7f4a400adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:34.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.548+0000 7f4a37400640 1 -- 172.21.15.107:0/1588477395 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a400b38b0 msgr2=0x7f4a400adde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:34.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.548+0000 7f4a37400640 1 --2- 172.21.15.107:0/1588477395 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a400b38b0 0x7f4a400adde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:34.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.548+0000 7f4a37400640 1 -- 172.21.15.107:0/1588477395 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a400ada10 msgr2=0x7f4a4009c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:34.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.548+0000 7f4a37400640 1 --2- 172.21.15.107:0/1588477395 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a400ada10 0x7f4a4009c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:34.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.548+0000 7f4a37400640 1 -- 172.21.15.107:0/1588477395 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a30009450 con 0x7f4a400b1120 2024-08-17T02:24:34.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.549+0000 7f4a37400640 1 --2- 172.21.15.107:0/1588477395 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a400b1120 0x7f4a40143820 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4a2800c600 tx=0x7f4a28007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:34.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.549+0000 7f4a37e00640 1 -- 172.21.15.107:0/1588477395 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a280073d0 con 0x7f4a400b1120 2024-08-17T02:24:34.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.549+0000 7f4a37e00640 1 -- 172.21.15.107:0/1588477395 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a28007550 con 0x7f4a400b1120 2024-08-17T02:24:34.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.549+0000 7f4a46c00640 1 -- 172.21.15.107:0/1588477395 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a4009cc50 con 0x7f4a400b1120 2024-08-17T02:24:34.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.549+0000 7f4a37e00640 1 -- 172.21.15.107:0/1588477395 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a280049f0 con 0x7f4a400b1120 2024-08-17T02:24:34.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.549+0000 7f4a46c00640 1 -- 172.21.15.107:0/1588477395 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a4009d210 con 0x7f4a400b1120 2024-08-17T02:24:34.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.550+0000 7f4a46c00640 1 -- 172.21.15.107:0/1588477395 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a4009da10 con 0x7f4a400b1120 2024-08-17T02:24:34.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.551+0000 7f4a37e00640 1 -- 172.21.15.107:0/1588477395 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4a2801c3b0 con 0x7f4a400b1120 2024-08-17T02:24:34.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.552+0000 7f4a37e00640 1 --2- 172.21.15.107:0/1588477395 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4a1c065150 0x7f4a1c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:34.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.552+0000 7f4a37e00640 1 -- 172.21.15.107:0/1588477395 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4a28081950 con 0x7f4a400b1120 2024-08-17T02:24:34.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.552+0000 7f4a3fe00640 1 --2- 172.21.15.107:0/1588477395 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4a1c065150 0x7f4a1c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:34.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.552+0000 7f4a3fe00640 1 --2- 172.21.15.107:0/1588477395 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4a1c065150 0x7f4a1c067600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4a30034000 tx=0x7f4a30032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:34.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.556+0000 7f4a37e00640 1 -- 172.21.15.107:0/1588477395 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4a4009da10 con 0x7f4a400b1120 2024-08-17T02:24:34.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.728+0000 7f4a46c00640 1 -- 172.21.15.107:0/1588477395 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a4009da10 con 0x7f4a400b1120 2024-08-17T02:24:34.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.729+0000 7f4a37e00640 1 -- 172.21.15.107:0/1588477395 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f4a4009da10 con 0x7f4a400b1120 2024-08-17T02:24:34.730 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:24:34.731 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":21,"fsid":"f207b4c0-329d-46b8-b83f-aaf30bdb6ce3","created":"2024-08-17T02:24:11.038049+0000","modified":"2024-08-17T02:24:30.420018+0000","last_up_change":"2024-08-17T02:24:22.047790+0000","last_in_change":"2024-08-17T02:24:13.892720+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:23.456166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:27.078670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:27.804418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"376363f3-b8bf-4f1e-b691-51cdd39171ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37302},{"type":"v1","addr":"172.21.15.107:6801","nonce":37302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37302},{"type":"v1","addr":"172.21.15.107:6803","nonce":37302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37302},{"type":"v1","addr":"172.21.15.107:6807","nonce":37302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37302},{"type":"v1","addr":"172.21.15.107:6805","nonce":37302}]},"public_addr":"172.21.15.107:6801/37302","cluster_addr":"172.21.15.107:6803/37302","heartbeat_back_addr":"172.21.15.107:6807/37302","heartbeat_front_addr":"172.21.15.107:6805/37302","state":["exists","up"]},{"osd":1,"uuid":"cc6624e3-2ad4-4db4-b377-05dfe57424e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37305},{"type":"v1","addr":"172.21.15.107:6824","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37305},{"type":"v1","addr":"172.21.15.107:6827","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37305},{"type":"v1","addr":"172.21.15.107:6831","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37305},{"type":"v1","addr":"172.21.15.107:6829","nonce":37305}]},"public_addr":"172.21.15.107:6824/37305","cluster_addr":"172.21.15.107:6827/37305","heartbeat_back_addr":"172.21.15.107:6831/37305","heartbeat_front_addr":"172.21.15.107:6829/37305","state":["exists","up"]},{"osd":2,"uuid":"25229542-29b5-4281-bcb0-798ae0930aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37307},{"type":"v1","addr":"172.21.15.107:6817","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37307},{"type":"v1","addr":"172.21.15.107:6819","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6823","nonce":37307},{"type":"v1","addr":"172.21.15.107:6825","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37307},{"type":"v1","addr":"172.21.15.107:6821","nonce":37307}]},"public_addr":"172.21.15.107:6817/37307","cluster_addr":"172.21.15.107:6819/37307","heartbeat_back_addr":"172.21.15.107:6825/37307","heartbeat_front_addr":"172.21.15.107:6821/37307","state":["exists","up"]},{"osd":3,"uuid":"5f16aee8-8950-4268-a61a-5cf6ebd670e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37306},{"type":"v1","addr":"172.21.15.107:6809","nonce":37306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37306},{"type":"v1","addr":"172.21.15.107:6811","nonce":37306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37306},{"type":"v1","addr":"172.21.15.107:6815","nonce":37306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37306},{"type":"v1","addr":"172.21.15.107:6813","nonce":37306}]},"public_addr":"172.21.15.107:6809/37306","cluster_addr":"172.21.15.107:6811/37306","heartbeat_back_addr":"172.21.15.107:6815/37306","heartbeat_front_addr":"172.21.15.107:6813/37306","state":["exists","up"]},{"osd":4,"uuid":"23232e28-e23b-4b4e-a531-4939246dbbde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":37329},{"type":"v1","addr":"172.21.15.157:6817","nonce":37329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":37329},{"type":"v1","addr":"172.21.15.157:6819","nonce":37329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":37329},{"type":"v1","addr":"172.21.15.157:6823","nonce":37329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":37329},{"type":"v1","addr":"172.21.15.157:6821","nonce":37329}]},"public_addr":"172.21.15.157:6817/37329","cluster_addr":"172.21.15.157:6819/37329","heartbeat_back_addr":"172.21.15.157:6823/37329","heartbeat_front_addr":"172.21.15.157:6821/37329","state":["exists","up"]},{"osd":5,"uuid":"f87ec331-3e59-4886-a317-6f7e26ec8e21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":37328},{"type":"v1","addr":"172.21.15.157:6804","nonce":37328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":37328},{"type":"v1","addr":"172.21.15.157:6808","nonce":37328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":37328},{"type":"v1","addr":"172.21.15.157:6815","nonce":37328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":37328},{"type":"v1","addr":"172.21.15.157:6812","nonce":37328}]},"public_addr":"172.21.15.157:6804/37328","cluster_addr":"172.21.15.157:6808/37328","heartbeat_back_addr":"172.21.15.157:6815/37328","heartbeat_front_addr":"172.21.15.157:6812/37328","state":["exists","up"]},{"osd":6,"uuid":"92852235-ce49-4d96-a940-6f18d97b13ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":37330},{"type":"v1","addr":"172.21.15.157:6801","nonce":37330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6803","nonce":37330},{"type":"v1","addr":"172.21.15.157:6805","nonce":37330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":37330},{"type":"v1","addr":"172.21.15.157:6813","nonce":37330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":37330},{"type":"v1","addr":"172.21.15.157:6809","nonce":37330}]},"public_addr":"172.21.15.157:6801/37330","cluster_addr":"172.21.15.157:6805/37330","heartbeat_back_addr":"172.21.15.157:6813/37330","heartbeat_front_addr":"172.21.15.157:6809/37330","state":["exists","up"]},{"osd":7,"uuid":"7484a061-723d-4663-b28f-b01766d62f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":37373},{"type":"v1","addr":"172.21.15.157:6825","nonce":37373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":37373},{"type":"v1","addr":"172.21.15.157:6827","nonce":37373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":37373},{"type":"v1","addr":"172.21.15.157:6831","nonce":37373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":37373},{"type":"v1","addr":"172.21.15.157:6829","nonce":37373}]},"public_addr":"172.21.15.157:6825/37373","cluster_addr":"172.21.15.157:6827/37373","heartbeat_back_addr":"172.21.15.157:6831/37373","heartbeat_front_addr":"172.21.15.157:6829/37373","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.110188+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.280265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.252119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.267996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.284582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.144420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.174764+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.308002+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:34.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.731+0000 7f4a46c00640 1 -- 172.21.15.107:0/1588477395 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4a1c065150 msgr2=0x7f4a1c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:34.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.731+0000 7f4a46c00640 1 --2- 172.21.15.107:0/1588477395 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4a1c065150 0x7f4a1c067600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4a30034000 tx=0x7f4a30032000 comp rx=0 tx=0).stop 2024-08-17T02:24:34.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.731+0000 7f4a46c00640 1 -- 172.21.15.107:0/1588477395 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a400b1120 msgr2=0x7f4a40143820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:34.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.731+0000 7f4a46c00640 1 --2- 172.21.15.107:0/1588477395 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a400b1120 0x7f4a40143820 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4a2800c600 tx=0x7f4a28007d80 comp rx=0 tx=0).stop 2024-08-17T02:24:34.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.731+0000 7f4a46c00640 1 -- 172.21.15.107:0/1588477395 shutdown_connections 2024-08-17T02:24:34.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.731+0000 7f4a46c00640 1 --2- 172.21.15.107:0/1588477395 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4a1c065150 0x7f4a1c067600 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:34.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.731+0000 7f4a46c00640 1 --2- 172.21.15.107:0/1588477395 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a400b38b0 0x7f4a400adde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:34.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.731+0000 7f4a46c00640 1 --2- 172.21.15.107:0/1588477395 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a400b1120 0x7f4a40143820 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:34.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.731+0000 7f4a46c00640 1 --2- 172.21.15.107:0/1588477395 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a400ada10 0x7f4a4009c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:34.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.732+0000 7f4a46c00640 1 -- 172.21.15.107:0/1588477395 >> 172.21.15.107:0/1588477395 conn(0x7f4a400cfdf0 msgr2=0x7f4a400675a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:34.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.732+0000 7f4a46c00640 1 -- 172.21.15.107:0/1588477395 shutdown_connections 2024-08-17T02:24:34.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.732+0000 7f4a46c00640 1 -- 172.21.15.107:0/1588477395 wait complete. 2024-08-17T02:24:34.748 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-08-17T02:24:34.748 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:34.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.893+0000 7f3859a00640 1 Processor -- start 2024-08-17T02:24:34.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.893+0000 7f3859a00640 1 -- start start 2024-08-17T02:24:34.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.894+0000 7f3859a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f38540b1440 0x7f38540caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:34.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.894+0000 7f3859a00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3854140580 0x7f38540c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:34.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.894+0000 7f3859a00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38540caa80 con 0x7f38541401b0 2024-08-17T02:24:34.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.894+0000 7f3859a00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38540cb450 con 0x7f3854140580 2024-08-17T02:24:34.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.894+0000 7f3859a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38540c9e70 con 0x7f38540b1440 2024-08-17T02:24:34.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.895+0000 7f3853400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3854140580 0x7f38540c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:34.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.895+0000 7f3852000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f38540b1440 0x7f38540caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:34.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.895+0000 7f3853400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3854140580 0x7f38540c9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:38522/0 (socket says 172.21.15.107:38522) 2024-08-17T02:24:34.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.895+0000 7f3853400640 1 -- 172.21.15.107:0/2593758571 learned_addr learned my addr 172.21.15.107:0/2593758571 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:34.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.895+0000 7f3852000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f38540b1440 0x7f38540caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:42056/0 (socket says 172.21.15.107:42056) 2024-08-17T02:24:34.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.895+0000 7f3852a00640 1 --1- 172.21.15.107:0/2593758571 >> v1:172.21.15.157:6789/0 conn(0x7f38541401b0 0x7f38540b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:45006/0 (socket says 172.21.15.107:45006) 2024-08-17T02:24:34.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.895+0000 7f3852000640 1 -- 172.21.15.107:0/2593758571 >> v2:172.21.15.157:3300/0 conn(0x7f3854140580 msgr2=0x7f38540c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:34.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.895+0000 7f3852000640 1 --2- 172.21.15.107:0/2593758571 >> v2:172.21.15.157:3300/0 conn(0x7f3854140580 0x7f38540c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:34.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.895+0000 7f3852000640 1 -- 172.21.15.107:0/2593758571 >> v1:172.21.15.157:6789/0 conn(0x7f38541401b0 legacy=0x7f38540b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:34.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.895+0000 7f3852000640 1 -- 172.21.15.107:0/2593758571 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38540ca150 con 0x7f38540b1440 2024-08-17T02:24:34.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.896+0000 7f3852000640 1 --2- 172.21.15.107:0/2593758571 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f38540b1440 0x7f38540caf10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3840009850 tx=0x7f38400090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c5a017740c98f8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:34.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.897+0000 7f3851600640 1 -- 172.21.15.107:0/2593758571 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384002ad90 con 0x7f38540b1440 2024-08-17T02:24:34.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.897+0000 7f3851600640 1 -- 172.21.15.107:0/2593758571 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3840032440 con 0x7f38540b1440 2024-08-17T02:24:34.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.897+0000 7f3851600640 1 -- 172.21.15.107:0/2593758571 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3840032820 con 0x7f38540b1440 2024-08-17T02:24:34.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.897+0000 7f3859a00640 1 -- 172.21.15.107:0/2593758571 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f38540b1440 msgr2=0x7f38540caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:34.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.897+0000 7f3859a00640 1 --2- 172.21.15.107:0/2593758571 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f38540b1440 0x7f38540caf10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3840009850 tx=0x7f38400090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:34.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.897+0000 7f3859a00640 1 -- 172.21.15.107:0/2593758571 shutdown_connections 2024-08-17T02:24:34.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.897+0000 7f3859a00640 1 --2- 172.21.15.107:0/2593758571 >> v2:172.21.15.157:3300/0 conn(0x7f3854140580 0x7f38540c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:34.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.897+0000 7f3859a00640 1 --2- 172.21.15.107:0/2593758571 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f38540b1440 0x7f38540caf10 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:34.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.897+0000 7f3859a00640 1 -- 172.21.15.107:0/2593758571 >> 172.21.15.107:0/2593758571 conn(0x7f38540cb9b0 msgr2=0x7f38540cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:34.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.897+0000 7f3859a00640 1 -- 172.21.15.107:0/2593758571 shutdown_connections 2024-08-17T02:24:34.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.897+0000 7f3859a00640 1 -- 172.21.15.107:0/2593758571 wait complete. 2024-08-17T02:24:34.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.899+0000 7f3859a00640 1 Processor -- start 2024-08-17T02:24:34.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.899+0000 7f3859a00640 1 -- start start 2024-08-17T02:24:34.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.900+0000 7f3859a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f38540b1440 0x7f38540aab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:34.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.900+0000 7f3859a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f38541401b0 0x7f38540a73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:34.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.900+0000 7f3859a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3854140580 0x7f385413e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:34.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.900+0000 7f3859a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38540c6dd0 con 0x7f38540b1440 2024-08-17T02:24:34.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.900+0000 7f3859a00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38540c64a0 con 0x7f3854140580 2024-08-17T02:24:34.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.900+0000 7f3859a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38540c6780 con 0x7f38541401b0 2024-08-17T02:24:34.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.900+0000 7f3852a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f38540b1440 0x7f38540aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:34.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.900+0000 7f3852a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f38540b1440 0x7f38540aab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37600/0 (socket says 172.21.15.107:37600) 2024-08-17T02:24:34.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.900+0000 7f3852a00640 1 -- 172.21.15.107:0/912520398 learned_addr learned my addr 172.21.15.107:0/912520398 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:34.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.900+0000 7f3853400640 1 --2- 172.21.15.107:0/912520398 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3854140580 0x7f385413e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:34.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.900+0000 7f3852000640 1 --2- 172.21.15.107:0/912520398 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f38541401b0 0x7f38540a73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:34.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.901+0000 7f3852a00640 1 -- 172.21.15.107:0/912520398 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f38541401b0 msgr2=0x7f38540a73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:34.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.901+0000 7f3852a00640 1 --2- 172.21.15.107:0/912520398 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f38541401b0 0x7f38540a73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:34.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.901+0000 7f3852a00640 1 -- 172.21.15.107:0/912520398 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3854140580 msgr2=0x7f385413e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:34.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.901+0000 7f3852a00640 1 --2- 172.21.15.107:0/912520398 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3854140580 0x7f385413e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:34.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.901+0000 7f3852a00640 1 -- 172.21.15.107:0/912520398 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3840009390 con 0x7f38540b1440 2024-08-17T02:24:34.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.901+0000 7f3853400640 1 --2- 172.21.15.107:0/912520398 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3854140580 0x7f385413e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:34.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.901+0000 7f3852a00640 1 --2- 172.21.15.107:0/912520398 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f38540b1440 0x7f38540aab00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f384400c910 tx=0x7f3844001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:34.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.901+0000 7f384a000640 1 -- 172.21.15.107:0/912520398 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3844005d60 con 0x7f38540b1440 2024-08-17T02:24:34.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.901+0000 7f384a000640 1 -- 172.21.15.107:0/912520398 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f384400a640 con 0x7f38540b1440 2024-08-17T02:24:34.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.901+0000 7f384a000640 1 -- 172.21.15.107:0/912520398 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384400a9e0 con 0x7f38540b1440 2024-08-17T02:24:34.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.901+0000 7f3859a00640 1 -- 172.21.15.107:0/912520398 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38540c6a60 con 0x7f38540b1440 2024-08-17T02:24:34.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.901+0000 7f3859a00640 1 -- 172.21.15.107:0/912520398 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38540ab260 con 0x7f38540b1440 2024-08-17T02:24:34.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.902+0000 7f3859a00640 1 -- 172.21.15.107:0/912520398 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3854064db0 con 0x7f38540b1440 2024-08-17T02:24:34.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.903+0000 7f384a000640 1 -- 172.21.15.107:0/912520398 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f38440070f0 con 0x7f38540b1440 2024-08-17T02:24:34.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.904+0000 7f384a000640 1 --2- 172.21.15.107:0/912520398 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3834065150 0x7f3834067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:34.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.904+0000 7f384a000640 1 -- 172.21.15.107:0/912520398 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3844082320 con 0x7f38540b1440 2024-08-17T02:24:34.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.904+0000 7f3852000640 1 --2- 172.21.15.107:0/912520398 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3834065150 0x7f3834067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:34.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.905+0000 7f3852000640 1 --2- 172.21.15.107:0/912520398 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3834065150 0x7f3834067600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3840034000 tx=0x7f3840032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:34.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:34.908+0000 7f384a000640 1 -- 172.21.15.107:0/912520398 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3844050340 con 0x7f38540b1440 2024-08-17T02:24:35.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.082+0000 7f3859a00640 1 -- 172.21.15.107:0/912520398 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38540c0c80 con 0x7f38540b1440 2024-08-17T02:24:35.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.083+0000 7f384a000640 1 -- 172.21.15.107:0/912520398 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f3844053960 con 0x7f38540b1440 2024-08-17T02:24:35.084 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:24:35.084 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":21,"fsid":"f207b4c0-329d-46b8-b83f-aaf30bdb6ce3","created":"2024-08-17T02:24:11.038049+0000","modified":"2024-08-17T02:24:30.420018+0000","last_up_change":"2024-08-17T02:24:22.047790+0000","last_in_change":"2024-08-17T02:24:13.892720+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:23.456166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:27.078670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:27.804418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"376363f3-b8bf-4f1e-b691-51cdd39171ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37302},{"type":"v1","addr":"172.21.15.107:6801","nonce":37302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37302},{"type":"v1","addr":"172.21.15.107:6803","nonce":37302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37302},{"type":"v1","addr":"172.21.15.107:6807","nonce":37302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37302},{"type":"v1","addr":"172.21.15.107:6805","nonce":37302}]},"public_addr":"172.21.15.107:6801/37302","cluster_addr":"172.21.15.107:6803/37302","heartbeat_back_addr":"172.21.15.107:6807/37302","heartbeat_front_addr":"172.21.15.107:6805/37302","state":["exists","up"]},{"osd":1,"uuid":"cc6624e3-2ad4-4db4-b377-05dfe57424e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37305},{"type":"v1","addr":"172.21.15.107:6824","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37305},{"type":"v1","addr":"172.21.15.107:6827","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37305},{"type":"v1","addr":"172.21.15.107:6831","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37305},{"type":"v1","addr":"172.21.15.107:6829","nonce":37305}]},"public_addr":"172.21.15.107:6824/37305","cluster_addr":"172.21.15.107:6827/37305","heartbeat_back_addr":"172.21.15.107:6831/37305","heartbeat_front_addr":"172.21.15.107:6829/37305","state":["exists","up"]},{"osd":2,"uuid":"25229542-29b5-4281-bcb0-798ae0930aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37307},{"type":"v1","addr":"172.21.15.107:6817","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37307},{"type":"v1","addr":"172.21.15.107:6819","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6823","nonce":37307},{"type":"v1","addr":"172.21.15.107:6825","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37307},{"type":"v1","addr":"172.21.15.107:6821","nonce":37307}]},"public_addr":"172.21.15.107:6817/37307","cluster_addr":"172.21.15.107:6819/37307","heartbeat_back_addr":"172.21.15.107:6825/37307","heartbeat_front_addr":"172.21.15.107:6821/37307","state":["exists","up"]},{"osd":3,"uuid":"5f16aee8-8950-4268-a61a-5cf6ebd670e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37306},{"type":"v1","addr":"172.21.15.107:6809","nonce":37306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37306},{"type":"v1","addr":"172.21.15.107:6811","nonce":37306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37306},{"type":"v1","addr":"172.21.15.107:6815","nonce":37306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37306},{"type":"v1","addr":"172.21.15.107:6813","nonce":37306}]},"public_addr":"172.21.15.107:6809/37306","cluster_addr":"172.21.15.107:6811/37306","heartbeat_back_addr":"172.21.15.107:6815/37306","heartbeat_front_addr":"172.21.15.107:6813/37306","state":["exists","up"]},{"osd":4,"uuid":"23232e28-e23b-4b4e-a531-4939246dbbde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":37329},{"type":"v1","addr":"172.21.15.157:6817","nonce":37329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":37329},{"type":"v1","addr":"172.21.15.157:6819","nonce":37329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":37329},{"type":"v1","addr":"172.21.15.157:6823","nonce":37329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":37329},{"type":"v1","addr":"172.21.15.157:6821","nonce":37329}]},"public_addr":"172.21.15.157:6817/37329","cluster_addr":"172.21.15.157:6819/37329","heartbeat_back_addr":"172.21.15.157:6823/37329","heartbeat_front_addr":"172.21.15.157:6821/37329","state":["exists","up"]},{"osd":5,"uuid":"f87ec331-3e59-4886-a317-6f7e26ec8e21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":37328},{"type":"v1","addr":"172.21.15.157:6804","nonce":37328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":37328},{"type":"v1","addr":"172.21.15.157:6808","nonce":37328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":37328},{"type":"v1","addr":"172.21.15.157:6815","nonce":37328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":37328},{"type":"v1","addr":"172.21.15.157:6812","nonce":37328}]},"public_addr":"172.21.15.157:6804/37328","cluster_addr":"172.21.15.157:6808/37328","heartbeat_back_addr":"172.21.15.157:6815/37328","heartbeat_front_addr":"172.21.15.157:6812/37328","state":["exists","up"]},{"osd":6,"uuid":"92852235-ce49-4d96-a940-6f18d97b13ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":37330},{"type":"v1","addr":"172.21.15.157:6801","nonce":37330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6803","nonce":37330},{"type":"v1","addr":"172.21.15.157:6805","nonce":37330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":37330},{"type":"v1","addr":"172.21.15.157:6813","nonce":37330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":37330},{"type":"v1","addr":"172.21.15.157:6809","nonce":37330}]},"public_addr":"172.21.15.157:6801/37330","cluster_addr":"172.21.15.157:6805/37330","heartbeat_back_addr":"172.21.15.157:6813/37330","heartbeat_front_addr":"172.21.15.157:6809/37330","state":["exists","up"]},{"osd":7,"uuid":"7484a061-723d-4663-b28f-b01766d62f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":37373},{"type":"v1","addr":"172.21.15.157:6825","nonce":37373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":37373},{"type":"v1","addr":"172.21.15.157:6827","nonce":37373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":37373},{"type":"v1","addr":"172.21.15.157:6831","nonce":37373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":37373},{"type":"v1","addr":"172.21.15.157:6829","nonce":37373}]},"public_addr":"172.21.15.157:6825/37373","cluster_addr":"172.21.15.157:6827/37373","heartbeat_back_addr":"172.21.15.157:6831/37373","heartbeat_front_addr":"172.21.15.157:6829/37373","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.110188+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.280265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.252119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.267996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.284582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.144420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.174764+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.308002+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:35.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.085+0000 7f3859a00640 1 -- 172.21.15.107:0/912520398 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3834065150 msgr2=0x7f3834067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.085+0000 7f3859a00640 1 --2- 172.21.15.107:0/912520398 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3834065150 0x7f3834067600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3840034000 tx=0x7f3840032000 comp rx=0 tx=0).stop 2024-08-17T02:24:35.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.085+0000 7f3859a00640 1 -- 172.21.15.107:0/912520398 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f38540b1440 msgr2=0x7f38540aab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.085+0000 7f3859a00640 1 --2- 172.21.15.107:0/912520398 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f38540b1440 0x7f38540aab00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f384400c910 tx=0x7f3844001710 comp rx=0 tx=0).stop 2024-08-17T02:24:35.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.085+0000 7f3859a00640 1 -- 172.21.15.107:0/912520398 shutdown_connections 2024-08-17T02:24:35.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.085+0000 7f3859a00640 1 --2- 172.21.15.107:0/912520398 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3834065150 0x7f3834067600 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.085+0000 7f3859a00640 1 --2- 172.21.15.107:0/912520398 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3854140580 0x7f385413e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.085+0000 7f3859a00640 1 --2- 172.21.15.107:0/912520398 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f38541401b0 0x7f38540a73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.085+0000 7f3859a00640 1 --2- 172.21.15.107:0/912520398 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f38540b1440 0x7f38540aab00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.085+0000 7f3859a00640 1 -- 172.21.15.107:0/912520398 >> 172.21.15.107:0/912520398 conn(0x7f38540cb9b0 msgr2=0x7f385413f110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:35.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.086+0000 7f3859a00640 1 -- 172.21.15.107:0/912520398 shutdown_connections 2024-08-17T02:24:35.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.086+0000 7f3859a00640 1 -- 172.21.15.107:0/912520398 wait complete. 2024-08-17T02:24:35.102 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-08-17T02:24:35.102 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-08-17T02:24:35.103 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-08-17T02:24:35.103 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-08-17T02:24:35.104 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-08-17T02:24:35.104 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-08-17T02:24:35.104 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-08-17T02:24:35.105 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-08-17T02:24:35.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.363+0000 7f91f1800640 1 Processor -- start 2024-08-17T02:24:35.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.364+0000 7fdd16800640 1 Processor -- start 2024-08-17T02:24:35.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.364+0000 7f91f1800640 1 -- start start 2024-08-17T02:24:35.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.364+0000 7fdd16800640 1 -- start start 2024-08-17T02:24:35.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.366+0000 7fdd16800640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdd1015c340 0x7fdd100cc010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.366+0000 7f91f1800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f91ec0ceb40 0x7f91ec0cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.366+0000 7f91f1800640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f91ec0ccad0 0x7f91ec162860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.366+0000 7f91ebe00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f91ec159ca0 0x7f91ec0ca360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:47874/0 (socket says 172.21.15.107:47874) 2024-08-17T02:24:35.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.366+0000 7f91ebe00640 1 -- 172.21.15.107:0/2999976301 learned_addr learned my addr 172.21.15.107:0/2999976301 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:35.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.366+0000 7fdd16800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fdd100cea00 0x7fdd100c4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.366+0000 7f91f1800640 1 -- 172.21.15.107:0/2999976301 --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91ec0cadc0 con 0x7f91ec159ca0 2024-08-17T02:24:35.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.367+0000 7f91f1800640 1 -- 172.21.15.107:0/2999976301 --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91ec0cd6e0 con 0x7f91ec0ccad0 2024-08-17T02:24:35.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.367+0000 7f91f1800640 1 -- 172.21.15.107:0/2999976301 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91ec0ccf70 con 0x7f91ec0ceb40 2024-08-17T02:24:35.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.367+0000 7f91eb400640 1 --2- 172.21.15.107:0/2999976301 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f91ec0ceb40 0x7f91ec0cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.367+0000 7f91f0e00640 1 --2- 172.21.15.107:0/2999976301 >> v2:172.21.15.157:3300/0 conn(0x7f91ec0ccad0 0x7f91ec162860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.367+0000 7fdd16800640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd100cb470 con 0x7fdd1015c710 2024-08-17T02:24:35.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.367+0000 7fdd16800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd100cc550 con 0x7fdd100cea00 2024-08-17T02:24:35.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.367+0000 7fdd16800640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd100c69f0 con 0x7fdd1015c340 2024-08-17T02:24:35.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.367+0000 7fdd0ea00640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fdd1015c710 0x7fdd100ce2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:45014/0 (socket says 172.21.15.107:45014) 2024-08-17T02:24:35.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.367+0000 7fdd0ea00640 1 -- 172.21.15.107:0/3947915988 learned_addr learned my addr 172.21.15.107:0/3947915988 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:35.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.367+0000 7fdd0fe00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fdd100cea00 0x7fdd100c4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.367+0000 7fdd0f400640 1 --2- 172.21.15.107:0/3947915988 >> v2:172.21.15.157:3300/0 conn(0x7fdd1015c340 0x7fdd100cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.368+0000 7f91eaa00640 1 -- 172.21.15.107:0/2999976301 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2532233941 0 0) 0x7f91ec0cadc0 con 0x7f91ec159ca0 2024-08-17T02:24:35.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.368+0000 7f91eaa00640 1 -- 172.21.15.107:0/2999976301 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91d00034e0 con 0x7f91ec159ca0 2024-08-17T02:24:35.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.368+0000 7fdd0e000640 1 -- 172.21.15.107:0/3947915988 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2195259140 0 0) 0x7fdd100cb470 con 0x7fdd1015c710 2024-08-17T02:24:35.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.368+0000 7fdd0fe00640 1 -- 172.21.15.107:0/3947915988 >> v2:172.21.15.157:3300/0 conn(0x7fdd1015c340 msgr2=0x7fdd100cc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:35.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.368+0000 7f91eb400640 1 -- 172.21.15.107:0/2999976301 >> v2:172.21.15.157:3300/0 conn(0x7f91ec0ccad0 msgr2=0x7f91ec162860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:35.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.368+0000 7f91eb400640 1 --2- 172.21.15.107:0/2999976301 >> v2:172.21.15.157:3300/0 conn(0x7f91ec0ccad0 0x7f91ec162860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.368+0000 7f91eb400640 1 -- 172.21.15.107:0/2999976301 >> v1:172.21.15.107:6789/0 conn(0x7f91ec159ca0 legacy=0x7f91ec0ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.368+0000 7fdd0fe00640 1 --2- 172.21.15.107:0/3947915988 >> v2:172.21.15.157:3300/0 conn(0x7fdd1015c340 0x7fdd100cc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.368+0000 7fdd0fe00640 1 -- 172.21.15.107:0/3947915988 >> v1:172.21.15.157:6789/0 conn(0x7fdd1015c710 legacy=0x7fdd100ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.368+0000 7fdd0fe00640 1 -- 172.21.15.107:0/3947915988 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd100cab60 con 0x7fdd100cea00 2024-08-17T02:24:35.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.369+0000 7fdd0f400640 1 --2- 172.21.15.107:0/3947915988 >> v2:172.21.15.157:3300/0 conn(0x7fdd1015c340 0x7fdd100cc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:35.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.370+0000 7f91eb400640 1 -- 172.21.15.107:0/2999976301 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ec0cb060 con 0x7f91ec0ceb40 2024-08-17T02:24:35.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.370+0000 7f91f0e00640 1 --2- 172.21.15.107:0/2999976301 >> v2:172.21.15.157:3300/0 conn(0x7f91ec0ccad0 0x7f91ec162860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:35.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.370+0000 7fdd0fe00640 1 --2- 172.21.15.107:0/3947915988 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd100cea00 0x7fdd100c4bb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdd100664e0 tx=0x7fdd08009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c81833beb97cce4d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.371+0000 7fdd0e000640 1 -- 172.21.15.107:0/3947915988 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd08007550 con 0x7fdd100cea00 2024-08-17T02:24:35.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.371+0000 7f3330600640 1 Processor -- start 2024-08-17T02:24:35.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.371+0000 7fdd0e000640 1 -- 172.21.15.107:0/3947915988 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd0802d050 con 0x7fdd100cea00 2024-08-17T02:24:35.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.371+0000 7f8396600640 1 Processor -- start 2024-08-17T02:24:35.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.372+0000 7f8396600640 1 -- start start 2024-08-17T02:24:35.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.372+0000 7f91eb400640 1 --2- 172.21.15.107:0/2999976301 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f91ec0ceb40 0x7f91ec0cc590 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f91e4009e60 tx=0x7f91e4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f035548eb9ed9e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.372+0000 7f3330600640 1 -- start start 2024-08-17T02:24:35.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.372+0000 7f91eaa00640 1 -- 172.21.15.107:0/2999976301 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e4007550 con 0x7f91ec0ceb40 2024-08-17T02:24:35.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.372+0000 7f91eaa00640 1 -- 172.21.15.107:0/2999976301 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e402d050 con 0x7f91ec0ceb40 2024-08-17T02:24:35.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.371+0000 7fdd0e000640 1 -- 172.21.15.107:0/3947915988 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd08007550 con 0x7fdd100cea00 2024-08-17T02:24:35.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.372+0000 7fdd16800640 1 -- 172.21.15.107:0/3947915988 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd100cea00 msgr2=0x7fdd100c4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.372+0000 7fdd16800640 1 --2- 172.21.15.107:0/3947915988 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd100cea00 0x7fdd100c4bb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdd100664e0 tx=0x7fdd08009780 comp rx=0 tx=0).stop 2024-08-17T02:24:35.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.372+0000 7f91eaa00640 1 -- 172.21.15.107:0/2999976301 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e4007920 con 0x7f91ec0ceb40 2024-08-17T02:24:35.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.373+0000 7fdd16800640 1 -- 172.21.15.107:0/3947915988 shutdown_connections 2024-08-17T02:24:35.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.373+0000 7fdd16800640 1 --2- 172.21.15.107:0/3947915988 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd100cea00 0x7fdd100c4bb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.373+0000 7fdd16800640 1 --2- 172.21.15.107:0/3947915988 >> v2:172.21.15.157:3300/0 conn(0x7fdd1015c340 0x7fdd100cc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.373+0000 7fdd16800640 1 -- 172.21.15.107:0/3947915988 >> 172.21.15.107:0/3947915988 conn(0x7fdd1006eb90 msgr2=0x7fdd100cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:35.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.373+0000 7fdd16800640 1 -- 172.21.15.107:0/3947915988 shutdown_connections 2024-08-17T02:24:35.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.373+0000 7fdd16800640 1 -- 172.21.15.107:0/3947915988 wait complete. 2024-08-17T02:24:35.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.374+0000 7f8396600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f83900cd700 0x7f83900ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.374+0000 7f8396600640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f83900cc9d0 0x7f83900acfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.374+0000 7f8396600640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83900cf9d0 con 0x7f8390158c80 2024-08-17T02:24:35.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.374+0000 7f8396600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83900ceb60 con 0x7f83900cd700 2024-08-17T02:24:35.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.374+0000 7f8396600640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83900cedc0 con 0x7f83900cc9d0 2024-08-17T02:24:35.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.374+0000 7f3330600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33280ada10 0x7f33280b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.374+0000 7f8395c00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f83900cc9d0 0x7f83900acfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.375+0000 7fdd16800640 1 Processor -- start 2024-08-17T02:24:35.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.374+0000 7f8395c00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f83900cc9d0 0x7f83900acfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:38568/0 (socket says 172.21.15.107:38568) 2024-08-17T02:24:35.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.374+0000 7f8395c00640 1 -- 172.21.15.107:0/1423361071 learned_addr learned my addr 172.21.15.107:0/1423361071 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:35.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.375+0000 7f3330600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33280d0ab0 con 0x7f33280b38b0 2024-08-17T02:24:35.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.375+0000 7f332dc00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33280ada10 0x7f33280b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.375+0000 7f332dc00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33280ada10 0x7f33280b2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:42078/0 (socket says 172.21.15.107:42078) 2024-08-17T02:24:35.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.375+0000 7f332dc00640 1 -- 172.21.15.107:0/1844701382 learned_addr learned my addr 172.21.15.107:0/1844701382 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:35.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.375+0000 7f838fe00640 1 --2- 172.21.15.107:0/1423361071 >> v2:172.21.15.107:3300/0 conn(0x7f83900cd700 0x7f83900ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.375+0000 7f8395c00640 1 -- 172.21.15.107:0/1423361071 >> v2:172.21.15.107:3300/0 conn(0x7f83900cd700 msgr2=0x7f83900ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:35.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.375+0000 7f3330600640 1 -- 172.21.15.107:0/1844701382 --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33280b00c0 con 0x7f33280b1120 2024-08-17T02:24:35.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.375+0000 7f8395c00640 1 --2- 172.21.15.107:0/1423361071 >> v2:172.21.15.107:3300/0 conn(0x7f83900cd700 0x7f83900ce620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.375+0000 7f8395c00640 1 -- 172.21.15.107:0/1423361071 >> v1:172.21.15.157:6789/0 conn(0x7f8390158c80 legacy=0x7f83900cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.375+0000 7f3330600640 1 -- 172.21.15.107:0/1844701382 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33280b0360 con 0x7f33280ada10 2024-08-17T02:24:35.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.375+0000 7f8395c00640 1 -- 172.21.15.107:0/1423361071 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83900cf0a0 con 0x7f83900cc9d0 2024-08-17T02:24:35.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.375+0000 7f838fe00640 1 --2- 172.21.15.107:0/1423361071 >> v2:172.21.15.107:3300/0 conn(0x7f83900cd700 0x7f83900ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:35.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.373+0000 7f91f1800640 1 -- 172.21.15.107:0/2999976301 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f91ec0ceb40 msgr2=0x7f91ec0cc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.373+0000 7f91f1800640 1 --2- 172.21.15.107:0/2999976301 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f91ec0ceb40 0x7f91ec0cc590 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f91e4009e60 tx=0x7f91e4009780 comp rx=0 tx=0).stop 2024-08-17T02:24:35.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.376+0000 7f91f1800640 1 -- 172.21.15.107:0/2999976301 shutdown_connections 2024-08-17T02:24:35.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.376+0000 7f91f1800640 1 --2- 172.21.15.107:0/2999976301 >> v2:172.21.15.157:3300/0 conn(0x7f91ec0ccad0 0x7f91ec162860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.376+0000 7f91f1800640 1 --2- 172.21.15.107:0/2999976301 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f91ec0ceb40 0x7f91ec0cc590 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.376+0000 7f91f1800640 1 -- 172.21.15.107:0/2999976301 >> 172.21.15.107:0/2999976301 conn(0x7f91ec098e00 msgr2=0x7f91ec06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:35.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.376+0000 7fdd16800640 1 -- start start 2024-08-17T02:24:35.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.376+0000 7f332dc00640 1 -- 172.21.15.107:0/1844701382 >> v1:172.21.15.157:6789/0 conn(0x7f33280b1120 legacy=0x7f33280b31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.376+0000 7f91f1800640 1 -- 172.21.15.107:0/2999976301 shutdown_connections 2024-08-17T02:24:35.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.376+0000 7f332dc00640 1 -- 172.21.15.107:0/1844701382 >> v1:172.21.15.107:6789/0 conn(0x7f33280b38b0 legacy=0x7f33280aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:35.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.376+0000 7f91f1800640 1 -- 172.21.15.107:0/2999976301 wait complete. 2024-08-17T02:24:35.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.376+0000 7f332dc00640 1 -- 172.21.15.107:0/1844701382 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33280b0640 con 0x7f33280ada10 2024-08-17T02:24:35.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.377+0000 7f8395c00640 1 --2- 172.21.15.107:0/1423361071 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83900cc9d0 0x7f83900acfd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f83900ca0f0 tx=0x7f83800091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a18f45b60418fb85 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.377+0000 7f838f400640 1 -- 172.21.15.107:0/1423361071 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838002add0 con 0x7f83900cc9d0 2024-08-17T02:24:35.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.377+0000 7f838f400640 1 -- 172.21.15.107:0/1423361071 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8380032440 con 0x7f83900cc9d0 2024-08-17T02:24:35.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.377+0000 7f838f400640 1 -- 172.21.15.107:0/1423361071 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8380032820 con 0x7f83900cc9d0 2024-08-17T02:24:35.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.378+0000 7f332dc00640 1 --2- 172.21.15.107:0/1844701382 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33280ada10 0x7f33280b2c60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f331c009940 tx=0x7f331c0091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d3d13bef4c43aeb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.378+0000 7f91f1800640 1 Processor -- start 2024-08-17T02:24:35.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.378+0000 7f91f1800640 1 -- start start 2024-08-17T02:24:35.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.378+0000 7fdd16800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd100cea00 0x7fdd10158930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.378+0000 7f8396600640 1 -- 172.21.15.107:0/1423361071 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83900cc9d0 msgr2=0x7f83900acfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.378+0000 7f8396600640 1 --2- 172.21.15.107:0/1423361071 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83900cc9d0 0x7f83900acfd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f83900ca0f0 tx=0x7f83800091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.379+0000 7f3327e00640 1 -- 172.21.15.107:0/1844701382 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331c02f510 con 0x7f33280ada10 2024-08-17T02:24:35.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.379+0000 7fdd16800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd1015c340 0x7fdd100c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.379+0000 7f3327e00640 1 -- 172.21.15.107:0/1844701382 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f331c02d050 con 0x7f33280ada10 2024-08-17T02:24:35.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.379+0000 7faf8da00640 1 Processor -- start 2024-08-17T02:24:35.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.379+0000 7f8396600640 1 -- 172.21.15.107:0/1423361071 shutdown_connections 2024-08-17T02:24:35.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.379+0000 7f8396600640 1 --2- 172.21.15.107:0/1423361071 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83900cc9d0 0x7f83900acfd0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.379+0000 7f8396600640 1 --2- 172.21.15.107:0/1423361071 >> v2:172.21.15.107:3300/0 conn(0x7f83900cd700 0x7f83900ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.379+0000 7f8396600640 1 -- 172.21.15.107:0/1423361071 >> 172.21.15.107:0/1423361071 conn(0x7f8390098e30 msgr2=0x7f839006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:35.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.379+0000 7f3327e00640 1 -- 172.21.15.107:0/1844701382 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331c02f8e0 con 0x7f33280ada10 2024-08-17T02:24:35.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.379+0000 7faf8da00640 1 -- start start 2024-08-17T02:24:35.388 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.379+0000 7fdd16800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd1015c710 0x7fdd100688c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.388 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.379+0000 7fdd16800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1009a5c0 con 0x7fdd1015c710 2024-08-17T02:24:35.388 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.379+0000 7fdd16800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1009baa0 con 0x7fdd1015c340 2024-08-17T02:24:35.388 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.379+0000 7fdd16800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1009bd60 con 0x7fdd100cea00 2024-08-17T02:24:35.388 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.379+0000 7fdd0f400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd100cea00 0x7fdd10158930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.388 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.379+0000 7f8396600640 1 -- 172.21.15.107:0/1423361071 shutdown_connections 2024-08-17T02:24:35.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.380+0000 7fdd0f400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd100cea00 0x7fdd10158930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:42082/0 (socket says 172.21.15.107:42082) 2024-08-17T02:24:35.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.380+0000 7fdd0f400640 1 -- 172.21.15.107:0/3865479995 learned_addr learned my addr 172.21.15.107:0/3865479995 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:35.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.380+0000 7fdd0ea00640 1 --2- 172.21.15.107:0/3865479995 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd1015c340 0x7fdd100c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.380+0000 7f91f1800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91ec0ccad0 0x7f91ec168870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.380+0000 7f91f1800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91ec0ceb40 0x7f91ec09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.380+0000 7f91f1800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f91ec159ca0 0x7f91ec09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.380+0000 7f3330600640 1 -- 172.21.15.107:0/1844701382 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33280ada10 msgr2=0x7f33280b2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.380+0000 7f3330600640 1 --2- 172.21.15.107:0/1844701382 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33280ada10 0x7f33280b2c60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f331c009940 tx=0x7f331c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.380+0000 7fdd0fe00640 1 --2- 172.21.15.107:0/3865479995 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd1015c710 0x7fdd100688c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.381+0000 7f91ebe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91ec0ccad0 0x7f91ec168870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.381+0000 7f91eb400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91ec0ceb40 0x7f91ec09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.381+0000 7f3330600640 1 -- 172.21.15.107:0/1844701382 shutdown_connections 2024-08-17T02:24:35.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.381+0000 7f3330600640 1 --2- 172.21.15.107:0/1844701382 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33280ada10 0x7f33280b2c60 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.381+0000 7f3330600640 1 -- 172.21.15.107:0/1844701382 >> 172.21.15.107:0/1844701382 conn(0x7f33280cfdf0 msgr2=0x7f33280d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:35.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.381+0000 7fdd0ea00640 1 -- 172.21.15.107:0/3865479995 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd100cea00 msgr2=0x7fdd10158930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.381+0000 7fdd0ea00640 1 --2- 172.21.15.107:0/3865479995 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd100cea00 0x7fdd10158930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.381+0000 7fdd0ea00640 1 -- 172.21.15.107:0/3865479995 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd1015c710 msgr2=0x7fdd100688c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.381+0000 7faf8da00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7faf880cd700 0x7faf880ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.381+0000 7faf8da00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7faf880cc9d0 0x7faf880acfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.381+0000 7faf8da00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf880cf9d0 con 0x7faf88158c80 2024-08-17T02:24:35.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.381+0000 7faf8da00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf880ceb60 con 0x7faf880cd700 2024-08-17T02:24:35.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.381+0000 7faf8da00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf880cedc0 con 0x7faf880cc9d0 2024-08-17T02:24:35.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.381+0000 7f91ebe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91ec0ccad0 0x7f91ec168870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37624/0 (socket says 172.21.15.107:37624) 2024-08-17T02:24:35.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.381+0000 7f91f1800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ec09b330 con 0x7f91ec0ccad0 2024-08-17T02:24:35.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.381+0000 7f91f1800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ec0c5e50 con 0x7f91ec0ceb40 2024-08-17T02:24:35.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.381+0000 7f91f1800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91ec09aa00 con 0x7f91ec159ca0 2024-08-17T02:24:35.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.381+0000 7f91eb400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91ec0ceb40 0x7f91ec09c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:38594/0 (socket says 172.21.15.107:38594) 2024-08-17T02:24:35.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.381+0000 7f91f0e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f91ec159ca0 0x7f91ec09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.381+0000 7f3330600640 1 -- 172.21.15.107:0/1844701382 shutdown_connections 2024-08-17T02:24:35.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.382+0000 7fdd0ea00640 1 --2- 172.21.15.107:0/3865479995 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd1015c710 0x7fdd100688c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.381+0000 7f8396600640 1 -- 172.21.15.107:0/1423361071 wait complete. 2024-08-17T02:24:35.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.382+0000 7faf87e00640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7faf88158c80 0x7faf880cc2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:45036/0 (socket says 172.21.15.107:45036) 2024-08-17T02:24:35.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.382+0000 7faf87e00640 1 -- 172.21.15.107:0/2105929008 learned_addr learned my addr 172.21.15.107:0/2105929008 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:35.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.382+0000 7faf87400640 1 --2- 172.21.15.107:0/2105929008 >> v2:172.21.15.107:3300/0 conn(0x7faf880cd700 0x7faf880ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.382+0000 7f91ebe00640 1 -- 172.21.15.107:0/159931882 learned_addr learned my addr 172.21.15.107:0/159931882 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:35.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.381+0000 7f3330600640 1 -- 172.21.15.107:0/1844701382 wait complete. 2024-08-17T02:24:35.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.382+0000 7fdd0ea00640 1 -- 172.21.15.107:0/3865479995 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd08009a20 con 0x7fdd1015c340 2024-08-17T02:24:35.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.382+0000 7fdd0fe00640 1 --2- 172.21.15.107:0/3865479995 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd1015c710 0x7fdd100688c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:35.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.383+0000 7f8396600640 1 Processor -- start 2024-08-17T02:24:35.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.383+0000 7f8396600640 1 -- start start 2024-08-17T02:24:35.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.383+0000 7faf8d000640 1 --2- 172.21.15.107:0/2105929008 >> v2:172.21.15.157:3300/0 conn(0x7faf880cc9d0 0x7faf880acfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.383+0000 7f91eb400640 1 -- 172.21.15.107:0/159931882 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f91ec159ca0 msgr2=0x7f91ec09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.383+0000 7f91eb400640 1 --2- 172.21.15.107:0/159931882 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f91ec159ca0 0x7f91ec09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.383+0000 7f91eb400640 1 -- 172.21.15.107:0/159931882 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91ec0ccad0 msgr2=0x7f91ec168870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.383+0000 7faf86a00640 1 -- 172.21.15.107:0/2105929008 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1636219915 0 0) 0x7faf880cf9d0 con 0x7faf88158c80 2024-08-17T02:24:35.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.384+0000 7f91eb400640 1 --2- 172.21.15.107:0/159931882 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91ec0ccad0 0x7f91ec168870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.383+0000 7faf86a00640 1 -- 172.21.15.107:0/2105929008 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf6c0034e0 con 0x7faf88158c80 2024-08-17T02:24:35.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.384+0000 7f91eb400640 1 -- 172.21.15.107:0/159931882 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91dc009390 con 0x7f91ec0ceb40 2024-08-17T02:24:35.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.384+0000 7fdd0ea00640 1 --2- 172.21.15.107:0/3865479995 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd1015c340 0x7fdd100c8dc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000c460 tx=0x7fdd00007ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.384+0000 7f3330600640 1 Processor -- start 2024-08-17T02:24:35.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.384+0000 7f4ad7200640 1 Processor -- start 2024-08-17T02:24:35.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.384+0000 7f91ebe00640 1 --2- 172.21.15.107:0/159931882 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91ec0ccad0 0x7f91ec168870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:35.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.384+0000 7faf87400640 1 -- 172.21.15.107:0/2105929008 >> v2:172.21.15.157:3300/0 conn(0x7faf880cc9d0 msgr2=0x7faf880acfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:35.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.384+0000 7faf87400640 1 --2- 172.21.15.107:0/2105929008 >> v2:172.21.15.157:3300/0 conn(0x7faf880cc9d0 0x7faf880acfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.384+0000 7f91eb400640 1 --2- 172.21.15.107:0/159931882 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91ec0ceb40 0x7f91ec09c9c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f91e4031000 tx=0x7f91e4037000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.384+0000 7f3330600640 1 -- start start 2024-08-17T02:24:35.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.384+0000 7fdd06a00640 1 -- 172.21.15.107:0/3865479995 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd00005aa0 con 0x7fdd1015c340 2024-08-17T02:24:35.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.384+0000 7fdd06a00640 1 -- 172.21.15.107:0/3865479995 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd00005c00 con 0x7fdd1015c340 2024-08-17T02:24:35.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.385+0000 7f91e3400640 1 -- 172.21.15.107:0/159931882 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e4031650 con 0x7f91ec0ceb40 2024-08-17T02:24:35.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.385+0000 7f91e3400640 1 -- 172.21.15.107:0/159931882 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e4040070 con 0x7f91ec0ceb40 2024-08-17T02:24:35.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.385+0000 7f91e3400640 1 -- 172.21.15.107:0/159931882 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e4031a00 con 0x7f91ec0ceb40 2024-08-17T02:24:35.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.384+0000 7f4ad7200640 1 -- start start 2024-08-17T02:24:35.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.384+0000 7fdd06a00640 1 -- 172.21.15.107:0/3865479995 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd000070d0 con 0x7fdd1015c340 2024-08-17T02:24:35.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.384+0000 7fdd16800640 1 -- 172.21.15.107:0/3865479995 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd10099d20 con 0x7fdd1015c340 2024-08-17T02:24:35.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.385+0000 7fdd16800640 1 -- 172.21.15.107:0/3865479995 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd1009a2e0 con 0x7fdd1015c340 2024-08-17T02:24:35.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.384+0000 7faf87400640 1 -- 172.21.15.107:0/2105929008 >> v1:172.21.15.157:6789/0 conn(0x7faf88158c80 legacy=0x7faf880cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.384+0000 7faf87400640 1 -- 172.21.15.107:0/2105929008 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf880cf0a0 con 0x7faf880cd700 2024-08-17T02:24:35.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.385+0000 7f91f1800640 1 -- 172.21.15.107:0/159931882 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e4009a20 con 0x7f91ec0ceb40 2024-08-17T02:24:35.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.385+0000 7f8396600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f83900cc9d0 0x7f8390150410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.386+0000 7f91f1800640 1 -- 172.21.15.107:0/159931882 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91ec09afc0 con 0x7f91ec0ceb40 2024-08-17T02:24:35.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.386+0000 7f3330600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33280ada10 0x7f3328141170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.385+0000 7fd9bd400640 1 Processor -- start 2024-08-17T02:24:35.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.386+0000 7faf87400640 1 --2- 172.21.15.107:0/2105929008 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faf880cd700 0x7faf880ce620 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7faf880ca0f0 tx=0x7faf740090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1a24cefc64c854f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.386+0000 7f8396600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83900cd700 0x7f83900af1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.386+0000 7f8396600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8390158c80 0x7f83900b14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.404 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.386+0000 7fd9bd400640 1 -- start start 2024-08-17T02:24:35.404 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.386+0000 7f8396600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83900b00e0 con 0x7f83900cc9d0 2024-08-17T02:24:35.404 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.386+0000 7faf86a00640 1 -- 172.21.15.107:0/2105929008 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7402ac80 con 0x7faf880cd700 2024-08-17T02:24:35.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.386+0000 7faf86a00640 1 -- 172.21.15.107:0/2105929008 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf7402ade0 con 0x7faf880cd700 2024-08-17T02:24:35.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.386+0000 7faf86a00640 1 -- 172.21.15.107:0/2105929008 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf74032670 con 0x7faf880cd700 2024-08-17T02:24:35.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.386+0000 7f8396600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83900c7560 con 0x7f8390158c80 2024-08-17T02:24:35.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.386+0000 7f8396600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83900c7ae0 con 0x7f83900cd700 2024-08-17T02:24:35.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.386+0000 7f8395c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8390158c80 0x7f83900b14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.386+0000 7f838fe00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83900cd700 0x7f83900af1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.387+0000 7f838fe00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83900cd700 0x7f83900af1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:42106/0 (socket says 172.21.15.107:42106) 2024-08-17T02:24:35.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.387+0000 7f838fe00640 1 -- 172.21.15.107:0/207810583 learned_addr learned my addr 172.21.15.107:0/207810583 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:35.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.387+0000 7f8395200640 1 --2- 172.21.15.107:0/207810583 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f83900cc9d0 0x7f8390150410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.406 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.387+0000 7f91f1800640 1 -- 172.21.15.107:0/159931882 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f91ec071050 con 0x7f91ec0ceb40 2024-08-17T02:24:35.406 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.387+0000 7f8395200640 1 -- 172.21.15.107:0/207810583 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83900cd700 msgr2=0x7f83900af1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.406 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.387+0000 7f8395200640 1 --2- 172.21.15.107:0/207810583 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83900cd700 0x7f83900af1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.406 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.387+0000 7f8395200640 1 -- 172.21.15.107:0/207810583 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8390158c80 msgr2=0x7f83900b14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.406 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.387+0000 7f8395200640 1 --2- 172.21.15.107:0/207810583 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8390158c80 0x7f83900b14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.406 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.387+0000 7faf8da00640 1 -- 172.21.15.107:0/2105929008 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faf880cd700 msgr2=0x7faf880ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.387+0000 7faf8da00640 1 --2- 172.21.15.107:0/2105929008 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faf880cd700 0x7faf880ce620 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7faf880ca0f0 tx=0x7faf740090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.387+0000 7f8395200640 1 -- 172.21.15.107:0/207810583 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8380009450 con 0x7f83900cc9d0 2024-08-17T02:24:35.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.388+0000 7f4ad7200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4ad00ada10 0x7f4ad00b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.388+0000 7faf8da00640 1 -- 172.21.15.107:0/2105929008 shutdown_connections 2024-08-17T02:24:35.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.388+0000 7faf8da00640 1 --2- 172.21.15.107:0/2105929008 >> v2:172.21.15.157:3300/0 conn(0x7faf880cc9d0 0x7faf880acfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.388+0000 7faf8da00640 1 --2- 172.21.15.107:0/2105929008 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faf880cd700 0x7faf880ce620 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.388+0000 7faf8da00640 1 -- 172.21.15.107:0/2105929008 >> 172.21.15.107:0/2105929008 conn(0x7faf88098e30 msgr2=0x7faf8806eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:35.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.388+0000 7f4ad7200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4ad00b1120 0x7f4ad00b31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.388+0000 7f4ad7200640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad00d0ab0 con 0x7f4ad00b36e0 2024-08-17T02:24:35.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.388+0000 7f4ad7200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ad00b00c0 con 0x7f4ad00ada10 2024-08-17T02:24:35.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.388+0000 7f4ad7200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad00b0360 con 0x7f4ad00b1120 2024-08-17T02:24:35.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.388+0000 7faf8da00640 1 -- 172.21.15.107:0/2105929008 shutdown_connections 2024-08-17T02:24:35.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.388+0000 7f4acfe00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4ad00ada10 0x7f4ad00b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.388+0000 7faf8da00640 1 -- 172.21.15.107:0/2105929008 wait complete. 2024-08-17T02:24:35.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.388+0000 7fd9bd400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd9b00ddd90 0x7fd9b00de160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.388+0000 7f8395200640 1 --2- 172.21.15.107:0/207810583 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f83900cc9d0 0x7f8390150410 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f837800c4c0 tx=0x7f8378007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.388+0000 7f4acfe00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4ad00ada10 0x7f4ad00b2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37650/0 (socket says 172.21.15.107:37650) 2024-08-17T02:24:35.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.388+0000 7f4acfe00640 1 -- 172.21.15.107:0/2920947090 learned_addr learned my addr 172.21.15.107:0/2920947090 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:35.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.389+0000 7fd9bd400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd9b00502f0 0x7fd9b0034160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.389+0000 7f8387e00640 1 -- 172.21.15.107:0/207810583 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8378011590 con 0x7f83900cc9d0 2024-08-17T02:24:35.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.389+0000 7f8387e00640 1 -- 172.21.15.107:0/207810583 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83780116f0 con 0x7f83900cc9d0 2024-08-17T02:24:35.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.389+0000 7f8387e00640 1 -- 172.21.15.107:0/207810583 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8378011ab0 con 0x7f83900cc9d0 2024-08-17T02:24:35.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.389+0000 7f8396600640 1 -- 172.21.15.107:0/207810583 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83900afb80 con 0x7f83900cc9d0 2024-08-17T02:24:35.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.389+0000 7fd9b7e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd9b00ddd90 0x7fd9b00de160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.389+0000 7fd9b7400640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fd9b0053020 0x7fd9b004fbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:45048/0 (socket says 172.21.15.107:45048) 2024-08-17T02:24:35.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.389+0000 7fd9b7e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd9b00ddd90 0x7fd9b00de160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37664/0 (socket says 172.21.15.107:37664) 2024-08-17T02:24:35.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.388+0000 7fdd06a00640 1 -- 172.21.15.107:0/3865479995 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fdd00007500 con 0x7fdd1015c340 2024-08-17T02:24:35.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.388+0000 7fdd16800640 1 -- 172.21.15.107:0/3865479995 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdd10071050 con 0x7fdd1015c340 2024-08-17T02:24:35.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.389+0000 7fdd06a00640 1 --2- 172.21.15.107:0/3865479995 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fdcf0065220 0x7fdcf00676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.390+0000 7fdd06a00640 1 -- 172.21.15.107:0/3865479995 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdd00081880 con 0x7fdd1015c340 2024-08-17T02:24:35.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.390+0000 7fdd06a00640 1 --2- 172.21.15.107:0/3865479995 >> [v2:172.21.15.107:6822/37305,v1:172.21.15.107:6824/37305] conn(0x7fdcf006d3b0 0x7fdcf006f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.390+0000 7fdd06a00640 1 -- 172.21.15.107:0/3865479995 --> [v2:172.21.15.107:6822/37305,v1:172.21.15.107:6824/37305] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdcf006fe70 con 0x7fdcf006d3b0 2024-08-17T02:24:35.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.390+0000 7f8396600640 1 -- 172.21.15.107:0/207810583 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8390150950 con 0x7f83900cc9d0 2024-08-17T02:24:35.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.390+0000 7fd9bd400640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9b0054130 con 0x7fd9b0053020 2024-08-17T02:24:35.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.390+0000 7fd9bd400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9b0053520 con 0x7fd9b00ddd90 2024-08-17T02:24:35.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.390+0000 7fd9bd400640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9b0053800 con 0x7fd9b00502f0 2024-08-17T02:24:35.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.390+0000 7fd9b7400640 1 -- 172.21.15.107:0/2724409989 learned_addr learned my addr 172.21.15.107:0/2724409989 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:35.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.390+0000 7fd9bca00640 1 --2- 172.21.15.107:0/2724409989 >> v2:172.21.15.157:3300/0 conn(0x7fd9b00502f0 0x7fd9b0034160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.389+0000 7f4acfe00640 1 -- 172.21.15.107:0/2920947090 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4ad00b1120 msgr2=0x7f4ad00b31a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:24:35.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.389+0000 7f4acfe00640 1 --2- 172.21.15.107:0/2920947090 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4ad00b1120 0x7f4ad00b31a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.389+0000 7f4acfe00640 1 -- 172.21.15.107:0/2920947090 >> v1:172.21.15.157:6789/0 conn(0x7f4ad00b36e0 legacy=0x7f4ad00adde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.389+0000 7f4acfe00640 1 -- 172.21.15.107:0/2920947090 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad00b0640 con 0x7f4ad00ada10 2024-08-17T02:24:35.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.390+0000 7f3330600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33280b1120 0x7f33281416b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.391+0000 7f91e3400640 1 -- 172.21.15.107:0/159931882 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f91e4042030 con 0x7f91ec0ceb40 2024-08-17T02:24:35.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.391+0000 7fd9bca00640 1 -- 172.21.15.107:0/2724409989 >> v2:172.21.15.107:3300/0 conn(0x7fd9b00ddd90 msgr2=0x7fd9b00de160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:35.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.391+0000 7fd9b6a00640 1 -- 172.21.15.107:0/2724409989 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 573365901 0 0) 0x7fd9b0054130 con 0x7fd9b0053020 2024-08-17T02:24:35.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.391+0000 7f3330600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33280b38b0 0x7f3328141bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.391+0000 7f3330600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332806db40 con 0x7f33280b1120 2024-08-17T02:24:35.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.391+0000 7f3330600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332806cf30 con 0x7f33280b38b0 2024-08-17T02:24:35.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.391+0000 7faf8da00640 1 Processor -- start 2024-08-17T02:24:35.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.391+0000 7f3330600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f332806d210 con 0x7f33280ada10 2024-08-17T02:24:35.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.391+0000 7f4acfe00640 1 --2- 172.21.15.107:0/2920947090 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ad00ada10 0x7f4ad00b2c60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4abc009910 tx=0x7f4abc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd9284528613eb1d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.392+0000 7f8396600640 1 -- 172.21.15.107:0/207810583 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f83900aff20 con 0x7f83900cc9d0 2024-08-17T02:24:35.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.392+0000 7faf8da00640 1 -- start start 2024-08-17T02:24:35.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.392+0000 7f91e3400640 1 --2- 172.21.15.107:0/159931882 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f91c80652a0 0x7f91c8067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.392+0000 7f91e3400640 1 -- 172.21.15.107:0/159931882 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f91e40a39e0 con 0x7f91ec0ceb40 2024-08-17T02:24:35.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.392+0000 7f332e600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33280b38b0 0x7f3328141bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.391+0000 7fdd0f400640 1 --2- 172.21.15.107:0/3865479995 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fdcf0065220 0x7fdcf00676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.392+0000 7fdd0fe00640 1 --2- 172.21.15.107:0/3865479995 >> [v2:172.21.15.107:6822/37305,v1:172.21.15.107:6824/37305] conn(0x7fdcf006d3b0 0x7fdcf006f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.392+0000 7fdd0f400640 1 --2- 172.21.15.107:0/3865479995 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fdcf0065220 0x7fdcf00676d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc00ad30 tx=0x7fdcfc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.393+0000 7fdd06a00640 1 -- 172.21.15.107:0/3865479995 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd0000cea0 con 0x7fdd1015c340 2024-08-17T02:24:35.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.391+0000 7fd9bca00640 1 --2- 172.21.15.107:0/2724409989 >> v2:172.21.15.107:3300/0 conn(0x7fd9b00ddd90 0x7fd9b00de160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.391+0000 7fd9bca00640 1 -- 172.21.15.107:0/2724409989 >> v1:172.21.15.157:6789/0 conn(0x7fd9b0053020 legacy=0x7fd9b004fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.391+0000 7fd9bca00640 1 -- 172.21.15.107:0/2724409989 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b0053ae0 con 0x7fd9b00502f0 2024-08-17T02:24:35.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.392+0000 7f332dc00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33280ada10 0x7f3328141170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.392+0000 7f332dc00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33280ada10 0x7f3328141170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:42126/0 (socket says 172.21.15.107:42126) 2024-08-17T02:24:35.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.392+0000 7f332dc00640 1 -- 172.21.15.107:0/3888010165 learned_addr learned my addr 172.21.15.107:0/3888010165 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:35.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.392+0000 7f332dc00640 1 -- 172.21.15.107:0/3888010165 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33280b38b0 msgr2=0x7f3328141bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.392+0000 7f332dc00640 1 --2- 172.21.15.107:0/3888010165 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33280b38b0 0x7f3328141bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.392+0000 7f332dc00640 1 -- 172.21.15.107:0/3888010165 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33280b1120 msgr2=0x7f33281416b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:24:35.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.393+0000 7f91ebe00640 1 --2- 172.21.15.107:0/159931882 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f91c80652a0 0x7f91c8067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.393+0000 7f3fcc200640 1 Processor -- start 2024-08-17T02:24:35.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.393+0000 7f3fcc200640 1 -- start start 2024-08-17T02:24:35.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.393+0000 7f8387e00640 1 -- 172.21.15.107:0/207810583 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f837801b3b0 con 0x7f83900cc9d0 2024-08-17T02:24:35.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.394+0000 7faf8da00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faf880cc9d0 0x7faf8814f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.394+0000 7faf8da00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faf880cd700 0x7faf88067b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.394+0000 7faf8da00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf88158c80 0x7faf880680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.394+0000 7fd9bca00640 1 --2- 172.21.15.107:0/2724409989 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9b00502f0 0x7fd9b0034160 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd9b804c0c0 tx=0x7fd9b806f710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df50365118fedd9d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.394+0000 7f332d200640 1 --2- 172.21.15.107:0/3888010165 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33280b1120 0x7f33281416b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.394+0000 7f3fcc200640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3fc406d7f0 0x7f3fc40aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.394+0000 7f332dc00640 1 --2- 172.21.15.107:0/3888010165 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33280b1120 0x7f33281416b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.394+0000 7fd9b6a00640 1 -- 172.21.15.107:0/2724409989 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b80a96f0 con 0x7fd9b00502f0 2024-08-17T02:24:35.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.394+0000 7f3fcc200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3fc40b10d0 0x7f3fc406dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.394+0000 7f3fcc200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fc40b1900 con 0x7f3fc406e100 2024-08-17T02:24:35.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.394+0000 7f3fcc200640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc40b1be0 con 0x7f3fc406d7f0 2024-08-17T02:24:35.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.394+0000 7f3fcc200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc40c8570 con 0x7f3fc40b10d0 2024-08-17T02:24:35.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.395+0000 7fd9b6a00640 1 -- 172.21.15.107:0/2724409989 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b80a5040 con 0x7fd9b00502f0 2024-08-17T02:24:35.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.395+0000 7fd9b6a00640 1 -- 172.21.15.107:0/2724409989 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b80a9aa0 con 0x7fd9b00502f0 2024-08-17T02:24:35.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.394+0000 7f332dc00640 1 -- 172.21.15.107:0/3888010165 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f331c009450 con 0x7f33280ada10 2024-08-17T02:24:35.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.395+0000 7f332d200640 1 --2- 172.21.15.107:0/3888010165 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33280b1120 0x7f33281416b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:35.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.394+0000 7faf8da00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf880c5500 con 0x7faf880cd700 2024-08-17T02:24:35.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.394+0000 7faf8da00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf880c5070 con 0x7faf88158c80 2024-08-17T02:24:35.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.394+0000 7faf8da00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf880c4460 con 0x7faf880cc9d0 2024-08-17T02:24:35.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.395+0000 7faf87e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faf880cc9d0 0x7faf8814f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.395+0000 7faf8d000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf88158c80 0x7faf880680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.395+0000 7f3fca200640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f3fc406e100 0x7f3fc40c9050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:47890/0 (socket says 172.21.15.107:47890) 2024-08-17T02:24:35.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.395+0000 7f3fca200640 1 -- 172.21.15.107:0/1704296753 learned_addr learned my addr 172.21.15.107:0/1704296753 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:35.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.395+0000 7f3fc9800640 1 --2- 172.21.15.107:0/1704296753 >> v2:172.21.15.157:3300/0 conn(0x7f3fc406d7f0 0x7f3fc40aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.395+0000 7f8387e00640 1 --2- 172.21.15.107:0/207810583 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f836c065220 0x7f836c0676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.394+0000 7f4acea00640 1 -- 172.21.15.107:0/2920947090 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4abc02ae60 con 0x7f4ad00ada10 2024-08-17T02:24:35.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.394+0000 7f4acea00640 1 -- 172.21.15.107:0/2920947090 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4abc032440 con 0x7f4ad00ada10 2024-08-17T02:24:35.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.394+0000 7f4acea00640 1 -- 172.21.15.107:0/2920947090 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4abc02ae60 con 0x7f4ad00ada10 2024-08-17T02:24:35.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.395+0000 7faf8d000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf88158c80 0x7faf880680b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:38640/0 (socket says 172.21.15.107:38640) 2024-08-17T02:24:35.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.395+0000 7faf8d000640 1 -- 172.21.15.107:0/2359002340 learned_addr learned my addr 172.21.15.107:0/2359002340 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:35.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.395+0000 7f3fc3e00640 1 -- 172.21.15.107:0/1704296753 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2914029816 0 0) 0x7f3fc40b1900 con 0x7f3fc406e100 2024-08-17T02:24:35.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.396+0000 7f3fc3e00640 1 -- 172.21.15.107:0/1704296753 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fac0034e0 con 0x7f3fc406e100 2024-08-17T02:24:35.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.396+0000 7faf87400640 1 --2- 172.21.15.107:0/2359002340 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faf880cd700 0x7faf88067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.396+0000 7f3fc9800640 1 -- 172.21.15.107:0/1704296753 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3fc40b10d0 msgr2=0x7f3fc406dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:35.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.396+0000 7f332dc00640 1 --2- 172.21.15.107:0/3888010165 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33280ada10 0x7f3328141170 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f331c0099a0 tx=0x7f331c035000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.396+0000 7fd9bd400640 1 -- 172.21.15.107:0/2724409989 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9b00502f0 msgr2=0x7fd9b0034160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.396+0000 7fd9bd400640 1 --2- 172.21.15.107:0/2724409989 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9b00502f0 0x7fd9b0034160 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd9b804c0c0 tx=0x7fd9b806f710 comp rx=0 tx=0).stop 2024-08-17T02:24:35.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.393+0000 7f91e3400640 1 --2- 172.21.15.107:0/159931882 >> [v2:172.21.15.107:6800/37302,v1:172.21.15.107:6801/37302] conn(0x7f91c806d4b0 0x7f91c806f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.393+0000 7f91e3400640 1 -- 172.21.15.107:0/159931882 --> [v2:172.21.15.107:6800/37302,v1:172.21.15.107:6801/37302] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f91c806ff70 con 0x7f91c806d4b0 2024-08-17T02:24:35.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.393+0000 7f91e3400640 1 -- 172.21.15.107:0/159931882 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91e40a8220 con 0x7f91ec0ceb40 2024-08-17T02:24:35.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.394+0000 7f91f0e00640 1 --2- 172.21.15.107:0/159931882 >> [v2:172.21.15.107:6800/37302,v1:172.21.15.107:6801/37302] conn(0x7f91c806d4b0 0x7f91c806f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.395+0000 7f91f0e00640 1 --2- 172.21.15.107:0/159931882 >> [v2:172.21.15.107:6800/37302,v1:172.21.15.107:6801/37302] conn(0x7f91c806d4b0 0x7f91c806f8c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.394+0000 7fdd0fe00640 1 --2- 172.21.15.107:0/3865479995 >> [v2:172.21.15.107:6822/37305,v1:172.21.15.107:6824/37305] conn(0x7fdcf006d3b0 0x7fdcf006f7c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.396+0000 7f3fc8e00640 1 --2- 172.21.15.107:0/1704296753 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3fc40b10d0 0x7f3fc406dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.396+0000 7f3fc9800640 1 --2- 172.21.15.107:0/1704296753 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3fc40b10d0 0x7f3fc406dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.396+0000 7f3fc9800640 1 -- 172.21.15.107:0/1704296753 >> v1:172.21.15.107:6789/0 conn(0x7f3fc406e100 legacy=0x7f3fc40c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.396+0000 7f3fc9800640 1 -- 172.21.15.107:0/1704296753 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc40c8850 con 0x7f3fc406d7f0 2024-08-17T02:24:35.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.396+0000 7f3fc8e00640 1 --2- 172.21.15.107:0/1704296753 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3fc40b10d0 0x7f3fc406dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:35.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.396+0000 7f91e3400640 1 -- 172.21.15.107:0/159931882 <== osd.0 v2:172.21.15.107:6800/37302 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f91c806ff70 con 0x7f91c806d4b0 2024-08-17T02:24:35.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.396+0000 7faf87e00640 1 -- 172.21.15.107:0/2359002340 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf88158c80 msgr2=0x7faf880680b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.396+0000 7faf87e00640 1 --2- 172.21.15.107:0/2359002340 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf88158c80 0x7faf880680b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.396+0000 7faf87e00640 1 -- 172.21.15.107:0/2359002340 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faf880cd700 msgr2=0x7faf88067b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.396+0000 7faf87e00640 1 --2- 172.21.15.107:0/2359002340 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faf880cd700 0x7faf88067b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.396+0000 7fd9bd400640 1 -- 172.21.15.107:0/2724409989 shutdown_connections 2024-08-17T02:24:35.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.396+0000 7fd9bd400640 1 --2- 172.21.15.107:0/2724409989 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9b00502f0 0x7fd9b0034160 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.397+0000 7f3324c00640 1 -- 172.21.15.107:0/3888010165 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331c031ac0 con 0x7f33280ada10 2024-08-17T02:24:35.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.397+0000 7faf87e00640 1 -- 172.21.15.107:0/2359002340 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf74009390 con 0x7faf880cc9d0 2024-08-17T02:24:35.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.397+0000 7f3324c00640 1 -- 172.21.15.107:0/3888010165 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f331c03f070 con 0x7f33280ada10 2024-08-17T02:24:35.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.397+0000 7f3324c00640 1 -- 172.21.15.107:0/3888010165 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331c031e90 con 0x7f33280ada10 2024-08-17T02:24:35.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.397+0000 7faf87400640 1 --2- 172.21.15.107:0/2359002340 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faf880cd700 0x7faf88067b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:35.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.396+0000 7fd9bd400640 1 --2- 172.21.15.107:0/2724409989 >> v2:172.21.15.107:3300/0 conn(0x7fd9b00ddd90 0x7fd9b00de160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.396+0000 7fd9bd400640 1 -- 172.21.15.107:0/2724409989 >> 172.21.15.107:0/2724409989 conn(0x7fd9b0009fa0 msgr2=0x7fd9b000a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:35.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.397+0000 7f3330600640 1 -- 172.21.15.107:0/3888010165 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f332806d4f0 con 0x7f33280ada10 2024-08-17T02:24:35.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.397+0000 7f3330600640 1 -- 172.21.15.107:0/3888010165 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3328142130 con 0x7f33280ada10 2024-08-17T02:24:35.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.395+0000 7f8387e00640 1 -- 172.21.15.107:0/207810583 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8378081800 con 0x7f83900cc9d0 2024-08-17T02:24:35.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.397+0000 7f8387e00640 1 --2- 172.21.15.107:0/207810583 >> [v2:172.21.15.157:6816/37329,v1:172.21.15.157:6817/37329] conn(0x7f836c06d430 0x7f836c06f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.397+0000 7f8387e00640 1 -- 172.21.15.107:0/207810583 --> [v2:172.21.15.157:6816/37329,v1:172.21.15.157:6817/37329] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f836c06fef0 con 0x7f836c06d430 2024-08-17T02:24:35.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.397+0000 7f8387e00640 1 -- 172.21.15.107:0/207810583 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8378081a60 con 0x7f83900cc9d0 2024-08-17T02:24:35.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.397+0000 7fd9bd400640 1 -- 172.21.15.107:0/2724409989 shutdown_connections 2024-08-17T02:24:35.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.397+0000 7faf87e00640 1 --2- 172.21.15.107:0/2359002340 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faf880cc9d0 0x7faf8814f1e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7faf7800c5c0 tx=0x7faf78007ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.397+0000 7f838fe00640 1 --2- 172.21.15.107:0/207810583 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f836c065220 0x7f836c0676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.398+0000 7f8395c00640 1 --2- 172.21.15.107:0/207810583 >> [v2:172.21.15.157:6816/37329,v1:172.21.15.157:6817/37329] conn(0x7f836c06d430 0x7f836c06f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.398+0000 7f3fc9800640 1 --2- 172.21.15.107:0/1704296753 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3fc406d7f0 0x7f3fc40aeda0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8009880 tx=0x7f3fb80090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b4da044bd741104 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.398+0000 7f3fc3e00640 1 -- 172.21.15.107:0/1704296753 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb802ad70 con 0x7f3fc406d7f0 2024-08-17T02:24:35.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.398+0000 7f3fc3e00640 1 -- 172.21.15.107:0/1704296753 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb8032440 con 0x7f3fc406d7f0 2024-08-17T02:24:35.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.398+0000 7f3fc3e00640 1 -- 172.21.15.107:0/1704296753 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb8032820 con 0x7f3fc406d7f0 2024-08-17T02:24:35.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.399+0000 7f91ebe00640 1 --2- 172.21.15.107:0/159931882 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f91c80652a0 0x7f91c8067750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f91d4007fd0 tx=0x7f91d4007e10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.399+0000 7f3330600640 1 -- 172.21.15.107:0/3888010165 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3328064db0 con 0x7f33280ada10 2024-08-17T02:24:35.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.399+0000 7f838fe00640 1 --2- 172.21.15.107:0/207810583 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f836c065220 0x7f836c0676d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8390064070 tx=0x7f8388007910 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.397+0000 7fd9bd400640 1 -- 172.21.15.107:0/2724409989 wait complete. 2024-08-17T02:24:35.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.399+0000 7f4ad7200640 1 -- 172.21.15.107:0/2920947090 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ad00ada10 msgr2=0x7f4ad00b2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.399+0000 7f4ad7200640 1 --2- 172.21.15.107:0/2920947090 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ad00ada10 0x7f4ad00b2c60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4abc009910 tx=0x7f4abc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.399+0000 7f3fcc200640 1 -- 172.21.15.107:0/1704296753 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3fc406d7f0 msgr2=0x7f3fc40aeda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.399+0000 7f3fcc200640 1 --2- 172.21.15.107:0/1704296753 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3fc406d7f0 0x7f3fc40aeda0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8009880 tx=0x7f3fb80090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.399+0000 7f8395c00640 1 --2- 172.21.15.107:0/207810583 >> [v2:172.21.15.157:6816/37329,v1:172.21.15.157:6817/37329] conn(0x7f836c06d430 0x7f836c06f840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.399+0000 7f4ad7200640 1 -- 172.21.15.107:0/2920947090 shutdown_connections 2024-08-17T02:24:35.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.399+0000 7f4ad7200640 1 --2- 172.21.15.107:0/2920947090 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4ad00b1120 0x7f4ad00b31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.399+0000 7f4ad7200640 1 --2- 172.21.15.107:0/2920947090 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ad00ada10 0x7f4ad00b2c60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.399+0000 7f4ad7200640 1 -- 172.21.15.107:0/2920947090 >> 172.21.15.107:0/2920947090 conn(0x7f4ad00cfdf0 msgr2=0x7f4ad00d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:35.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.396+0000 7fdd06a00640 1 -- 172.21.15.107:0/3865479995 <== osd.1 v2:172.21.15.107:6822/37305 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fdcf006fe70 con 0x7fdcf006d3b0 2024-08-17T02:24:35.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.399+0000 7f3fcc200640 1 -- 172.21.15.107:0/1704296753 shutdown_connections 2024-08-17T02:24:35.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.400+0000 7f3fcc200640 1 --2- 172.21.15.107:0/1704296753 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3fc40b10d0 0x7f3fc406dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.400+0000 7f3fcc200640 1 --2- 172.21.15.107:0/1704296753 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3fc406d7f0 0x7f3fc40aeda0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.400+0000 7f3fcc200640 1 -- 172.21.15.107:0/1704296753 >> 172.21.15.107:0/1704296753 conn(0x7f3fc40cb9b0 msgr2=0x7f3fc40cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:35.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.400+0000 7f3fcc200640 1 -- 172.21.15.107:0/1704296753 shutdown_connections 2024-08-17T02:24:35.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.400+0000 7f3fcc200640 1 -- 172.21.15.107:0/1704296753 wait complete. 2024-08-17T02:24:35.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.400+0000 7faf7f400640 1 -- 172.21.15.107:0/2359002340 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf78005aa0 con 0x7faf880cc9d0 2024-08-17T02:24:35.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.400+0000 7faf7f400640 1 -- 172.21.15.107:0/2359002340 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf78005c00 con 0x7faf880cc9d0 2024-08-17T02:24:35.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.400+0000 7fd9bd400640 1 Processor -- start 2024-08-17T02:24:35.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.400+0000 7fd9bd400640 1 -- start start 2024-08-17T02:24:35.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.400+0000 7f3324c00640 1 -- 172.21.15.107:0/3888010165 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f331c046690 con 0x7f33280ada10 2024-08-17T02:24:35.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.400+0000 7f8387e00640 1 -- 172.21.15.107:0/207810583 <== osd.4 v2:172.21.15.157:6816/37329 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f836c06fef0 con 0x7f836c06d430 2024-08-17T02:24:35.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.401+0000 7f4ad7200640 1 -- 172.21.15.107:0/2920947090 shutdown_connections 2024-08-17T02:24:35.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.401+0000 7f4ad7200640 1 -- 172.21.15.107:0/2920947090 wait complete. 2024-08-17T02:24:35.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.401+0000 7faf7f400640 1 -- 172.21.15.107:0/2359002340 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf780070f0 con 0x7faf880cc9d0 2024-08-17T02:24:35.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.401+0000 7faf8da00640 1 -- 172.21.15.107:0/2359002340 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf880c4740 con 0x7faf880cc9d0 2024-08-17T02:24:35.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.401+0000 7faf8da00640 1 -- 172.21.15.107:0/2359002340 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf880c4d00 con 0x7faf880cc9d0 2024-08-17T02:24:35.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.401+0000 7f3324c00640 1 --2- 172.21.15.107:0/3888010165 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f33080652a0 0x7f3308067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.402+0000 7fd9bd400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9b00502f0 0x7fd9b004e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.402+0000 7fd9bd400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9b0053020 0x7fd9b0102830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.402+0000 7fd9bd400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9b00ddd90 0x7fd9b00d9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.402+0000 7fd9bd400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b004cb50 con 0x7fd9b00ddd90 2024-08-17T02:24:35.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.402+0000 7fd9bd400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b004ce30 con 0x7fd9b00502f0 2024-08-17T02:24:35.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.402+0000 7fd9bd400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b004d110 con 0x7fd9b0053020 2024-08-17T02:24:35.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.402+0000 7f3324c00640 1 -- 172.21.15.107:0/3888010165 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f331c041070 con 0x7f33280ada10 2024-08-17T02:24:35.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.402+0000 7faf8da00640 1 -- 172.21.15.107:0/2359002340 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faf88071050 con 0x7faf880cc9d0 2024-08-17T02:24:35.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.402+0000 7fd9b7e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9b00502f0 0x7fd9b004e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.402+0000 7f3324c00640 1 --2- 172.21.15.107:0/3888010165 >> [v2:172.21.15.107:6816/37307,v1:172.21.15.107:6817/37307] conn(0x7f330806d340 0x7f330806f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.402+0000 7f3324c00640 1 -- 172.21.15.107:0/3888010165 --> [v2:172.21.15.107:6816/37307,v1:172.21.15.107:6817/37307] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f330806fe00 con 0x7f330806d340 2024-08-17T02:24:35.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.402+0000 7f3324c00640 1 -- 172.21.15.107:0/3888010165 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f331c0a8200 con 0x7f33280ada10 2024-08-17T02:24:35.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.402+0000 7fd9bca00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9b00ddd90 0x7fd9b00d9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.402+0000 7fd9b7e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9b00502f0 0x7fd9b004e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:38648/0 (socket says 172.21.15.107:38648) 2024-08-17T02:24:35.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.402+0000 7fd9bca00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9b00ddd90 0x7fd9b00d9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37686/0 (socket says 172.21.15.107:37686) 2024-08-17T02:24:35.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.402+0000 7fd9b7e00640 1 -- 172.21.15.107:0/4238399817 learned_addr learned my addr 172.21.15.107:0/4238399817 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:35.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.402+0000 7f332d200640 1 --2- 172.21.15.107:0/3888010165 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f33080652a0 0x7f3308067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.403+0000 7f332e600640 1 --2- 172.21.15.107:0/3888010165 >> [v2:172.21.15.107:6816/37307,v1:172.21.15.107:6817/37307] conn(0x7f330806d340 0x7f330806f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.403+0000 7f3fcc200640 1 Processor -- start 2024-08-17T02:24:35.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.403+0000 7f4ad7200640 1 Processor -- start 2024-08-17T02:24:35.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.404+0000 7f332e600640 1 --2- 172.21.15.107:0/3888010165 >> [v2:172.21.15.107:6816/37307,v1:172.21.15.107:6817/37307] conn(0x7f330806d340 0x7f330806f750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.404+0000 7f332d200640 1 --2- 172.21.15.107:0/3888010165 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f33080652a0 0x7f3308067750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f33280ae8d0 tx=0x7f3314009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.403+0000 7fd9b7400640 1 --2- 172.21.15.107:0/4238399817 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9b0053020 0x7fd9b0102830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.403+0000 7fd9b7400640 1 -- 172.21.15.107:0/4238399817 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9b00502f0 msgr2=0x7fd9b004e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.403+0000 7fd9b7400640 1 --2- 172.21.15.107:0/4238399817 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9b00502f0 0x7fd9b004e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.403+0000 7fd9b7400640 1 -- 172.21.15.107:0/4238399817 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9b00ddd90 msgr2=0x7fd9b00d9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.403+0000 7fd9b7400640 1 --2- 172.21.15.107:0/4238399817 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9b00ddd90 0x7fd9b00d9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.403+0000 7fd9b7400640 1 -- 172.21.15.107:0/4238399817 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b804c200 con 0x7fd9b0053020 2024-08-17T02:24:35.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.403+0000 7fd9b7400640 1 --2- 172.21.15.107:0/4238399817 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9b0053020 0x7fd9b0102830 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd9a400c500 tx=0x7fd9a4007ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.405+0000 7fd9ab400640 1 -- 172.21.15.107:0/4238399817 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a4005aa0 con 0x7fd9b0053020 2024-08-17T02:24:35.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.403+0000 7f3fcc200640 1 -- start start 2024-08-17T02:24:35.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.405+0000 7fd9ab400640 1 -- 172.21.15.107:0/4238399817 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a4005c00 con 0x7fd9b0053020 2024-08-17T02:24:35.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.405+0000 7fd9ab400640 1 -- 172.21.15.107:0/4238399817 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a40070d0 con 0x7fd9b0053020 2024-08-17T02:24:35.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.403+0000 7f4ad7200640 1 -- start start 2024-08-17T02:24:35.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.405+0000 7f4ad7200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4ad00ada10 0x7f4ad0159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.405+0000 7f3324c00640 1 -- 172.21.15.107:0/3888010165 <== osd.2 v2:172.21.15.107:6816/37307 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f330806fe00 con 0x7f330806d340 2024-08-17T02:24:35.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.405+0000 7f4ad7200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ad00b1120 0x7f4ad015a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.405+0000 7f3fcc200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3fc406d7f0 0x7f3fc416d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.405+0000 7f3fcc200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3fc406e100 0x7f3fc415abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.405+0000 7f4ad7200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ad00b36e0 0x7f4ad0153990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.405+0000 7f3fcc200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3fc40b10d0 0x7f3fc415b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.405+0000 7f3fcc200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc4159480 con 0x7f3fc40b10d0 2024-08-17T02:24:35.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.405+0000 7f3fcc200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc415b670 con 0x7f3fc406e100 2024-08-17T02:24:35.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.405+0000 7f3fcc200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc4170820 con 0x7f3fc406d7f0 2024-08-17T02:24:35.449 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.405+0000 7f4ad7200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad01702e0 con 0x7f4ad00b36e0 2024-08-17T02:24:35.449 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.405+0000 7f4ad7200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad014b670 con 0x7f4ad00b1120 2024-08-17T02:24:35.449 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.405+0000 7f4ad7200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad0159aa0 con 0x7f4ad00ada10 2024-08-17T02:24:35.449 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.406+0000 7fd9bd400640 1 -- 172.21.15.107:0/4238399817 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b004d3f0 con 0x7fd9b0053020 2024-08-17T02:24:35.450 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.406+0000 7f3fc8e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3fc406e100 0x7f3fc415abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.450 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.406+0000 7f3fc8e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3fc406e100 0x7f3fc415abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:38650/0 (socket says 172.21.15.107:38650) 2024-08-17T02:24:35.450 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.406+0000 7f3fc8e00640 1 -- 172.21.15.107:0/4031421036 learned_addr learned my addr 172.21.15.107:0/4031421036 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:35.450 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.406+0000 7fd9bd400640 1 -- 172.21.15.107:0/4238399817 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b00dac90 con 0x7fd9b0053020 2024-08-17T02:24:35.450 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.406+0000 7f4acf400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ad00b1120 0x7f4ad015a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.451 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.407+0000 7faf7f400640 1 -- 172.21.15.107:0/2359002340 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7faf78007520 con 0x7faf880cc9d0 2024-08-17T02:24:35.451 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.407+0000 7f3fc9800640 1 --2- 172.21.15.107:0/4031421036 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3fc406d7f0 0x7f3fc416d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.451 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.407+0000 7f3fc8e00640 1 -- 172.21.15.107:0/4031421036 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3fc406d7f0 msgr2=0x7f3fc416d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.451 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.407+0000 7f3fc8e00640 1 --2- 172.21.15.107:0/4031421036 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3fc406d7f0 0x7f3fc416d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.452 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.407+0000 7f3fc8e00640 1 -- 172.21.15.107:0/4031421036 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3fc40b10d0 msgr2=0x7f3fc415b130 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:24:35.452 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.407+0000 7f4ad5200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ad00b36e0 0x7f4ad0153990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.452 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.407+0000 7f4ad5200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ad00b36e0 0x7f4ad0153990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37714/0 (socket says 172.21.15.107:37714) 2024-08-17T02:24:35.452 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.407+0000 7f3fca200640 1 --2- 172.21.15.107:0/4031421036 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3fc40b10d0 0x7f3fc415b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.452 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.407+0000 7f3fc8e00640 1 --2- 172.21.15.107:0/4031421036 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3fc40b10d0 0x7f3fc415b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.452 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.407+0000 7f3fc8e00640 1 -- 172.21.15.107:0/4031421036 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb8009390 con 0x7f3fc406e100 2024-08-17T02:24:35.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.407+0000 7f3fca200640 1 --2- 172.21.15.107:0/4031421036 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3fc40b10d0 0x7f3fc415b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:35.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.407+0000 7f4ad5200640 1 -- 172.21.15.107:0/2667473233 learned_addr learned my addr 172.21.15.107:0/2667473233 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:35.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.407+0000 7fd9bd400640 1 -- 172.21.15.107:0/4238399817 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd9b0005320 con 0x7fd9b0053020 2024-08-17T02:24:35.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.407+0000 7f4acfe00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4ad00ada10 0x7f4ad0159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.407+0000 7f3fc8e00640 1 --2- 172.21.15.107:0/4031421036 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3fc406e100 0x7f3fc415abf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3fb000c880 tx=0x7f3fb0008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.408+0000 7f4ad5200640 1 -- 172.21.15.107:0/2667473233 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4ad00ada10 msgr2=0x7f4ad0159430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.408+0000 7f4ad5200640 1 --2- 172.21.15.107:0/2667473233 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4ad00ada10 0x7f4ad0159430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.408+0000 7f4ad5200640 1 -- 172.21.15.107:0/2667473233 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ad00b1120 msgr2=0x7f4ad015a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.408+0000 7f4ad5200640 1 --2- 172.21.15.107:0/2667473233 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ad00b1120 0x7f4ad015a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.408+0000 7f4ad5200640 1 -- 172.21.15.107:0/2667473233 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4abc009450 con 0x7f4ad00b36e0 2024-08-17T02:24:35.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.408+0000 7f4ad5200640 1 --2- 172.21.15.107:0/2667473233 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ad00b36e0 0x7f4ad0153990 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800c7c0 tx=0x7f4ac8001590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.409+0000 7f3fc0c00640 1 -- 172.21.15.107:0/4031421036 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb000ce10 con 0x7f3fc406e100 2024-08-17T02:24:35.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.409+0000 7f3fcc200640 1 -- 172.21.15.107:0/4031421036 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc4159e30 con 0x7f3fc406e100 2024-08-17T02:24:35.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.409+0000 7f3fcc200640 1 -- 172.21.15.107:0/4031421036 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc415a470 con 0x7f3fc406e100 2024-08-17T02:24:35.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.409+0000 7faf7f400640 1 --2- 172.21.15.107:0/2359002340 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7faf68065220 0x7faf680676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.456 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.409+0000 7faf7f400640 1 -- 172.21.15.107:0/2359002340 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faf78081d90 con 0x7faf880cc9d0 2024-08-17T02:24:35.456 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.409+0000 7f3fc0c00640 1 -- 172.21.15.107:0/4031421036 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb0007830 con 0x7f3fc406e100 2024-08-17T02:24:35.456 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.409+0000 7f3fc0c00640 1 -- 172.21.15.107:0/4031421036 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0007c10 con 0x7f3fc406e100 2024-08-17T02:24:35.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.409+0000 7f4ac7400640 1 -- 172.21.15.107:0/2667473233 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac800a5e0 con 0x7f4ad00b36e0 2024-08-17T02:24:35.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.409+0000 7f4ac7400640 1 -- 172.21.15.107:0/2667473233 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac800a740 con 0x7f4ad00b36e0 2024-08-17T02:24:35.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.409+0000 7f4ac7400640 1 -- 172.21.15.107:0/2667473233 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac800ab00 con 0x7f4ad00b36e0 2024-08-17T02:24:35.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.410+0000 7f4ad7200640 1 -- 172.21.15.107:0/2667473233 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad0159d80 con 0x7f4ad00b36e0 2024-08-17T02:24:35.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.411+0000 7f4ad7200640 1 -- 172.21.15.107:0/2667473233 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad015a340 con 0x7f4ad00b36e0 2024-08-17T02:24:35.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.410+0000 7faf87400640 1 --2- 172.21.15.107:0/2359002340 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7faf68065220 0x7faf680676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.410+0000 7fd9ab400640 1 -- 172.21.15.107:0/4238399817 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd9a40074c0 con 0x7fd9b0053020 2024-08-17T02:24:35.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.411+0000 7fd9ab400640 1 --2- 172.21.15.107:0/4238399817 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd9980652a0 0x7fd998067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.411+0000 7fd9ab400640 1 -- 172.21.15.107:0/4238399817 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd9a4081870 con 0x7fd9b0053020 2024-08-17T02:24:35.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.412+0000 7fd9ab400640 1 --2- 172.21.15.107:0/4238399817 >> [v2:172.21.15.157:6802/37328,v1:172.21.15.157:6804/37328] conn(0x7fd99806d4b0 0x7fd99806f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.412+0000 7fd9ab400640 1 -- 172.21.15.107:0/4238399817 --> [v2:172.21.15.157:6802/37328,v1:172.21.15.157:6804/37328] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd99806ff70 con 0x7fd99806d4b0 2024-08-17T02:24:35.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.412+0000 7fd9ab400640 1 -- 172.21.15.107:0/4238399817 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd9a4083db0 con 0x7fd9b0053020 2024-08-17T02:24:35.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.412+0000 7fd9b7e00640 1 --2- 172.21.15.107:0/4238399817 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd9980652a0 0x7fd998067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.411+0000 7f3fcc200640 1 -- 172.21.15.107:0/4031421036 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3fa0000fd0 con 0x7f3fc406e100 2024-08-17T02:24:35.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.412+0000 7f3fc0c00640 1 -- 172.21.15.107:0/4031421036 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3fb0011600 con 0x7f3fc406e100 2024-08-17T02:24:35.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.413+0000 7fd9bca00640 1 --2- 172.21.15.107:0/4238399817 >> [v2:172.21.15.157:6802/37328,v1:172.21.15.157:6804/37328] conn(0x7fd99806d4b0 0x7fd99806f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.412+0000 7faf7f400640 1 --2- 172.21.15.107:0/2359002340 >> [v2:172.21.15.107:6808/37306,v1:172.21.15.107:6809/37306] conn(0x7faf6806d2c0 0x7faf6806f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.413+0000 7faf7f400640 1 -- 172.21.15.107:0/2359002340 --> [v2:172.21.15.107:6808/37306,v1:172.21.15.107:6809/37306] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faf6806fd80 con 0x7faf6806d2c0 2024-08-17T02:24:35.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.413+0000 7faf7f400640 1 -- 172.21.15.107:0/2359002340 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf780842d0 con 0x7faf880cc9d0 2024-08-17T02:24:35.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.414+0000 7faf87400640 1 --2- 172.21.15.107:0/2359002340 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7faf68065220 0x7faf680676d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faf74034000 tx=0x7faf74032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.461 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.413+0000 7fd9b7e00640 1 --2- 172.21.15.107:0/4238399817 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd9980652a0 0x7fd998067750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac009d40 tx=0x7fd9ac0090f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.461 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.413+0000 7fd9bca00640 1 --2- 172.21.15.107:0/4238399817 >> [v2:172.21.15.157:6802/37328,v1:172.21.15.157:6804/37328] conn(0x7fd99806d4b0 0x7fd99806f8c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.461 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.414+0000 7f4ad7200640 1 -- 172.21.15.107:0/2667473233 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4aa8000fd0 con 0x7f4ad00b36e0 2024-08-17T02:24:35.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.414+0000 7f3fc0c00640 1 --2- 172.21.15.107:0/4031421036 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3fa4065150 0x7f3fa4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.414+0000 7f3fc0c00640 1 -- 172.21.15.107:0/4031421036 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3fb0081900 con 0x7f3fc406e100 2024-08-17T02:24:35.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.414+0000 7f3fc0c00640 1 --2- 172.21.15.107:0/4031421036 >> [v2:172.21.15.157:6824/37373,v1:172.21.15.157:6825/37373] conn(0x7f3fa406d360 0x7f3fa406f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.414+0000 7f3fc0c00640 1 -- 172.21.15.107:0/4031421036 --> [v2:172.21.15.157:6824/37373,v1:172.21.15.157:6825/37373] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3fa406fe20 con 0x7f3fa406d360 2024-08-17T02:24:35.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.414+0000 7fd9ab400640 1 -- 172.21.15.107:0/4238399817 <== osd.5 v2:172.21.15.157:6802/37328 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fd99806ff70 con 0x7fd99806d4b0 2024-08-17T02:24:35.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.414+0000 7f3fc0c00640 1 -- 172.21.15.107:0/4031421036 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3fb0081bc0 con 0x7f3fc406e100 2024-08-17T02:24:35.463 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.415+0000 7faf8d000640 1 --2- 172.21.15.107:0/2359002340 >> [v2:172.21.15.107:6808/37306,v1:172.21.15.107:6809/37306] conn(0x7faf6806d2c0 0x7faf6806f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.463 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.414+0000 7f3fc9800640 1 --2- 172.21.15.107:0/4031421036 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3fa4065150 0x7f3fa4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.463 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.415+0000 7f3fca200640 1 --2- 172.21.15.107:0/4031421036 >> [v2:172.21.15.157:6824/37373,v1:172.21.15.157:6825/37373] conn(0x7f3fa406d360 0x7f3fa406f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.463 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.416+0000 7faf8d000640 1 --2- 172.21.15.107:0/2359002340 >> [v2:172.21.15.107:6808/37306,v1:172.21.15.107:6809/37306] conn(0x7faf6806d2c0 0x7faf6806f6d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.416+0000 7f3fc9800640 1 --2- 172.21.15.107:0/4031421036 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3fa4065150 0x7f3fa4067600 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8034000 tx=0x7f3fb8032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.417+0000 7faf7f400640 1 -- 172.21.15.107:0/2359002340 <== osd.3 v2:172.21.15.107:6808/37306 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7faf6806fd80 con 0x7faf6806d2c0 2024-08-17T02:24:35.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.416+0000 7f4ac7400640 1 -- 172.21.15.107:0/2667473233 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4ac8003030 con 0x7f4ad00b36e0 2024-08-17T02:24:35.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.416+0000 7f3fca200640 1 --2- 172.21.15.107:0/4031421036 >> [v2:172.21.15.157:6824/37373,v1:172.21.15.157:6825/37373] conn(0x7f3fa406d360 0x7f3fa406f770 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.417+0000 7f3fc0c00640 1 -- 172.21.15.107:0/4031421036 <== osd.7 v2:172.21.15.157:6824/37373 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f3fa406fe20 con 0x7f3fa406d360 2024-08-17T02:24:35.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.417+0000 7f4ac7400640 1 --2- 172.21.15.107:0/2667473233 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4ab00652d0 0x7f4ab0067780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.418+0000 7f4ac7400640 1 -- 172.21.15.107:0/2667473233 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4ac8082270 con 0x7f4ad00b36e0 2024-08-17T02:24:35.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.418+0000 7f4ac7400640 1 --2- 172.21.15.107:0/2667473233 >> [v2:172.21.15.157:6800/37330,v1:172.21.15.157:6801/37330] conn(0x7f4ab006d4e0 0x7f4ab006f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.418+0000 7f4ac7400640 1 -- 172.21.15.107:0/2667473233 --> [v2:172.21.15.157:6800/37330,v1:172.21.15.157:6801/37330] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4ab006ffa0 con 0x7f4ab006d4e0 2024-08-17T02:24:35.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.418+0000 7f4ac7400640 1 -- 172.21.15.107:0/2667473233 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ac8084810 con 0x7f4ad00b36e0 2024-08-17T02:24:35.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.418+0000 7f4acfe00640 1 --2- 172.21.15.107:0/2667473233 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4ab00652d0 0x7f4ab0067780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.419+0000 7f4acf400640 1 --2- 172.21.15.107:0/2667473233 >> [v2:172.21.15.157:6800/37330,v1:172.21.15.157:6801/37330] conn(0x7f4ab006d4e0 0x7f4ab006f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.419+0000 7f4acfe00640 1 --2- 172.21.15.107:0/2667473233 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4ab00652d0 0x7f4ab0067780 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4abc034000 tx=0x7f4abc032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.425+0000 7f4acf400640 1 --2- 172.21.15.107:0/2667473233 >> [v2:172.21.15.157:6800/37330,v1:172.21.15.157:6801/37330] conn(0x7f4ab006d4e0 0x7f4ab006f8f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.425+0000 7fdd16800640 1 -- 172.21.15.107:0/3865479995 --> [v2:172.21.15.107:6822/37305,v1:172.21.15.107:6824/37305] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdd100894e0 con 0x7fdcf006d3b0 2024-08-17T02:24:35.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.426+0000 7fdd06a00640 1 -- 172.21.15.107:0/3865479995 <== osd.1 v2:172.21.15.107:6822/37305 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdd100894e0 con 0x7fdcf006d3b0 2024-08-17T02:24:35.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.426+0000 7f4ac7400640 1 -- 172.21.15.107:0/2667473233 <== osd.6 v2:172.21.15.157:6800/37330 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f4ab006ffa0 con 0x7f4ab006d4e0 2024-08-17T02:24:35.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.426+0000 7fdd16800640 1 -- 172.21.15.107:0/3865479995 >> [v2:172.21.15.107:6822/37305,v1:172.21.15.107:6824/37305] conn(0x7fdcf006d3b0 msgr2=0x7fdcf006f7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.426+0000 7fdd16800640 1 --2- 172.21.15.107:0/3865479995 >> [v2:172.21.15.107:6822/37305,v1:172.21.15.107:6824/37305] conn(0x7fdcf006d3b0 0x7fdcf006f7c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.427+0000 7f91f1800640 1 -- 172.21.15.107:0/159931882 --> [v2:172.21.15.107:6800/37302,v1:172.21.15.107:6801/37302] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f91ec0b5790 con 0x7f91c806d4b0 2024-08-17T02:24:35.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.428+0000 7fdd16800640 1 -- 172.21.15.107:0/3865479995 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fdcf0065220 msgr2=0x7fdcf00676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.428+0000 7fdd16800640 1 --2- 172.21.15.107:0/3865479995 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fdcf0065220 0x7fdcf00676d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc00ad30 tx=0x7fdcfc008040 comp rx=0 tx=0).stop 2024-08-17T02:24:35.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.428+0000 7f91e3400640 1 -- 172.21.15.107:0/159931882 <== osd.0 v2:172.21.15.107:6800/37302 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f91ec0b5790 con 0x7f91c806d4b0 2024-08-17T02:24:35.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.428+0000 7fdd16800640 1 -- 172.21.15.107:0/3865479995 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd1015c340 msgr2=0x7fdd100c8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.428+0000 7fdd16800640 1 --2- 172.21.15.107:0/3865479995 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd1015c340 0x7fdd100c8dc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000c460 tx=0x7fdd00007ec0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.428+0000 7fdd0fe00640 1 -- 172.21.15.107:0/3865479995 reap_dead start 2024-08-17T02:24:35.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.428+0000 7fdd16800640 1 -- 172.21.15.107:0/3865479995 shutdown_connections 2024-08-17T02:24:35.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.428+0000 7fdd16800640 1 -- 172.21.15.107:0/3865479995 >> 172.21.15.107:0/3865479995 conn(0x7fdd1006eb90 msgr2=0x7fdd10067580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:35.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.428+0000 7fdd16800640 1 -- 172.21.15.107:0/3865479995 shutdown_connections 2024-08-17T02:24:35.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.428+0000 7fdd16800640 1 -- 172.21.15.107:0/3865479995 wait complete. 2024-08-17T02:24:35.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.429+0000 7f8396600640 1 -- 172.21.15.107:0/207810583 --> [v2:172.21.15.157:6816/37329,v1:172.21.15.157:6817/37329] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8390071050 con 0x7f836c06d430 2024-08-17T02:24:35.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.430+0000 7f8387e00640 1 -- 172.21.15.107:0/207810583 <== osd.4 v2:172.21.15.157:6816/37329 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8390071050 con 0x7f836c06d430 2024-08-17T02:24:35.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.430+0000 7f8396600640 1 -- 172.21.15.107:0/207810583 >> [v2:172.21.15.157:6816/37329,v1:172.21.15.157:6817/37329] conn(0x7f836c06d430 msgr2=0x7f836c06f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.430+0000 7f8396600640 1 --2- 172.21.15.107:0/207810583 >> [v2:172.21.15.157:6816/37329,v1:172.21.15.157:6817/37329] conn(0x7f836c06d430 0x7f836c06f840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.431+0000 7f8396600640 1 -- 172.21.15.107:0/207810583 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f836c065220 msgr2=0x7f836c0676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.431+0000 7f8396600640 1 --2- 172.21.15.107:0/207810583 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f836c065220 0x7f836c0676d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8390064070 tx=0x7f8388007910 comp rx=0 tx=0).stop 2024-08-17T02:24:35.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.431+0000 7f8396600640 1 -- 172.21.15.107:0/207810583 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f83900cc9d0 msgr2=0x7f8390150410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.431+0000 7f8396600640 1 --2- 172.21.15.107:0/207810583 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f83900cc9d0 0x7f8390150410 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f837800c4c0 tx=0x7f8378007df0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.431+0000 7f91f1800640 1 -- 172.21.15.107:0/159931882 >> [v2:172.21.15.107:6800/37302,v1:172.21.15.107:6801/37302] conn(0x7f91c806d4b0 msgr2=0x7f91c806f8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.431+0000 7f91f1800640 1 --2- 172.21.15.107:0/159931882 >> [v2:172.21.15.107:6800/37302,v1:172.21.15.107:6801/37302] conn(0x7f91c806d4b0 0x7f91c806f8c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.431+0000 7f8395c00640 1 -- 172.21.15.107:0/207810583 reap_dead start 2024-08-17T02:24:35.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.431+0000 7f8396600640 1 -- 172.21.15.107:0/207810583 shutdown_connections 2024-08-17T02:24:35.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.431+0000 7f8396600640 1 -- 172.21.15.107:0/207810583 >> 172.21.15.107:0/207810583 conn(0x7f8390098e30 msgr2=0x7f83900680d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:35.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.433+0000 7f91f1800640 1 -- 172.21.15.107:0/159931882 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f91c80652a0 msgr2=0x7f91c8067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.433+0000 7f91f1800640 1 --2- 172.21.15.107:0/159931882 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f91c80652a0 0x7f91c8067750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f91d4007fd0 tx=0x7f91d4007e10 comp rx=0 tx=0).stop 2024-08-17T02:24:35.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.433+0000 7f91f1800640 1 -- 172.21.15.107:0/159931882 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91ec0ceb40 msgr2=0x7f91ec09c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.433+0000 7f91f1800640 1 --2- 172.21.15.107:0/159931882 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91ec0ceb40 0x7f91ec09c9c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f91e4031000 tx=0x7f91e4037000 comp rx=0 tx=0).stop 2024-08-17T02:24:35.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.433+0000 7f91f0e00640 1 -- 172.21.15.107:0/159931882 reap_dead start 2024-08-17T02:24:35.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.433+0000 7f91f1800640 1 -- 172.21.15.107:0/159931882 shutdown_connections 2024-08-17T02:24:35.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.433+0000 7f91f1800640 1 -- 172.21.15.107:0/159931882 >> 172.21.15.107:0/159931882 conn(0x7f91ec098e00 msgr2=0x7f91ec159540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:35.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.433+0000 7f91f1800640 1 -- 172.21.15.107:0/159931882 shutdown_connections 2024-08-17T02:24:35.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.433+0000 7f91f1800640 1 -- 172.21.15.107:0/159931882 wait complete. 2024-08-17T02:24:35.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.431+0000 7f8396600640 1 -- 172.21.15.107:0/207810583 shutdown_connections 2024-08-17T02:24:35.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.432+0000 7f8396600640 1 -- 172.21.15.107:0/207810583 wait complete. 2024-08-17T02:24:35.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.442+0000 7f3330600640 1 -- 172.21.15.107:0/3888010165 --> [v2:172.21.15.107:6816/37307,v1:172.21.15.107:6817/37307] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3328142410 con 0x7f330806d340 2024-08-17T02:24:35.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.445+0000 7fd9bd400640 1 -- 172.21.15.107:0/4238399817 --> [v2:172.21.15.157:6802/37328,v1:172.21.15.157:6804/37328] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd9b004cfa0 con 0x7fd99806d4b0 2024-08-17T02:24:35.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.446+0000 7f3fcc200640 1 -- 172.21.15.107:0/4031421036 --> [v2:172.21.15.157:6824/37373,v1:172.21.15.157:6825/37373] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3fa0002ca0 con 0x7f3fa406d360 2024-08-17T02:24:35.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.446+0000 7fd9ab400640 1 -- 172.21.15.107:0/4238399817 <== osd.5 v2:172.21.15.157:6802/37328 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd9b004cfa0 con 0x7fd99806d4b0 2024-08-17T02:24:35.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.446+0000 7faf8da00640 1 -- 172.21.15.107:0/2359002340 --> [v2:172.21.15.107:6808/37306,v1:172.21.15.107:6809/37306] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faf880cbaf0 con 0x7faf6806d2c0 2024-08-17T02:24:35.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.446+0000 7f3fc0c00640 1 -- 172.21.15.107:0/4031421036 <== osd.7 v2:172.21.15.157:6824/37373 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3fa0002ca0 con 0x7f3fa406d360 2024-08-17T02:24:35.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.447+0000 7f3324c00640 1 -- 172.21.15.107:0/3888010165 <== osd.2 v2:172.21.15.107:6816/37307 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3328142410 con 0x7f330806d340 2024-08-17T02:24:35.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.447+0000 7f3fb6000640 1 -- 172.21.15.107:0/4031421036 >> [v2:172.21.15.157:6824/37373,v1:172.21.15.157:6825/37373] conn(0x7f3fa406d360 msgr2=0x7f3fa406f770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.447+0000 7f3fb6000640 1 --2- 172.21.15.107:0/4031421036 >> [v2:172.21.15.157:6824/37373,v1:172.21.15.157:6825/37373] conn(0x7f3fa406d360 0x7f3fa406f770 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.447+0000 7f3fb6000640 1 -- 172.21.15.107:0/4031421036 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3fa4065150 msgr2=0x7f3fa4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.447+0000 7f3fb6000640 1 --2- 172.21.15.107:0/4031421036 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3fa4065150 0x7f3fa4067600 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8034000 tx=0x7f3fb8032000 comp rx=0 tx=0).stop 2024-08-17T02:24:35.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.448+0000 7f3fb6000640 1 -- 172.21.15.107:0/4031421036 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3fc406e100 msgr2=0x7f3fc415abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.448+0000 7f3fb6000640 1 --2- 172.21.15.107:0/4031421036 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3fc406e100 0x7f3fc415abf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3fb000c880 tx=0x7f3fb0008040 comp rx=0 tx=0).stop 2024-08-17T02:24:35.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.448+0000 7f3fca200640 1 -- 172.21.15.107:0/4031421036 reap_dead start 2024-08-17T02:24:35.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.448+0000 7f3fb6000640 1 -- 172.21.15.107:0/4031421036 shutdown_connections 2024-08-17T02:24:35.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.448+0000 7f3fb6000640 1 -- 172.21.15.107:0/4031421036 >> 172.21.15.107:0/4031421036 conn(0x7f3fc40cb9b0 msgr2=0x7f3fc40ca880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:35.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.449+0000 7f3fb6000640 1 -- 172.21.15.107:0/4031421036 shutdown_connections 2024-08-17T02:24:35.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.450+0000 7f3fb6000640 1 -- 172.21.15.107:0/4031421036 wait complete. 2024-08-17T02:24:35.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.449+0000 7f3330600640 1 -- 172.21.15.107:0/3888010165 >> [v2:172.21.15.107:6816/37307,v1:172.21.15.107:6817/37307] conn(0x7f330806d340 msgr2=0x7f330806f750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.449+0000 7f3330600640 1 --2- 172.21.15.107:0/3888010165 >> [v2:172.21.15.107:6816/37307,v1:172.21.15.107:6817/37307] conn(0x7f330806d340 0x7f330806f750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.450+0000 7f3330600640 1 -- 172.21.15.107:0/3888010165 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f33080652a0 msgr2=0x7f3308067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.450+0000 7f3330600640 1 --2- 172.21.15.107:0/3888010165 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f33080652a0 0x7f3308067750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f33280ae8d0 tx=0x7f3314009040 comp rx=0 tx=0).stop 2024-08-17T02:24:35.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.450+0000 7f3330600640 1 -- 172.21.15.107:0/3888010165 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33280ada10 msgr2=0x7f3328141170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.450+0000 7f3330600640 1 --2- 172.21.15.107:0/3888010165 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33280ada10 0x7f3328141170 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f331c0099a0 tx=0x7f331c035000 comp rx=0 tx=0).stop 2024-08-17T02:24:35.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.450+0000 7faf7f400640 1 -- 172.21.15.107:0/2359002340 <== osd.3 v2:172.21.15.107:6808/37306 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7faf880cbaf0 con 0x7faf6806d2c0 2024-08-17T02:24:35.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.450+0000 7f332e600640 1 -- 172.21.15.107:0/3888010165 reap_dead start 2024-08-17T02:24:35.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.450+0000 7f3330600640 1 -- 172.21.15.107:0/3888010165 shutdown_connections 2024-08-17T02:24:35.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.450+0000 7f3330600640 1 -- 172.21.15.107:0/3888010165 >> 172.21.15.107:0/3888010165 conn(0x7f33280cfdf0 msgr2=0x7f3328067690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:35.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.450+0000 7fd9bd400640 1 -- 172.21.15.107:0/4238399817 >> [v2:172.21.15.157:6802/37328,v1:172.21.15.157:6804/37328] conn(0x7fd99806d4b0 msgr2=0x7fd99806f8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.450+0000 7fd9bd400640 1 --2- 172.21.15.107:0/4238399817 >> [v2:172.21.15.157:6802/37328,v1:172.21.15.157:6804/37328] conn(0x7fd99806d4b0 0x7fd99806f8c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.451+0000 7fd9bd400640 1 -- 172.21.15.107:0/4238399817 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd9980652a0 msgr2=0x7fd998067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.451+0000 7fd9bd400640 1 --2- 172.21.15.107:0/4238399817 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd9980652a0 0x7fd998067750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac009d40 tx=0x7fd9ac0090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.451+0000 7faf8da00640 1 -- 172.21.15.107:0/2359002340 >> [v2:172.21.15.107:6808/37306,v1:172.21.15.107:6809/37306] conn(0x7faf6806d2c0 msgr2=0x7faf6806f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.451+0000 7faf8da00640 1 --2- 172.21.15.107:0/2359002340 >> [v2:172.21.15.107:6808/37306,v1:172.21.15.107:6809/37306] conn(0x7faf6806d2c0 0x7faf6806f6d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.451+0000 7fd9bd400640 1 -- 172.21.15.107:0/4238399817 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9b0053020 msgr2=0x7fd9b0102830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.451+0000 7fd9bd400640 1 --2- 172.21.15.107:0/4238399817 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9b0053020 0x7fd9b0102830 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd9a400c500 tx=0x7fd9a4007ca0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.451+0000 7fd9bca00640 1 -- 172.21.15.107:0/4238399817 reap_dead start 2024-08-17T02:24:35.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.451+0000 7fd9bd400640 1 -- 172.21.15.107:0/4238399817 shutdown_connections 2024-08-17T02:24:35.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.451+0000 7fd9bd400640 1 -- 172.21.15.107:0/4238399817 >> 172.21.15.107:0/4238399817 conn(0x7fd9b0009fa0 msgr2=0x7fd9b0049930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:35.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.452+0000 7fd9bd400640 1 -- 172.21.15.107:0/4238399817 shutdown_connections 2024-08-17T02:24:35.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.452+0000 7faf8da00640 1 -- 172.21.15.107:0/2359002340 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7faf68065220 msgr2=0x7faf680676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.452+0000 7faf8da00640 1 --2- 172.21.15.107:0/2359002340 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7faf68065220 0x7faf680676d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faf74034000 tx=0x7faf74032000 comp rx=0 tx=0).stop 2024-08-17T02:24:35.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.452+0000 7faf8da00640 1 -- 172.21.15.107:0/2359002340 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faf880cc9d0 msgr2=0x7faf8814f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.452+0000 7faf8da00640 1 --2- 172.21.15.107:0/2359002340 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faf880cc9d0 0x7faf8814f1e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7faf7800c5c0 tx=0x7faf78007ce0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.452+0000 7faf8d000640 1 -- 172.21.15.107:0/2359002340 reap_dead start 2024-08-17T02:24:35.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.452+0000 7fd9bd400640 1 -- 172.21.15.107:0/4238399817 wait complete. 2024-08-17T02:24:35.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.452+0000 7faf8da00640 1 -- 172.21.15.107:0/2359002340 shutdown_connections 2024-08-17T02:24:35.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.452+0000 7faf8da00640 1 -- 172.21.15.107:0/2359002340 >> 172.21.15.107:0/2359002340 conn(0x7faf88098e30 msgr2=0x7faf880acfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:35.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.452+0000 7faf8da00640 1 -- 172.21.15.107:0/2359002340 shutdown_connections 2024-08-17T02:24:35.483 INFO:teuthology.orchestra.run.smithi107.stdout:55834574852 2024-08-17T02:24:35.484 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.454+0000 7faf8da00640 1 -- 172.21.15.107:0/2359002340 wait complete. 2024-08-17T02:24:35.484 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-17T02:24:35.485 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.452+0000 7f3330600640 1 -- 172.21.15.107:0/3888010165 shutdown_connections 2024-08-17T02:24:35.485 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.454+0000 7f3330600640 1 -- 172.21.15.107:0/3888010165 wait complete. 2024-08-17T02:24:35.485 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.455+0000 7f4ad7200640 1 -- 172.21.15.107:0/2667473233 --> [v2:172.21.15.157:6800/37330,v1:172.21.15.157:6801/37330] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4aa8002ca0 con 0x7f4ab006d4e0 2024-08-17T02:24:35.485 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.456+0000 7f4ac7400640 1 -- 172.21.15.107:0/2667473233 <== osd.6 v2:172.21.15.157:6800/37330 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4aa8002ca0 con 0x7f4ab006d4e0 2024-08-17T02:24:35.486 INFO:teuthology.orchestra.run.smithi107.stdout:55834574852 2024-08-17T02:24:35.487 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-17T02:24:35.487 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.458+0000 7f4ad7200640 1 -- 172.21.15.107:0/2667473233 >> [v2:172.21.15.157:6800/37330,v1:172.21.15.157:6801/37330] conn(0x7f4ab006d4e0 msgr2=0x7f4ab006f8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.487 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.458+0000 7f4ad7200640 1 --2- 172.21.15.107:0/2667473233 >> [v2:172.21.15.157:6800/37330,v1:172.21.15.157:6801/37330] conn(0x7f4ab006d4e0 0x7f4ab006f8f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.487 INFO:teuthology.orchestra.run.smithi107.stdout:55834574852 2024-08-17T02:24:35.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.458+0000 7f4ad7200640 1 -- 172.21.15.107:0/2667473233 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4ab00652d0 msgr2=0x7f4ab0067780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.488 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-17T02:24:35.489 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.458+0000 7f4ad7200640 1 --2- 172.21.15.107:0/2667473233 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4ab00652d0 0x7f4ab0067780 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4abc034000 tx=0x7f4abc032000 comp rx=0 tx=0).stop 2024-08-17T02:24:35.489 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.459+0000 7f4ad7200640 1 -- 172.21.15.107:0/2667473233 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ad00b36e0 msgr2=0x7f4ad0153990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.489 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.459+0000 7f4ad7200640 1 --2- 172.21.15.107:0/2667473233 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ad00b36e0 0x7f4ad0153990 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800c7c0 tx=0x7f4ac8001590 comp rx=0 tx=0).stop 2024-08-17T02:24:35.489 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.459+0000 7f4ad5200640 1 -- 172.21.15.107:0/2667473233 reap_dead start 2024-08-17T02:24:35.489 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.459+0000 7f4ad7200640 1 -- 172.21.15.107:0/2667473233 shutdown_connections 2024-08-17T02:24:35.490 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.459+0000 7f4ad7200640 1 -- 172.21.15.107:0/2667473233 >> 172.21.15.107:0/2667473233 conn(0x7f4ad00cfdf0 msgr2=0x7f4ad00b3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:35.490 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.459+0000 7f4ad7200640 1 -- 172.21.15.107:0/2667473233 shutdown_connections 2024-08-17T02:24:35.490 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.459+0000 7f4ad7200640 1 -- 172.21.15.107:0/2667473233 wait complete. 2024-08-17T02:24:35.490 INFO:teuthology.orchestra.run.smithi107.stdout:55834574853 2024-08-17T02:24:35.491 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-17T02:24:35.491 INFO:teuthology.orchestra.run.smithi107.stdout:55834574853 2024-08-17T02:24:35.491 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-17T02:24:35.492 INFO:teuthology.orchestra.run.smithi107.stdout:55834574853 2024-08-17T02:24:35.492 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-17T02:24:35.493 INFO:teuthology.orchestra.run.smithi107.stdout:55834574852 2024-08-17T02:24:35.493 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-17T02:24:35.494 INFO:teuthology.orchestra.run.smithi107.stdout:55834574852 2024-08-17T02:24:35.495 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-17T02:24:35.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.784+0000 7fbf32400640 1 Processor -- start 2024-08-17T02:24:35.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.785+0000 7fbf32400640 1 -- start start 2024-08-17T02:24:35.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.787+0000 7fbf32400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbf24054d00 0x7fbf24006150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.787+0000 7fbf32400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fbf24006690 0x7fbf240e5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.787+0000 7fbf32400640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf24006c10 con 0x7fbf240e1bd0 2024-08-17T02:24:35.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.787+0000 7fbf32400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf24006ef0 con 0x7fbf24054d00 2024-08-17T02:24:35.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.787+0000 7fbf32400640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf240071d0 con 0x7fbf24006690 2024-08-17T02:24:35.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.787+0000 7fbf31000640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fbf240e1bd0 0x7fbf240e1fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:45052/0 (socket says 172.21.15.107:45052) 2024-08-17T02:24:35.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.787+0000 7fbf31000640 1 -- 172.21.15.107:0/2257355917 learned_addr learned my addr 172.21.15.107:0/2257355917 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:35.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.787+0000 7fbf31a00640 1 --2- 172.21.15.107:0/2257355917 >> v2:172.21.15.157:3300/0 conn(0x7fbf24006690 0x7fbf240e5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.788+0000 7fbf2be00640 1 --2- 172.21.15.107:0/2257355917 >> v2:172.21.15.107:3300/0 conn(0x7fbf24054d00 0x7fbf24006150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.788+0000 7fbf31a00640 1 -- 172.21.15.107:0/2257355917 >> v2:172.21.15.107:3300/0 conn(0x7fbf24054d00 msgr2=0x7fbf24006150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:35.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.788+0000 7fbf31a00640 1 --2- 172.21.15.107:0/2257355917 >> v2:172.21.15.107:3300/0 conn(0x7fbf24054d00 0x7fbf24006150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.788+0000 7fbf31a00640 1 -- 172.21.15.107:0/2257355917 >> v1:172.21.15.157:6789/0 conn(0x7fbf240e1bd0 legacy=0x7fbf240e1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.788+0000 7fbf31a00640 1 -- 172.21.15.107:0/2257355917 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf240074b0 con 0x7fbf24006690 2024-08-17T02:24:35.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.789+0000 7fbf2be00640 1 --2- 172.21.15.107:0/2257355917 >> v2:172.21.15.107:3300/0 conn(0x7fbf24054d00 0x7fbf24006150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:35.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.789+0000 7fbf31a00640 1 --2- 172.21.15.107:0/2257355917 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf24006690 0x7fbf240e5c30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c04c0c0 tx=0x7fbf2c06f710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd1e11e40ddbe8bb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.790+0000 7fbf2b400640 1 -- 172.21.15.107:0/2257355917 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c0a65e0 con 0x7fbf24006690 2024-08-17T02:24:35.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.790+0000 7fbf2b400640 1 -- 172.21.15.107:0/2257355917 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf2c0a4050 con 0x7fbf24006690 2024-08-17T02:24:35.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.790+0000 7fbf2b400640 1 -- 172.21.15.107:0/2257355917 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c0a65e0 con 0x7fbf24006690 2024-08-17T02:24:35.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.791+0000 7fbf32400640 1 -- 172.21.15.107:0/2257355917 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf24006690 msgr2=0x7fbf240e5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.791+0000 7fbf32400640 1 --2- 172.21.15.107:0/2257355917 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf24006690 0x7fbf240e5c30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c04c0c0 tx=0x7fbf2c06f710 comp rx=0 tx=0).stop 2024-08-17T02:24:35.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.792+0000 7fbf32400640 1 -- 172.21.15.107:0/2257355917 shutdown_connections 2024-08-17T02:24:35.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.792+0000 7fbf32400640 1 --2- 172.21.15.107:0/2257355917 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf24006690 0x7fbf240e5c30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.792+0000 7fbf32400640 1 --2- 172.21.15.107:0/2257355917 >> v2:172.21.15.107:3300/0 conn(0x7fbf24054d00 0x7fbf24006150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.792+0000 7fbf32400640 1 -- 172.21.15.107:0/2257355917 >> 172.21.15.107:0/2257355917 conn(0x7fbf2400f070 msgr2=0x7fbf24058f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:35.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.793+0000 7fbf32400640 1 -- 172.21.15.107:0/2257355917 shutdown_connections 2024-08-17T02:24:35.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.793+0000 7fbf32400640 1 -- 172.21.15.107:0/2257355917 wait complete. 2024-08-17T02:24:35.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.795+0000 7fbf32400640 1 Processor -- start 2024-08-17T02:24:35.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.795+0000 7fbf32400640 1 -- start start 2024-08-17T02:24:35.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.794+0000 7f7898400640 1 Processor -- start 2024-08-17T02:24:35.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.794+0000 7f7898400640 1 -- start start 2024-08-17T02:24:35.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.796+0000 7f7898400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7890160660 0x7f78900b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.796+0000 7f7898400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f78900ada10 0x7f78900b0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.797+0000 7f7898400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f78900af5c0 0x7f78900afa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.797+0000 7f7898400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78900b30e0 con 0x7f78900af5c0 2024-08-17T02:24:35.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.797+0000 7f7898400640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7890089760 con 0x7f78900ada10 2024-08-17T02:24:35.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.797+0000 7f7898400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78900aeca0 con 0x7f7890160660 2024-08-17T02:24:35.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.794+0000 7fcb95400640 1 Processor -- start 2024-08-17T02:24:35.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.794+0000 7fcb95400640 1 -- start start 2024-08-17T02:24:35.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.796+0000 7fcb95400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fcb900ccca0 0x7fcb90163870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.796+0000 7fcb95400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb900cadc0 con 0x7fcb90159ca0 2024-08-17T02:24:35.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.796+0000 7fcb95400640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb900cb060 con 0x7fcb900ceb40 2024-08-17T02:24:35.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.796+0000 7fcb95400640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb900cd6e0 con 0x7fcb900ccca0 2024-08-17T02:24:35.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.796+0000 7fcb94a00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fcb900ccca0 0x7fcb90163870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.797+0000 7fcb8f400640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fcb900ceb40 0x7fcb900cc590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:45056/0 (socket says 172.21.15.107:45056) 2024-08-17T02:24:35.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.797+0000 7fcb8f400640 1 -- 172.21.15.107:0/2623745023 learned_addr learned my addr 172.21.15.107:0/2623745023 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:35.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.797+0000 7f7895a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7890160660 0x7f78900b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.797+0000 7f7895a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7890160660 0x7f78900b08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:42184/0 (socket says 172.21.15.107:42184) 2024-08-17T02:24:35.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.797+0000 7f7895a00640 1 -- 172.21.15.107:0/1214945981 learned_addr learned my addr 172.21.15.107:0/1214945981 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:35.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.797+0000 7f7895000640 1 --2- 172.21.15.107:0/1214945981 >> v2:172.21.15.157:3300/0 conn(0x7f78900ada10 0x7f78900b0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.798+0000 7fbf32400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbf24006690 0x7fbf240ea8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.798+0000 7fbf32400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf24054d00 0x7fbf240f99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.798+0000 7f7896400640 1 --2- 172.21.15.107:0/1214945981 >> v2:172.21.15.107:3300/0 conn(0x7f78900af5c0 0x7f78900afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.798+0000 7fbf31000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbf24006690 0x7fbf240ea8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.798+0000 7fbf31000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbf24006690 0x7fbf240ea8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:42192/0 (socket says 172.21.15.107:42192) 2024-08-17T02:24:35.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.798+0000 7fbf31000640 1 -- 172.21.15.107:0/1421615147 learned_addr learned my addr 172.21.15.107:0/1421615147 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:35.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.799+0000 7fbf32400640 1 --2- 172.21.15.107:0/1421615147 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf240e1bd0 0x7fbf240f9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.799+0000 7f7895a00640 1 -- 172.21.15.107:0/1214945981 >> v2:172.21.15.157:3300/0 conn(0x7f78900ada10 msgr2=0x7f78900b0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:35.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.799+0000 7f7895a00640 1 --2- 172.21.15.107:0/1214945981 >> v2:172.21.15.157:3300/0 conn(0x7f78900ada10 0x7f78900b0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.799+0000 7f7895a00640 1 -- 172.21.15.107:0/1214945981 >> v2:172.21.15.107:3300/0 conn(0x7f78900af5c0 msgr2=0x7f78900afa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:35.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.799+0000 7f56ee600640 1 Processor -- start 2024-08-17T02:24:35.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.799+0000 7f56ee600640 1 -- start start 2024-08-17T02:24:35.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.799+0000 7fbf2be00640 1 --2- 172.21.15.107:0/1421615147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf24054d00 0x7fbf240f99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.797+0000 7fcb94a00640 1 -- 172.21.15.107:0/2623745023 >> v1:172.21.15.157:6789/0 conn(0x7fcb900ceb40 legacy=0x7fcb900cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.799+0000 7fbf32400640 1 -- 172.21.15.107:0/1421615147 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf240e9620 con 0x7fbf24054d00 2024-08-17T02:24:35.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.799+0000 7fbf32400640 1 -- 172.21.15.107:0/1421615147 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf240ea410 con 0x7fbf240e1bd0 2024-08-17T02:24:35.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.799+0000 7fbf32400640 1 -- 172.21.15.107:0/1421615147 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf240e9800 con 0x7fbf24006690 2024-08-17T02:24:35.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.797+0000 7fcb94a00640 1 -- 172.21.15.107:0/2623745023 >> v1:172.21.15.107:6789/0 conn(0x7fcb90159ca0 legacy=0x7fcb900ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.797+0000 7fcb94a00640 1 -- 172.21.15.107:0/2623745023 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb900cb300 con 0x7fcb900ccca0 2024-08-17T02:24:35.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.799+0000 7f7895a00640 1 --2- 172.21.15.107:0/1214945981 >> v2:172.21.15.107:3300/0 conn(0x7f78900af5c0 0x7f78900afa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.799+0000 7fcb94a00640 1 --2- 172.21.15.107:0/2623745023 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb900ccca0 0x7fcb90163870 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcb88009e60 tx=0x7fcb88009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4229ee9c956739b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.800+0000 7f4aba200640 1 Processor -- start 2024-08-17T02:24:35.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.800+0000 7fcb8ea00640 1 -- 172.21.15.107:0/2623745023 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8802e050 con 0x7fcb900ccca0 2024-08-17T02:24:35.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.800+0000 7fcb8ea00640 1 -- 172.21.15.107:0/2623745023 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb88007550 con 0x7fcb900ccca0 2024-08-17T02:24:35.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.800+0000 7f4aba200640 1 -- start start 2024-08-17T02:24:35.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.800+0000 7fcb8ea00640 1 -- 172.21.15.107:0/2623745023 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb88007930 con 0x7fcb900ccca0 2024-08-17T02:24:35.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.799+0000 7fbf31a00640 1 --2- 172.21.15.107:0/1421615147 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf240e1bd0 0x7fbf240f9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.799+0000 7f7895a00640 1 -- 172.21.15.107:0/1214945981 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78900aef80 con 0x7f7890160660 2024-08-17T02:24:35.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.799+0000 7f7896400640 1 --2- 172.21.15.107:0/1214945981 >> v2:172.21.15.107:3300/0 conn(0x7f78900af5c0 0x7f78900afa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:35.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.800+0000 7fbf2be00640 1 -- 172.21.15.107:0/1421615147 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbf24006690 msgr2=0x7fbf240ea8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.800+0000 7fbf2be00640 1 --2- 172.21.15.107:0/1421615147 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbf24006690 0x7fbf240ea8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.800+0000 7fbf2be00640 1 -- 172.21.15.107:0/1421615147 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf240e1bd0 msgr2=0x7fbf240f9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.800+0000 7fbf2be00640 1 --2- 172.21.15.107:0/1421615147 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf240e1bd0 0x7fbf240f9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.800+0000 7fbf2be00640 1 -- 172.21.15.107:0/1421615147 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf2c04c200 con 0x7fbf24054d00 2024-08-17T02:24:35.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.801+0000 7f56ee600640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f56e806ddf0 0x7f56e8158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.801+0000 7f56ee600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56e80a9a10 con 0x7f56e80aa7d0 2024-08-17T02:24:35.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.801+0000 7f56ee600640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56e80a9cf0 con 0x7f56e806da20 2024-08-17T02:24:35.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.801+0000 7f56ee600640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56e80ac400 con 0x7f56e806ddf0 2024-08-17T02:24:35.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.801+0000 7fbf2be00640 1 --2- 172.21.15.107:0/1421615147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf24054d00 0x7fbf240f99f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbf1800c880 tx=0x7fbf18008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.802+0000 7fbf1fe00640 1 -- 172.21.15.107:0/1421615147 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1800ce10 con 0x7fbf24054d00 2024-08-17T02:24:35.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.801+0000 7f7895a00640 1 --2- 172.21.15.107:0/1214945981 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7890160660 0x7f78900b08d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f78900889c0 tx=0x7f7888009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a1af5aaf7833983 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.802+0000 7f788fe00640 1 -- 172.21.15.107:0/1214945981 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7888031400 con 0x7f7890160660 2024-08-17T02:24:35.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.802+0000 7f788fe00640 1 -- 172.21.15.107:0/1214945981 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f788802d050 con 0x7f7890160660 2024-08-17T02:24:35.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.802+0000 7f788fe00640 1 -- 172.21.15.107:0/1214945981 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78880317d0 con 0x7f7890160660 2024-08-17T02:24:35.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.801+0000 7fcb95400640 1 -- 172.21.15.107:0/2623745023 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb900ccca0 msgr2=0x7fcb90163870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.801+0000 7fcb95400640 1 --2- 172.21.15.107:0/2623745023 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb900ccca0 0x7fcb90163870 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcb88009e60 tx=0x7fcb88009780 comp rx=0 tx=0).stop 2024-08-17T02:24:35.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.801+0000 7fcb95400640 1 -- 172.21.15.107:0/2623745023 shutdown_connections 2024-08-17T02:24:35.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.801+0000 7fcb95400640 1 --2- 172.21.15.107:0/2623745023 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb900ccca0 0x7fcb90163870 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.801+0000 7fcb95400640 1 -- 172.21.15.107:0/2623745023 >> 172.21.15.107:0/2623745023 conn(0x7fcb90098e00 msgr2=0x7fcb9006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:35.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.802+0000 7fcb95400640 1 -- 172.21.15.107:0/2623745023 shutdown_connections 2024-08-17T02:24:35.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.802+0000 7fcb95400640 1 -- 172.21.15.107:0/2623745023 wait complete. 2024-08-17T02:24:35.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.801+0000 7f56e7e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f56e806ddf0 0x7f56e8158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.802+0000 7f56dea00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f56e80aa7d0 0x7f56e80ab6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:47904/0 (socket says 172.21.15.107:47904) 2024-08-17T02:24:35.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.802+0000 7f56dea00640 1 -- 172.21.15.107:0/743090638 learned_addr learned my addr 172.21.15.107:0/743090638 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:35.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.802+0000 7f56e7e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f56e806ddf0 0x7f56e8158fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:38702/0 (socket says 172.21.15.107:38702) 2024-08-17T02:24:35.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.802+0000 7f56e7400640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f56e806da20 0x7f56e8158890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:45072/0 (socket says 172.21.15.107:45072) 2024-08-17T02:24:35.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.802+0000 7f4aba200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4ab406ac30 0x7f4ab4159690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.802+0000 7f4aba200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4ab40aea20 0x7f4ab40af710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.803+0000 7fbb5cc00640 1 Processor -- start 2024-08-17T02:24:35.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.802+0000 7f4aba200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ab415a5c0 con 0x7f4ab41557f0 2024-08-17T02:24:35.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.803+0000 7fbf1fe00640 1 -- 172.21.15.107:0/1421615147 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf18007830 con 0x7fbf24054d00 2024-08-17T02:24:35.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.803+0000 7fbf1fe00640 1 -- 172.21.15.107:0/1421615147 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf18007bd0 con 0x7fbf24054d00 2024-08-17T02:24:35.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.803+0000 7f56e6a00640 1 -- 172.21.15.107:0/743090638 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2022076848 0 0) 0x7f56e80a9cf0 con 0x7f56e806da20 2024-08-17T02:24:35.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.803+0000 7f56e6a00640 1 -- 172.21.15.107:0/743090638 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56cc0034e0 con 0x7f56e806da20 2024-08-17T02:24:35.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.803+0000 7f56e6a00640 1 -- 172.21.15.107:0/743090638 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 276896818 0 0) 0x7f56e80a9a10 con 0x7f56e80aa7d0 2024-08-17T02:24:35.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.803+0000 7f56e6a00640 1 -- 172.21.15.107:0/743090638 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56e80a9cf0 con 0x7f56e80aa7d0 2024-08-17T02:24:35.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.802+0000 7f4aba200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ab4159d20 con 0x7f4ab406ac30 2024-08-17T02:24:35.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.802+0000 7f4aba200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab415a000 con 0x7f4ab40aea20 2024-08-17T02:24:35.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.803+0000 7f7898400640 1 -- 172.21.15.107:0/1214945981 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7890160660 msgr2=0x7f78900b08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.803+0000 7f7898400640 1 --2- 172.21.15.107:0/1214945981 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7890160660 0x7f78900b08d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f78900889c0 tx=0x7f7888009840 comp rx=0 tx=0).stop 2024-08-17T02:24:35.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.803+0000 7f56e7e00640 1 -- 172.21.15.107:0/743090638 >> v1:172.21.15.157:6789/0 conn(0x7f56e806da20 legacy=0x7f56e8158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.803+0000 7f56e7e00640 1 -- 172.21.15.107:0/743090638 >> v1:172.21.15.107:6789/0 conn(0x7f56e80aa7d0 legacy=0x7f56e80ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.803+0000 7f56e7e00640 1 -- 172.21.15.107:0/743090638 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e80a9fd0 con 0x7f56e806ddf0 2024-08-17T02:24:35.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.803+0000 7f7898400640 1 -- 172.21.15.107:0/1214945981 shutdown_connections 2024-08-17T02:24:35.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.803+0000 7f7898400640 1 --2- 172.21.15.107:0/1214945981 >> v2:172.21.15.107:3300/0 conn(0x7f78900af5c0 0x7f78900afa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.804+0000 7f7898400640 1 --2- 172.21.15.107:0/1214945981 >> v2:172.21.15.157:3300/0 conn(0x7f78900ada10 0x7f78900b0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.804+0000 7f7898400640 1 --2- 172.21.15.107:0/1214945981 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7890160660 0x7f78900b08d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.804+0000 7f7898400640 1 -- 172.21.15.107:0/1214945981 >> 172.21.15.107:0/1214945981 conn(0x7f78900cfdf0 msgr2=0x7f78900d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:35.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.803+0000 7f4ab3400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f4ab41557f0 0x7f4ab406a520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:47918/0 (socket says 172.21.15.107:47918) 2024-08-17T02:24:35.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.804+0000 7f4ab3400640 1 -- 172.21.15.107:0/2233532444 learned_addr learned my addr 172.21.15.107:0/2233532444 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:35.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.803+0000 7f4ab3e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4ab40aea20 0x7f4ab40af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.803+0000 7fbb5cc00640 1 -- start start 2024-08-17T02:24:35.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.804+0000 7f7898400640 1 -- 172.21.15.107:0/1214945981 shutdown_connections 2024-08-17T02:24:35.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.804+0000 7fbf32400640 1 -- 172.21.15.107:0/1421615147 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf240e9ae0 con 0x7fbf24054d00 2024-08-17T02:24:35.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.804+0000 7fbf32400640 1 -- 172.21.15.107:0/1421615147 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf240ea0a0 con 0x7fbf24054d00 2024-08-17T02:24:35.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.804+0000 7f4ab2a00640 1 --2- 172.21.15.107:0/2233532444 >> v2:172.21.15.107:3300/0 conn(0x7f4ab406ac30 0x7f4ab4159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.804+0000 7f7898400640 1 -- 172.21.15.107:0/1214945981 wait complete. 2024-08-17T02:24:35.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.804+0000 7f4ab3e00640 1 -- 172.21.15.107:0/2233532444 >> v2:172.21.15.107:3300/0 conn(0x7f4ab406ac30 msgr2=0x7f4ab4159690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:35.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.805+0000 7f56e7e00640 1 --2- 172.21.15.107:0/743090638 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f56e806ddf0 0x7f56e8158fa0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f56e0009e60 tx=0x7f56e0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cceb22018e784b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.804+0000 7f4ab3e00640 1 --2- 172.21.15.107:0/2233532444 >> v2:172.21.15.107:3300/0 conn(0x7f4ab406ac30 0x7f4ab4159690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.805+0000 7fc6f6a00640 1 Processor -- start 2024-08-17T02:24:35.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.805+0000 7fcb95400640 1 Processor -- start 2024-08-17T02:24:35.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.805+0000 7fcb95400640 1 -- start start 2024-08-17T02:24:35.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.806+0000 7fbf32400640 1 -- 172.21.15.107:0/1421615147 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf240ea5a0 con 0x7fbf24054d00 2024-08-17T02:24:35.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.806+0000 7f56e6a00640 1 -- 172.21.15.107:0/743090638 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e0007550 con 0x7f56e806ddf0 2024-08-17T02:24:35.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.806+0000 7f56e6a00640 1 -- 172.21.15.107:0/743090638 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e002d050 con 0x7f56e806ddf0 2024-08-17T02:24:35.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.806+0000 7f56e6a00640 1 -- 172.21.15.107:0/743090638 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e0007920 con 0x7f56e806ddf0 2024-08-17T02:24:35.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.805+0000 7fc6f6a00640 1 -- start start 2024-08-17T02:24:35.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.804+0000 7f4ab3e00640 1 -- 172.21.15.107:0/2233532444 >> v1:172.21.15.107:6789/0 conn(0x7f4ab41557f0 legacy=0x7f4ab406a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.804+0000 7f4ab3e00640 1 -- 172.21.15.107:0/2233532444 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab415a2e0 con 0x7f4ab40aea20 2024-08-17T02:24:35.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.806+0000 7fbb5cc00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fbb580adb50 0x7fbb58069ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.806+0000 7fbb5cc00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbb5806a410 0x7fbb580aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.806+0000 7fbb5cc00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb580af6e0 con 0x7fbb5806e7f0 2024-08-17T02:24:35.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.806+0000 7fbb5cc00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb580adfd0 con 0x7fbb5806a410 2024-08-17T02:24:35.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.806+0000 7fbb5cc00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb580ad6c0 con 0x7fbb580adb50 2024-08-17T02:24:35.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.807+0000 7f7898400640 1 Processor -- start 2024-08-17T02:24:35.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.807+0000 7f4ab3e00640 1 --2- 172.21.15.107:0/2233532444 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4ab40aea20 0x7f4ab40af710 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4aac00d0d0 tx=0x7f4aac00b990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df1bab1ba691bc3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.807+0000 7fbb55e00640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fbb5806e7f0 0x7fbb5813e130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:45076/0 (socket says 172.21.15.107:45076) 2024-08-17T02:24:35.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.807+0000 7fbb55e00640 1 -- 172.21.15.107:0/1988526815 learned_addr learned my addr 172.21.15.107:0/1988526815 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:35.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.807+0000 7fbb56800640 1 --2- 172.21.15.107:0/1988526815 >> v2:172.21.15.107:3300/0 conn(0x7fbb5806a410 0x7fbb580aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.807+0000 7fbb55400640 1 --2- 172.21.15.107:0/1988526815 >> v2:172.21.15.157:3300/0 conn(0x7fbb580adb50 0x7fbb58069ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.807+0000 7f7898400640 1 -- start start 2024-08-17T02:24:35.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.807+0000 7fcb95400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb900ccca0 0x7fcb90169440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.807+0000 7fcb95400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcb900ceb40 0x7fcb900c4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.807+0000 7f4ab2000640 1 -- 172.21.15.107:0/2233532444 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac00b2e0 con 0x7f4ab40aea20 2024-08-17T02:24:35.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.807+0000 7fcb95400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcb90159ca0 0x7fcb900c5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.807+0000 7fcb95400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb900c3b80 con 0x7fcb90159ca0 2024-08-17T02:24:35.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.807+0000 7fcb95400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb900c3e60 con 0x7fcb900ccca0 2024-08-17T02:24:35.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.807+0000 7fcb95400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb900c4140 con 0x7fcb900ceb40 2024-08-17T02:24:35.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.808+0000 7fc6f6a00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc6f00b1120 0x7fc6f00aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.808+0000 7fc6f6a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc6f00b3370 0x7fc6f00b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.808+0000 7fc6f6a00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6f00d0ab0 con 0x7fc6f00ada10 2024-08-17T02:24:35.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.808+0000 7fc6f6a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6f00b00c0 con 0x7fc6f00b3370 2024-08-17T02:24:35.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.808+0000 7fc6f6a00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6f00af330 con 0x7fc6f00b1120 2024-08-17T02:24:35.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.808+0000 7f4ab2000640 1 -- 172.21.15.107:0/2233532444 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aac009550 con 0x7f4ab40aea20 2024-08-17T02:24:35.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.808+0000 7f4ab2000640 1 -- 172.21.15.107:0/2233532444 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac009930 con 0x7f4ab40aea20 2024-08-17T02:24:35.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.808+0000 7fcb94a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcb90159ca0 0x7fcb900c5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.808+0000 7fcb8f400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcb900ceb40 0x7fcb900c4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.809+0000 7fcb8f400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcb900ceb40 0x7fcb900c4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:42198/0 (socket says 172.21.15.107:42198) 2024-08-17T02:24:35.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.809+0000 7fcb94a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcb90159ca0 0x7fcb900c5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37758/0 (socket says 172.21.15.107:37758) 2024-08-17T02:24:35.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.809+0000 7fcb94a00640 1 -- 172.21.15.107:0/4091979938 learned_addr learned my addr 172.21.15.107:0/4091979938 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:35.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.808+0000 7fc6efe00640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fc6f00ada10 0x7fc6f00b2c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:45080/0 (socket says 172.21.15.107:45080) 2024-08-17T02:24:35.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.808+0000 7fc6efe00640 1 -- 172.21.15.107:0/1135099813 learned_addr learned my addr 172.21.15.107:0/1135099813 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:35.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.808+0000 7fc6ef400640 1 --2- 172.21.15.107:0/1135099813 >> v2:172.21.15.157:3300/0 conn(0x7fc6f00b1120 0x7fc6f00aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.809+0000 7fc6ef400640 1 -- 172.21.15.107:0/1135099813 >> v2:172.21.15.107:3300/0 conn(0x7fc6f00b3370 msgr2=0x7fc6f00b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:35.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.809+0000 7fc6ef400640 1 --2- 172.21.15.107:0/1135099813 >> v2:172.21.15.107:3300/0 conn(0x7fc6f00b3370 0x7fc6f00b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.809+0000 7fc6ef400640 1 -- 172.21.15.107:0/1135099813 >> v1:172.21.15.157:6789/0 conn(0x7fc6f00ada10 legacy=0x7fc6f00b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.809+0000 7fbf1fe00640 1 -- 172.21.15.107:0/1421615147 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbf18024480 con 0x7fbf24054d00 2024-08-17T02:24:35.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.809+0000 7fc6eea00640 1 -- 172.21.15.107:0/1135099813 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4064157175 0 0) 0x7fc6f00d0ab0 con 0x7fc6f00ada10 2024-08-17T02:24:35.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.809+0000 7f7898400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78900ada10 0x7f78900afd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.810+0000 7fcb94a00640 1 -- 172.21.15.107:0/4091979938 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcb900ceb40 msgr2=0x7fcb900c4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.810+0000 7fcb94a00640 1 --2- 172.21.15.107:0/4091979938 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcb900ceb40 0x7fcb900c4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.810+0000 7fcb94a00640 1 -- 172.21.15.107:0/4091979938 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb900ccca0 msgr2=0x7fcb90169440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.810+0000 7fcb94a00640 1 --2- 172.21.15.107:0/4091979938 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb900ccca0 0x7fcb90169440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.832 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.809+0000 7f56ee600640 1 -- 172.21.15.107:0/743090638 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f56e806ddf0 msgr2=0x7f56e8158fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.832 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.809+0000 7f56ee600640 1 --2- 172.21.15.107:0/743090638 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f56e806ddf0 0x7f56e8158fa0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f56e0009e60 tx=0x7f56e0009780 comp rx=0 tx=0).stop 2024-08-17T02:24:35.832 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.810+0000 7f7898400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78900af5c0 0x7f7890144e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.832 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.810+0000 7f7898400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7890160660 0x7f7890069f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.833 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.810+0000 7fcb94a00640 1 -- 172.21.15.107:0/4091979938 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb88009a20 con 0x7fcb90159ca0 2024-08-17T02:24:35.833 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.810+0000 7f56ee600640 1 -- 172.21.15.107:0/743090638 shutdown_connections 2024-08-17T02:24:35.833 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.810+0000 7f56ee600640 1 --2- 172.21.15.107:0/743090638 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f56e806ddf0 0x7f56e8158fa0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.833 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.810+0000 7f56ee600640 1 -- 172.21.15.107:0/743090638 >> 172.21.15.107:0/743090638 conn(0x7f56e80cb9b0 msgr2=0x7f56e80cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:35.833 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.810+0000 7f56ee600640 1 -- 172.21.15.107:0/743090638 shutdown_connections 2024-08-17T02:24:35.833 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.810+0000 7f4aba200640 1 -- 172.21.15.107:0/2233532444 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4ab40aea20 msgr2=0x7f4ab40af710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.810+0000 7f4aba200640 1 --2- 172.21.15.107:0/2233532444 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4ab40aea20 0x7f4ab40af710 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4aac00d0d0 tx=0x7f4aac00b990 comp rx=0 tx=0).stop 2024-08-17T02:24:35.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.807+0000 7fbb54a00640 1 -- 172.21.15.107:0/1988526815 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1202666127 0 0) 0x7fbb580af6e0 con 0x7fbb5806e7f0 2024-08-17T02:24:35.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.807+0000 7fbb54a00640 1 -- 172.21.15.107:0/1988526815 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb3c0034e0 con 0x7fbb5806e7f0 2024-08-17T02:24:35.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.808+0000 7fbb55400640 1 -- 172.21.15.107:0/1988526815 >> v2:172.21.15.107:3300/0 conn(0x7fbb5806a410 msgr2=0x7fbb580aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:35.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.808+0000 7fbb54a00640 1 -- 172.21.15.107:0/1988526815 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2017681569 0 0) 0x7fbb3c0034e0 con 0x7fbb5806e7f0 2024-08-17T02:24:35.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.808+0000 7fbb55400640 1 --2- 172.21.15.107:0/1988526815 >> v2:172.21.15.107:3300/0 conn(0x7fbb5806a410 0x7fbb580aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.808+0000 7fbb55400640 1 -- 172.21.15.107:0/1988526815 >> v1:172.21.15.157:6789/0 conn(0x7fbb5806e7f0 legacy=0x7fbb5813e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.808+0000 7fbb55400640 1 -- 172.21.15.107:0/1988526815 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb5806a810 con 0x7fbb580adb50 2024-08-17T02:24:35.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.810+0000 7f51c9200640 1 Processor -- start 2024-08-17T02:24:35.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.810+0000 7f4aba200640 1 -- 172.21.15.107:0/2233532444 shutdown_connections 2024-08-17T02:24:35.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.810+0000 7f4aba200640 1 --2- 172.21.15.107:0/2233532444 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4ab40aea20 0x7f4ab40af710 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.810+0000 7fbf1fe00640 1 --2- 172.21.15.107:0/1421615147 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbf0c0651d0 0x7fbf0c067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.810+0000 7f4aba200640 1 --2- 172.21.15.107:0/2233532444 >> v2:172.21.15.107:3300/0 conn(0x7f4ab406ac30 0x7f4ab4159690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.810+0000 7f4aba200640 1 -- 172.21.15.107:0/2233532444 >> 172.21.15.107:0/2233532444 conn(0x7f4ab40cc480 msgr2=0x7f4ab40687b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:35.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.809+0000 7fc6ef400640 1 -- 172.21.15.107:0/1135099813 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f00b0360 con 0x7fc6f00b1120 2024-08-17T02:24:35.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.811+0000 7f7895000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78900af5c0 0x7f7890144e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.811+0000 7f7895000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78900af5c0 0x7f7890144e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:38732/0 (socket says 172.21.15.107:38732) 2024-08-17T02:24:35.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.811+0000 7f7895000640 1 -- 172.21.15.107:0/1910044521 learned_addr learned my addr 172.21.15.107:0/1910044521 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:35.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.811+0000 7f7896400640 1 --2- 172.21.15.107:0/1910044521 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7890160660 0x7f7890069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.811+0000 7f7895a00640 1 --2- 172.21.15.107:0/1910044521 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78900ada10 0x7f78900afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.811+0000 7fcb8f400640 1 --2- 172.21.15.107:0/4091979938 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcb900ceb40 0x7fcb900c4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:35.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.810+0000 7f56ee600640 1 -- 172.21.15.107:0/743090638 wait complete. 2024-08-17T02:24:35.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.811+0000 7f4aba200640 1 -- 172.21.15.107:0/2233532444 shutdown_connections 2024-08-17T02:24:35.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.811+0000 7f7898400640 1 -- 172.21.15.107:0/1910044521 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7890170ab0 con 0x7f78900ada10 2024-08-17T02:24:35.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.811+0000 7f51c9200640 1 -- start start 2024-08-17T02:24:35.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.811+0000 7fc6ef400640 1 --2- 172.21.15.107:0/1135099813 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6f00b1120 0x7fc6f00aedf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc6f008a250 tx=0x7fc6e00090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bb395f1a7a4ee7e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.811+0000 7fbb56800640 1 --2- 172.21.15.107:0/1988526815 >> v2:172.21.15.107:3300/0 conn(0x7fbb5806a410 0x7fbb580aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:35.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.811+0000 7fbb55400640 1 --2- 172.21.15.107:0/1988526815 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbb580adb50 0x7fbb58069ed0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbb580682c0 tx=0x7fbb440090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=deff4157143c1f06 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.811+0000 7f7898400640 1 -- 172.21.15.107:0/1910044521 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7890171910 con 0x7f78900af5c0 2024-08-17T02:24:35.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.811+0000 7f7898400640 1 -- 172.21.15.107:0/1910044521 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78900b02a0 con 0x7f7890160660 2024-08-17T02:24:35.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.811+0000 7fbf1fe00640 1 -- 172.21.15.107:0/1421615147 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbf18082940 con 0x7fbf24054d00 2024-08-17T02:24:35.840 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.811+0000 7fcb94a00640 1 --2- 172.21.15.107:0/4091979938 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcb90159ca0 0x7fcb900c5150 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcb880099f0 tx=0x7fcb88038000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.840 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.812+0000 7fbf31000640 1 --2- 172.21.15.107:0/1421615147 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbf0c0651d0 0x7fbf0c067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.840 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.812+0000 7fbb54a00640 1 -- 172.21.15.107:0/1988526815 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb48001470 con 0x7fbb580adb50 2024-08-17T02:24:35.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.812+0000 7fc6eea00640 1 -- 172.21.15.107:0/1135099813 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e002ae60 con 0x7fc6f00b1120 2024-08-17T02:24:35.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.812+0000 7fbb54a00640 1 -- 172.21.15.107:0/1988526815 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb44038440 con 0x7fbb580adb50 2024-08-17T02:24:35.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.812+0000 7fbb54a00640 1 -- 172.21.15.107:0/1988526815 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb440385b0 con 0x7fbb580adb50 2024-08-17T02:24:35.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.812+0000 7fc6eea00640 1 -- 172.21.15.107:0/1135099813 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e0032440 con 0x7fc6f00b1120 2024-08-17T02:24:35.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.812+0000 7fc6eea00640 1 -- 172.21.15.107:0/1135099813 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e00327e0 con 0x7fc6f00b1120 2024-08-17T02:24:35.842 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.812+0000 7f7896400640 1 -- 172.21.15.107:0/1910044521 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78900af5c0 msgr2=0x7f7890144e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.842 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.812+0000 7f7896400640 1 --2- 172.21.15.107:0/1910044521 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78900af5c0 0x7f7890144e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.842 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.812+0000 7f7896400640 1 -- 172.21.15.107:0/1910044521 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78900ada10 msgr2=0x7f78900afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.842 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.812+0000 7f7896400640 1 --2- 172.21.15.107:0/1910044521 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78900ada10 0x7f78900afd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.842 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.812+0000 7f7896400640 1 -- 172.21.15.107:0/1910044521 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7884009390 con 0x7f7890160660 2024-08-17T02:24:35.842 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.811+0000 7f4aba200640 1 -- 172.21.15.107:0/2233532444 wait complete. 2024-08-17T02:24:35.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.813+0000 7f56ee600640 1 Processor -- start 2024-08-17T02:24:35.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.813+0000 7f7896400640 1 --2- 172.21.15.107:0/1910044521 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7890160660 0x7f7890069f50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f788400e9b0 tx=0x7f78840090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.813+0000 7f788cc00640 1 -- 172.21.15.107:0/1910044521 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788400c940 con 0x7f7890160660 2024-08-17T02:24:35.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.813+0000 7f788cc00640 1 -- 172.21.15.107:0/1910044521 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f788400caa0 con 0x7f7890160660 2024-08-17T02:24:35.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.813+0000 7f788cc00640 1 -- 172.21.15.107:0/1910044521 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788400ce60 con 0x7f7890160660 2024-08-17T02:24:35.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.813+0000 7f51c9200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f51c406d7a0 0x7f51c406db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.813+0000 7fc6f6a00640 1 -- 172.21.15.107:0/1135099813 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6f00b1120 msgr2=0x7fc6f00aedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.813+0000 7f7898400640 1 -- 172.21.15.107:0/1910044521 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7888009ae0 con 0x7f7890160660 2024-08-17T02:24:35.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.813+0000 7f7898400640 1 -- 172.21.15.107:0/1910044521 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78901712c0 con 0x7f7890160660 2024-08-17T02:24:35.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.813+0000 7f56ee600640 1 -- start start 2024-08-17T02:24:35.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.813+0000 7fc6f6a00640 1 --2- 172.21.15.107:0/1135099813 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6f00b1120 0x7fc6f00aedf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc6f008a250 tx=0x7fc6e00090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.814+0000 7f4aba200640 1 Processor -- start 2024-08-17T02:24:35.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.813+0000 7fbb5cc00640 1 -- 172.21.15.107:0/1988526815 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbb580adb50 msgr2=0x7fbb58069ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.813+0000 7fbb5cc00640 1 --2- 172.21.15.107:0/1988526815 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbb580adb50 0x7fbb58069ed0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbb580682c0 tx=0x7fbb440090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.814+0000 7fbf31000640 1 --2- 172.21.15.107:0/1421615147 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbf0c0651d0 0x7fbf0c067680 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbf20001860 tx=0x7fbf20009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.814+0000 7fc6f6a00640 1 -- 172.21.15.107:0/1135099813 shutdown_connections 2024-08-17T02:24:35.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.814+0000 7fc6f6a00640 1 --2- 172.21.15.107:0/1135099813 >> v2:172.21.15.107:3300/0 conn(0x7fc6f00b3370 0x7fc6f00b37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.814+0000 7fc6f6a00640 1 --2- 172.21.15.107:0/1135099813 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6f00b1120 0x7fc6f00aedf0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.814+0000 7fc6f6a00640 1 -- 172.21.15.107:0/1135099813 >> 172.21.15.107:0/1135099813 conn(0x7fc6f00cfdf0 msgr2=0x7fc6f00d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:35.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.814+0000 7f4aba200640 1 -- start start 2024-08-17T02:24:35.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.814+0000 7f51c9200640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f51c40cc400 0x7f51c40ab210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.814+0000 7f51c9200640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51c40adb40 con 0x7f51c40adfd0 2024-08-17T02:24:35.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.814+0000 7f51c9200640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51c40abdf0 con 0x7f51c40cc400 2024-08-17T02:24:35.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.814+0000 7f51c9200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c40abb10 con 0x7f51c406d7a0 2024-08-17T02:24:35.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.814+0000 7f51c3e00640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f51c40adfd0 0x7f51c41547f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:45094/0 (socket says 172.21.15.107:45094) 2024-08-17T02:24:35.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.814+0000 7f51c3e00640 1 -- 172.21.15.107:0/2850926040 learned_addr learned my addr 172.21.15.107:0/2850926040 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:35.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.814+0000 7f56ee600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f56e806da20 0x7f56e8153d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.814+0000 7f56ee600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f56e806ddf0 0x7f56e80ca640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.814+0000 7f56ee600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56e80aa7d0 0x7f56e8153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.814+0000 7f56ee600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e815a080 con 0x7f56e80aa7d0 2024-08-17T02:24:35.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.814+0000 7f56ee600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e80b0ce0 con 0x7f56e806ddf0 2024-08-17T02:24:35.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.814+0000 7f56ee600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e80b0f30 con 0x7f56e806da20 2024-08-17T02:24:35.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.814+0000 7fbb5cc00640 1 -- 172.21.15.107:0/1988526815 shutdown_connections 2024-08-17T02:24:35.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.814+0000 7fbb5cc00640 1 --2- 172.21.15.107:0/1988526815 >> v2:172.21.15.107:3300/0 conn(0x7fbb5806a410 0x7fbb580aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.814+0000 7fbb5cc00640 1 --2- 172.21.15.107:0/1988526815 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbb580adb50 0x7fbb58069ed0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.814+0000 7fbb5cc00640 1 -- 172.21.15.107:0/1988526815 >> 172.21.15.107:0/1988526815 conn(0x7fbb580cc480 msgr2=0x7fbb580687b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:35.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.815+0000 7fbb5cc00640 1 -- 172.21.15.107:0/1988526815 shutdown_connections 2024-08-17T02:24:35.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.814+0000 7f51c3400640 1 --2- 172.21.15.107:0/2850926040 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f51c406d7a0 0x7f51c406db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.815+0000 7fbb5cc00640 1 -- 172.21.15.107:0/1988526815 wait complete. 2024-08-17T02:24:35.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.814+0000 7f51c2a00640 1 --2- 172.21.15.107:0/2850926040 >> v2:172.21.15.157:3300/0 conn(0x7f51c40cc400 0x7f51c40ab210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.815+0000 7f51c3400640 1 -- 172.21.15.107:0/2850926040 >> v2:172.21.15.157:3300/0 conn(0x7f51c40cc400 msgr2=0x7f51c40ab210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:35.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.815+0000 7f51c3400640 1 --2- 172.21.15.107:0/2850926040 >> v2:172.21.15.157:3300/0 conn(0x7f51c40cc400 0x7f51c40ab210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.815+0000 7f51c3400640 1 -- 172.21.15.107:0/2850926040 >> v1:172.21.15.157:6789/0 conn(0x7f51c40adfd0 legacy=0x7f51c41547f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.815+0000 7f51c3400640 1 -- 172.21.15.107:0/2850926040 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c40ad4f0 con 0x7f51c406d7a0 2024-08-17T02:24:35.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.815+0000 7f56e7400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f56e806da20 0x7f56e8153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.815+0000 7f7898400640 1 -- 172.21.15.107:0/1910044521 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7890170e20 con 0x7f7890160660 2024-08-17T02:24:35.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.816+0000 7f56e7400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f56e806da20 0x7f56e8153d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:42230/0 (socket says 172.21.15.107:42230) 2024-08-17T02:24:35.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.816+0000 7f56e7400640 1 -- 172.21.15.107:0/2767186927 learned_addr learned my addr 172.21.15.107:0/2767186927 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:35.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.816+0000 7f56dea00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f56e806ddf0 0x7f56e80ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.816+0000 7fc6f6a00640 1 -- 172.21.15.107:0/1135099813 shutdown_connections 2024-08-17T02:24:35.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.816+0000 7f56e7e00640 1 --2- 172.21.15.107:0/2767186927 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56e80aa7d0 0x7f56e8153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.816+0000 7fcb87400640 1 -- 172.21.15.107:0/4091979938 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb880328a0 con 0x7fcb90159ca0 2024-08-17T02:24:35.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.816+0000 7fc6f6a00640 1 -- 172.21.15.107:0/1135099813 wait complete. 2024-08-17T02:24:35.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.816+0000 7fcb87400640 1 -- 172.21.15.107:0/4091979938 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb88041070 con 0x7fcb90159ca0 2024-08-17T02:24:35.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.816+0000 7fcb87400640 1 -- 172.21.15.107:0/4091979938 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb88032c50 con 0x7fcb90159ca0 2024-08-17T02:24:35.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.816+0000 7fcb95400640 1 -- 172.21.15.107:0/4091979938 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb900c4420 con 0x7fcb90159ca0 2024-08-17T02:24:35.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.816+0000 7f56e7400640 1 -- 172.21.15.107:0/2767186927 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f56e806ddf0 msgr2=0x7f56e80ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.816+0000 7f56e7400640 1 --2- 172.21.15.107:0/2767186927 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f56e806ddf0 0x7f56e80ca640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.816+0000 7f56e7400640 1 -- 172.21.15.107:0/2767186927 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56e80aa7d0 msgr2=0x7f56e8153140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.816+0000 7fbf1fe00640 1 -- 172.21.15.107:0/1421615147 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbf180509e0 con 0x7fbf24054d00 2024-08-17T02:24:35.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.817+0000 7f4aba200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ab406ac30 0x7f4ab4172d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.817+0000 7fcb95400640 1 -- 172.21.15.107:0/4091979938 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb90169980 con 0x7fcb90159ca0 2024-08-17T02:24:35.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.817+0000 7f51c3400640 1 --2- 172.21.15.107:0/2850926040 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f51c406d7a0 0x7f51c406db70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f51b40098e0 tx=0x7f51b40090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d6afc1edff27671 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.817+0000 7f56e7400640 1 --2- 172.21.15.107:0/2767186927 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56e80aa7d0 0x7f56e8153140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.817+0000 7f56e7400640 1 -- 172.21.15.107:0/2767186927 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e0009a20 con 0x7f56e806da20 2024-08-17T02:24:35.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.817+0000 7f4aba200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ab40aea20 0x7f4ab40aaa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.817+0000 7f4aba200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4ab41557f0 0x7f4ab4157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.817+0000 7f4aba200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab41732b0 con 0x7f4ab40aea20 2024-08-17T02:24:35.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.817+0000 7f4aba200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab4157840 con 0x7f4ab406ac30 2024-08-17T02:24:35.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.817+0000 7fbb5cc00640 1 Processor -- start 2024-08-17T02:24:35.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.817+0000 7f56e7e00640 1 --2- 172.21.15.107:0/2767186927 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56e80aa7d0 0x7f56e8153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:35.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.817+0000 7f4aba200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab4156c30 con 0x7f4ab41557f0 2024-08-17T02:24:35.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.817+0000 7f788cc00640 1 -- 172.21.15.107:0/1910044521 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7884013680 con 0x7f7890160660 2024-08-17T02:24:35.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.817+0000 7fbb5cc00640 1 -- start start 2024-08-17T02:24:35.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.817+0000 7f56e7400640 1 --2- 172.21.15.107:0/2767186927 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f56e806da20 0x7f56e8153d30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f56d800c5b0 tx=0x7f56d8007d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.817+0000 7f51c2000640 1 -- 172.21.15.107:0/2850926040 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b4033510 con 0x7f51c406d7a0 2024-08-17T02:24:35.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.817+0000 7f51c2000640 1 -- 172.21.15.107:0/2850926040 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b4031050 con 0x7f51c406d7a0 2024-08-17T02:24:35.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.817+0000 7f51c2000640 1 -- 172.21.15.107:0/2850926040 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b40338a0 con 0x7f51c406d7a0 2024-08-17T02:24:35.858 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.818+0000 7f4ab3400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ab406ac30 0x7f4ab4172d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.858 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.818+0000 7f4ab3e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4ab41557f0 0x7f4ab4157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.858 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.818+0000 7f4ab2a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ab40aea20 0x7f4ab40aaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.858 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.818+0000 7f51c9200640 1 -- 172.21.15.107:0/2850926040 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f51c406d7a0 msgr2=0x7f51c406db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.858 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.818+0000 7f51c9200640 1 --2- 172.21.15.107:0/2850926040 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f51c406d7a0 0x7f51c406db70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f51b40098e0 tx=0x7f51b40090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.818+0000 7fcb95400640 1 -- 172.21.15.107:0/4091979938 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb90169bd0 con 0x7fcb90159ca0 2024-08-17T02:24:35.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.819+0000 7fc6f6a00640 1 Processor -- start 2024-08-17T02:24:35.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.819+0000 7fbb5cc00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb5806a410 0x7fbb5813a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.819+0000 7fbb5cc00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbb5806e7f0 0x7fbb581569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.819+0000 7fbb5cc00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbb580adb50 0x7fbb5806db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.819+0000 7fbb5cc00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb58157ed0 con 0x7fbb580adb50 2024-08-17T02:24:35.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.819+0000 7fbb5cc00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5813a600 con 0x7fbb5806e7f0 2024-08-17T02:24:35.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.819+0000 7fbb5cc00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb581572c0 con 0x7fbb5806a410 2024-08-17T02:24:35.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.819+0000 7f51c9200640 1 -- 172.21.15.107:0/2850926040 shutdown_connections 2024-08-17T02:24:35.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.819+0000 7f51c9200640 1 --2- 172.21.15.107:0/2850926040 >> v2:172.21.15.157:3300/0 conn(0x7f51c40cc400 0x7f51c40ab210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.819+0000 7f51c9200640 1 --2- 172.21.15.107:0/2850926040 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f51c406d7a0 0x7f51c406db70 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.819+0000 7f51c9200640 1 -- 172.21.15.107:0/2850926040 >> 172.21.15.107:0/2850926040 conn(0x7f51c4067750 msgr2=0x7f51c40cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:35.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.819+0000 7f788cc00640 1 --2- 172.21.15.107:0/1910044521 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f78700651d0 0x7f7870067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.819+0000 7f788cc00640 1 -- 172.21.15.107:0/1910044521 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7884082420 con 0x7f7890160660 2024-08-17T02:24:35.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.820+0000 7f7895a00640 1 --2- 172.21.15.107:0/1910044521 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f78700651d0 0x7f7870067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.820+0000 7fcb87400640 1 -- 172.21.15.107:0/4091979938 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fcb88043030 con 0x7fcb90159ca0 2024-08-17T02:24:35.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.819+0000 7fc6f6a00640 1 -- start start 2024-08-17T02:24:35.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.818+0000 7f4ab3400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ab406ac30 0x7f4ab4172d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:38746/0 (socket says 172.21.15.107:38746) 2024-08-17T02:24:35.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.819+0000 7f4ab3400640 1 -- 172.21.15.107:0/3157808916 learned_addr learned my addr 172.21.15.107:0/3157808916 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:35.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.818+0000 7f4ab3e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4ab41557f0 0x7f4ab4157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:42240/0 (socket says 172.21.15.107:42240) 2024-08-17T02:24:35.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.820+0000 7f4ab3e00640 1 -- 172.21.15.107:0/3157808916 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ab406ac30 msgr2=0x7f4ab4172d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.820+0000 7f4ab3e00640 1 --2- 172.21.15.107:0/3157808916 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ab406ac30 0x7f4ab4172d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.820+0000 7f4ab3e00640 1 -- 172.21.15.107:0/3157808916 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ab40aea20 msgr2=0x7f4ab40aaa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.820+0000 7f4ab3e00640 1 --2- 172.21.15.107:0/3157808916 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ab40aea20 0x7f4ab40aaa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.820+0000 7f4ab3e00640 1 -- 172.21.15.107:0/3157808916 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aac00bc30 con 0x7f4ab41557f0 2024-08-17T02:24:35.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.819+0000 7fbb55e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb5806a410 0x7fbb5813a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.819+0000 7fbb55e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb5806a410 0x7fbb5813a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:42244/0 (socket says 172.21.15.107:42244) 2024-08-17T02:24:35.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.819+0000 7fbb56800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbb580adb50 0x7fbb5806db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.820+0000 7fbb55e00640 1 -- 172.21.15.107:0/971308964 learned_addr learned my addr 172.21.15.107:0/971308964 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:35.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.820+0000 7fbb55400640 1 --2- 172.21.15.107:0/971308964 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbb5806e7f0 0x7fbb581569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.820+0000 7fbb55e00640 1 -- 172.21.15.107:0/971308964 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbb5806e7f0 msgr2=0x7fbb581569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.820+0000 7fbb55e00640 1 --2- 172.21.15.107:0/971308964 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbb5806e7f0 0x7fbb581569c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.820+0000 7fbb55e00640 1 -- 172.21.15.107:0/971308964 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbb580adb50 msgr2=0x7fbb5806db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.820+0000 7fbb55e00640 1 --2- 172.21.15.107:0/971308964 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbb580adb50 0x7fbb5806db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.820+0000 7fbb55e00640 1 -- 172.21.15.107:0/971308964 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb50009a20 con 0x7fbb5806a410 2024-08-17T02:24:35.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.819+0000 7f51c9200640 1 -- 172.21.15.107:0/2850926040 shutdown_connections 2024-08-17T02:24:35.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.819+0000 7f51c9200640 1 -- 172.21.15.107:0/2850926040 wait complete. 2024-08-17T02:24:35.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.820+0000 7fbb55400640 1 --2- 172.21.15.107:0/971308964 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbb5806e7f0 0x7fbb581569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:35.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.820+0000 7fbb56800640 1 --2- 172.21.15.107:0/971308964 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbb580adb50 0x7fbb5806db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:35.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.821+0000 7f7895a00640 1 --2- 172.21.15.107:0/1910044521 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f78700651d0 0x7f7870067680 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7888033000 tx=0x7f7888036000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.821+0000 7fbb55e00640 1 --2- 172.21.15.107:0/971308964 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb5806a410 0x7fbb5813a0c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbb48001380 tx=0x7fbb480019d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.821+0000 7f4ab3e00640 1 --2- 172.21.15.107:0/3157808916 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4ab41557f0 0x7f4ab4157cd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4aac033000 tx=0x7f4aac039000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.821+0000 7fcb87400640 1 --2- 172.21.15.107:0/4091979938 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fcb70065220 0x7fcb700676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.821+0000 7fc6f6a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6f00ada10 0x7fc6f0148870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.822+0000 7fcb87400640 1 -- 172.21.15.107:0/4091979938 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcb880a3cb0 con 0x7fcb90159ca0 2024-08-17T02:24:35.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.822+0000 7fc6f6a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6f00b1120 0x7fc6f00cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.822+0000 7f51c9200640 1 Processor -- start 2024-08-17T02:24:35.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.822+0000 7fc6f6a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6f00b3370 0x7fc6f00b46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.822+0000 7fcb8fe00640 1 --2- 172.21.15.107:0/4091979938 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fcb70065220 0x7fcb700676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.822+0000 7fc6efe00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6f00ada10 0x7fc6f0148870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.822+0000 7fc6f6a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f016d110 con 0x7fc6f00b3370 2024-08-17T02:24:35.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.822+0000 7fc6f6a00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f0148db0 con 0x7fc6f00b1120 2024-08-17T02:24:35.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.822+0000 7fc6f6a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f016c500 con 0x7fc6f00ada10 2024-08-17T02:24:35.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.822+0000 7f51c9200640 1 -- start start 2024-08-17T02:24:35.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.822+0000 7fc6efe00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6f00ada10 0x7fc6f0148870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:42248/0 (socket says 172.21.15.107:42248) 2024-08-17T02:24:35.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.822+0000 7fc6ef400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6f00b1120 0x7fc6f00cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.822+0000 7fc6efe00640 1 -- 172.21.15.107:0/1317971763 learned_addr learned my addr 172.21.15.107:0/1317971763 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:35.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.823+0000 7fc6f4a00640 1 --2- 172.21.15.107:0/1317971763 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6f00b3370 0x7fc6f00b46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.823+0000 7fc6ef400640 1 -- 172.21.15.107:0/1317971763 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6f00ada10 msgr2=0x7fc6f0148870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.823+0000 7fc6ef400640 1 --2- 172.21.15.107:0/1317971763 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6f00ada10 0x7fc6f0148870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.823+0000 7fc6ef400640 1 -- 172.21.15.107:0/1317971763 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6f00b3370 msgr2=0x7fc6f00b46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:35.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.823+0000 7fc6ef400640 1 --2- 172.21.15.107:0/1317971763 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6f00b3370 0x7fc6f00b46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.823+0000 7fc6ef400640 1 -- 172.21.15.107:0/1317971763 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e0009390 con 0x7fc6f00b1120 2024-08-17T02:24:35.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.823+0000 7fc6f4a00640 1 --2- 172.21.15.107:0/1317971763 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6f00b3370 0x7fc6f00b46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:35.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.823+0000 7fc6ef400640 1 --2- 172.21.15.107:0/1317971763 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6f00b1120 0x7fc6f00cd4f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0031000 tx=0x7fc6e0032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.823+0000 7fcb8fe00640 1 --2- 172.21.15.107:0/4091979938 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fcb70065220 0x7fcb700676d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcb90155690 tx=0x7fcb7c007ab0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.824+0000 7f56df400640 1 -- 172.21.15.107:0/2767186927 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d8007300 con 0x7f56e806da20 2024-08-17T02:24:35.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.824+0000 7f56df400640 1 -- 172.21.15.107:0/2767186927 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d8007480 con 0x7f56e806da20 2024-08-17T02:24:35.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.824+0000 7f56df400640 1 -- 172.21.15.107:0/2767186927 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d80049f0 con 0x7f56e806da20 2024-08-17T02:24:35.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.824+0000 7f4aaaa00640 1 -- 172.21.15.107:0/3157808916 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac033cf0 con 0x7f4ab41557f0 2024-08-17T02:24:35.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.824+0000 7f4aaaa00640 1 -- 172.21.15.107:0/3157808916 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aac033e50 con 0x7f4ab41557f0 2024-08-17T02:24:35.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.824+0000 7f4aaaa00640 1 -- 172.21.15.107:0/3157808916 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac03d690 con 0x7f4ab41557f0 2024-08-17T02:24:35.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.824+0000 7f788cc00640 1 -- 172.21.15.107:0/1910044521 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f78840504f0 con 0x7f7890160660 2024-08-17T02:24:35.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.824+0000 7fbb4d600640 1 -- 172.21.15.107:0/971308964 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb48007150 con 0x7fbb5806a410 2024-08-17T02:24:35.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.824+0000 7f51c9200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51c406d7a0 0x7f51c4140160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.824+0000 7fc6e7400640 1 -- 172.21.15.107:0/1317971763 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0031a60 con 0x7fc6f00b1120 2024-08-17T02:24:35.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.824+0000 7fc6e7400640 1 -- 172.21.15.107:0/1317971763 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e0031bc0 con 0x7fc6f00b1120 2024-08-17T02:24:35.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.824+0000 7fbb4d600640 1 -- 172.21.15.107:0/971308964 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb480072b0 con 0x7fbb5806a410 2024-08-17T02:24:35.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.824+0000 7fbb4d600640 1 -- 172.21.15.107:0/971308964 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb48007670 con 0x7fbb5806a410 2024-08-17T02:24:35.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.824+0000 7fc6e7400640 1 -- 172.21.15.107:0/1317971763 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e003c410 con 0x7fc6f00b1120 2024-08-17T02:24:35.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.824+0000 7f51c9200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51c40adfd0 0x7f51c40c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.824+0000 7f51c9200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f51c40cc400 0x7f51c4156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.824+0000 7f51c9200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c40c9f30 con 0x7f51c406d7a0 2024-08-17T02:24:35.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.824+0000 7f51c9200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c41509c0 con 0x7f51c40adfd0 2024-08-17T02:24:35.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.825+0000 7f51c3e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f51c40cc400 0x7f51c4156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.825+0000 7f51c3e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f51c40cc400 0x7f51c4156cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:42250/0 (socket says 172.21.15.107:42250) 2024-08-17T02:24:35.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.825+0000 7f51c9200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c40c9320 con 0x7f51c40cc400 2024-08-17T02:24:35.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.825+0000 7f51c3e00640 1 -- 172.21.15.107:0/1544412111 learned_addr learned my addr 172.21.15.107:0/1544412111 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:35.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.825+0000 7f4aba200640 1 -- 172.21.15.107:0/3157808916 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ab4156f10 con 0x7f4ab41557f0 2024-08-17T02:24:35.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.825+0000 7f4aba200640 1 -- 172.21.15.107:0/3157808916 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ab41574d0 con 0x7f4ab41557f0 2024-08-17T02:24:35.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.825+0000 7fbb5cc00640 1 -- 172.21.15.107:0/971308964 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb44009390 con 0x7fbb5806a410 2024-08-17T02:24:35.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.825+0000 7fc6f6a00640 1 -- 172.21.15.107:0/1317971763 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6f016c7e0 con 0x7fc6f00b1120 2024-08-17T02:24:35.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.825+0000 7fc6f6a00640 1 -- 172.21.15.107:0/1317971763 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6f016cda0 con 0x7fc6f00b1120 2024-08-17T02:24:35.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.826+0000 7fbb5cc00640 1 -- 172.21.15.107:0/971308964 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb58157880 con 0x7fbb5806a410 2024-08-17T02:24:35.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.824+0000 7f56ee600640 1 -- 172.21.15.107:0/2767186927 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e80b1210 con 0x7f56e806da20 2024-08-17T02:24:35.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.824+0000 7f56ee600640 1 -- 172.21.15.107:0/2767186927 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56e8154500 con 0x7f56e806da20 2024-08-17T02:24:35.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.826+0000 7f51c3e00640 1 -- 172.21.15.107:0/1544412111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51c40adfd0 msgr2=0x7f51c40c8880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:24:35.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.826+0000 7f51c3e00640 1 --2- 172.21.15.107:0/1544412111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51c40adfd0 0x7f51c40c8880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.826+0000 7f51c3e00640 1 -- 172.21.15.107:0/1544412111 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51c406d7a0 msgr2=0x7f51c4140160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:24:35.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.826+0000 7f51c3e00640 1 --2- 172.21.15.107:0/1544412111 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51c406d7a0 0x7f51c4140160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:35.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.826+0000 7f51c3e00640 1 -- 172.21.15.107:0/1544412111 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b4009390 con 0x7f51c40cc400 2024-08-17T02:24:35.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.827+0000 7f4aba200640 1 -- 172.21.15.107:0/3157808916 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ab4064db0 con 0x7f4ab41557f0 2024-08-17T02:24:35.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.829+0000 7f56ee600640 1 -- 172.21.15.107:0/2767186927 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56e815a490 con 0x7f56e806da20 2024-08-17T02:24:35.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.827+0000 7fbb5cc00640 1 -- 172.21.15.107:0/971308964 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb58064db0 con 0x7fbb5806a410 2024-08-17T02:24:35.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.827+0000 7f51c3e00640 1 --2- 172.21.15.107:0/1544412111 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f51c40cc400 0x7f51c4156cd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f51bc0019d0 tx=0x7f51bc006280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.828+0000 7f51baa00640 1 -- 172.21.15.107:0/1544412111 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc0083b0 con 0x7f51c40cc400 2024-08-17T02:24:35.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.828+0000 7f51baa00640 1 -- 172.21.15.107:0/1544412111 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51bc006480 con 0x7f51c40cc400 2024-08-17T02:24:35.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.828+0000 7f51baa00640 1 -- 172.21.15.107:0/1544412111 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc006840 con 0x7f51c40cc400 2024-08-17T02:24:35.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.828+0000 7f51c9200640 1 -- 172.21.15.107:0/1544412111 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51c40c9600 con 0x7f51c40cc400 2024-08-17T02:24:35.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.828+0000 7f51c9200640 1 -- 172.21.15.107:0/1544412111 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51c40c9bc0 con 0x7f51c40cc400 2024-08-17T02:24:35.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.830+0000 7fc6f6a00640 1 -- 172.21.15.107:0/1317971763 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6f0064db0 con 0x7fc6f00b1120 2024-08-17T02:24:35.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.830+0000 7f56df400640 1 -- 172.21.15.107:0/2767186927 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f56d801c3b0 con 0x7f56e806da20 2024-08-17T02:24:35.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.829+0000 7f4aaaa00640 1 -- 172.21.15.107:0/3157808916 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4aac03da80 con 0x7f4ab41557f0 2024-08-17T02:24:35.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.830+0000 7f4aaaa00640 1 --2- 172.21.15.107:0/3157808916 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4a94065220 0x7f4a940676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.879 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.829+0000 7fbb4d600640 1 -- 172.21.15.107:0/971308964 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbb480049b0 con 0x7fbb5806a410 2024-08-17T02:24:35.879 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.831+0000 7fbb4d600640 1 --2- 172.21.15.107:0/971308964 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbb38065220 0x7fbb380676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.879 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.831+0000 7f4ab3400640 1 --2- 172.21.15.107:0/3157808916 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4a94065220 0x7f4a940676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.879 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.831+0000 7fbb55400640 1 --2- 172.21.15.107:0/971308964 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbb38065220 0x7fbb380676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.879 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.831+0000 7fc6e7400640 1 -- 172.21.15.107:0/1317971763 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc6e0039050 con 0x7fc6f00b1120 2024-08-17T02:24:35.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.831+0000 7f4aaaa00640 1 -- 172.21.15.107:0/3157808916 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4aac0a3a40 con 0x7f4ab41557f0 2024-08-17T02:24:35.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.832+0000 7f56df400640 1 --2- 172.21.15.107:0/2767186927 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f56c40652a0 0x7f56c4067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.832+0000 7fbb4d600640 1 -- 172.21.15.107:0/971308964 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbb480540e0 con 0x7fbb5806a410 2024-08-17T02:24:35.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.832+0000 7f4ab3400640 1 --2- 172.21.15.107:0/3157808916 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4a94065220 0x7f4a940676d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4ab40aa150 tx=0x7f4aa0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.832+0000 7fbb55400640 1 --2- 172.21.15.107:0/971308964 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbb38065220 0x7fbb380676d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbb4403d000 tx=0x7fbb4403e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.832+0000 7f56df400640 1 -- 172.21.15.107:0/2767186927 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f56d8081830 con 0x7f56e806da20 2024-08-17T02:24:35.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.832+0000 7f56dea00640 1 --2- 172.21.15.107:0/2767186927 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f56c40652a0 0x7f56c4067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.829+0000 7f51c9200640 1 -- 172.21.15.107:0/1544412111 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f519c005210 con 0x7f51c40cc400 2024-08-17T02:24:35.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.833+0000 7fcb87400640 1 -- 172.21.15.107:0/4091979938 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fcb88071df0 con 0x7fcb90159ca0 2024-08-17T02:24:35.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.833+0000 7f51baa00640 1 -- 172.21.15.107:0/1544412111 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f51bc006c30 con 0x7f51c40cc400 2024-08-17T02:24:35.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.833+0000 7fc6e7400640 1 --2- 172.21.15.107:0/1317971763 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fc6d00652a0 0x7fc6d0067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.834+0000 7fc6e7400640 1 -- 172.21.15.107:0/1317971763 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc6e00a2b80 con 0x7fc6f00b1120 2024-08-17T02:24:35.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.834+0000 7f56dea00640 1 --2- 172.21.15.107:0/2767186927 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f56c40652a0 0x7f56c4067750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f56e80ca040 tx=0x7f56d0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.834+0000 7fc6efe00640 1 --2- 172.21.15.107:0/1317971763 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fc6d00652a0 0x7fc6d0067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.834+0000 7f56df400640 1 -- 172.21.15.107:0/2767186927 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f56d804fa00 con 0x7f56e806da20 2024-08-17T02:24:35.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.834+0000 7f51baa00640 1 --2- 172.21.15.107:0/1544412111 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f51a4065150 0x7f51a4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:35.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.834+0000 7f51baa00640 1 -- 172.21.15.107:0/1544412111 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f51bc081b70 con 0x7f51c40cc400 2024-08-17T02:24:35.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.835+0000 7fc6efe00640 1 --2- 172.21.15.107:0/1317971763 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fc6d00652a0 0x7fc6d0067750 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8006fd0 tx=0x7fc6e8001a80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.835+0000 7f51c3400640 1 --2- 172.21.15.107:0/1544412111 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f51a4065150 0x7f51a4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:35.885 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.835+0000 7f51c3400640 1 --2- 172.21.15.107:0/1544412111 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f51a4065150 0x7f51a4067600 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f51b4038000 tx=0x7f51b4039000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:35.885 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.837+0000 7fc6e7400640 1 -- 172.21.15.107:0/1317971763 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc6e0070d90 con 0x7fc6f00b1120 2024-08-17T02:24:35.885 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.839+0000 7f4aaaa00640 1 -- 172.21.15.107:0/3157808916 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4aac0a5e60 con 0x7f4ab41557f0 2024-08-17T02:24:35.885 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.843+0000 7fbb4d600640 1 -- 172.21.15.107:0/971308964 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbb480504b0 con 0x7fbb5806a410 2024-08-17T02:24:35.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:35.848+0000 7f51baa00640 1 -- 172.21.15.107:0/1544412111 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f51bc04fc30 con 0x7f51c40cc400 2024-08-17T02:24:36.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.227+0000 7fbf32400640 1 -- 172.21.15.107:0/1421615147 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbf24005320 con 0x7fbf24054d00 2024-08-17T02:24:36.229 INFO:teuthology.orchestra.run.smithi107.stdout:55834574851 2024-08-17T02:24:36.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.228+0000 7fbf1fe00640 1 -- 172.21.15.107:0/1421615147 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbf1801f090 con 0x7fbf24054d00 2024-08-17T02:24:36.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.231+0000 7fbf32400640 1 -- 172.21.15.107:0/1421615147 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbf0c0651d0 msgr2=0x7fbf0c067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:36.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.231+0000 7fbf32400640 1 --2- 172.21.15.107:0/1421615147 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbf0c0651d0 0x7fbf0c067680 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbf20001860 tx=0x7fbf20009040 comp rx=0 tx=0).stop 2024-08-17T02:24:36.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.231+0000 7fbf32400640 1 -- 172.21.15.107:0/1421615147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf24054d00 msgr2=0x7fbf240f99f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:36.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.232+0000 7fbf32400640 1 --2- 172.21.15.107:0/1421615147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf24054d00 0x7fbf240f99f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbf1800c880 tx=0x7fbf18008040 comp rx=0 tx=0).stop 2024-08-17T02:24:36.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.233+0000 7fbf32400640 1 -- 172.21.15.107:0/1421615147 shutdown_connections 2024-08-17T02:24:36.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.233+0000 7fbf32400640 1 --2- 172.21.15.107:0/1421615147 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbf0c0651d0 0x7fbf0c067680 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.233+0000 7fbf32400640 1 --2- 172.21.15.107:0/1421615147 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf240e1bd0 0x7fbf240f9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.233+0000 7fbf32400640 1 --2- 172.21.15.107:0/1421615147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf24054d00 0x7fbf240f99f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.233+0000 7fbf32400640 1 --2- 172.21.15.107:0/1421615147 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbf24006690 0x7fbf240ea8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.233+0000 7fbf32400640 1 -- 172.21.15.107:0/1421615147 >> 172.21.15.107:0/1421615147 conn(0x7fbf2400f070 msgr2=0x7fbf24038030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:36.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.234+0000 7fbf32400640 1 -- 172.21.15.107:0/1421615147 shutdown_connections 2024-08-17T02:24:36.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.234+0000 7fbf32400640 1 -- 172.21.15.107:0/1421615147 wait complete. 2024-08-17T02:24:36.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.240+0000 7f7898400640 1 -- 172.21.15.107:0/1910044521 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f789006bdc0 con 0x7f7890160660 2024-08-17T02:24:36.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.240+0000 7fc6f6a00640 1 -- 172.21.15.107:0/1317971763 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fc6f00676b0 con 0x7fc6f00b1120 2024-08-17T02:24:36.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.240+0000 7f56ee600640 1 -- 172.21.15.107:0/2767186927 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f56e8064db0 con 0x7f56e806da20 2024-08-17T02:24:36.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.241+0000 7f788cc00640 1 -- 172.21.15.107:0/1910044521 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7884053b10 con 0x7f7890160660 2024-08-17T02:24:36.243 INFO:teuthology.orchestra.run.smithi107.stdout:55834574851 2024-08-17T02:24:36.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.241+0000 7fcb95400640 1 -- 172.21.15.107:0/4091979938 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcb900c4920 con 0x7fcb90159ca0 2024-08-17T02:24:36.244 INFO:teuthology.orchestra.run.smithi107.stdout:55834574852 2024-08-17T02:24:36.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.241+0000 7f56df400640 1 -- 172.21.15.107:0/2767186927 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f56d8018090 con 0x7f56e806da20 2024-08-17T02:24:36.244 INFO:teuthology.orchestra.run.smithi107.stdout:55834574852 2024-08-17T02:24:36.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.241+0000 7fc6e7400640 1 -- 172.21.15.107:0/1317971763 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc6e004a090 con 0x7fc6f00b1120 2024-08-17T02:24:36.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.242+0000 7fcb87400640 1 -- 172.21.15.107:0/4091979938 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcb88075410 con 0x7fcb90159ca0 2024-08-17T02:24:36.245 INFO:teuthology.orchestra.run.smithi107.stdout:55834574851 2024-08-17T02:24:36.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.245+0000 7f7898400640 1 -- 172.21.15.107:0/1910044521 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f78700651d0 msgr2=0x7f7870067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:36.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.245+0000 7f7898400640 1 --2- 172.21.15.107:0/1910044521 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f78700651d0 0x7f7870067680 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7888033000 tx=0x7f7888036000 comp rx=0 tx=0).stop 2024-08-17T02:24:36.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.245+0000 7fc6f6a00640 1 -- 172.21.15.107:0/1317971763 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fc6d00652a0 msgr2=0x7fc6d0067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:36.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.245+0000 7fc6f6a00640 1 --2- 172.21.15.107:0/1317971763 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fc6d00652a0 0x7fc6d0067750 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8006fd0 tx=0x7fc6e8001a80 comp rx=0 tx=0).stop 2024-08-17T02:24:36.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.245+0000 7fc6f6a00640 1 -- 172.21.15.107:0/1317971763 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6f00b1120 msgr2=0x7fc6f00cd4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:36.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.245+0000 7fc6f6a00640 1 --2- 172.21.15.107:0/1317971763 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6f00b1120 0x7fc6f00cd4f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0031000 tx=0x7fc6e0032000 comp rx=0 tx=0).stop 2024-08-17T02:24:36.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.245+0000 7f56ee600640 1 -- 172.21.15.107:0/2767186927 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f56c40652a0 msgr2=0x7f56c4067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:36.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.245+0000 7f56ee600640 1 --2- 172.21.15.107:0/2767186927 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f56c40652a0 0x7f56c4067750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f56e80ca040 tx=0x7f56d0009040 comp rx=0 tx=0).stop 2024-08-17T02:24:36.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.245+0000 7f56ee600640 1 -- 172.21.15.107:0/2767186927 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f56e806da20 msgr2=0x7f56e8153d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:36.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.245+0000 7f56ee600640 1 --2- 172.21.15.107:0/2767186927 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f56e806da20 0x7f56e8153d30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f56d800c5b0 tx=0x7f56d8007d90 comp rx=0 tx=0).stop 2024-08-17T02:24:36.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.245+0000 7f7898400640 1 -- 172.21.15.107:0/1910044521 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7890160660 msgr2=0x7f7890069f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:36.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.245+0000 7fc6f6a00640 1 -- 172.21.15.107:0/1317971763 shutdown_connections 2024-08-17T02:24:36.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.245+0000 7f7898400640 1 --2- 172.21.15.107:0/1910044521 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7890160660 0x7f7890069f50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f788400e9b0 tx=0x7f78840090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.245+0000 7fc6f6a00640 1 --2- 172.21.15.107:0/1317971763 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fc6d00652a0 0x7fc6d0067750 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8006fd0 tx=0x7fc6e8001a80 comp rx=0 tx=0).stop 2024-08-17T02:24:36.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.245+0000 7fc6f6a00640 1 --2- 172.21.15.107:0/1317971763 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6f00b3370 0x7fc6f00b46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.245+0000 7fc6f6a00640 1 --2- 172.21.15.107:0/1317971763 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6f00b1120 0x7fc6f00cd4f0 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0031000 tx=0x7fc6e0032000 comp rx=0 tx=0).stop 2024-08-17T02:24:36.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.246+0000 7f7898400640 1 -- 172.21.15.107:0/1910044521 shutdown_connections 2024-08-17T02:24:36.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.245+0000 7fc6f6a00640 1 --2- 172.21.15.107:0/1317971763 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6f00ada10 0x7fc6f0148870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.245+0000 7fc6f6a00640 1 -- 172.21.15.107:0/1317971763 >> 172.21.15.107:0/1317971763 conn(0x7fc6f00cfdf0 msgr2=0x7fc6f00adde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:36.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.246+0000 7f7898400640 1 --2- 172.21.15.107:0/1910044521 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f78700651d0 0x7f7870067680 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.246+0000 7f7898400640 1 --2- 172.21.15.107:0/1910044521 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7890160660 0x7f7890069f50 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.246+0000 7f56ee600640 1 -- 172.21.15.107:0/2767186927 shutdown_connections 2024-08-17T02:24:36.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.246+0000 7f56ee600640 1 --2- 172.21.15.107:0/2767186927 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f56c40652a0 0x7f56c4067750 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.246+0000 7f56ee600640 1 --2- 172.21.15.107:0/2767186927 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56e80aa7d0 0x7f56e8153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.246+0000 7f56ee600640 1 --2- 172.21.15.107:0/2767186927 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f56e806ddf0 0x7f56e80ca640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.246+0000 7f56ee600640 1 --2- 172.21.15.107:0/2767186927 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f56e806da20 0x7f56e8153d30 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.246+0000 7f56ee600640 1 -- 172.21.15.107:0/2767186927 >> 172.21.15.107:0/2767186927 conn(0x7f56e80cb9b0 msgr2=0x7f56e806c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:36.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.246+0000 7f7898400640 1 --2- 172.21.15.107:0/1910044521 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78900af5c0 0x7f7890144e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.246+0000 7f7898400640 1 --2- 172.21.15.107:0/1910044521 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78900ada10 0x7f78900afd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.246+0000 7f7898400640 1 -- 172.21.15.107:0/1910044521 >> 172.21.15.107:0/1910044521 conn(0x7f78900cfdf0 msgr2=0x7f789015e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:36.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.246+0000 7f7898400640 1 -- 172.21.15.107:0/1910044521 shutdown_connections 2024-08-17T02:24:36.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.246+0000 7f56ee600640 1 -- 172.21.15.107:0/2767186927 shutdown_connections 2024-08-17T02:24:36.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.246+0000 7f56ee600640 1 -- 172.21.15.107:0/2767186927 wait complete. 2024-08-17T02:24:36.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.246+0000 7fc6f6a00640 1 -- 172.21.15.107:0/1317971763 shutdown_connections 2024-08-17T02:24:36.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.246+0000 7f7898400640 1 -- 172.21.15.107:0/1910044521 wait complete. 2024-08-17T02:24:36.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.247+0000 7fc6f6a00640 1 -- 172.21.15.107:0/1317971763 wait complete. 2024-08-17T02:24:36.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.247+0000 7fcb95400640 1 -- 172.21.15.107:0/4091979938 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fcb70065220 msgr2=0x7fcb700676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:36.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.247+0000 7fcb95400640 1 --2- 172.21.15.107:0/4091979938 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fcb70065220 0x7fcb700676d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcb90155690 tx=0x7fcb7c007ab0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.247+0000 7fcb95400640 1 -- 172.21.15.107:0/4091979938 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcb90159ca0 msgr2=0x7fcb900c5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:36.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.247+0000 7fcb95400640 1 --2- 172.21.15.107:0/4091979938 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcb90159ca0 0x7fcb900c5150 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcb880099f0 tx=0x7fcb88038000 comp rx=0 tx=0).stop 2024-08-17T02:24:36.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.248+0000 7fcb95400640 1 -- 172.21.15.107:0/4091979938 shutdown_connections 2024-08-17T02:24:36.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.248+0000 7fcb95400640 1 --2- 172.21.15.107:0/4091979938 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fcb70065220 0x7fcb700676d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.248+0000 7fcb95400640 1 --2- 172.21.15.107:0/4091979938 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcb90159ca0 0x7fcb900c5150 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.248+0000 7fcb95400640 1 --2- 172.21.15.107:0/4091979938 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcb900ceb40 0x7fcb900c4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.248+0000 7fcb95400640 1 --2- 172.21.15.107:0/4091979938 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb900ccca0 0x7fcb90169440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.248+0000 7fcb95400640 1 -- 172.21.15.107:0/4091979938 >> 172.21.15.107:0/4091979938 conn(0x7fcb90098e00 msgr2=0x7fcb90155fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:36.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.248+0000 7fcb95400640 1 -- 172.21.15.107:0/4091979938 shutdown_connections 2024-08-17T02:24:36.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.248+0000 7fcb95400640 1 -- 172.21.15.107:0/4091979938 wait complete. 2024-08-17T02:24:36.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.253+0000 7fbb5cc00640 1 -- 172.21.15.107:0/971308964 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbb5806ad20 con 0x7fbb5806a410 2024-08-17T02:24:36.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.254+0000 7fbb4d600640 1 -- 172.21.15.107:0/971308964 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbb48018070 con 0x7fbb5806a410 2024-08-17T02:24:36.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.255+0000 7f4aba200640 1 -- 172.21.15.107:0/3157808916 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4ab4069640 con 0x7f4ab41557f0 2024-08-17T02:24:36.256 INFO:teuthology.orchestra.run.smithi107.stdout:55834574851 2024-08-17T02:24:36.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.255+0000 7f51c9200640 1 -- 172.21.15.107:0/1544412111 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f519c005790 con 0x7f51c40cc400 2024-08-17T02:24:36.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.256+0000 7f4aaaa00640 1 -- 172.21.15.107:0/3157808916 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4aac041020 con 0x7f4ab41557f0 2024-08-17T02:24:36.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.256+0000 7f51baa00640 1 -- 172.21.15.107:0/1544412111 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f51bc018020 con 0x7f51c40cc400 2024-08-17T02:24:36.257 INFO:teuthology.orchestra.run.smithi107.stdout:55834574852 2024-08-17T02:24:36.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.259+0000 7fbb5cc00640 1 -- 172.21.15.107:0/971308964 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbb38065220 msgr2=0x7fbb380676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:36.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.259+0000 7fbb5cc00640 1 --2- 172.21.15.107:0/971308964 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbb38065220 0x7fbb380676d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbb4403d000 tx=0x7fbb4403e000 comp rx=0 tx=0).stop 2024-08-17T02:24:36.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.259+0000 7fbb5cc00640 1 -- 172.21.15.107:0/971308964 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb5806a410 msgr2=0x7fbb5813a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:36.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.259+0000 7fbb5cc00640 1 --2- 172.21.15.107:0/971308964 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb5806a410 0x7fbb5813a0c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbb48001380 tx=0x7fbb480019d0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.262 INFO:teuthology.orchestra.run.smithi107.stdout:55834574851 2024-08-17T02:24:36.262 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.1 2024-08-17T02:24:36.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.260+0000 7fbb5cc00640 1 -- 172.21.15.107:0/971308964 shutdown_connections 2024-08-17T02:24:36.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.260+0000 7fbb5cc00640 1 --2- 172.21.15.107:0/971308964 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbb38065220 0x7fbb380676d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.260+0000 7fbb5cc00640 1 --2- 172.21.15.107:0/971308964 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbb580adb50 0x7fbb5806db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.260+0000 7fbb5cc00640 1 --2- 172.21.15.107:0/971308964 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbb5806e7f0 0x7fbb581569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.260+0000 7fbb5cc00640 1 --2- 172.21.15.107:0/971308964 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb5806a410 0x7fbb5813a0c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.260+0000 7fbb5cc00640 1 -- 172.21.15.107:0/971308964 >> 172.21.15.107:0/971308964 conn(0x7fbb580cc480 msgr2=0x7fbb580687b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:36.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.260+0000 7f4aba200640 1 -- 172.21.15.107:0/3157808916 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4a94065220 msgr2=0x7f4a940676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:36.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.260+0000 7f4aba200640 1 --2- 172.21.15.107:0/3157808916 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4a94065220 0x7f4a940676d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4ab40aa150 tx=0x7f4aa0009040 comp rx=0 tx=0).stop 2024-08-17T02:24:36.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.260+0000 7f4aba200640 1 -- 172.21.15.107:0/3157808916 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4ab41557f0 msgr2=0x7f4ab4157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:36.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.260+0000 7f4aba200640 1 --2- 172.21.15.107:0/3157808916 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4ab41557f0 0x7f4ab4157cd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4aac033000 tx=0x7f4aac039000 comp rx=0 tx=0).stop 2024-08-17T02:24:36.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.260+0000 7f4aba200640 1 -- 172.21.15.107:0/3157808916 shutdown_connections 2024-08-17T02:24:36.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.260+0000 7f4aba200640 1 --2- 172.21.15.107:0/3157808916 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4a94065220 0x7f4a940676d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.260+0000 7f4aba200640 1 --2- 172.21.15.107:0/3157808916 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4ab41557f0 0x7f4ab4157cd0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.260+0000 7f4aba200640 1 --2- 172.21.15.107:0/3157808916 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ab40aea20 0x7f4ab40aaa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.260+0000 7f4aba200640 1 --2- 172.21.15.107:0/3157808916 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ab406ac30 0x7f4ab4172d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.260+0000 7f4aba200640 1 -- 172.21.15.107:0/3157808916 >> 172.21.15.107:0/3157808916 conn(0x7f4ab40cc480 msgr2=0x7f4ab40ad690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:36.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.260+0000 7fbb5cc00640 1 -- 172.21.15.107:0/971308964 shutdown_connections 2024-08-17T02:24:36.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.261+0000 7f4aba200640 1 -- 172.21.15.107:0/3157808916 shutdown_connections 2024-08-17T02:24:36.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.261+0000 7fbb5cc00640 1 -- 172.21.15.107:0/971308964 wait complete. 2024-08-17T02:24:36.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.261+0000 7f4aba200640 1 -- 172.21.15.107:0/3157808916 wait complete. 2024-08-17T02:24:36.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.261+0000 7f51c9200640 1 -- 172.21.15.107:0/1544412111 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f51a4065150 msgr2=0x7f51a4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:36.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.261+0000 7f51c9200640 1 --2- 172.21.15.107:0/1544412111 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f51a4065150 0x7f51a4067600 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f51b4038000 tx=0x7f51b4039000 comp rx=0 tx=0).stop 2024-08-17T02:24:36.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.261+0000 7f51c9200640 1 -- 172.21.15.107:0/1544412111 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f51c40cc400 msgr2=0x7f51c4156cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:36.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.261+0000 7f51c9200640 1 --2- 172.21.15.107:0/1544412111 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f51c40cc400 0x7f51c4156cd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f51bc0019d0 tx=0x7f51bc006280 comp rx=0 tx=0).stop 2024-08-17T02:24:36.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.261+0000 7f51c9200640 1 -- 172.21.15.107:0/1544412111 shutdown_connections 2024-08-17T02:24:36.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.261+0000 7f51c9200640 1 --2- 172.21.15.107:0/1544412111 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f51a4065150 0x7f51a4067600 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.261+0000 7f51c9200640 1 --2- 172.21.15.107:0/1544412111 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f51c40cc400 0x7f51c4156cd0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.261+0000 7f51c9200640 1 --2- 172.21.15.107:0/1544412111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51c40adfd0 0x7f51c40c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.261+0000 7f51c9200640 1 --2- 172.21.15.107:0/1544412111 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51c406d7a0 0x7f51c4140160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:36.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.261+0000 7f51c9200640 1 -- 172.21.15.107:0/1544412111 >> 172.21.15.107:0/1544412111 conn(0x7f51c4067750 msgr2=0x7f51c40aefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:36.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.262+0000 7f51c9200640 1 -- 172.21.15.107:0/1544412111 shutdown_connections 2024-08-17T02:24:36.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:36.262+0000 7f51c9200640 1 -- 172.21.15.107:0/1544412111 wait complete. 2024-08-17T02:24:36.273 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.4 2024-08-17T02:24:36.275 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2024-08-17T02:24:36.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.5 2024-08-17T02:24:36.279 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.0 2024-08-17T02:24:36.284 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2024-08-17T02:24:36.289 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.2 2024-08-17T02:24:36.291 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.6 2024-08-17T02:24:37.264 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-17T02:24:37.274 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-17T02:24:37.276 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-17T02:24:37.276 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-17T02:24:37.280 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-17T02:24:37.284 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-17T02:24:37.289 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-17T02:24:37.292 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-17T02:24:37.491 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.490+0000 7fed3d200640 1 Processor -- start 2024-08-17T02:24:37.492 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.490+0000 7fed3d200640 1 -- start start 2024-08-17T02:24:37.494 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.493+0000 7fed3d200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fed300d86d0 0x7fed30005e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.495 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.494+0000 7fed35400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fed3004f1d0 0x7fed3004fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:33852/0 (socket says 172.21.15.107:33852) 2024-08-17T02:24:37.495 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.494+0000 7fed35400640 1 -- 172.21.15.107:0/3010366959 learned_addr learned my addr 172.21.15.107:0/3010366959 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:37.495 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.494+0000 7fed35e00640 1 --2- 172.21.15.107:0/3010366959 >> v2:172.21.15.107:3300/0 conn(0x7fed300d86d0 0x7fed30005e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.495 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.494+0000 7fed3d200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed30053840 con 0x7fed3004f1d0 2024-08-17T02:24:37.496 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.495+0000 7fed3d200640 1 -- 172.21.15.107:0/3010366959 --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed30053380 con 0x7fed300504b0 2024-08-17T02:24:37.496 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.495+0000 7fed3d200640 1 -- 172.21.15.107:0/3010366959 --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed300df740 con 0x7fed300d86d0 2024-08-17T02:24:37.496 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.495+0000 7fed34a00640 1 -- 172.21.15.107:0/3010366959 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 927702165 0 0) 0x7fed30053380 con 0x7fed300504b0 2024-08-17T02:24:37.497 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.496+0000 7fed34a00640 1 -- 172.21.15.107:0/3010366959 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed1c0034e0 con 0x7fed300504b0 2024-08-17T02:24:37.497 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.496+0000 7fed34a00640 1 -- 172.21.15.107:0/3010366959 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 373744976 0 0) 0x7fed30053840 con 0x7fed3004f1d0 2024-08-17T02:24:37.497 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.496+0000 7fed34a00640 1 -- 172.21.15.107:0/3010366959 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed30053380 con 0x7fed3004f1d0 2024-08-17T02:24:37.497 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.497+0000 7fed35e00640 1 -- 172.21.15.107:0/3010366959 >> v1:172.21.15.157:6789/0 conn(0x7fed300504b0 legacy=0x7fed30053cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.497+0000 7fed34a00640 1 -- 172.21.15.107:0/3010366959 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 866495353 0 0) 0x7fed30053380 con 0x7fed3004f1d0 2024-08-17T02:24:37.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.497+0000 7fed35e00640 1 -- 172.21.15.107:0/3010366959 >> v1:172.21.15.107:6789/0 conn(0x7fed3004f1d0 legacy=0x7fed3004fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.497+0000 7fed35e00640 1 -- 172.21.15.107:0/3010366959 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed300deea0 con 0x7fed300d86d0 2024-08-17T02:24:37.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.498+0000 7fed35e00640 1 --2- 172.21.15.107:0/3010366959 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed300d86d0 0x7fed30005e20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fed3804ca10 tx=0x7fed38064990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c20943dad48ad8e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:37.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.498+0000 7fed34a00640 1 -- 172.21.15.107:0/3010366959 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed20001470 con 0x7fed300d86d0 2024-08-17T02:24:37.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.498+0000 7fed34a00640 1 -- 172.21.15.107:0/3010366959 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed380a6050 con 0x7fed300d86d0 2024-08-17T02:24:37.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.498+0000 7fed34a00640 1 -- 172.21.15.107:0/3010366959 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed28001470 con 0x7fed300d86d0 2024-08-17T02:24:37.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.500+0000 7fed3d200640 1 -- 172.21.15.107:0/3010366959 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed300d86d0 msgr2=0x7fed30005e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.500+0000 7fed3d200640 1 --2- 172.21.15.107:0/3010366959 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed300d86d0 0x7fed30005e20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fed3804ca10 tx=0x7fed38064990 comp rx=0 tx=0).stop 2024-08-17T02:24:37.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.501+0000 7fed3d200640 1 -- 172.21.15.107:0/3010366959 shutdown_connections 2024-08-17T02:24:37.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.501+0000 7fed3d200640 1 --2- 172.21.15.107:0/3010366959 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed300d86d0 0x7fed30005e20 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.501+0000 7fed3d200640 1 -- 172.21.15.107:0/3010366959 >> 172.21.15.107:0/3010366959 conn(0x7fed30051600 msgr2=0x7fed30051a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:37.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.501+0000 7fed3d200640 1 -- 172.21.15.107:0/3010366959 shutdown_connections 2024-08-17T02:24:37.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.501+0000 7fed3d200640 1 -- 172.21.15.107:0/3010366959 wait complete. 2024-08-17T02:24:37.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.504+0000 7fed3d200640 1 Processor -- start 2024-08-17T02:24:37.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.504+0000 7fed3d200640 1 -- start start 2024-08-17T02:24:37.508 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.506+0000 7fed3d200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fed3004f1d0 0x7fed300dcd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.508 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.506+0000 7fed3d200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed300504b0 0x7fed300da6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.508 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.506+0000 7fed3d200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed300d86d0 0x7fed300dabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.507+0000 7fed35e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fed3004f1d0 0x7fed300dcd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.507+0000 7fed35e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fed3004f1d0 0x7fed300dcd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:54914/0 (socket says 172.21.15.107:54914) 2024-08-17T02:24:37.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.508+0000 7fed36800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed300d86d0 0x7fed300dabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.508+0000 7fed36800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed300d86d0 0x7fed300dabe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60766/0 (socket says 172.21.15.107:60766) 2024-08-17T02:24:37.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.508+0000 7fed3d200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed300ddd00 con 0x7fed300d86d0 2024-08-17T02:24:37.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.509+0000 7fed35e00640 1 -- 172.21.15.107:0/3680059867 learned_addr learned my addr 172.21.15.107:0/3680059867 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:37.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.509+0000 7fed3d200640 1 -- 172.21.15.107:0/3680059867 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed300dd740 con 0x7fed300504b0 2024-08-17T02:24:37.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.509+0000 7fed3d200640 1 -- 172.21.15.107:0/3680059867 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed300dda20 con 0x7fed3004f1d0 2024-08-17T02:24:37.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.510+0000 7fed35400640 1 --2- 172.21.15.107:0/3680059867 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed300504b0 0x7fed300da6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.510+0000 7fed36800640 1 -- 172.21.15.107:0/3680059867 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fed3004f1d0 msgr2=0x7fed300dcd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.510+0000 7fed36800640 1 --2- 172.21.15.107:0/3680059867 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fed3004f1d0 0x7fed300dcd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.510+0000 7fed36800640 1 -- 172.21.15.107:0/3680059867 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed300504b0 msgr2=0x7fed300da6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.510+0000 7fed36800640 1 --2- 172.21.15.107:0/3680059867 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed300504b0 0x7fed300da6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.510+0000 7fed36800640 1 -- 172.21.15.107:0/3680059867 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed38065e30 con 0x7fed300d86d0 2024-08-17T02:24:37.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.510+0000 7fed36800640 1 --2- 172.21.15.107:0/3680059867 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed300d86d0 0x7fed300dabe0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fed2800cb60 tx=0x7fed280019d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:37.513 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.511+0000 7fed35e00640 1 --2- 172.21.15.107:0/3680059867 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fed3004f1d0 0x7fed300dcd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:37.513 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.511+0000 7fed35400640 1 --2- 172.21.15.107:0/3680059867 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed300504b0 0x7fed300da6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:37.513 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.512+0000 7fed2d600640 1 -- 172.21.15.107:0/3680059867 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2800a640 con 0x7fed300d86d0 2024-08-17T02:24:37.513 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.512+0000 7fed2d600640 1 -- 172.21.15.107:0/3680059867 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed2800a7a0 con 0x7fed300d86d0 2024-08-17T02:24:37.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.512+0000 7fed2d600640 1 -- 172.21.15.107:0/3680059867 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2800ab20 con 0x7fed300d86d0 2024-08-17T02:24:37.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.512+0000 7fed3d200640 1 -- 172.21.15.107:0/3680059867 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed30037c30 con 0x7fed300d86d0 2024-08-17T02:24:37.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.513+0000 7fed3d200640 1 -- 172.21.15.107:0/3680059867 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed300c1230 con 0x7fed300d86d0 2024-08-17T02:24:37.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.516+0000 7fed2d600640 1 -- 172.21.15.107:0/3680059867 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fed2801b400 con 0x7fed300d86d0 2024-08-17T02:24:37.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.518+0000 7fed2d600640 1 --2- 172.21.15.107:0/3680059867 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fed14065220 0x7fed140676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.519+0000 7fed2d600640 1 -- 172.21.15.107:0/3680059867 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fed28081fe0 con 0x7fed300d86d0 2024-08-17T02:24:37.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.519+0000 7fed35e00640 1 --2- 172.21.15.107:0/3680059867 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fed14065220 0x7fed140676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.521+0000 7fed35e00640 1 --2- 172.21.15.107:0/3680059867 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fed14065220 0x7fed140676d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fed380649d0 tx=0x7fed380ab000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:37.527 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.522+0000 7fed3d200640 1 -- 172.21.15.107:0/3680059867 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed30005320 con 0x7fed300d86d0 2024-08-17T02:24:37.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.532+0000 7fed2d600640 1 -- 172.21.15.107:0/3680059867 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fed28050200 con 0x7fed300d86d0 2024-08-17T02:24:37.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.570+0000 7fd1cf000640 1 Processor -- start 2024-08-17T02:24:37.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.570+0000 7fd1cf000640 1 -- start start 2024-08-17T02:24:37.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.572+0000 7fd1cf000640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd1c00e5eb0 0x7fd1c00e6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.574 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.572+0000 7fd1cf000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd1c0033f00 0x7fd1c00063e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.574 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.572+0000 7fd1cf000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1c004fbe0 con 0x7fd1c0033a80 2024-08-17T02:24:37.574 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.572+0000 7fd1cf000640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1c0051210 con 0x7fd1c00e5eb0 2024-08-17T02:24:37.574 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.572+0000 7fd1cf000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c0005f50 con 0x7fd1c0033f00 2024-08-17T02:24:37.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.573+0000 7fd1c7400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fd1c0033a80 0x7fd1c00e5090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:33866/0 (socket says 172.21.15.107:33866) 2024-08-17T02:24:37.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.573+0000 7fd1c7e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd1c00e5eb0 0x7fd1c00e6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.573+0000 7fd1c7e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd1c00e5eb0 0x7fd1c00e6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:57764/0 (socket says 172.21.15.107:57764) 2024-08-17T02:24:37.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.574+0000 7fd1c7e00640 1 -- 172.21.15.107:0/3472300203 learned_addr learned my addr 172.21.15.107:0/3472300203 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:37.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.575+0000 7fd1cd000640 1 --2- 172.21.15.107:0/3472300203 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd1c0033f00 0x7fd1c00063e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.575+0000 7fd1c6a00640 1 -- 172.21.15.107:0/3472300203 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 950177699 0 0) 0x7fd1c004fbe0 con 0x7fd1c0033a80 2024-08-17T02:24:37.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.575+0000 7fd1c6a00640 1 -- 172.21.15.107:0/3472300203 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1b00034e0 con 0x7fd1c0033a80 2024-08-17T02:24:37.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.576+0000 7fd1cd000640 1 -- 172.21.15.107:0/3472300203 >> v2:172.21.15.157:3300/0 conn(0x7fd1c00e5eb0 msgr2=0x7fd1c00e6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:37.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.576+0000 7fd1cd000640 1 --2- 172.21.15.107:0/3472300203 >> v2:172.21.15.157:3300/0 conn(0x7fd1c00e5eb0 0x7fd1c00e6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.576+0000 7fd1cd000640 1 -- 172.21.15.107:0/3472300203 >> v1:172.21.15.107:6789/0 conn(0x7fd1c0033a80 legacy=0x7fd1c00e5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.576+0000 7fd1cd000640 1 -- 172.21.15.107:0/3472300203 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c004fe30 con 0x7fd1c0033f00 2024-08-17T02:24:37.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.578+0000 7fd1cd000640 1 --2- 172.21.15.107:0/3472300203 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd1c0033f00 0x7fd1c00063e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4009850 tx=0x7fd1b40090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1d8413fb1e9b22e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:37.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.578+0000 7fd1c6a00640 1 -- 172.21.15.107:0/3472300203 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b402ab10 con 0x7fd1c0033f00 2024-08-17T02:24:37.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.578+0000 7fd1c6a00640 1 -- 172.21.15.107:0/3472300203 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b402ac70 con 0x7fd1c0033f00 2024-08-17T02:24:37.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.578+0000 7fd1c6a00640 1 -- 172.21.15.107:0/3472300203 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b4032670 con 0x7fd1c0033f00 2024-08-17T02:24:37.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.579+0000 7fd1cf000640 1 -- 172.21.15.107:0/3472300203 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd1c0033f00 msgr2=0x7fd1c00063e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.579+0000 7fd1cf000640 1 --2- 172.21.15.107:0/3472300203 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd1c0033f00 0x7fd1c00063e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4009850 tx=0x7fd1b40090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.580+0000 7fd1cf000640 1 -- 172.21.15.107:0/3472300203 shutdown_connections 2024-08-17T02:24:37.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.580+0000 7fd1cf000640 1 --2- 172.21.15.107:0/3472300203 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd1c0033f00 0x7fd1c00063e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.580+0000 7fd1cf000640 1 --2- 172.21.15.107:0/3472300203 >> v2:172.21.15.157:3300/0 conn(0x7fd1c00e5eb0 0x7fd1c00e6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.580+0000 7fd1cf000640 1 -- 172.21.15.107:0/3472300203 >> 172.21.15.107:0/3472300203 conn(0x7fd1c0051600 msgr2=0x7fd1c0051a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:37.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.580+0000 7f2deca00640 1 Processor -- start 2024-08-17T02:24:37.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.580+0000 7fd1cf000640 1 -- 172.21.15.107:0/3472300203 shutdown_connections 2024-08-17T02:24:37.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.580+0000 7f2deca00640 1 -- start start 2024-08-17T02:24:37.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.580+0000 7fd1cf000640 1 -- 172.21.15.107:0/3472300203 wait complete. 2024-08-17T02:24:37.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.582+0000 7f2deca00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2de00e2020 0x7f2de003aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.582+0000 7f2deca00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2de003b3f0 0x7f2de0038b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.582+0000 7f2deca00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2de0039090 0x7f2de00378a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.582+0000 7f2deca00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de0007a30 con 0x7f2de00e2020 2024-08-17T02:24:37.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.582+0000 7f2deca00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de00394f0 con 0x7f2de0039090 2024-08-17T02:24:37.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.582+0000 7f2deca00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de0006e20 con 0x7f2de003b3f0 2024-08-17T02:24:37.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.582+0000 7fd1cf000640 1 Processor -- start 2024-08-17T02:24:37.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.583+0000 7fd1cf000640 1 -- start start 2024-08-17T02:24:37.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.583+0000 7f2de6a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2de003b3f0 0x7f2de0038b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.583+0000 7f2de6a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2de003b3f0 0x7f2de0038b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:54940/0 (socket says 172.21.15.107:54940) 2024-08-17T02:24:37.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.583+0000 7f2de7e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2de0039090 0x7f2de00378a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.583+0000 7f2de7e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2de0039090 0x7f2de00378a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:57776/0 (socket says 172.21.15.107:57776) 2024-08-17T02:24:37.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.584+0000 7f2de7400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2de00e2020 0x7f2de003aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.584+0000 7f2de7e00640 1 -- 172.21.15.107:0/2219433069 learned_addr learned my addr 172.21.15.107:0/2219433069 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:37.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.584+0000 7f2de7400640 1 -- 172.21.15.107:0/2219433069 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2de003b3f0 msgr2=0x7f2de0038b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:37.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.584+0000 7f2de7400640 1 --2- 172.21.15.107:0/2219433069 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2de003b3f0 0x7f2de0038b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.584+0000 7f2de7400640 1 -- 172.21.15.107:0/2219433069 >> v2:172.21.15.157:3300/0 conn(0x7f2de0039090 msgr2=0x7f2de00378a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:37.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.584+0000 7f2de7400640 1 --2- 172.21.15.107:0/2219433069 >> v2:172.21.15.157:3300/0 conn(0x7f2de0039090 0x7f2de00378a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.584+0000 7f2de7400640 1 -- 172.21.15.107:0/2219433069 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de0007100 con 0x7f2de00e2020 2024-08-17T02:24:37.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.585+0000 7fd1cf000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd1c0033a80 0x7fd1c00dd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.585+0000 7fd1cf000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1c0033f00 0x7fd1c0039fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.585+0000 7fd1cf000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1c00e5eb0 0x7fd1c00f2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.586+0000 7fd1cf000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c00ddd60 con 0x7fd1c00e5eb0 2024-08-17T02:24:37.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.586+0000 7fd1cd000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1c00e5eb0 0x7fd1c00f2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.586+0000 7fd1cd000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1c00e5eb0 0x7fd1c00f2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60788/0 (socket says 172.21.15.107:60788) 2024-08-17T02:24:37.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.586+0000 7fd1cd000640 1 -- 172.21.15.107:0/3485952214 learned_addr learned my addr 172.21.15.107:0/3485952214 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:37.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.586+0000 7fd1c7e00640 1 --2- 172.21.15.107:0/3485952214 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd1c0033a80 0x7fd1c00dd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.586+0000 7fd1cf000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c0038320 con 0x7fd1c0033f00 2024-08-17T02:24:37.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.586+0000 7fd1c7400640 1 --2- 172.21.15.107:0/3485952214 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1c0033f00 0x7fd1c0039fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.586+0000 7f2de7400640 1 --2- 172.21.15.107:0/2219433069 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2de00e2020 0x7f2de003aeb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2de804c0c0 tx=0x7f2de806f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2e37af01dad1e0f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:37.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.587+0000 7fd1cf000640 1 -- 172.21.15.107:0/3485952214 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c00385c0 con 0x7fd1c0033a80 2024-08-17T02:24:37.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.587+0000 7f2de6000640 1 -- 172.21.15.107:0/2219433069 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de80ac070 con 0x7f2de00e2020 2024-08-17T02:24:37.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.587+0000 7f2de6000640 1 -- 172.21.15.107:0/2219433069 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de80a7440 con 0x7f2de00e2020 2024-08-17T02:24:37.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.587+0000 7f2de6000640 1 -- 172.21.15.107:0/2219433069 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de80a7840 con 0x7f2de00e2020 2024-08-17T02:24:37.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.588+0000 7fd1c7e00640 1 -- 172.21.15.107:0/3485952214 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1c0033f00 msgr2=0x7fd1c0039fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.588+0000 7f2deca00640 1 -- 172.21.15.107:0/2219433069 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2de00e2020 msgr2=0x7f2de003aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.588+0000 7f2deca00640 1 --2- 172.21.15.107:0/2219433069 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2de00e2020 0x7f2de003aeb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2de804c0c0 tx=0x7f2de806f710 comp rx=0 tx=0).stop 2024-08-17T02:24:37.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.588+0000 7fd1c7e00640 1 --2- 172.21.15.107:0/3485952214 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1c0033f00 0x7fd1c0039fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.588+0000 7fd1c7e00640 1 -- 172.21.15.107:0/3485952214 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1c00e5eb0 msgr2=0x7fd1c00f2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.588+0000 7fd1c7e00640 1 --2- 172.21.15.107:0/3485952214 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1c00e5eb0 0x7fd1c00f2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.588+0000 7fd1c7e00640 1 -- 172.21.15.107:0/3485952214 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b4009390 con 0x7fd1c0033a80 2024-08-17T02:24:37.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.588+0000 7f2deca00640 1 -- 172.21.15.107:0/2219433069 shutdown_connections 2024-08-17T02:24:37.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.588+0000 7f2deca00640 1 --2- 172.21.15.107:0/2219433069 >> v2:172.21.15.157:3300/0 conn(0x7f2de0039090 0x7f2de00378a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.588+0000 7f2deca00640 1 --2- 172.21.15.107:0/2219433069 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2de003b3f0 0x7f2de0038b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.588+0000 7f2deca00640 1 --2- 172.21.15.107:0/2219433069 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2de00e2020 0x7f2de003aeb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.588+0000 7f2deca00640 1 -- 172.21.15.107:0/2219433069 >> 172.21.15.107:0/2219433069 conn(0x7f2de000f050 msgr2=0x7f2de0058f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:37.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.588+0000 7fd1cd000640 1 --2- 172.21.15.107:0/3485952214 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1c00e5eb0 0x7fd1c00f2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:37.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.588+0000 7fd1c7400640 1 --2- 172.21.15.107:0/3485952214 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1c0033f00 0x7fd1c0039fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:37.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.589+0000 7fd1c7e00640 1 --2- 172.21.15.107:0/3485952214 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd1c0033a80 0x7fd1c00dd2b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd1c804b670 tx=0x7fd1c8069040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:37.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.589+0000 7fd1bb400640 1 -- 172.21.15.107:0/3485952214 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c808f430 con 0x7fd1c0033a80 2024-08-17T02:24:37.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.589+0000 7fd1cf000640 1 -- 172.21.15.107:0/3485952214 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c00388a0 con 0x7fd1c0033a80 2024-08-17T02:24:37.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.589+0000 7fd1bb400640 1 -- 172.21.15.107:0/3485952214 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c808f5d0 con 0x7fd1c0033a80 2024-08-17T02:24:37.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.589+0000 7fd1bb400640 1 -- 172.21.15.107:0/3485952214 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c808f990 con 0x7fd1c0033a80 2024-08-17T02:24:37.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.589+0000 7fd1cf000640 1 -- 172.21.15.107:0/3485952214 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1c004d700 con 0x7fd1c0033a80 2024-08-17T02:24:37.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.589+0000 7f2deca00640 1 -- 172.21.15.107:0/2219433069 shutdown_connections 2024-08-17T02:24:37.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.589+0000 7f2deca00640 1 -- 172.21.15.107:0/2219433069 wait complete. 2024-08-17T02:24:37.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.591+0000 7fd1cf000640 1 -- 172.21.15.107:0/3485952214 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1c004d920 con 0x7fd1c0033a80 2024-08-17T02:24:37.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.591+0000 7f2deca00640 1 Processor -- start 2024-08-17T02:24:37.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.592+0000 7f2deca00640 1 -- start start 2024-08-17T02:24:37.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.592+0000 7fce97e00640 1 Processor -- start 2024-08-17T02:24:37.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.592+0000 7fce97e00640 1 -- start start 2024-08-17T02:24:37.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.593+0000 7f2deca00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2de0039090 0x7f2de004cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.593+0000 7f2deca00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2de003b3f0 0x7f2de0054730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.593+0000 7f2deca00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2de00e2020 0x7f2de00e11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.593+0000 7f2deca00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de00e31a0 con 0x7f2de00e2020 2024-08-17T02:24:37.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.593+0000 7f2deca00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de00e2590 con 0x7f2de003b3f0 2024-08-17T02:24:37.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.593+0000 7f2deca00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de00e2870 con 0x7f2de0039090 2024-08-17T02:24:37.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.594+0000 7fce97e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fce98155900 0x7fce98155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.594+0000 7f2de6a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2de003b3f0 0x7f2de0054730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.594+0000 7f2de6a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2de003b3f0 0x7f2de0054730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:57798/0 (socket says 172.21.15.107:57798) 2024-08-17T02:24:37.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.594+0000 7fce97e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce98157690 con 0x7fce980b0270 2024-08-17T02:24:37.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.594+0000 7fce97e00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce98156a80 con 0x7fce98158b30 2024-08-17T02:24:37.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.594+0000 7fce97e00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce98156d60 con 0x7fce98155900 2024-08-17T02:24:37.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.595+0000 7fce8e000640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fce980b0270 0x7fce98156210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:33876/0 (socket says 172.21.15.107:33876) 2024-08-17T02:24:37.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.594+0000 7f2de6a00640 1 -- 172.21.15.107:0/3609588811 learned_addr learned my addr 172.21.15.107:0/3609588811 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:37.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.595+0000 7fce8e000640 1 -- 172.21.15.107:0/2248384518 learned_addr learned my addr 172.21.15.107:0/2248384518 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:37.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.593+0000 7fd1bb400640 1 -- 172.21.15.107:0/3485952214 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd1c808c4a0 con 0x7fd1c0033a80 2024-08-17T02:24:37.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.595+0000 7fd1bb400640 1 --2- 172.21.15.107:0/3485952214 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd1a80651d0 0x7fd1a8067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.595+0000 7fd1bb400640 1 -- 172.21.15.107:0/3485952214 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd1c80f8d00 con 0x7fd1c0033a80 2024-08-17T02:24:37.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.595+0000 7fe34b200640 1 Processor -- start 2024-08-17T02:24:37.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.595+0000 7fe34b200640 1 -- start start 2024-08-17T02:24:37.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.596+0000 7fd1c7400640 1 --2- 172.21.15.107:0/3485952214 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd1a80651d0 0x7fd1a8067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.596+0000 7f2de7400640 1 --2- 172.21.15.107:0/3609588811 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2de0039090 0x7f2de004cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.596+0000 7fce96000640 1 -- 172.21.15.107:0/2248384518 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1781420714 0 0) 0x7fce98157690 con 0x7fce980b0270 2024-08-17T02:24:37.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.596+0000 7fce96000640 1 -- 172.21.15.107:0/2248384518 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce7c0034e0 con 0x7fce980b0270 2024-08-17T02:24:37.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.596+0000 7fce96a00640 1 --2- 172.21.15.107:0/2248384518 >> v2:172.21.15.157:3300/0 conn(0x7fce98155900 0x7fce98155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.596+0000 7f2de7e00640 1 --2- 172.21.15.107:0/3609588811 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2de00e2020 0x7f2de00e11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.596+0000 7f2de6a00640 1 -- 172.21.15.107:0/3609588811 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2de0039090 msgr2=0x7f2de004cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.596+0000 7f2de6a00640 1 --2- 172.21.15.107:0/3609588811 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2de0039090 0x7f2de004cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.596+0000 7f2de6a00640 1 -- 172.21.15.107:0/3609588811 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2de00e2020 msgr2=0x7f2de00e11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.597+0000 7fce96000640 1 -- 172.21.15.107:0/2248384518 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1555626727 0 0) 0x7fce7c0034e0 con 0x7fce980b0270 2024-08-17T02:24:37.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.597+0000 7f2de6a00640 1 --2- 172.21.15.107:0/3609588811 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2de00e2020 0x7f2de00e11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.597+0000 7f2de6a00640 1 -- 172.21.15.107:0/3609588811 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de804c200 con 0x7f2de003b3f0 2024-08-17T02:24:37.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.597+0000 7fe34b200640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe3440ae330 0x7fe3440aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.597+0000 7fe34b200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe344165d20 0x7fe344069ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.597+0000 7fe34b200640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe344166b00 con 0x7fe34406a410 2024-08-17T02:24:37.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.597+0000 7fe34b200640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe34406a890 con 0x7fe3440ae330 2024-08-17T02:24:37.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.597+0000 7fe34b200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe34406eac0 con 0x7fe344165d20 2024-08-17T02:24:37.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.597+0000 7f2de7e00640 1 --2- 172.21.15.107:0/3609588811 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2de00e2020 0x7f2de00e11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:37.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.597+0000 7fe343e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe3440ae330 0x7fe3440aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.597+0000 7fce96000640 1 -- 172.21.15.107:0/2248384518 >> v2:172.21.15.157:3300/0 conn(0x7fce98155900 msgr2=0x7fce98155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:37.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.597+0000 7fce96000640 1 --2- 172.21.15.107:0/2248384518 >> v2:172.21.15.157:3300/0 conn(0x7fce98155900 0x7fce98155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.597+0000 7fce96000640 1 -- 172.21.15.107:0/2248384518 >> v1:172.21.15.157:6789/0 conn(0x7fce98158b30 legacy=0x7fce980ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.597+0000 7fce96000640 1 -- 172.21.15.107:0/2248384518 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce98157040 con 0x7fce980b0270 2024-08-17T02:24:37.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.597+0000 7fce96000640 1 -- 172.21.15.107:0/2248384518 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 537989081 0 0) 0x7fce880017f0 con 0x7fce980b0270 2024-08-17T02:24:37.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.597+0000 7fe343e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe3440ae330 0x7fe3440aea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:57808/0 (socket says 172.21.15.107:57808) 2024-08-17T02:24:37.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.597+0000 7fe343e00640 1 -- 172.21.15.107:0/1391245623 learned_addr learned my addr 172.21.15.107:0/1391245623 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:37.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.597+0000 7fce96000640 1 -- 172.21.15.107:0/2248384518 >> v1:172.21.15.107:6789/0 conn(0x7fce980b0270 legacy=0x7fce98156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.597+0000 7fce96000640 1 --2- 172.21.15.107:0/2248384518 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fce7c0039d0 0x7fce7c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.597+0000 7fce96000640 1 --2- 172.21.15.107:0/2248384518 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce7c0042e0 0x7fce7c004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.597+0000 7fce96000640 1 --2- 172.21.15.107:0/2248384518 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce7c004f60 0x7fce7c00ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.597+0000 7fce96000640 1 -- 172.21.15.107:0/2248384518 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce98156d60 con 0x7fce7c004f60 2024-08-17T02:24:37.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.597+0000 7fce96000640 1 -- 172.21.15.107:0/2248384518 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c010520 con 0x7fce7c0042e0 2024-08-17T02:24:37.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.597+0000 7fce96000640 1 -- 172.21.15.107:0/2248384518 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c010660 con 0x7fce7c0039d0 2024-08-17T02:24:37.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.598+0000 7fe343e00640 1 -- 172.21.15.107:0/1391245623 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe344165d20 msgr2=0x7fe344069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:37.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.598+0000 7fce97400640 1 --2- 172.21.15.107:0/2248384518 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce7c004f60 0x7fce7c00ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.598+0000 7fd1c7400640 1 --2- 172.21.15.107:0/3485952214 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd1a80651d0 0x7fd1a8067680 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd1c004c000 tx=0x7fd1bc007cd0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:37.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.598+0000 7f2de6a00640 1 --2- 172.21.15.107:0/3609588811 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2de003b3f0 0x7f2de0054730 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2dd400d890 tx=0x7f2dd4008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:37.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.598+0000 7fe343400640 1 --2- 172.21.15.107:0/1391245623 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe344165d20 0x7fe344069ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.598+0000 7fce96a00640 1 --2- 172.21.15.107:0/2248384518 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fce7c0039d0 0x7fce7c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.598+0000 7fe343e00640 1 --2- 172.21.15.107:0/1391245623 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe344165d20 0x7fe344069ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.598+0000 7fe343e00640 1 -- 172.21.15.107:0/1391245623 >> v1:172.21.15.157:6789/0 conn(0x7fe34406a410 legacy=0x7fe344166f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.598+0000 7fe342a00640 1 -- 172.21.15.107:0/1391245623 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 864041891 0 0) 0x7fe344166b00 con 0x7fe34406a410 2024-08-17T02:24:37.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.598+0000 7fe343e00640 1 -- 172.21.15.107:0/1391245623 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3440af0b0 con 0x7fe3440ae330 2024-08-17T02:24:37.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.598+0000 7fce97400640 1 -- 172.21.15.107:0/2248384518 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fce7c0039d0 msgr2=0x7fce7c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:37.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.598+0000 7fce97400640 1 --2- 172.21.15.107:0/2248384518 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fce7c0039d0 0x7fce7c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.598+0000 7fce97400640 1 -- 172.21.15.107:0/2248384518 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce7c0042e0 msgr2=0x7fce7c004780 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:24:37.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.598+0000 7fce97400640 1 --2- 172.21.15.107:0/2248384518 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce7c0042e0 0x7fce7c004780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.598+0000 7f2ddaa00640 1 -- 172.21.15.107:0/3609588811 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd400de20 con 0x7f2de003b3f0 2024-08-17T02:24:37.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.598+0000 7fce97400640 1 -- 172.21.15.107:0/2248384518 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce98157040 con 0x7fce7c004f60 2024-08-17T02:24:37.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.598+0000 7fe343400640 1 --2- 172.21.15.107:0/1391245623 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe344165d20 0x7fe344069ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:37.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.599+0000 7fce96a00640 1 --2- 172.21.15.107:0/2248384518 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fce7c0039d0 0x7fce7c003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:37.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.599+0000 7f2ddaa00640 1 -- 172.21.15.107:0/3609588811 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd400b8d0 con 0x7f2de003b3f0 2024-08-17T02:24:37.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.599+0000 7f2ddaa00640 1 -- 172.21.15.107:0/3609588811 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd400bc70 con 0x7f2de003b3f0 2024-08-17T02:24:37.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.599+0000 7fce97400640 1 -- 172.21.15.107:0/2248384518 reap_dead start 2024-08-17T02:24:37.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.600+0000 7f4f39600640 1 Processor -- start 2024-08-17T02:24:37.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.600+0000 7f4f39600640 1 -- start start 2024-08-17T02:24:37.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.600+0000 7f2deca00640 1 -- 172.21.15.107:0/3609588811 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2de00e2b50 con 0x7f2de003b3f0 2024-08-17T02:24:37.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.600+0000 7f2deca00640 1 -- 172.21.15.107:0/3609588811 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2de004d1c0 con 0x7f2de003b3f0 2024-08-17T02:24:37.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.600+0000 7fce97400640 1 --2- 172.21.15.107:0/2248384518 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce7c004f60 0x7fce7c00ffe0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fce90001960 tx=0x7fce90007c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b9b2a42417c57d2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:37.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.601+0000 7fce96000640 1 -- 172.21.15.107:0/2248384518 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9002aab0 con 0x7fce7c004f60 2024-08-17T02:24:37.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.601+0000 7f4f39600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4f340b1120 0x7f4f340aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.601+0000 7f4f39600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f340d0ab0 con 0x7f4f340b3370 2024-08-17T02:24:37.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.601+0000 7f4f39600640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f340b00c0 con 0x7f4f340ada10 2024-08-17T02:24:37.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.601+0000 7f4f39600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f340af330 con 0x7f4f340b1120 2024-08-17T02:24:37.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.602+0000 7f482de00640 1 Processor -- start 2024-08-17T02:24:37.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.602+0000 7fd1bb400640 1 -- 172.21.15.107:0/3485952214 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd1c80c6e90 con 0x7fd1c0033a80 2024-08-17T02:24:37.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.601+0000 7fce96000640 1 -- 172.21.15.107:0/2248384518 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce9002ac10 con 0x7fce7c004f60 2024-08-17T02:24:37.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.601+0000 7fce96000640 1 -- 172.21.15.107:0/2248384518 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce90033470 con 0x7fce7c004f60 2024-08-17T02:24:37.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.602+0000 7f482de00640 1 -- start start 2024-08-17T02:24:37.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.602+0000 7fce97e00640 1 -- 172.21.15.107:0/2248384518 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce7c004f60 msgr2=0x7fce7c00ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.602+0000 7fce97e00640 1 --2- 172.21.15.107:0/2248384518 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce7c004f60 0x7fce7c00ffe0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fce90001960 tx=0x7fce90007c40 comp rx=0 tx=0).stop 2024-08-17T02:24:37.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.602+0000 7f4f32000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4f340b1120 0x7f4f340aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.602+0000 7f4f33400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f4f340b3370 0x7f4f341629e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:33880/0 (socket says 172.21.15.107:33880) 2024-08-17T02:24:37.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.602+0000 7f4f33400640 1 -- 172.21.15.107:0/1035639755 learned_addr learned my addr 172.21.15.107:0/1035639755 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:37.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.602+0000 7fe343e00640 1 --2- 172.21.15.107:0/1391245623 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3440ae330 0x7fe3440aea20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe334009910 tx=0x7fe3340091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf4445cbb976625a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:37.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.603+0000 7f1456800640 1 Processor -- start 2024-08-17T02:24:37.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.602+0000 7fce97e00640 1 -- 172.21.15.107:0/2248384518 shutdown_connections 2024-08-17T02:24:37.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.603+0000 7fce97e00640 1 --2- 172.21.15.107:0/2248384518 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce7c004f60 0x7fce7c00ffe0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.603+0000 7f2ddaa00640 1 -- 172.21.15.107:0/3609588811 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2dd4014640 con 0x7f2de003b3f0 2024-08-17T02:24:37.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.603+0000 7fce97e00640 1 -- 172.21.15.107:0/2248384518 >> 172.21.15.107:0/2248384518 conn(0x7fce98067750 msgr2=0x7fce980cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:37.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.603+0000 7fce97e00640 1 -- 172.21.15.107:0/2248384518 shutdown_connections 2024-08-17T02:24:37.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.603+0000 7fe342a00640 1 -- 172.21.15.107:0/1391245623 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33402ae40 con 0x7fe3440ae330 2024-08-17T02:24:37.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.603+0000 7fce97e00640 1 -- 172.21.15.107:0/2248384518 wait complete. 2024-08-17T02:24:37.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.603+0000 7fe342a00640 1 -- 172.21.15.107:0/1391245623 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe334032440 con 0x7fe3440ae330 2024-08-17T02:24:37.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.603+0000 7fe342a00640 1 -- 172.21.15.107:0/1391245623 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe334032820 con 0x7fe3440ae330 2024-08-17T02:24:37.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.603+0000 7f4f32000640 1 -- 172.21.15.107:0/1035639755 >> v1:172.21.15.157:6789/0 conn(0x7f4f340ada10 legacy=0x7f4f340b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.604+0000 7f2deca00640 1 -- 172.21.15.107:0/3609588811 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2de0005770 con 0x7f2de003b3f0 2024-08-17T02:24:37.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.604+0000 7f2ddaa00640 1 --2- 172.21.15.107:0/3609588811 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f2dc8065150 0x7f2dc8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.604+0000 7f2ddaa00640 1 -- 172.21.15.107:0/3609588811 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2dd4082a80 con 0x7f2de003b3f0 2024-08-17T02:24:37.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.604+0000 7f482de00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4828159060 0x7f48280c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.604+0000 7f482de00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4828159430 0x7f48280cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.604+0000 7f482de00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48280cbf40 con 0x7f48280c6a30 2024-08-17T02:24:37.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.604+0000 7f482de00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48280cb930 con 0x7f4828159430 2024-08-17T02:24:37.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.604+0000 7f482de00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48280ced10 con 0x7f4828159060 2024-08-17T02:24:37.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.604+0000 7f4826a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4828159060 0x7f48280c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.604+0000 7f4826a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4828159060 0x7f48280c6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:54990/0 (socket says 172.21.15.107:54990) 2024-08-17T02:24:37.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.604+0000 7f4826a00640 1 -- 172.21.15.107:0/3867346126 learned_addr learned my addr 172.21.15.107:0/3867346126 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:37.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.604+0000 7f4f31600640 1 -- 172.21.15.107:0/1035639755 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3871086533 0 0) 0x7f4f340b00c0 con 0x7f4f340ada10 2024-08-17T02:24:37.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.604+0000 7f4f32000640 1 -- 172.21.15.107:0/1035639755 >> v1:172.21.15.107:6789/0 conn(0x7f4f340b3370 legacy=0x7f4f341629e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.604+0000 7f4f32000640 1 -- 172.21.15.107:0/1035639755 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f340b0360 con 0x7f4f340b1120 2024-08-17T02:24:37.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.605+0000 7f4826a00640 1 -- 172.21.15.107:0/3867346126 >> v2:172.21.15.107:3300/0 conn(0x7f4828159430 msgr2=0x7f48280cb2d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:24:37.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.605+0000 7f4826a00640 1 --2- 172.21.15.107:0/3867346126 >> v2:172.21.15.107:3300/0 conn(0x7f4828159430 0x7f48280cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.605+0000 7f4826a00640 1 -- 172.21.15.107:0/3867346126 >> v1:172.21.15.107:6789/0 conn(0x7f48280c6a30 legacy=0x7f48280cabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:37.621 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.605+0000 7f4f32000640 1 --2- 172.21.15.107:0/1035639755 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f340b1120 0x7f4f340aedf0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c009850 tx=0x7f4f1c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5122d332464f0aa server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:37.621 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.603+0000 7f1456800640 1 -- start start 2024-08-17T02:24:37.621 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.605+0000 7fe34b200640 1 -- 172.21.15.107:0/1391245623 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3440ae330 msgr2=0x7fe3440aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.621 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.605+0000 7f1456800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f145015d830 0x7f145006e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.605+0000 7f1456800640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f14500b0610 0x7f145015dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.605+0000 7f1456800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f145015e140 0x7f145015e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.605+0000 7f1456800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14500b1b20 con 0x7f145015e140 2024-08-17T02:24:37.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.605+0000 7f1456800640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14500b1690 con 0x7f14500b0610 2024-08-17T02:24:37.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.605+0000 7f1456800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14500ae4a0 con 0x7f145015d830 2024-08-17T02:24:37.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.606+0000 7fe34b200640 1 --2- 172.21.15.107:0/1391245623 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3440ae330 0x7fe3440aea20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe334009910 tx=0x7fe3340091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.623 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.606+0000 7f4f31600640 1 -- 172.21.15.107:0/1035639755 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c02ae40 con 0x7f4f340b1120 2024-08-17T02:24:37.623 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.606+0000 7f4f31600640 1 -- 172.21.15.107:0/1035639755 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1c032440 con 0x7f4f340b1120 2024-08-17T02:24:37.623 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.606+0000 7f4f31600640 1 -- 172.21.15.107:0/1035639755 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c032820 con 0x7f4f340b1120 2024-08-17T02:24:37.623 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.605+0000 7f2de7400640 1 --2- 172.21.15.107:0/3609588811 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f2dc8065150 0x7f2dc8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.624 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.606+0000 7fce97e00640 1 Processor -- start 2024-08-17T02:24:37.624 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.606+0000 7fce97e00640 1 -- start start 2024-08-17T02:24:37.624 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.606+0000 7f144f400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f145015d830 0x7f145006e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.624 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.606+0000 7fe34b200640 1 -- 172.21.15.107:0/1391245623 shutdown_connections 2024-08-17T02:24:37.624 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.606+0000 7fe34b200640 1 --2- 172.21.15.107:0/1391245623 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe344165d20 0x7fe344069ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.606+0000 7fe34b200640 1 --2- 172.21.15.107:0/1391245623 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3440ae330 0x7fe3440aea20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.606+0000 7f144f400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f145015d830 0x7f145006e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:55006/0 (socket says 172.21.15.107:55006) 2024-08-17T02:24:37.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.606+0000 7f144f400640 1 -- 172.21.15.107:0/1757884923 learned_addr learned my addr 172.21.15.107:0/1757884923 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:37.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.606+0000 7f4826a00640 1 -- 172.21.15.107:0/3867346126 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48280cbbd0 con 0x7f4828159060 2024-08-17T02:24:37.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.606+0000 7f4f39600640 1 -- 172.21.15.107:0/1035639755 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f340b1120 msgr2=0x7f4f340aedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.606+0000 7f4f39600640 1 --2- 172.21.15.107:0/1035639755 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f340b1120 0x7f4f340aedf0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c009850 tx=0x7f4f1c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.626 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.606+0000 7fe34b200640 1 -- 172.21.15.107:0/1391245623 >> 172.21.15.107:0/1391245623 conn(0x7fe3440cc480 msgr2=0x7fe3440687b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:37.626 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.607+0000 7f4f39600640 1 -- 172.21.15.107:0/1035639755 shutdown_connections 2024-08-17T02:24:37.626 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.607+0000 7f4f39600640 1 --2- 172.21.15.107:0/1035639755 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f340b1120 0x7f4f340aedf0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.627 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.607+0000 7f4f39600640 1 -- 172.21.15.107:0/1035639755 >> 172.21.15.107:0/1035639755 conn(0x7f4f340cfdf0 msgr2=0x7f4f340d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:37.627 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.607+0000 7f4f39600640 1 -- 172.21.15.107:0/1035639755 shutdown_connections 2024-08-17T02:24:37.627 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.607+0000 7f4f39600640 1 -- 172.21.15.107:0/1035639755 wait complete. 2024-08-17T02:24:37.627 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.607+0000 7f144f400640 1 -- 172.21.15.107:0/1757884923 >> v2:172.21.15.157:3300/0 conn(0x7f14500b0610 msgr2=0x7f145015dc00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:24:37.627 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.607+0000 7f144f400640 1 --2- 172.21.15.107:0/1757884923 >> v2:172.21.15.157:3300/0 conn(0x7f14500b0610 0x7f145015dc00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.627 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.607+0000 7f144f400640 1 -- 172.21.15.107:0/1757884923 >> v2:172.21.15.107:3300/0 conn(0x7f145015e140 msgr2=0x7f145015e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:37.628 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.607+0000 7f144f400640 1 --2- 172.21.15.107:0/1757884923 >> v2:172.21.15.107:3300/0 conn(0x7f145015e140 0x7f145015e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.628 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.607+0000 7f144f400640 1 -- 172.21.15.107:0/1757884923 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f145015b200 con 0x7f145015d830 2024-08-17T02:24:37.628 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.608+0000 7f2de7400640 1 --2- 172.21.15.107:0/3609588811 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f2dc8065150 0x7f2dc8067600 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2de0011ca0 tx=0x7f2de80aa000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:37.628 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.608+0000 7fce97e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fce7c004f60 0x7fce980c1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.629 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.608+0000 7fe34b200640 1 -- 172.21.15.107:0/1391245623 shutdown_connections 2024-08-17T02:24:37.629 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.608+0000 7fe34b200640 1 -- 172.21.15.107:0/1391245623 wait complete. 2024-08-17T02:24:37.629 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.608+0000 7fce97e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce980a8e60 0x7fce980ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.629 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.609+0000 7f4f39600640 1 Processor -- start 2024-08-17T02:24:37.629 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.608+0000 7f4826a00640 1 --2- 172.21.15.107:0/3867346126 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4828159060 0x7f48280c6e90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4818009910 tx=0x7f48180091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ad6f429e115c7fa server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:37.630 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.609+0000 7f4f39600640 1 -- start start 2024-08-17T02:24:37.630 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.609+0000 7f4825600640 1 -- 172.21.15.107:0/3867346126 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481802ad20 con 0x7f4828159060 2024-08-17T02:24:37.630 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.609+0000 7f4825600640 1 -- 172.21.15.107:0/3867346126 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f481802ae80 con 0x7f4828159060 2024-08-17T02:24:37.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.609+0000 7fce8e000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce980a8e60 0x7fce980ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.610+0000 7f144f400640 1 --2- 172.21.15.107:0/1757884923 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f145015d830 0x7f145006e1b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f145006c4d0 tx=0x7f1448009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=575826f8db6e0f2b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:37.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.610+0000 7fce97e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce98167b30 0x7fce98167f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.610+0000 7fce97e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce980aae00 con 0x7fce980a8e60 2024-08-17T02:24:37.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.609+0000 7f4825600640 1 -- 172.21.15.107:0/3867346126 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4818032670 con 0x7f4828159060 2024-08-17T02:24:37.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.610+0000 7f144e000640 1 -- 172.21.15.107:0/1757884923 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1448007400 con 0x7f145015d830 2024-08-17T02:24:37.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.610+0000 7fce96a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fce7c004f60 0x7fce980c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.610+0000 7f4f39600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f340ada10 0x7f4f340cd070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.610+0000 7f144e000640 1 -- 172.21.15.107:0/1757884923 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1448007560 con 0x7f145015d830 2024-08-17T02:24:37.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.610+0000 7f144e000640 1 -- 172.21.15.107:0/1757884923 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1448007400 con 0x7f145015d830 2024-08-17T02:24:37.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.610+0000 7f4f39600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f340b1120 0x7f4f3406d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.610+0000 7fce97400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce98167b30 0x7fce98167f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.634 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.610+0000 7fce97400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce98167b30 0x7fce98167f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:57822/0 (socket says 172.21.15.107:57822) 2024-08-17T02:24:37.634 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.610+0000 7fce97400640 1 -- 172.21.15.107:0/1209548648 learned_addr learned my addr 172.21.15.107:0/1209548648 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:37.634 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.610+0000 7fce96a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fce7c004f60 0x7fce980c1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:55016/0 (socket says 172.21.15.107:55016) 2024-08-17T02:24:37.634 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.610+0000 7f4f39600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f340b3370 0x7f4f3409c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.634 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.610+0000 7f4f39600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f340cda30 con 0x7f4f340b3370 2024-08-17T02:24:37.634 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.610+0000 7f4f39600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f340cdd10 con 0x7f4f340b1120 2024-08-17T02:24:37.634 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.610+0000 7f4f39600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f340cdff0 con 0x7f4f340ada10 2024-08-17T02:24:37.635 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.610+0000 7f482de00640 1 -- 172.21.15.107:0/3867346126 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4828159060 msgr2=0x7f48280c6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.635 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.610+0000 7f482de00640 1 --2- 172.21.15.107:0/3867346126 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4828159060 0x7f48280c6e90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4818009910 tx=0x7f48180091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.635 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.610+0000 7f4f32a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f340ada10 0x7f4f340cd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.635 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.611+0000 7f4f32a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f340ada10 0x7f4f340cd070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:55022/0 (socket says 172.21.15.107:55022) 2024-08-17T02:24:37.635 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.611+0000 7f4f32a00640 1 -- 172.21.15.107:0/2526054443 learned_addr learned my addr 172.21.15.107:0/2526054443 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:37.635 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.611+0000 7f4f32000640 1 --2- 172.21.15.107:0/2526054443 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f340b1120 0x7f4f3406d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.636 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.611+0000 7f482de00640 1 -- 172.21.15.107:0/3867346126 shutdown_connections 2024-08-17T02:24:37.636 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.611+0000 7fe34b200640 1 Processor -- start 2024-08-17T02:24:37.636 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.611+0000 7f482de00640 1 --2- 172.21.15.107:0/3867346126 >> v2:172.21.15.107:3300/0 conn(0x7f4828159430 0x7f48280cb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.611+0000 7f482de00640 1 --2- 172.21.15.107:0/3867346126 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4828159060 0x7f48280c6e90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.611+0000 7f4f33400640 1 --2- 172.21.15.107:0/2526054443 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f340b3370 0x7f4f3409c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.611+0000 7f482de00640 1 -- 172.21.15.107:0/3867346126 >> 172.21.15.107:0/3867346126 conn(0x7f48280cfde0 msgr2=0x7f48280d01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:37.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.611+0000 7fe34b200640 1 -- start start 2024-08-17T02:24:37.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.611+0000 7f482de00640 1 -- 172.21.15.107:0/3867346126 shutdown_connections 2024-08-17T02:24:37.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.611+0000 7f4f32000640 1 -- 172.21.15.107:0/2526054443 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f340ada10 msgr2=0x7f4f340cd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.611+0000 7f4f32000640 1 --2- 172.21.15.107:0/2526054443 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f340ada10 0x7f4f340cd070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.611+0000 7f4f32000640 1 -- 172.21.15.107:0/2526054443 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f340b3370 msgr2=0x7f4f3409c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.611+0000 7f4f32000640 1 --2- 172.21.15.107:0/2526054443 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f340b3370 0x7f4f3409c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.611+0000 7f4f32000640 1 -- 172.21.15.107:0/2526054443 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f1c009390 con 0x7f4f340b1120 2024-08-17T02:24:37.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.611+0000 7fce97e00640 1 -- 172.21.15.107:0/1209548648 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce981684a0 con 0x7fce98167b30 2024-08-17T02:24:37.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.611+0000 7fce97e00640 1 -- 172.21.15.107:0/1209548648 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce980c1770 con 0x7fce7c004f60 2024-08-17T02:24:37.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.612+0000 7f4f32000640 1 --2- 172.21.15.107:0/2526054443 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f340b1120 0x7f4f3406d9a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c031000 tx=0x7f4f1c032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:37.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.612+0000 7f4f2a000640 1 -- 172.21.15.107:0/2526054443 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c031b30 con 0x7f4f340b1120 2024-08-17T02:24:37.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.611+0000 7f1456800640 1 -- 172.21.15.107:0/1757884923 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f145015d830 msgr2=0x7f145006e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.612+0000 7f4f2a000640 1 -- 172.21.15.107:0/2526054443 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1c031cb0 con 0x7f4f340b1120 2024-08-17T02:24:37.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.612+0000 7f4f2a000640 1 -- 172.21.15.107:0/2526054443 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c03c660 con 0x7f4f340b1120 2024-08-17T02:24:37.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.612+0000 7f1456800640 1 --2- 172.21.15.107:0/1757884923 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f145015d830 0x7f145006e1b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f145006c4d0 tx=0x7f1448009840 comp rx=0 tx=0).stop 2024-08-17T02:24:37.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.613+0000 7f1456800640 1 -- 172.21.15.107:0/1757884923 shutdown_connections 2024-08-17T02:24:37.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.613+0000 7f1456800640 1 --2- 172.21.15.107:0/1757884923 >> v2:172.21.15.107:3300/0 conn(0x7f145015e140 0x7f145015e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.613+0000 7f1456800640 1 --2- 172.21.15.107:0/1757884923 >> v2:172.21.15.157:3300/0 conn(0x7f14500b0610 0x7f145015dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.613+0000 7f1456800640 1 --2- 172.21.15.107:0/1757884923 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f145015d830 0x7f145006e1b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.613+0000 7f1456800640 1 -- 172.21.15.107:0/1757884923 >> 172.21.15.107:0/1757884923 conn(0x7f14500cb9b0 msgr2=0x7f14500cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:37.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.612+0000 7f4f39600640 1 -- 172.21.15.107:0/2526054443 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f340ce2d0 con 0x7f4f340b1120 2024-08-17T02:24:37.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.612+0000 7f4f39600640 1 -- 172.21.15.107:0/2526054443 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f340cd5b0 con 0x7f4f340b1120 2024-08-17T02:24:37.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.613+0000 7fce8e000640 1 -- 172.21.15.107:0/1209548648 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fce7c004f60 msgr2=0x7fce980c1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.611+0000 7f482de00640 1 -- 172.21.15.107:0/3867346126 wait complete. 2024-08-17T02:24:37.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.613+0000 7fce8e000640 1 --2- 172.21.15.107:0/1209548648 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fce7c004f60 0x7fce980c1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.613+0000 7fce8e000640 1 -- 172.21.15.107:0/1209548648 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce98167b30 msgr2=0x7fce98167f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.613+0000 7fce8e000640 1 --2- 172.21.15.107:0/1209548648 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce98167b30 0x7fce98167f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.613+0000 7fce8e000640 1 -- 172.21.15.107:0/1209548648 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce980a9430 con 0x7fce980a8e60 2024-08-17T02:24:37.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.613+0000 7fe34b200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe34406a410 0x7fe3440abff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.613+0000 7fe34b200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3440ae330 0x7fe344153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.613+0000 7fe34b200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe344165d20 0x7fe3440a9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.613+0000 7fe34b200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe344177de0 con 0x7fe34406a410 2024-08-17T02:24:37.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.613+0000 7fe34b200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe344153680 con 0x7fe3440ae330 2024-08-17T02:24:37.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.613+0000 7fe34b200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3440ac600 con 0x7fe344165d20 2024-08-17T02:24:37.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.613+0000 7f1456800640 1 -- 172.21.15.107:0/1757884923 shutdown_connections 2024-08-17T02:24:37.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.613+0000 7fce96a00640 1 --2- 172.21.15.107:0/1209548648 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fce7c004f60 0x7fce980c1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:37.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.613+0000 7f1456800640 1 -- 172.21.15.107:0/1757884923 wait complete. 2024-08-17T02:24:37.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.613+0000 7fce8e000640 1 --2- 172.21.15.107:0/1209548648 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce980a8e60 0x7fce980ca3f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fce8800cd00 tx=0x7fce88007e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:37.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.614+0000 7fe343400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3440ae330 0x7fe344153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.614+0000 7fe349200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe344165d20 0x7fe3440a9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.614+0000 7f482de00640 1 Processor -- start 2024-08-17T02:24:37.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.614+0000 7fe343400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3440ae330 0x7fe344153140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:57834/0 (socket says 172.21.15.107:57834) 2024-08-17T02:24:37.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.614+0000 7fe343400640 1 -- 172.21.15.107:0/3620040672 learned_addr learned my addr 172.21.15.107:0/3620040672 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:37.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.614+0000 7fce8ea00640 1 -- 172.21.15.107:0/1209548648 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8800ce60 con 0x7fce980a8e60 2024-08-17T02:24:37.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.614+0000 7fe343e00640 1 --2- 172.21.15.107:0/3620040672 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe34406a410 0x7fe3440abff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.614+0000 7f482de00640 1 -- start start 2024-08-17T02:24:37.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.614+0000 7fce8ea00640 1 -- 172.21.15.107:0/1209548648 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce88004d30 con 0x7fce980a8e60 2024-08-17T02:24:37.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.614+0000 7fce8ea00640 1 -- 172.21.15.107:0/1209548648 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce88004ea0 con 0x7fce980a8e60 2024-08-17T02:24:37.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.614+0000 7fce97e00640 1 -- 172.21.15.107:0/1209548648 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce980a9710 con 0x7fce980a8e60 2024-08-17T02:24:37.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.615+0000 7fce97e00640 1 -- 172.21.15.107:0/1209548648 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce980a9cd0 con 0x7fce980a8e60 2024-08-17T02:24:37.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.615+0000 7fe343400640 1 -- 172.21.15.107:0/3620040672 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe344165d20 msgr2=0x7fe3440a9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.615+0000 7fe343400640 1 --2- 172.21.15.107:0/3620040672 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe344165d20 0x7fe3440a9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.615+0000 7fe343400640 1 -- 172.21.15.107:0/3620040672 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe34406a410 msgr2=0x7fe3440abff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.614+0000 7f4f39600640 1 -- 172.21.15.107:0/2526054443 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f340ce7d0 con 0x7f4f340b1120 2024-08-17T02:24:37.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.615+0000 7fe343400640 1 --2- 172.21.15.107:0/3620040672 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe34406a410 0x7fe3440abff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.615+0000 7f2ddaa00640 1 -- 172.21.15.107:0/3609588811 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2dd4050b40 con 0x7f2de003b3f0 2024-08-17T02:24:37.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.615+0000 7fe343400640 1 -- 172.21.15.107:0/3620040672 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe334009450 con 0x7fe3440ae330 2024-08-17T02:24:37.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.615+0000 7fe349200640 1 --2- 172.21.15.107:0/3620040672 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe344165d20 0x7fe3440a9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:37.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.615+0000 7fe343e00640 1 --2- 172.21.15.107:0/3620040672 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe34406a410 0x7fe3440abff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:37.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.615+0000 7fe343400640 1 --2- 172.21.15.107:0/3620040672 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3440ae330 0x7fe344153140 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe33000c8b0 tx=0x7fe330008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:37.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.616+0000 7f4f2a000640 1 -- 172.21.15.107:0/2526054443 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4f1c039050 con 0x7f4f340b1120 2024-08-17T02:24:37.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.617+0000 7f1456800640 1 Processor -- start 2024-08-17T02:24:37.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.617+0000 7f482de00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48280c6a30 0x7f4828169240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.617+0000 7f4f2a000640 1 --2- 172.21.15.107:0/2526054443 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4f100652a0 0x7f4f10067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.617+0000 7f4f2a000640 1 -- 172.21.15.107:0/2526054443 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4f1c02ae40 con 0x7f4f340b1120 2024-08-17T02:24:37.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.617+0000 7f482de00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4828159060 0x7f4828068030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.617+0000 7f482de00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4828159430 0x7f4828068570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.617+0000 7f1456800640 1 -- start start 2024-08-17T02:24:37.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.617+0000 7fce97e00640 1 -- 172.21.15.107:0/1209548648 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce70005210 con 0x7fce980a8e60 2024-08-17T02:24:37.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.618+0000 7f4826a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48280c6a30 0x7f4828169240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.618+0000 7f4826a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48280c6a30 0x7f4828169240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:55038/0 (socket says 172.21.15.107:55038) 2024-08-17T02:24:37.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.618+0000 7f4826a00640 1 -- 172.21.15.107:0/2666882077 learned_addr learned my addr 172.21.15.107:0/2666882077 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:37.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.618+0000 7f482de00640 1 -- 172.21.15.107:0/2666882077 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48280b3760 con 0x7f4828159060 2024-08-17T02:24:37.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.618+0000 7f482de00640 1 -- 172.21.15.107:0/2666882077 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4828169780 con 0x7f4828159430 2024-08-17T02:24:37.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.618+0000 7f482de00640 1 -- 172.21.15.107:0/2666882077 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f482815ca10 con 0x7f48280c6a30 2024-08-17T02:24:37.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.618+0000 7f4827400640 1 --2- 172.21.15.107:0/2666882077 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4828159430 0x7f4828068570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.618+0000 7fce8ea00640 1 -- 172.21.15.107:0/1209548648 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fce88007150 con 0x7fce980a8e60 2024-08-17T02:24:37.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.619+0000 7fce8ea00640 1 --2- 172.21.15.107:0/1209548648 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fce74065220 0x7fce740676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.619+0000 7fce8ea00640 1 -- 172.21.15.107:0/1209548648 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fce88081e60 con 0x7fce980a8e60 2024-08-17T02:24:37.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.619+0000 7f1456800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14500b0610 0x7f1450142ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.617+0000 7f4f32a00640 1 --2- 172.21.15.107:0/2526054443 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4f100652a0 0x7f4f10067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.654 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.620+0000 7f1456800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f145015d830 0x7f1450143530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.654 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.620+0000 7f4f32a00640 1 --2- 172.21.15.107:0/2526054443 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4f100652a0 0x7f4f10067750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c001560 tx=0x7f4f2c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:37.654 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.620+0000 7f1456800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f145015e140 0x7f1450143a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.654 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.620+0000 7f144f400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14500b0610 0x7f1450142ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.654 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.620+0000 7f144f400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14500b0610 0x7f1450142ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:55042/0 (socket says 172.21.15.107:55042) 2024-08-17T02:24:37.655 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.620+0000 7f144f400640 1 -- 172.21.15.107:0/3966787923 learned_addr learned my addr 172.21.15.107:0/3966787923 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:37.655 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.620+0000 7f1456800640 1 -- 172.21.15.107:0/3966787923 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14500a5880 con 0x7f145015e140 2024-08-17T02:24:37.655 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.620+0000 7f1456800640 1 -- 172.21.15.107:0/3966787923 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1450149160 con 0x7f145015d830 2024-08-17T02:24:37.655 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.620+0000 7fe33b400640 1 -- 172.21.15.107:0/3620040672 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33000ce40 con 0x7fe3440ae330 2024-08-17T02:24:37.655 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.621+0000 7fe33b400640 1 -- 172.21.15.107:0/3620040672 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe330007890 con 0x7fe3440ae330 2024-08-17T02:24:37.655 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.621+0000 7fe33b400640 1 -- 172.21.15.107:0/3620040672 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe330007c10 con 0x7fe3440ae330 2024-08-17T02:24:37.656 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.620+0000 7f1456800640 1 -- 172.21.15.107:0/3966787923 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1450149440 con 0x7f14500b0610 2024-08-17T02:24:37.656 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.621+0000 7f144ea00640 1 --2- 172.21.15.107:0/3966787923 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f145015d830 0x7f1450143530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.656 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.621+0000 7f4f2a000640 1 -- 172.21.15.107:0/2526054443 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4f1c071200 con 0x7f4f340b1120 2024-08-17T02:24:37.657 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.621+0000 7f144f400640 1 -- 172.21.15.107:0/3966787923 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f145015d830 msgr2=0x7f1450143530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.657 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.621+0000 7f144f400640 1 --2- 172.21.15.107:0/3966787923 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f145015d830 0x7f1450143530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.657 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.621+0000 7f144f400640 1 -- 172.21.15.107:0/3966787923 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f145015e140 msgr2=0x7f1450143a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.657 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.621+0000 7f144f400640 1 --2- 172.21.15.107:0/3966787923 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f145015e140 0x7f1450143a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.657 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.621+0000 7f144f400640 1 -- 172.21.15.107:0/3966787923 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1448009ae0 con 0x7f14500b0610 2024-08-17T02:24:37.657 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.622+0000 7f144f400640 1 --2- 172.21.15.107:0/3966787923 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14500b0610 0x7f1450142ff0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1448009f50 tx=0x7f1448034000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:37.657 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.622+0000 7fce96a00640 1 --2- 172.21.15.107:0/1209548648 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fce74065220 0x7fce740676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.618+0000 7f4826000640 1 --2- 172.21.15.107:0/2666882077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4828159060 0x7f4828068030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.619+0000 7f4827400640 1 -- 172.21.15.107:0/2666882077 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48280c6a30 msgr2=0x7f4828169240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.619+0000 7f4827400640 1 --2- 172.21.15.107:0/2666882077 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48280c6a30 0x7f4828169240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.619+0000 7f4827400640 1 -- 172.21.15.107:0/2666882077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4828159060 msgr2=0x7f4828068030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.622+0000 7f4827400640 1 --2- 172.21.15.107:0/2666882077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4828159060 0x7f4828068030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.622+0000 7f4827400640 1 -- 172.21.15.107:0/2666882077 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4818009450 con 0x7f4828159430 2024-08-17T02:24:37.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.622+0000 7f1446a00640 1 -- 172.21.15.107:0/3966787923 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1448007400 con 0x7f14500b0610 2024-08-17T02:24:37.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.622+0000 7f1446a00640 1 -- 172.21.15.107:0/3966787923 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1448032db0 con 0x7f14500b0610 2024-08-17T02:24:37.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.622+0000 7f4826a00640 1 --2- 172.21.15.107:0/2666882077 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48280c6a30 0x7f4828169240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:37.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.622+0000 7f4826000640 1 --2- 172.21.15.107:0/2666882077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4828159060 0x7f4828068030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:37.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.622+0000 7fe34b200640 1 -- 172.21.15.107:0/3620040672 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3440ac8e0 con 0x7fe3440ae330 2024-08-17T02:24:37.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.622+0000 7f1456800640 1 -- 172.21.15.107:0/3966787923 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1450143fb0 con 0x7f14500b0610 2024-08-17T02:24:37.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.623+0000 7fe34b200640 1 -- 172.21.15.107:0/3620040672 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3440acea0 con 0x7fe3440ae330 2024-08-17T02:24:37.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.622+0000 7f1446a00640 1 -- 172.21.15.107:0/3966787923 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144803d680 con 0x7f14500b0610 2024-08-17T02:24:37.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.625+0000 7f4827400640 1 --2- 172.21.15.107:0/2666882077 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4828159430 0x7f4828068570 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f482000bad0 tx=0x7f4820009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:37.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.622+0000 7f1456800640 1 -- 172.21.15.107:0/3966787923 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1450144530 con 0x7f14500b0610 2024-08-17T02:24:37.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.625+0000 7f481e000640 1 -- 172.21.15.107:0/2666882077 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482000c9b0 con 0x7f4828159430 2024-08-17T02:24:37.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.625+0000 7f481e000640 1 -- 172.21.15.107:0/2666882077 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f482000cb30 con 0x7f4828159430 2024-08-17T02:24:37.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.625+0000 7f481e000640 1 -- 172.21.15.107:0/2666882077 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4820014410 con 0x7f4828159430 2024-08-17T02:24:37.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.625+0000 7f1456800640 1 -- 172.21.15.107:0/3966787923 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1450064db0 con 0x7f14500b0610 2024-08-17T02:24:37.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.626+0000 7f482de00640 1 -- 172.21.15.107:0/2666882077 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48280b2e30 con 0x7f4828159430 2024-08-17T02:24:37.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.626+0000 7fce96a00640 1 --2- 172.21.15.107:0/1209548648 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fce74065220 0x7fce740676d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fce8000bbf0 tx=0x7fce80008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:37.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.626+0000 7fe33b400640 1 -- 172.21.15.107:0/3620040672 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe3300113f0 con 0x7fe3440ae330 2024-08-17T02:24:37.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.627+0000 7fe33b400640 1 --2- 172.21.15.107:0/3620040672 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe324065220 0x7fe3240676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.626+0000 7f482de00640 1 -- 172.21.15.107:0/2666882077 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48280b33f0 con 0x7f4828159430 2024-08-17T02:24:37.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.628+0000 7fe33b400640 1 -- 172.21.15.107:0/3620040672 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe3300822c0 con 0x7fe3440ae330 2024-08-17T02:24:37.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.628+0000 7fe343e00640 1 --2- 172.21.15.107:0/3620040672 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe324065220 0x7fe3240676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.628+0000 7f482de00640 1 -- 172.21.15.107:0/2666882077 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4800005210 con 0x7f4828159430 2024-08-17T02:24:37.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.629+0000 7fe343e00640 1 --2- 172.21.15.107:0/3620040672 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe324065220 0x7fe3240676d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe334034000 tx=0x7fe334032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:37.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.629+0000 7fe34b200640 1 -- 172.21.15.107:0/3620040672 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe344064db0 con 0x7fe3440ae330 2024-08-17T02:24:37.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.630+0000 7f1446a00640 1 -- 172.21.15.107:0/3966787923 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1448003040 con 0x7f14500b0610 2024-08-17T02:24:37.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.631+0000 7fce8ea00640 1 -- 172.21.15.107:0/1209548648 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fce88050130 con 0x7fce980a8e60 2024-08-17T02:24:37.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.631+0000 7f1446a00640 1 --2- 172.21.15.107:0/3966787923 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f1430065150 0x7f1430067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.631+0000 7f481e000640 1 -- 172.21.15.107:0/2666882077 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4820014800 con 0x7f4828159430 2024-08-17T02:24:37.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.632+0000 7f1446a00640 1 -- 172.21.15.107:0/3966787923 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f14480a3780 con 0x7f14500b0610 2024-08-17T02:24:37.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.632+0000 7f144ea00640 1 --2- 172.21.15.107:0/3966787923 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f1430065150 0x7f1430067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.633+0000 7f144ea00640 1 --2- 172.21.15.107:0/3966787923 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f1430065150 0x7f1430067600 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1450144cf0 tx=0x7f1440008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:37.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.633+0000 7f481e000640 1 --2- 172.21.15.107:0/2666882077 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4808065220 0x7f48080676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:37.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.634+0000 7f4826a00640 1 --2- 172.21.15.107:0/2666882077 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4808065220 0x7f48080676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:37.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.634+0000 7fe33b400640 1 -- 172.21.15.107:0/3620040672 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe330053f40 con 0x7fe3440ae330 2024-08-17T02:24:37.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.634+0000 7f481e000640 1 -- 172.21.15.107:0/2666882077 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4820054700 con 0x7f4828159430 2024-08-17T02:24:37.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.636+0000 7f4826a00640 1 --2- 172.21.15.107:0/2666882077 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4808065220 0x7f48080676d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4818003080 tx=0x7f4818032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:37.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.636+0000 7f1446a00640 1 -- 172.21.15.107:0/3966787923 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f14480717a0 con 0x7f14500b0610 2024-08-17T02:24:37.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.640+0000 7f481e000640 1 -- 172.21.15.107:0/2666882077 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4820050340 con 0x7f4828159430 2024-08-17T02:24:37.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.934+0000 7fed3d200640 1 -- 172.21.15.107:0/3680059867 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fed30052f50 con 0x7fed300d86d0 2024-08-17T02:24:37.936 INFO:teuthology.orchestra.run.smithi107.stdout:55834574852 2024-08-17T02:24:37.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.935+0000 7fed2d600640 1 -- 172.21.15.107:0/3680059867 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fed28053820 con 0x7fed300d86d0 2024-08-17T02:24:37.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.938+0000 7fed3d200640 1 -- 172.21.15.107:0/3680059867 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fed14065220 msgr2=0x7fed140676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.938+0000 7fed3d200640 1 --2- 172.21.15.107:0/3680059867 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fed14065220 0x7fed140676d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fed380649d0 tx=0x7fed380ab000 comp rx=0 tx=0).stop 2024-08-17T02:24:37.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.938+0000 7fed3d200640 1 -- 172.21.15.107:0/3680059867 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed300d86d0 msgr2=0x7fed300dabe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.938+0000 7fed3d200640 1 --2- 172.21.15.107:0/3680059867 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed300d86d0 0x7fed300dabe0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fed2800cb60 tx=0x7fed280019d0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.940 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.938+0000 7fed3d200640 1 -- 172.21.15.107:0/3680059867 shutdown_connections 2024-08-17T02:24:37.940 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.938+0000 7fed3d200640 1 --2- 172.21.15.107:0/3680059867 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fed14065220 0x7fed140676d0 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fed380649d0 tx=0x7fed380ab000 comp rx=0 tx=0).stop 2024-08-17T02:24:37.940 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.938+0000 7fed3d200640 1 --2- 172.21.15.107:0/3680059867 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed300d86d0 0x7fed300dabe0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.940 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.938+0000 7fed3d200640 1 --2- 172.21.15.107:0/3680059867 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed300504b0 0x7fed300da6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.940 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.938+0000 7fed3d200640 1 --2- 172.21.15.107:0/3680059867 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fed3004f1d0 0x7fed300dcd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.940 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.938+0000 7fed3d200640 1 -- 172.21.15.107:0/3680059867 >> 172.21.15.107:0/3680059867 conn(0x7fed30051600 msgr2=0x7fed30049dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:37.940 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.939+0000 7fed3d200640 1 -- 172.21.15.107:0/3680059867 shutdown_connections 2024-08-17T02:24:37.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.942+0000 7fed3d200640 1 -- 172.21.15.107:0/3680059867 wait complete. 2024-08-17T02:24:37.967 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.1 2024-08-17T02:24:37.968 DEBUG:teuthology.parallel:result is None 2024-08-17T02:24:37.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.993+0000 7f482de00640 1 -- 172.21.15.107:0/2666882077 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4800005790 con 0x7f4828159430 2024-08-17T02:24:37.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.994+0000 7f481e000640 1 -- 172.21.15.107:0/2666882077 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4820053960 con 0x7f4828159430 2024-08-17T02:24:37.995 INFO:teuthology.orchestra.run.smithi107.stdout:55834574852 2024-08-17T02:24:37.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.996+0000 7f482de00640 1 -- 172.21.15.107:0/2666882077 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4808065220 msgr2=0x7f48080676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.996+0000 7f482de00640 1 --2- 172.21.15.107:0/2666882077 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4808065220 0x7f48080676d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4818003080 tx=0x7f4818032000 comp rx=0 tx=0).stop 2024-08-17T02:24:37.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.996+0000 7f482de00640 1 -- 172.21.15.107:0/2666882077 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4828159430 msgr2=0x7f4828068570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:37.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.996+0000 7f482de00640 1 --2- 172.21.15.107:0/2666882077 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4828159430 0x7f4828068570 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f482000bad0 tx=0x7f4820009780 comp rx=0 tx=0).stop 2024-08-17T02:24:37.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.996+0000 7f482de00640 1 -- 172.21.15.107:0/2666882077 shutdown_connections 2024-08-17T02:24:37.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.996+0000 7f482de00640 1 --2- 172.21.15.107:0/2666882077 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4808065220 0x7f48080676d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.996+0000 7f482de00640 1 --2- 172.21.15.107:0/2666882077 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4828159430 0x7f4828068570 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.996+0000 7f482de00640 1 --2- 172.21.15.107:0/2666882077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4828159060 0x7f4828068030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.996+0000 7f482de00640 1 --2- 172.21.15.107:0/2666882077 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48280c6a30 0x7f4828169240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:37.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.996+0000 7f482de00640 1 -- 172.21.15.107:0/2666882077 >> 172.21.15.107:0/2666882077 conn(0x7f48280cfde0 msgr2=0x7f4828157ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:37.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.997+0000 7f482de00640 1 -- 172.21.15.107:0/2666882077 shutdown_connections 2024-08-17T02:24:37.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:37.997+0000 7f482de00640 1 -- 172.21.15.107:0/2666882077 wait complete. 2024-08-17T02:24:38.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.005+0000 7fd1cf000640 1 -- 172.21.15.107:0/3485952214 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fd1c0005320 con 0x7fd1c0033a80 2024-08-17T02:24:38.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.006+0000 7fd1bb400640 1 -- 172.21.15.107:0/3485952214 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd1c8094090 con 0x7fd1c0033a80 2024-08-17T02:24:38.007 INFO:teuthology.orchestra.run.smithi107.stdout:55834574852 2024-08-17T02:24:38.011 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.010+0000 7fd1cf000640 1 -- 172.21.15.107:0/3485952214 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd1a80651d0 msgr2=0x7fd1a8067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.011 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.010+0000 7fd1cf000640 1 --2- 172.21.15.107:0/3485952214 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd1a80651d0 0x7fd1a8067680 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd1c004c000 tx=0x7fd1bc007cd0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.011 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.010+0000 7fd1cf000640 1 -- 172.21.15.107:0/3485952214 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd1c0033a80 msgr2=0x7fd1c00dd2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.010+0000 7fd1cf000640 1 --2- 172.21.15.107:0/3485952214 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd1c0033a80 0x7fd1c00dd2b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd1c804b670 tx=0x7fd1c8069040 comp rx=0 tx=0).stop 2024-08-17T02:24:38.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.011+0000 7fd1cf000640 1 -- 172.21.15.107:0/3485952214 shutdown_connections 2024-08-17T02:24:38.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.011+0000 7fd1cf000640 1 --2- 172.21.15.107:0/3485952214 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd1a80651d0 0x7fd1a8067680 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.011+0000 7fd1cf000640 1 --2- 172.21.15.107:0/3485952214 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1c00e5eb0 0x7fd1c00f2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.011+0000 7fd1cf000640 1 --2- 172.21.15.107:0/3485952214 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1c0033f00 0x7fd1c0039fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.011+0000 7fd1cf000640 1 --2- 172.21.15.107:0/3485952214 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd1c0033a80 0x7fd1c00dd2b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.011+0000 7fd1cf000640 1 -- 172.21.15.107:0/3485952214 >> 172.21.15.107:0/3485952214 conn(0x7fd1c0051600 msgr2=0x7fd1c000b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:38.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.011+0000 7fd1cf000640 1 -- 172.21.15.107:0/3485952214 shutdown_connections 2024-08-17T02:24:38.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.011+0000 7fd1cf000640 1 -- 172.21.15.107:0/3485952214 wait complete. 2024-08-17T02:24:38.014 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.2 2024-08-17T02:24:38.015 DEBUG:teuthology.parallel:result is None 2024-08-17T02:24:38.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.028+0000 7f2deca00640 1 -- 172.21.15.107:0/3609588811 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f2de0038620 con 0x7f2de003b3f0 2024-08-17T02:24:38.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.029+0000 7f2ddaa00640 1 -- 172.21.15.107:0/3609588811 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2dd4054160 con 0x7f2de003b3f0 2024-08-17T02:24:38.030 INFO:teuthology.orchestra.run.smithi107.stdout:55834574853 2024-08-17T02:24:38.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.029+0000 7f4f39600640 1 -- 172.21.15.107:0/2526054443 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f4f34064db0 con 0x7f4f340b1120 2024-08-17T02:24:38.031 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.030+0000 7f4f2a000640 1 -- 172.21.15.107:0/2526054443 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4f1c074820 con 0x7f4f340b1120 2024-08-17T02:24:38.031 INFO:teuthology.orchestra.run.smithi107.stdout:55834574852 2024-08-17T02:24:38.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.032+0000 7f2deca00640 1 -- 172.21.15.107:0/3609588811 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f2dc8065150 msgr2=0x7f2dc8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.032+0000 7f2deca00640 1 --2- 172.21.15.107:0/3609588811 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f2dc8065150 0x7f2dc8067600 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2de0011ca0 tx=0x7f2de80aa000 comp rx=0 tx=0).stop 2024-08-17T02:24:38.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.032+0000 7f2deca00640 1 -- 172.21.15.107:0/3609588811 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2de003b3f0 msgr2=0x7f2de0054730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.032+0000 7f2deca00640 1 --2- 172.21.15.107:0/3609588811 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2de003b3f0 0x7f2de0054730 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2dd400d890 tx=0x7f2dd4008040 comp rx=0 tx=0).stop 2024-08-17T02:24:38.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.032+0000 7f2deca00640 1 -- 172.21.15.107:0/3609588811 shutdown_connections 2024-08-17T02:24:38.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.032+0000 7f2deca00640 1 --2- 172.21.15.107:0/3609588811 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f2dc8065150 0x7f2dc8067600 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.032+0000 7f2deca00640 1 --2- 172.21.15.107:0/3609588811 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2de00e2020 0x7f2de00e11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.032+0000 7f2deca00640 1 --2- 172.21.15.107:0/3609588811 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2de003b3f0 0x7f2de0054730 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.032+0000 7f2deca00640 1 --2- 172.21.15.107:0/3609588811 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2de0039090 0x7f2de004cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.032+0000 7f2deca00640 1 -- 172.21.15.107:0/3609588811 >> 172.21.15.107:0/3609588811 conn(0x7f2de000f050 msgr2=0x7f2de0058330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:38.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.032+0000 7f2deca00640 1 -- 172.21.15.107:0/3609588811 shutdown_connections 2024-08-17T02:24:38.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.032+0000 7f2deca00640 1 -- 172.21.15.107:0/3609588811 wait complete. 2024-08-17T02:24:38.035 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.033+0000 7f4f39600640 1 -- 172.21.15.107:0/2526054443 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4f100652a0 msgr2=0x7f4f10067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.035 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.033+0000 7f4f39600640 1 --2- 172.21.15.107:0/2526054443 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4f100652a0 0x7f4f10067750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c001560 tx=0x7f4f2c009040 comp rx=0 tx=0).stop 2024-08-17T02:24:38.035 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.033+0000 7f4f39600640 1 -- 172.21.15.107:0/2526054443 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f340b1120 msgr2=0x7f4f3406d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.035 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.033+0000 7f4f39600640 1 --2- 172.21.15.107:0/2526054443 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f340b1120 0x7f4f3406d9a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c031000 tx=0x7f4f1c032000 comp rx=0 tx=0).stop 2024-08-17T02:24:38.035 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.033+0000 7f4f39600640 1 -- 172.21.15.107:0/2526054443 shutdown_connections 2024-08-17T02:24:38.035 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.033+0000 7f4f39600640 1 --2- 172.21.15.107:0/2526054443 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4f100652a0 0x7f4f10067750 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.033+0000 7f4f39600640 1 --2- 172.21.15.107:0/2526054443 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f340b3370 0x7f4f3409c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.033+0000 7f4f39600640 1 --2- 172.21.15.107:0/2526054443 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f340b1120 0x7f4f3406d9a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.033+0000 7f4f39600640 1 --2- 172.21.15.107:0/2526054443 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f340ada10 0x7f4f340cd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.033+0000 7f4f39600640 1 -- 172.21.15.107:0/2526054443 >> 172.21.15.107:0/2526054443 conn(0x7f4f340cfdf0 msgr2=0x7f4f340ae340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:38.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.034+0000 7f4f39600640 1 -- 172.21.15.107:0/2526054443 shutdown_connections 2024-08-17T02:24:38.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.034+0000 7f4f39600640 1 -- 172.21.15.107:0/2526054443 wait complete. 2024-08-17T02:24:38.037 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.4 2024-08-17T02:24:38.037 DEBUG:teuthology.parallel:result is None 2024-08-17T02:24:38.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.036+0000 7f1456800640 1 -- 172.21.15.107:0/3966787923 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f145006f370 con 0x7f14500b0610 2024-08-17T02:24:38.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.037+0000 7f1446a00640 1 -- 172.21.15.107:0/3966787923 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1448074dc0 con 0x7f14500b0610 2024-08-17T02:24:38.039 INFO:teuthology.orchestra.run.smithi107.stdout:55834574853 2024-08-17T02:24:38.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.039+0000 7f1456800640 1 -- 172.21.15.107:0/3966787923 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f1430065150 msgr2=0x7f1430067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.039+0000 7f1456800640 1 --2- 172.21.15.107:0/3966787923 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f1430065150 0x7f1430067600 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1450144cf0 tx=0x7f1440008040 comp rx=0 tx=0).stop 2024-08-17T02:24:38.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.039+0000 7f1456800640 1 -- 172.21.15.107:0/3966787923 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14500b0610 msgr2=0x7f1450142ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.039+0000 7f1456800640 1 --2- 172.21.15.107:0/3966787923 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14500b0610 0x7f1450142ff0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1448009f50 tx=0x7f1448034000 comp rx=0 tx=0).stop 2024-08-17T02:24:38.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.039+0000 7f1456800640 1 -- 172.21.15.107:0/3966787923 shutdown_connections 2024-08-17T02:24:38.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.039+0000 7f1456800640 1 --2- 172.21.15.107:0/3966787923 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f1430065150 0x7f1430067600 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.039+0000 7f1456800640 1 --2- 172.21.15.107:0/3966787923 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f145015e140 0x7f1450143a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.039+0000 7f1456800640 1 --2- 172.21.15.107:0/3966787923 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f145015d830 0x7f1450143530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.039+0000 7f1456800640 1 --2- 172.21.15.107:0/3966787923 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14500b0610 0x7f1450142ff0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.039+0000 7f1456800640 1 -- 172.21.15.107:0/3966787923 >> 172.21.15.107:0/3966787923 conn(0x7f14500cb9b0 msgr2=0x7f145015c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:38.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.040+0000 7f1456800640 1 -- 172.21.15.107:0/3966787923 shutdown_connections 2024-08-17T02:24:38.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.040+0000 7f1456800640 1 -- 172.21.15.107:0/3966787923 wait complete. 2024-08-17T02:24:38.049 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.048+0000 7fce97e00640 1 -- 172.21.15.107:0/1209548648 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fce70005790 con 0x7fce980a8e60 2024-08-17T02:24:38.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.049+0000 7fce8ea00640 1 -- 172.21.15.107:0/1209548648 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fce88018020 con 0x7fce980a8e60 2024-08-17T02:24:38.050 INFO:teuthology.orchestra.run.smithi107.stdout:55834574853 2024-08-17T02:24:38.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.052+0000 7fe34b200640 1 -- 172.21.15.107:0/3620040672 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe3440cafd0 con 0x7fe3440ae330 2024-08-17T02:24:38.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.052+0000 7fce97e00640 1 -- 172.21.15.107:0/1209548648 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fce74065220 msgr2=0x7fce740676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.052+0000 7fce97e00640 1 --2- 172.21.15.107:0/1209548648 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fce74065220 0x7fce740676d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fce8000bbf0 tx=0x7fce80008040 comp rx=0 tx=0).stop 2024-08-17T02:24:38.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.052+0000 7fce97e00640 1 -- 172.21.15.107:0/1209548648 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce980a8e60 msgr2=0x7fce980ca3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.052+0000 7fce97e00640 1 --2- 172.21.15.107:0/1209548648 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce980a8e60 0x7fce980ca3f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fce8800cd00 tx=0x7fce88007e20 comp rx=0 tx=0).stop 2024-08-17T02:24:38.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.052+0000 7fce97e00640 1 -- 172.21.15.107:0/1209548648 shutdown_connections 2024-08-17T02:24:38.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.052+0000 7fce97e00640 1 --2- 172.21.15.107:0/1209548648 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fce74065220 0x7fce740676d0 secure :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fce8000bbf0 tx=0x7fce80008040 comp rx=0 tx=0).stop 2024-08-17T02:24:38.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.052+0000 7fce97e00640 1 --2- 172.21.15.107:0/1209548648 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce98167b30 0x7fce98167f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.052+0000 7fce97e00640 1 --2- 172.21.15.107:0/1209548648 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce980a8e60 0x7fce980ca3f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.052+0000 7fce97e00640 1 --2- 172.21.15.107:0/1209548648 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fce7c004f60 0x7fce980c1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.052+0000 7fce97e00640 1 -- 172.21.15.107:0/1209548648 >> 172.21.15.107:0/1209548648 conn(0x7fce98067750 msgr2=0x7fce98069ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:38.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.053+0000 7fce97e00640 1 -- 172.21.15.107:0/1209548648 shutdown_connections 2024-08-17T02:24:38.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.053+0000 7fce97e00640 1 -- 172.21.15.107:0/1209548648 wait complete. 2024-08-17T02:24:38.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.053+0000 7fe33b400640 1 -- 172.21.15.107:0/3620040672 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe33001e070 con 0x7fe3440ae330 2024-08-17T02:24:38.055 INFO:teuthology.orchestra.run.smithi107.stdout:55834574852 2024-08-17T02:24:38.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.055+0000 7fe34b200640 1 -- 172.21.15.107:0/3620040672 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe324065220 msgr2=0x7fe3240676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.055+0000 7fe34b200640 1 --2- 172.21.15.107:0/3620040672 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe324065220 0x7fe3240676d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe334034000 tx=0x7fe334032000 comp rx=0 tx=0).stop 2024-08-17T02:24:38.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.055+0000 7fe34b200640 1 -- 172.21.15.107:0/3620040672 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3440ae330 msgr2=0x7fe344153140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.055+0000 7fe34b200640 1 --2- 172.21.15.107:0/3620040672 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3440ae330 0x7fe344153140 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe33000c8b0 tx=0x7fe330008040 comp rx=0 tx=0).stop 2024-08-17T02:24:38.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.056+0000 7fe34b200640 1 -- 172.21.15.107:0/3620040672 shutdown_connections 2024-08-17T02:24:38.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.056+0000 7fe34b200640 1 --2- 172.21.15.107:0/3620040672 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe324065220 0x7fe3240676d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.056+0000 7fe34b200640 1 --2- 172.21.15.107:0/3620040672 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe344165d20 0x7fe3440a9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.056+0000 7fe34b200640 1 --2- 172.21.15.107:0/3620040672 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3440ae330 0x7fe344153140 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.056+0000 7fe34b200640 1 --2- 172.21.15.107:0/3620040672 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe34406a410 0x7fe3440abff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.056+0000 7fe34b200640 1 -- 172.21.15.107:0/3620040672 >> 172.21.15.107:0/3620040672 conn(0x7fe3440cc480 msgr2=0x7fe344167830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:38.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.056+0000 7fe34b200640 1 -- 172.21.15.107:0/3620040672 shutdown_connections 2024-08-17T02:24:38.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.056+0000 7fe34b200640 1 -- 172.21.15.107:0/3620040672 wait complete. 2024-08-17T02:24:38.059 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2024-08-17T02:24:38.059 DEBUG:teuthology.parallel:result is None 2024-08-17T02:24:38.059 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.6 2024-08-17T02:24:38.060 DEBUG:teuthology.parallel:result is None 2024-08-17T02:24:38.060 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2024-08-17T02:24:38.060 DEBUG:teuthology.parallel:result is None 2024-08-17T02:24:38.071 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2024-08-17T02:24:38.072 DEBUG:teuthology.parallel:result is None 2024-08-17T02:24:38.074 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.0 2024-08-17T02:24:38.074 DEBUG:teuthology.parallel:result is None 2024-08-17T02:24:38.074 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-17T02:24:38.074 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:24:38.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.260+0000 7f8e54c00640 1 Processor -- start 2024-08-17T02:24:38.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.260+0000 7f8e54c00640 1 -- start start 2024-08-17T02:24:38.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.261+0000 7f8e54c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8e50155a20 0x7f8e500adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.261+0000 7f8e54c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e50156670 con 0x7f8e5006df00 2024-08-17T02:24:38.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.261+0000 7f8e54c00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e5006e5e0 con 0x7f8e50155df0 2024-08-17T02:24:38.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.261+0000 7f8e54c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e500b0350 con 0x7f8e50155a20 2024-08-17T02:24:38.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.261+0000 7f8e4de00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8e50155a20 0x7f8e500adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.261+0000 7f8e4e800640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f8e5006df00 0x7f8e50156b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:33906/0 (socket says 172.21.15.107:33906) 2024-08-17T02:24:38.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.261+0000 7f8e4e800640 1 -- 172.21.15.107:0/855365976 learned_addr learned my addr 172.21.15.107:0/855365976 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:38.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.261+0000 7f8e4de00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8e50155a20 0x7f8e500adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60860/0 (socket says 172.21.15.107:60860) 2024-08-17T02:24:38.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.262+0000 7f8e4de00640 1 -- 172.21.15.107:0/855365976 >> v1:172.21.15.157:6789/0 conn(0x7f8e50155df0 legacy=0x7f8e5006d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:38.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.262+0000 7f8e4de00640 1 -- 172.21.15.107:0/855365976 >> v1:172.21.15.107:6789/0 conn(0x7f8e5006df00 legacy=0x7f8e50156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.262+0000 7f8e4de00640 1 -- 172.21.15.107:0/855365976 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e5006e8c0 con 0x7f8e50155a20 2024-08-17T02:24:38.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.263+0000 7f8e4de00640 1 --2- 172.21.15.107:0/855365976 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e50155a20 0x7f8e500adf10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8e40009850 tx=0x7f8e400090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eafcc35dc50d14b3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:38.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.263+0000 7f8e4ca00640 1 -- 172.21.15.107:0/855365976 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4002ad00 con 0x7f8e50155a20 2024-08-17T02:24:38.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.263+0000 7f8e4ca00640 1 -- 172.21.15.107:0/855365976 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4002ae60 con 0x7f8e50155a20 2024-08-17T02:24:38.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.263+0000 7f8e4ca00640 1 -- 172.21.15.107:0/855365976 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e40032670 con 0x7f8e50155a20 2024-08-17T02:24:38.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.263+0000 7f8e54c00640 1 -- 172.21.15.107:0/855365976 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e50155a20 msgr2=0x7f8e500adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.263+0000 7f8e54c00640 1 --2- 172.21.15.107:0/855365976 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e50155a20 0x7f8e500adf10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8e40009850 tx=0x7f8e400090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.264+0000 7f8e54c00640 1 -- 172.21.15.107:0/855365976 shutdown_connections 2024-08-17T02:24:38.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.264+0000 7f8e54c00640 1 --2- 172.21.15.107:0/855365976 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e50155a20 0x7f8e500adf10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.264+0000 7f8e54c00640 1 -- 172.21.15.107:0/855365976 >> 172.21.15.107:0/855365976 conn(0x7f8e500cb9b0 msgr2=0x7f8e500cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:38.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.264+0000 7f8e54c00640 1 -- 172.21.15.107:0/855365976 shutdown_connections 2024-08-17T02:24:38.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.264+0000 7f8e54c00640 1 -- 172.21.15.107:0/855365976 wait complete. 2024-08-17T02:24:38.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.265+0000 7f8e54c00640 1 Processor -- start 2024-08-17T02:24:38.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.265+0000 7f8e54c00640 1 -- start start 2024-08-17T02:24:38.268 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.266+0000 7f8e54c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e5006df00 0x7f8e5015dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.268 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.266+0000 7f8e54c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8e50155a20 0x7f8e5015c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.268 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.266+0000 7f8e54c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8e50155df0 0x7f8e501595c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.268 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.266+0000 7f8e54c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5015ad70 con 0x7f8e5006df00 2024-08-17T02:24:38.268 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.266+0000 7f8e54c00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e50151040 con 0x7f8e50155df0 2024-08-17T02:24:38.268 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.266+0000 7f8e54c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5015a160 con 0x7f8e50155a20 2024-08-17T02:24:38.269 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.266+0000 7f8e4de00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e5006df00 0x7f8e5015dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.269 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.266+0000 7f8e4de00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e5006df00 0x7f8e5015dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60874/0 (socket says 172.21.15.107:60874) 2024-08-17T02:24:38.269 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.266+0000 7f8e4de00640 1 -- 172.21.15.107:0/2186944264 learned_addr learned my addr 172.21.15.107:0/2186944264 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:38.269 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.266+0000 7f8e4d400640 1 --2- 172.21.15.107:0/2186944264 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8e50155a20 0x7f8e5015c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.269 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.266+0000 7f8e4e800640 1 --2- 172.21.15.107:0/2186944264 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8e50155df0 0x7f8e501595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.269 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.266+0000 7f8e4de00640 1 -- 172.21.15.107:0/2186944264 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8e50155a20 msgr2=0x7f8e5015c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.269 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.266+0000 7f8e4de00640 1 --2- 172.21.15.107:0/2186944264 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8e50155a20 0x7f8e5015c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.269 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.266+0000 7f8e4de00640 1 -- 172.21.15.107:0/2186944264 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8e50155df0 msgr2=0x7f8e501595c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.269 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.266+0000 7f8e4de00640 1 --2- 172.21.15.107:0/2186944264 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8e50155df0 0x7f8e501595c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.269 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.266+0000 7f8e4de00640 1 -- 172.21.15.107:0/2186944264 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e40009390 con 0x7f8e5006df00 2024-08-17T02:24:38.269 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.266+0000 7f8e4e800640 1 --2- 172.21.15.107:0/2186944264 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8e50155df0 0x7f8e501595c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:38.269 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.267+0000 7f8e4d400640 1 --2- 172.21.15.107:0/2186944264 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8e50155a20 0x7f8e5015c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:38.270 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.267+0000 7f8e4de00640 1 --2- 172.21.15.107:0/2186944264 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e5006df00 0x7f8e5015dfd0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8e40009850 tx=0x7f8e40032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:38.270 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.267+0000 7f8e45600640 1 -- 172.21.15.107:0/2186944264 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e40032e20 con 0x7f8e5006df00 2024-08-17T02:24:38.270 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.267+0000 7f8e45600640 1 -- 172.21.15.107:0/2186944264 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e40031a60 con 0x7f8e5006df00 2024-08-17T02:24:38.270 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.267+0000 7f8e45600640 1 -- 172.21.15.107:0/2186944264 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e40031e20 con 0x7f8e5006df00 2024-08-17T02:24:38.270 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.267+0000 7f8e54c00640 1 -- 172.21.15.107:0/2186944264 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e5015a440 con 0x7f8e5006df00 2024-08-17T02:24:38.270 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.267+0000 7f8e54c00640 1 -- 172.21.15.107:0/2186944264 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e5015aa00 con 0x7f8e5006df00 2024-08-17T02:24:38.271 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.268+0000 7f8e54c00640 1 -- 172.21.15.107:0/2186944264 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e50064db0 con 0x7f8e5006df00 2024-08-17T02:24:38.271 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.269+0000 7f8e45600640 1 -- 172.21.15.107:0/2186944264 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8e40044030 con 0x7f8e5006df00 2024-08-17T02:24:38.271 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.270+0000 7f8e45600640 1 --2- 172.21.15.107:0/2186944264 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f8e30065150 0x7f8e30067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.271 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.270+0000 7f8e45600640 1 -- 172.21.15.107:0/2186944264 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8e40042070 con 0x7f8e5006df00 2024-08-17T02:24:38.271 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.270+0000 7f8e4d400640 1 --2- 172.21.15.107:0/2186944264 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f8e30065150 0x7f8e30067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.271 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.271+0000 7f8e4d400640 1 --2- 172.21.15.107:0/2186944264 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f8e30065150 0x7f8e30067600 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8e50160c30 tx=0x7f8e3c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:38.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.274+0000 7f8e45600640 1 -- 172.21.15.107:0/2186944264 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8e40071030 con 0x7f8e5006df00 2024-08-17T02:24:38.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.442+0000 7f8e54c00640 1 -- 172.21.15.107:0/2186944264 --> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8e501521d0 con 0x7f8e30065150 2024-08-17T02:24:38.450 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.449+0000 7f8e45600640 1 -- 172.21.15.107:0/2186944264 <== mgr.4110 v2:172.21.15.107:6832/37039 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264553 (secure 0 0 0) 0x7f8e501521d0 con 0x7f8e30065150 2024-08-17T02:24:38.453 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:24:38.455 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-08-17T02:24:38.456 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.453+0000 7f8e54c00640 1 -- 172.21.15.107:0/2186944264 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f8e30065150 msgr2=0x7f8e30067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.456 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.453+0000 7f8e54c00640 1 --2- 172.21.15.107:0/2186944264 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f8e30065150 0x7f8e30067600 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8e50160c30 tx=0x7f8e3c008040 comp rx=0 tx=0).stop 2024-08-17T02:24:38.456 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.453+0000 7f8e54c00640 1 -- 172.21.15.107:0/2186944264 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e5006df00 msgr2=0x7f8e5015dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.453+0000 7f8e54c00640 1 --2- 172.21.15.107:0/2186944264 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e5006df00 0x7f8e5015dfd0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8e40009850 tx=0x7f8e40032000 comp rx=0 tx=0).stop 2024-08-17T02:24:38.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.453+0000 7f8e54c00640 1 -- 172.21.15.107:0/2186944264 shutdown_connections 2024-08-17T02:24:38.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.453+0000 7f8e54c00640 1 --2- 172.21.15.107:0/2186944264 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f8e30065150 0x7f8e30067600 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.453+0000 7f8e54c00640 1 --2- 172.21.15.107:0/2186944264 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8e50155df0 0x7f8e501595c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.453+0000 7f8e54c00640 1 --2- 172.21.15.107:0/2186944264 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8e50155a20 0x7f8e5015c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.453+0000 7f8e54c00640 1 --2- 172.21.15.107:0/2186944264 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e5006df00 0x7f8e5015dfd0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.453+0000 7f8e54c00640 1 -- 172.21.15.107:0/2186944264 >> 172.21.15.107:0/2186944264 conn(0x7f8e500cb9b0 msgr2=0x7f8e5006c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:38.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.453+0000 7f8e54c00640 1 -- 172.21.15.107:0/2186944264 shutdown_connections 2024-08-17T02:24:38.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.453+0000 7f8e54c00640 1 -- 172.21.15.107:0/2186944264 wait complete. 2024-08-17T02:24:38.469 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-08-17T02:24:37.407232+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2398432,"kb_used_data":2920,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752576288,"statfs":{"total":773094113280,"available":770638118912,"internally_reserved":0,"allocated":2990080,"data_stored":1787916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002682"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.452250+0000","last_change":"2024-08-17T02:24:29.448867+0000","last_active":"2024-08-17T02:24:29.452250+0000","last_peered":"2024-08-17T02:24:29.452250+0000","last_clean":"2024-08-17T02:24:29.452250+0000","last_became_active":"2024-08-17T02:24:29.448338+0000","last_became_peered":"2024-08-17T02:24:29.448338+0000","last_unstale":"2024-08-17T02:24:29.452250+0000","last_undegraded":"2024-08-17T02:24:29.452250+0000","last_fullsized":"2024-08-17T02:24:29.452250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:48:33.196839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.435860+0000","last_change":"2024-08-17T02:24:29.429588+0000","last_active":"2024-08-17T02:24:29.435860+0000","last_peered":"2024-08-17T02:24:29.435860+0000","last_clean":"2024-08-17T02:24:29.435860+0000","last_became_active":"2024-08-17T02:24:29.429300+0000","last_became_peered":"2024-08-17T02:24:29.429300+0000","last_unstale":"2024-08-17T02:24:29.435860+0000","last_undegraded":"2024-08-17T02:24:29.435860+0000","last_fullsized":"2024-08-17T02:24:29.435860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:40:05.110498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.435639+0000","last_change":"2024-08-17T02:24:29.428604+0000","last_active":"2024-08-17T02:24:29.435639+0000","last_peered":"2024-08-17T02:24:29.435639+0000","last_clean":"2024-08-17T02:24:29.435639+0000","last_became_active":"2024-08-17T02:24:29.428271+0000","last_became_peered":"2024-08-17T02:24:29.428271+0000","last_unstale":"2024-08-17T02:24:29.435639+0000","last_undegraded":"2024-08-17T02:24:29.435639+0000","last_fullsized":"2024-08-17T02:24:29.435639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:33.180306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.438068+0000","last_change":"2024-08-17T02:24:29.433468+0000","last_active":"2024-08-17T02:24:29.438068+0000","last_peered":"2024-08-17T02:24:29.438068+0000","last_clean":"2024-08-17T02:24:29.438068+0000","last_became_active":"2024-08-17T02:24:29.433248+0000","last_became_peered":"2024-08-17T02:24:29.433248+0000","last_unstale":"2024-08-17T02:24:29.438068+0000","last_undegraded":"2024-08-17T02:24:29.438068+0000","last_fullsized":"2024-08-17T02:24:29.438068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:46:58.314470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.451041+0000","last_change":"2024-08-17T02:24:29.444891+0000","last_active":"2024-08-17T02:24:29.451041+0000","last_peered":"2024-08-17T02:24:29.451041+0000","last_clean":"2024-08-17T02:24:29.451041+0000","last_became_active":"2024-08-17T02:24:29.444620+0000","last_became_peered":"2024-08-17T02:24:29.444620+0000","last_unstale":"2024-08-17T02:24:29.451041+0000","last_undegraded":"2024-08-17T02:24:29.451041+0000","last_fullsized":"2024-08-17T02:24:29.451041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:25:24.514567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450224+0000","last_change":"2024-08-17T02:24:29.438699+0000","last_active":"2024-08-17T02:24:29.450224+0000","last_peered":"2024-08-17T02:24:29.450224+0000","last_clean":"2024-08-17T02:24:29.450224+0000","last_became_active":"2024-08-17T02:24:29.438076+0000","last_became_peered":"2024-08-17T02:24:29.438076+0000","last_unstale":"2024-08-17T02:24:29.450224+0000","last_undegraded":"2024-08-17T02:24:29.450224+0000","last_fullsized":"2024-08-17T02:24:29.450224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:07:03.379300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.441450+0000","last_change":"2024-08-17T02:24:29.437568+0000","last_active":"2024-08-17T02:24:29.441450+0000","last_peered":"2024-08-17T02:24:29.441450+0000","last_clean":"2024-08-17T02:24:29.441450+0000","last_became_active":"2024-08-17T02:24:29.436316+0000","last_became_peered":"2024-08-17T02:24:29.436316+0000","last_unstale":"2024-08-17T02:24:29.441450+0000","last_undegraded":"2024-08-17T02:24:29.441450+0000","last_fullsized":"2024-08-17T02:24:29.441450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:46:58.314470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.442072+0000","last_change":"2024-08-17T02:24:29.438349+0000","last_active":"2024-08-17T02:24:29.442072+0000","last_peered":"2024-08-17T02:24:29.442072+0000","last_clean":"2024-08-17T02:24:29.442072+0000","last_became_active":"2024-08-17T02:24:29.438073+0000","last_became_peered":"2024-08-17T02:24:29.438073+0000","last_unstale":"2024-08-17T02:24:29.442072+0000","last_undegraded":"2024-08-17T02:24:29.442072+0000","last_fullsized":"2024-08-17T02:24:29.442072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:18.512619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.455304+0000","last_change":"2024-08-17T02:24:29.452166+0000","last_active":"2024-08-17T02:24:29.455304+0000","last_peered":"2024-08-17T02:24:29.455304+0000","last_clean":"2024-08-17T02:24:29.455304+0000","last_became_active":"2024-08-17T02:24:29.451022+0000","last_became_peered":"2024-08-17T02:24:29.451022+0000","last_unstale":"2024-08-17T02:24:29.455304+0000","last_undegraded":"2024-08-17T02:24:29.455304+0000","last_fullsized":"2024-08-17T02:24:29.455304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:29:30.041751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.447924+0000","last_change":"2024-08-17T02:24:29.443056+0000","last_active":"2024-08-17T02:24:29.447924+0000","last_peered":"2024-08-17T02:24:29.447924+0000","last_clean":"2024-08-17T02:24:29.447924+0000","last_became_active":"2024-08-17T02:24:29.442485+0000","last_became_peered":"2024-08-17T02:24:29.442485+0000","last_unstale":"2024-08-17T02:24:29.447924+0000","last_undegraded":"2024-08-17T02:24:29.447924+0000","last_fullsized":"2024-08-17T02:24:29.447924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:04:59.407311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.446564+0000","last_change":"2024-08-17T02:24:29.439275+0000","last_active":"2024-08-17T02:24:29.446564+0000","last_peered":"2024-08-17T02:24:29.446564+0000","last_clean":"2024-08-17T02:24:29.446564+0000","last_became_active":"2024-08-17T02:24:29.439101+0000","last_became_peered":"2024-08-17T02:24:29.439101+0000","last_unstale":"2024-08-17T02:24:29.446564+0000","last_undegraded":"2024-08-17T02:24:29.446564+0000","last_fullsized":"2024-08-17T02:24:29.446564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:58:14.241277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.436614+0000","last_change":"2024-08-17T02:24:29.430279+0000","last_active":"2024-08-17T02:24:29.436614+0000","last_peered":"2024-08-17T02:24:29.436614+0000","last_clean":"2024-08-17T02:24:29.436614+0000","last_became_active":"2024-08-17T02:24:29.430012+0000","last_became_peered":"2024-08-17T02:24:29.430012+0000","last_unstale":"2024-08-17T02:24:29.436614+0000","last_undegraded":"2024-08-17T02:24:29.436614+0000","last_fullsized":"2024-08-17T02:24:29.436614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:18:31.217481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.433404+0000","last_change":"2024-08-17T02:24:29.430879+0000","last_active":"2024-08-17T02:24:29.433404+0000","last_peered":"2024-08-17T02:24:29.433404+0000","last_clean":"2024-08-17T02:24:29.433404+0000","last_became_active":"2024-08-17T02:24:29.429162+0000","last_became_peered":"2024-08-17T02:24:29.429162+0000","last_unstale":"2024-08-17T02:24:29.433404+0000","last_undegraded":"2024-08-17T02:24:29.433404+0000","last_fullsized":"2024-08-17T02:24:29.433404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:59:44.626213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.442159+0000","last_change":"2024-08-17T02:24:29.438804+0000","last_active":"2024-08-17T02:24:29.442159+0000","last_peered":"2024-08-17T02:24:29.442159+0000","last_clean":"2024-08-17T02:24:29.442159+0000","last_became_active":"2024-08-17T02:24:29.438130+0000","last_became_peered":"2024-08-17T02:24:29.438130+0000","last_unstale":"2024-08-17T02:24:29.442159+0000","last_undegraded":"2024-08-17T02:24:29.442159+0000","last_fullsized":"2024-08-17T02:24:29.442159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:07:03.379300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.435960+0000","last_change":"2024-08-17T02:24:29.432494+0000","last_active":"2024-08-17T02:24:29.435960+0000","last_peered":"2024-08-17T02:24:29.435960+0000","last_clean":"2024-08-17T02:24:29.435960+0000","last_became_active":"2024-08-17T02:24:29.432128+0000","last_became_peered":"2024-08-17T02:24:29.432128+0000","last_unstale":"2024-08-17T02:24:29.435960+0000","last_undegraded":"2024-08-17T02:24:29.435960+0000","last_fullsized":"2024-08-17T02:24:29.435960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:18:37.161695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.432600+0000","last_change":"2024-08-17T02:24:29.431128+0000","last_active":"2024-08-17T02:24:29.432600+0000","last_peered":"2024-08-17T02:24:29.432600+0000","last_clean":"2024-08-17T02:24:29.432600+0000","last_became_active":"2024-08-17T02:24:29.428894+0000","last_became_peered":"2024-08-17T02:24:29.428894+0000","last_unstale":"2024-08-17T02:24:29.432600+0000","last_undegraded":"2024-08-17T02:24:29.432600+0000","last_fullsized":"2024-08-17T02:24:29.432600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:16.005540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450981+0000","last_change":"2024-08-17T02:24:29.444351+0000","last_active":"2024-08-17T02:24:29.450981+0000","last_peered":"2024-08-17T02:24:29.450981+0000","last_clean":"2024-08-17T02:24:29.450981+0000","last_became_active":"2024-08-17T02:24:29.443980+0000","last_became_peered":"2024-08-17T02:24:29.443980+0000","last_unstale":"2024-08-17T02:24:29.450981+0000","last_undegraded":"2024-08-17T02:24:29.450981+0000","last_fullsized":"2024-08-17T02:24:29.450981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:04:59.407311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.427120+0000","last_change":"2024-08-17T02:24:29.424479+0000","last_active":"2024-08-17T02:24:29.427120+0000","last_peered":"2024-08-17T02:24:29.427120+0000","last_clean":"2024-08-17T02:24:29.427120+0000","last_became_active":"2024-08-17T02:24:29.424027+0000","last_became_peered":"2024-08-17T02:24:29.424027+0000","last_unstale":"2024-08-17T02:24:29.427120+0000","last_undegraded":"2024-08-17T02:24:29.427120+0000","last_fullsized":"2024-08-17T02:24:29.427120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:18:31.217481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450896+0000","last_change":"2024-08-17T02:24:29.443271+0000","last_active":"2024-08-17T02:24:29.450896+0000","last_peered":"2024-08-17T02:24:29.450896+0000","last_clean":"2024-08-17T02:24:29.450896+0000","last_became_active":"2024-08-17T02:24:29.443006+0000","last_became_peered":"2024-08-17T02:24:29.443006+0000","last_unstale":"2024-08-17T02:24:29.450896+0000","last_undegraded":"2024-08-17T02:24:29.450896+0000","last_fullsized":"2024-08-17T02:24:29.450896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:26:09.573683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.435546+0000","last_change":"2024-08-17T02:24:29.434616+0000","last_active":"2024-08-17T02:24:29.435546+0000","last_peered":"2024-08-17T02:24:29.435546+0000","last_clean":"2024-08-17T02:24:29.435546+0000","last_became_active":"2024-08-17T02:24:29.434357+0000","last_became_peered":"2024-08-17T02:24:29.434357+0000","last_unstale":"2024-08-17T02:24:29.435546+0000","last_undegraded":"2024-08-17T02:24:29.435546+0000","last_fullsized":"2024-08-17T02:24:29.435546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:07:03.379300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.445449+0000","last_change":"2024-08-17T02:24:29.440294+0000","last_active":"2024-08-17T02:24:29.445449+0000","last_peered":"2024-08-17T02:24:29.445449+0000","last_clean":"2024-08-17T02:24:29.445449+0000","last_became_active":"2024-08-17T02:24:29.440044+0000","last_became_peered":"2024-08-17T02:24:29.440044+0000","last_unstale":"2024-08-17T02:24:29.445449+0000","last_undegraded":"2024-08-17T02:24:29.445449+0000","last_fullsized":"2024-08-17T02:24:29.445449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:18:37.161695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450245+0000","last_change":"2024-08-17T02:24:29.438981+0000","last_active":"2024-08-17T02:24:29.450245+0000","last_peered":"2024-08-17T02:24:29.450245+0000","last_clean":"2024-08-17T02:24:29.450245+0000","last_became_active":"2024-08-17T02:24:29.438545+0000","last_became_peered":"2024-08-17T02:24:29.438545+0000","last_unstale":"2024-08-17T02:24:29.450245+0000","last_undegraded":"2024-08-17T02:24:29.450245+0000","last_fullsized":"2024-08-17T02:24:29.450245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:26:09.573683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.441910+0000","last_change":"2024-08-17T02:24:29.437857+0000","last_active":"2024-08-17T02:24:29.441910+0000","last_peered":"2024-08-17T02:24:29.441910+0000","last_clean":"2024-08-17T02:24:29.441910+0000","last_became_active":"2024-08-17T02:24:29.437607+0000","last_became_peered":"2024-08-17T02:24:29.437607+0000","last_unstale":"2024-08-17T02:24:29.441910+0000","last_undegraded":"2024-08-17T02:24:29.441910+0000","last_fullsized":"2024-08-17T02:24:29.441910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:40:05.110498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.432619+0000","last_change":"2024-08-17T02:24:29.431695+0000","last_active":"2024-08-17T02:24:29.432619+0000","last_peered":"2024-08-17T02:24:29.432619+0000","last_clean":"2024-08-17T02:24:29.432619+0000","last_became_active":"2024-08-17T02:24:29.431435+0000","last_became_peered":"2024-08-17T02:24:29.431435+0000","last_unstale":"2024-08-17T02:24:29.432619+0000","last_undegraded":"2024-08-17T02:24:29.432619+0000","last_fullsized":"2024-08-17T02:24:29.432619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:39:33.176250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.437197+0000","last_change":"2024-08-17T02:24:29.435746+0000","last_active":"2024-08-17T02:24:29.437197+0000","last_peered":"2024-08-17T02:24:29.437197+0000","last_clean":"2024-08-17T02:24:29.437197+0000","last_became_active":"2024-08-17T02:24:29.435359+0000","last_became_peered":"2024-08-17T02:24:29.435359+0000","last_unstale":"2024-08-17T02:24:29.437197+0000","last_undegraded":"2024-08-17T02:24:29.437197+0000","last_fullsized":"2024-08-17T02:24:29.437197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:16.005540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.448489+0000","last_change":"2024-08-17T02:24:29.443168+0000","last_active":"2024-08-17T02:24:29.448489+0000","last_peered":"2024-08-17T02:24:29.448489+0000","last_clean":"2024-08-17T02:24:29.448489+0000","last_became_active":"2024-08-17T02:24:29.442833+0000","last_became_peered":"2024-08-17T02:24:29.442833+0000","last_unstale":"2024-08-17T02:24:29.448489+0000","last_undegraded":"2024-08-17T02:24:29.448489+0000","last_fullsized":"2024-08-17T02:24:29.448489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:48.171179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.435841+0000","last_change":"2024-08-17T02:24:29.429618+0000","last_active":"2024-08-17T02:24:29.435841+0000","last_peered":"2024-08-17T02:24:29.435841+0000","last_clean":"2024-08-17T02:24:29.435841+0000","last_became_active":"2024-08-17T02:24:29.429267+0000","last_became_peered":"2024-08-17T02:24:29.429267+0000","last_unstale":"2024-08-17T02:24:29.435841+0000","last_undegraded":"2024-08-17T02:24:29.435841+0000","last_fullsized":"2024-08-17T02:24:29.435841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:07:03.379300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.437177+0000","last_change":"2024-08-17T02:24:29.435512+0000","last_active":"2024-08-17T02:24:29.437177+0000","last_peered":"2024-08-17T02:24:29.437177+0000","last_clean":"2024-08-17T02:24:29.437177+0000","last_became_active":"2024-08-17T02:24:29.434546+0000","last_became_peered":"2024-08-17T02:24:29.434546+0000","last_unstale":"2024-08-17T02:24:29.437177+0000","last_undegraded":"2024-08-17T02:24:29.437177+0000","last_fullsized":"2024-08-17T02:24:29.437177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:23:46.771394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.437350+0000","last_change":"2024-08-17T02:24:29.434096+0000","last_active":"2024-08-17T02:24:29.437350+0000","last_peered":"2024-08-17T02:24:29.437350+0000","last_clean":"2024-08-17T02:24:29.437350+0000","last_became_active":"2024-08-17T02:24:29.432111+0000","last_became_peered":"2024-08-17T02:24:29.432111+0000","last_unstale":"2024-08-17T02:24:29.437350+0000","last_undegraded":"2024-08-17T02:24:29.437350+0000","last_fullsized":"2024-08-17T02:24:29.437350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:59:44.626213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450204+0000","last_change":"2024-08-17T02:24:29.438474+0000","last_active":"2024-08-17T02:24:29.450204+0000","last_peered":"2024-08-17T02:24:29.450204+0000","last_clean":"2024-08-17T02:24:29.450204+0000","last_became_active":"2024-08-17T02:24:29.434276+0000","last_became_peered":"2024-08-17T02:24:29.434276+0000","last_unstale":"2024-08-17T02:24:29.450204+0000","last_undegraded":"2024-08-17T02:24:29.450204+0000","last_fullsized":"2024-08-17T02:24:29.450204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:09:30.631732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.426340+0000","last_change":"2024-08-17T02:24:29.423201+0000","last_active":"2024-08-17T02:24:29.426340+0000","last_peered":"2024-08-17T02:24:29.426340+0000","last_clean":"2024-08-17T02:24:29.426340+0000","last_became_active":"2024-08-17T02:24:29.422912+0000","last_became_peered":"2024-08-17T02:24:29.422912+0000","last_unstale":"2024-08-17T02:24:29.426340+0000","last_undegraded":"2024-08-17T02:24:29.426340+0000","last_fullsized":"2024-08-17T02:24:29.426340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:52.792632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.432747+0000","last_change":"2024-08-17T02:24:29.431883+0000","last_active":"2024-08-17T02:24:29.432747+0000","last_peered":"2024-08-17T02:24:29.432747+0000","last_clean":"2024-08-17T02:24:29.432747+0000","last_became_active":"2024-08-17T02:24:29.431617+0000","last_became_peered":"2024-08-17T02:24:29.431617+0000","last_unstale":"2024-08-17T02:24:29.432747+0000","last_undegraded":"2024-08-17T02:24:29.432747+0000","last_fullsized":"2024-08-17T02:24:29.432747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:33.180306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.429731+0000","last_change":"2024-08-17T02:24:29.420479+0000","last_active":"2024-08-17T02:24:29.429731+0000","last_peered":"2024-08-17T02:24:29.429731+0000","last_clean":"2024-08-17T02:24:29.429731+0000","last_became_active":"2024-08-17T02:24:29.420224+0000","last_became_peered":"2024-08-17T02:24:29.420224+0000","last_unstale":"2024-08-17T02:24:29.429731+0000","last_undegraded":"2024-08-17T02:24:29.429731+0000","last_fullsized":"2024-08-17T02:24:29.429731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:02.260531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.457859+0000","last_change":"2024-08-17T02:24:28.436881+0000","last_active":"2024-08-17T02:24:29.457859+0000","last_peered":"2024-08-17T02:24:29.457859+0000","last_clean":"2024-08-17T02:24:29.457859+0000","last_became_active":"2024-08-17T02:24:28.436557+0000","last_became_peered":"2024-08-17T02:24:28.436557+0000","last_unstale":"2024-08-17T02:24:29.457859+0000","last_undegraded":"2024-08-17T02:24:29.457859+0000","last_fullsized":"2024-08-17T02:24:29.457859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:46:41.928641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.441803+0000","last_change":"2024-08-17T02:24:29.436940+0000","last_active":"2024-08-17T02:24:29.441803+0000","last_peered":"2024-08-17T02:24:29.441803+0000","last_clean":"2024-08-17T02:24:29.441803+0000","last_became_active":"2024-08-17T02:24:29.436582+0000","last_became_peered":"2024-08-17T02:24:29.436582+0000","last_unstale":"2024-08-17T02:24:29.441803+0000","last_undegraded":"2024-08-17T02:24:29.441803+0000","last_fullsized":"2024-08-17T02:24:29.441803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:22:20.026814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.456848+0000","last_change":"2024-08-17T02:24:28.438875+0000","last_active":"2024-08-17T02:24:29.456848+0000","last_peered":"2024-08-17T02:24:29.456848+0000","last_clean":"2024-08-17T02:24:29.456848+0000","last_became_active":"2024-08-17T02:24:28.438051+0000","last_became_peered":"2024-08-17T02:24:28.438051+0000","last_unstale":"2024-08-17T02:24:29.456848+0000","last_undegraded":"2024-08-17T02:24:29.456848+0000","last_fullsized":"2024-08-17T02:24:29.456848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:01.258133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.423658+0000","last_change":"2024-08-17T02:24:28.432912+0000","last_active":"2024-08-17T02:24:29.423658+0000","last_peered":"2024-08-17T02:24:29.423658+0000","last_clean":"2024-08-17T02:24:29.423658+0000","last_became_active":"2024-08-17T02:24:28.432676+0000","last_became_peered":"2024-08-17T02:24:28.432676+0000","last_unstale":"2024-08-17T02:24:29.423658+0000","last_undegraded":"2024-08-17T02:24:29.423658+0000","last_fullsized":"2024-08-17T02:24:29.423658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:18.717365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.433669+0000","last_change":"2024-08-17T02:24:29.431474+0000","last_active":"2024-08-17T02:24:29.433669+0000","last_peered":"2024-08-17T02:24:29.433669+0000","last_clean":"2024-08-17T02:24:29.433669+0000","last_became_active":"2024-08-17T02:24:29.429133+0000","last_became_peered":"2024-08-17T02:24:29.429133+0000","last_unstale":"2024-08-17T02:24:29.433669+0000","last_undegraded":"2024-08-17T02:24:29.433669+0000","last_fullsized":"2024-08-17T02:24:29.433669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:18:37.161695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.420882+0000","last_change":"2024-08-17T02:24:28.423819+0000","last_active":"2024-08-17T02:24:29.420882+0000","last_peered":"2024-08-17T02:24:29.420882+0000","last_clean":"2024-08-17T02:24:29.420882+0000","last_became_active":"2024-08-17T02:24:28.423549+0000","last_became_peered":"2024-08-17T02:24:28.423549+0000","last_unstale":"2024-08-17T02:24:29.420882+0000","last_undegraded":"2024-08-17T02:24:29.420882+0000","last_fullsized":"2024-08-17T02:24:29.420882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:34.991199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.435925+0000","last_change":"2024-08-17T02:24:29.432048+0000","last_active":"2024-08-17T02:24:29.435925+0000","last_peered":"2024-08-17T02:24:29.435925+0000","last_clean":"2024-08-17T02:24:29.435925+0000","last_became_active":"2024-08-17T02:24:29.431772+0000","last_became_peered":"2024-08-17T02:24:29.431772+0000","last_unstale":"2024-08-17T02:24:29.435925+0000","last_undegraded":"2024-08-17T02:24:29.435925+0000","last_fullsized":"2024-08-17T02:24:29.435925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:59:44.626213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.429707+0000","last_change":"2024-08-17T02:24:28.443065+0000","last_active":"2024-08-17T02:24:29.429707+0000","last_peered":"2024-08-17T02:24:29.429707+0000","last_clean":"2024-08-17T02:24:29.429707+0000","last_became_active":"2024-08-17T02:24:28.442641+0000","last_became_peered":"2024-08-17T02:24:28.442641+0000","last_unstale":"2024-08-17T02:24:29.429707+0000","last_undegraded":"2024-08-17T02:24:29.429707+0000","last_fullsized":"2024-08-17T02:24:29.429707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:55:38.492426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450640+0000","last_change":"2024-08-17T02:24:29.441379+0000","last_active":"2024-08-17T02:24:29.450640+0000","last_peered":"2024-08-17T02:24:29.450640+0000","last_clean":"2024-08-17T02:24:29.450640+0000","last_became_active":"2024-08-17T02:24:29.441099+0000","last_became_peered":"2024-08-17T02:24:29.441099+0000","last_unstale":"2024-08-17T02:24:29.450640+0000","last_undegraded":"2024-08-17T02:24:29.450640+0000","last_fullsized":"2024-08-17T02:24:29.450640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:18.512619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.423197+0000","last_change":"2024-08-17T02:24:28.440516+0000","last_active":"2024-08-17T02:24:29.423197+0000","last_peered":"2024-08-17T02:24:29.423197+0000","last_clean":"2024-08-17T02:24:29.423197+0000","last_became_active":"2024-08-17T02:24:28.440243+0000","last_became_peered":"2024-08-17T02:24:28.440243+0000","last_unstale":"2024-08-17T02:24:29.423197+0000","last_undegraded":"2024-08-17T02:24:29.423197+0000","last_fullsized":"2024-08-17T02:24:29.423197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:01.258133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.437435+0000","last_change":"2024-08-17T02:24:29.434837+0000","last_active":"2024-08-17T02:24:29.437435+0000","last_peered":"2024-08-17T02:24:29.437435+0000","last_clean":"2024-08-17T02:24:29.437435+0000","last_became_active":"2024-08-17T02:24:29.434528+0000","last_became_peered":"2024-08-17T02:24:29.434528+0000","last_unstale":"2024-08-17T02:24:29.437435+0000","last_undegraded":"2024-08-17T02:24:29.437435+0000","last_fullsized":"2024-08-17T02:24:29.437435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:23:46.771394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.461505+0000","last_change":"2024-08-17T02:24:28.434795+0000","last_active":"2024-08-17T02:24:29.461505+0000","last_peered":"2024-08-17T02:24:29.461505+0000","last_clean":"2024-08-17T02:24:29.461505+0000","last_became_active":"2024-08-17T02:24:28.434522+0000","last_became_peered":"2024-08-17T02:24:28.434522+0000","last_unstale":"2024-08-17T02:24:29.461505+0000","last_undegraded":"2024-08-17T02:24:29.461505+0000","last_fullsized":"2024-08-17T02:24:29.461505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:28:41.706792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450003+0000","last_change":"2024-08-17T02:24:29.443910+0000","last_active":"2024-08-17T02:24:29.450003+0000","last_peered":"2024-08-17T02:24:29.450003+0000","last_clean":"2024-08-17T02:24:29.450003+0000","last_became_active":"2024-08-17T02:24:29.443621+0000","last_became_peered":"2024-08-17T02:24:29.443621+0000","last_unstale":"2024-08-17T02:24:29.450003+0000","last_undegraded":"2024-08-17T02:24:29.450003+0000","last_fullsized":"2024-08-17T02:24:29.450003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:55:39.494824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.461687+0000","last_change":"2024-08-17T02:24:28.439962+0000","last_active":"2024-08-17T02:24:29.461687+0000","last_peered":"2024-08-17T02:24:29.461687+0000","last_clean":"2024-08-17T02:24:29.461687+0000","last_became_active":"2024-08-17T02:24:28.439277+0000","last_became_peered":"2024-08-17T02:24:28.439277+0000","last_unstale":"2024-08-17T02:24:29.461687+0000","last_undegraded":"2024-08-17T02:24:29.461687+0000","last_fullsized":"2024-08-17T02:24:29.461687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:28:41.706792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450874+0000","last_change":"2024-08-17T02:24:29.442682+0000","last_active":"2024-08-17T02:24:29.450874+0000","last_peered":"2024-08-17T02:24:29.450874+0000","last_clean":"2024-08-17T02:24:29.450874+0000","last_became_active":"2024-08-17T02:24:29.441913+0000","last_became_peered":"2024-08-17T02:24:29.441913+0000","last_unstale":"2024-08-17T02:24:29.450874+0000","last_undegraded":"2024-08-17T02:24:29.450874+0000","last_fullsized":"2024-08-17T02:24:29.450874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:26:38.223253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.457160+0000","last_change":"2024-08-17T02:24:28.423349+0000","last_active":"2024-08-17T02:24:29.457160+0000","last_peered":"2024-08-17T02:24:29.457160+0000","last_clean":"2024-08-17T02:24:29.457160+0000","last_became_active":"2024-08-17T02:24:28.423068+0000","last_became_peered":"2024-08-17T02:24:28.423068+0000","last_unstale":"2024-08-17T02:24:29.457160+0000","last_undegraded":"2024-08-17T02:24:29.457160+0000","last_fullsized":"2024-08-17T02:24:29.457160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:59.126938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.445464+0000","last_change":"2024-08-17T02:24:29.440328+0000","last_active":"2024-08-17T02:24:29.445464+0000","last_peered":"2024-08-17T02:24:29.445464+0000","last_clean":"2024-08-17T02:24:29.445464+0000","last_became_active":"2024-08-17T02:24:29.440057+0000","last_became_peered":"2024-08-17T02:24:29.440057+0000","last_unstale":"2024-08-17T02:24:29.445464+0000","last_undegraded":"2024-08-17T02:24:29.445464+0000","last_fullsized":"2024-08-17T02:24:29.445464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:16.005540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.421193+0000","last_change":"2024-08-17T02:24:28.435098+0000","last_active":"2024-08-17T02:24:29.421193+0000","last_peered":"2024-08-17T02:24:29.421193+0000","last_clean":"2024-08-17T02:24:29.421193+0000","last_became_active":"2024-08-17T02:24:28.434834+0000","last_became_peered":"2024-08-17T02:24:28.434834+0000","last_unstale":"2024-08-17T02:24:29.421193+0000","last_undegraded":"2024-08-17T02:24:29.421193+0000","last_fullsized":"2024-08-17T02:24:29.421193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:18.717365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.451653+0000","last_change":"2024-08-17T02:24:29.449862+0000","last_active":"2024-08-17T02:24:29.451653+0000","last_peered":"2024-08-17T02:24:29.451653+0000","last_clean":"2024-08-17T02:24:29.451653+0000","last_became_active":"2024-08-17T02:24:29.449560+0000","last_became_peered":"2024-08-17T02:24:29.449560+0000","last_unstale":"2024-08-17T02:24:29.451653+0000","last_undegraded":"2024-08-17T02:24:29.451653+0000","last_fullsized":"2024-08-17T02:24:29.451653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:48.171179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.420175+0000","last_change":"2024-08-17T02:24:28.438842+0000","last_active":"2024-08-17T02:24:29.420175+0000","last_peered":"2024-08-17T02:24:29.420175+0000","last_clean":"2024-08-17T02:24:29.420175+0000","last_became_active":"2024-08-17T02:24:28.438244+0000","last_became_peered":"2024-08-17T02:24:28.438244+0000","last_unstale":"2024-08-17T02:24:29.420175+0000","last_undegraded":"2024-08-17T02:24:29.420175+0000","last_fullsized":"2024-08-17T02:24:29.420175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:51.790234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.432534+0000","last_change":"2024-08-17T02:24:29.426910+0000","last_active":"2024-08-17T02:24:29.432534+0000","last_peered":"2024-08-17T02:24:29.432534+0000","last_clean":"2024-08-17T02:24:29.432534+0000","last_became_active":"2024-08-17T02:24:29.426608+0000","last_became_peered":"2024-08-17T02:24:29.426608+0000","last_unstale":"2024-08-17T02:24:29.432534+0000","last_undegraded":"2024-08-17T02:24:29.432534+0000","last_fullsized":"2024-08-17T02:24:29.432534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:02:43.252296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.460256+0000","last_change":"2024-08-17T02:24:28.426073+0000","last_active":"2024-08-17T02:24:29.460256+0000","last_peered":"2024-08-17T02:24:29.460256+0000","last_clean":"2024-08-17T02:24:29.460256+0000","last_became_active":"2024-08-17T02:24:28.425822+0000","last_became_peered":"2024-08-17T02:24:28.425822+0000","last_unstale":"2024-08-17T02:24:29.460256+0000","last_undegraded":"2024-08-17T02:24:29.460256+0000","last_fullsized":"2024-08-17T02:24:29.460256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:34.991199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.447515+0000","last_change":"2024-08-17T02:24:29.441566+0000","last_active":"2024-08-17T02:24:29.447515+0000","last_peered":"2024-08-17T02:24:29.447515+0000","last_clean":"2024-08-17T02:24:29.447515+0000","last_became_active":"2024-08-17T02:24:29.441269+0000","last_became_peered":"2024-08-17T02:24:29.441269+0000","last_unstale":"2024-08-17T02:24:29.447515+0000","last_undegraded":"2024-08-17T02:24:29.447515+0000","last_fullsized":"2024-08-17T02:24:29.447515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:39:33.176250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.460590+0000","last_change":"2024-08-17T02:24:28.423469+0000","last_active":"2024-08-17T02:24:29.460590+0000","last_peered":"2024-08-17T02:24:29.460590+0000","last_clean":"2024-08-17T02:24:29.460590+0000","last_became_active":"2024-08-17T02:24:28.423205+0000","last_became_peered":"2024-08-17T02:24:28.423205+0000","last_unstale":"2024-08-17T02:24:29.460590+0000","last_undegraded":"2024-08-17T02:24:29.460590+0000","last_fullsized":"2024-08-17T02:24:29.460590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:03:42.063288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.454737+0000","last_change":"2024-08-17T02:24:29.452111+0000","last_active":"2024-08-17T02:24:29.454737+0000","last_peered":"2024-08-17T02:24:29.454737+0000","last_clean":"2024-08-17T02:24:29.454737+0000","last_became_active":"2024-08-17T02:24:29.451873+0000","last_became_peered":"2024-08-17T02:24:29.451873+0000","last_unstale":"2024-08-17T02:24:29.454737+0000","last_undegraded":"2024-08-17T02:24:29.454737+0000","last_fullsized":"2024-08-17T02:24:29.454737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:18.512619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.459157+0000","last_change":"2024-08-17T02:24:28.436576+0000","last_active":"2024-08-17T02:24:29.459157+0000","last_peered":"2024-08-17T02:24:29.459157+0000","last_clean":"2024-08-17T02:24:29.459157+0000","last_became_active":"2024-08-17T02:24:28.436045+0000","last_became_peered":"2024-08-17T02:24:28.436045+0000","last_unstale":"2024-08-17T02:24:29.459157+0000","last_undegraded":"2024-08-17T02:24:29.459157+0000","last_fullsized":"2024-08-17T02:24:29.459157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:18.717365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.452269+0000","last_change":"2024-08-17T02:24:29.448760+0000","last_active":"2024-08-17T02:24:29.452269+0000","last_peered":"2024-08-17T02:24:29.452269+0000","last_clean":"2024-08-17T02:24:29.452269+0000","last_became_active":"2024-08-17T02:24:29.447419+0000","last_became_peered":"2024-08-17T02:24:29.447419+0000","last_unstale":"2024-08-17T02:24:29.452269+0000","last_undegraded":"2024-08-17T02:24:29.452269+0000","last_fullsized":"2024-08-17T02:24:29.452269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:09:30.631732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.460572+0000","last_change":"2024-08-17T02:24:28.423802+0000","last_active":"2024-08-17T02:24:29.460572+0000","last_peered":"2024-08-17T02:24:29.460572+0000","last_clean":"2024-08-17T02:24:29.460572+0000","last_became_active":"2024-08-17T02:24:28.423537+0000","last_became_peered":"2024-08-17T02:24:28.423537+0000","last_unstale":"2024-08-17T02:24:29.460572+0000","last_undegraded":"2024-08-17T02:24:29.460572+0000","last_fullsized":"2024-08-17T02:24:29.460572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:34.991199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.434226+0000","last_change":"2024-08-17T02:24:29.433363+0000","last_active":"2024-08-17T02:24:29.434226+0000","last_peered":"2024-08-17T02:24:29.434226+0000","last_clean":"2024-08-17T02:24:29.434226+0000","last_became_active":"2024-08-17T02:24:29.432999+0000","last_became_peered":"2024-08-17T02:24:29.432999+0000","last_unstale":"2024-08-17T02:24:29.434226+0000","last_undegraded":"2024-08-17T02:24:29.434226+0000","last_fullsized":"2024-08-17T02:24:29.434226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:48.171179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.412490+0000","last_change":"2024-08-17T02:24:28.435566+0000","last_active":"2024-08-17T02:24:29.412490+0000","last_peered":"2024-08-17T02:24:29.412490+0000","last_clean":"2024-08-17T02:24:29.412490+0000","last_became_active":"2024-08-17T02:24:28.434652+0000","last_became_peered":"2024-08-17T02:24:28.434652+0000","last_unstale":"2024-08-17T02:24:29.412490+0000","last_undegraded":"2024-08-17T02:24:29.412490+0000","last_fullsized":"2024-08-17T02:24:29.412490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:33:27.420267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.458174+0000","last_change":"2024-08-17T02:24:29.452901+0000","last_active":"2024-08-17T02:24:29.458174+0000","last_peered":"2024-08-17T02:24:29.458174+0000","last_clean":"2024-08-17T02:24:29.458174+0000","last_became_active":"2024-08-17T02:24:29.452427+0000","last_became_peered":"2024-08-17T02:24:29.452427+0000","last_unstale":"2024-08-17T02:24:29.458174+0000","last_undegraded":"2024-08-17T02:24:29.458174+0000","last_fullsized":"2024-08-17T02:24:29.458174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:51:44.570714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.423410+0000","last_change":"2024-08-17T02:24:25.092772+0000","last_active":"2024-08-17T02:24:29.423410+0000","last_peered":"2024-08-17T02:24:29.423410+0000","last_clean":"2024-08-17T02:24:29.423410+0000","last_became_active":"2024-08-17T02:24:25.091788+0000","last_became_peered":"2024-08-17T02:24:25.091788+0000","last_unstale":"2024-08-17T02:24:29.423410+0000","last_undegraded":"2024-08-17T02:24:29.423410+0000","last_fullsized":"2024-08-17T02:24:29.423410+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:24.051996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:24.051996+0000","last_clean_scrub_stamp":"2024-08-17T02:24:24.051996+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:31:45.454480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.420969+0000","last_change":"2024-08-17T02:24:28.429533+0000","last_active":"2024-08-17T02:24:29.420969+0000","last_peered":"2024-08-17T02:24:29.420969+0000","last_clean":"2024-08-17T02:24:29.420969+0000","last_became_active":"2024-08-17T02:24:28.429243+0000","last_became_peered":"2024-08-17T02:24:28.429243+0000","last_unstale":"2024-08-17T02:24:29.420969+0000","last_undegraded":"2024-08-17T02:24:29.420969+0000","last_fullsized":"2024-08-17T02:24:29.420969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:33:27.420267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.442042+0000","last_change":"2024-08-17T02:24:29.438354+0000","last_active":"2024-08-17T02:24:29.442042+0000","last_peered":"2024-08-17T02:24:29.442042+0000","last_clean":"2024-08-17T02:24:29.442042+0000","last_became_active":"2024-08-17T02:24:29.438160+0000","last_became_peered":"2024-08-17T02:24:29.438160+0000","last_unstale":"2024-08-17T02:24:29.442042+0000","last_undegraded":"2024-08-17T02:24:29.442042+0000","last_fullsized":"2024-08-17T02:24:29.442042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:26:09.573683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.423279+0000","last_change":"2024-08-17T02:24:28.438117+0000","last_active":"2024-08-17T02:24:29.423279+0000","last_peered":"2024-08-17T02:24:29.423279+0000","last_clean":"2024-08-17T02:24:29.423279+0000","last_became_active":"2024-08-17T02:24:28.437884+0000","last_became_peered":"2024-08-17T02:24:28.437884+0000","last_unstale":"2024-08-17T02:24:29.423279+0000","last_undegraded":"2024-08-17T02:24:29.423279+0000","last_fullsized":"2024-08-17T02:24:29.423279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:55:38.492426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.445436+0000","last_change":"2024-08-17T02:24:29.440285+0000","last_active":"2024-08-17T02:24:29.445436+0000","last_peered":"2024-08-17T02:24:29.445436+0000","last_clean":"2024-08-17T02:24:29.445436+0000","last_became_active":"2024-08-17T02:24:29.440027+0000","last_became_peered":"2024-08-17T02:24:29.440027+0000","last_unstale":"2024-08-17T02:24:29.445436+0000","last_undegraded":"2024-08-17T02:24:29.445436+0000","last_fullsized":"2024-08-17T02:24:29.445436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:40:05.110498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.412751+0000","last_change":"2024-08-17T02:24:28.434066+0000","last_active":"2024-08-17T02:24:29.412751+0000","last_peered":"2024-08-17T02:24:29.412751+0000","last_clean":"2024-08-17T02:24:29.412751+0000","last_became_active":"2024-08-17T02:24:28.433660+0000","last_became_peered":"2024-08-17T02:24:28.433660+0000","last_unstale":"2024-08-17T02:24:29.412751+0000","last_undegraded":"2024-08-17T02:24:29.412751+0000","last_fullsized":"2024-08-17T02:24:29.412751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:46:41.928641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.435766+0000","last_change":"2024-08-17T02:24:29.426088+0000","last_active":"2024-08-17T02:24:29.435766+0000","last_peered":"2024-08-17T02:24:29.435766+0000","last_clean":"2024-08-17T02:24:29.435766+0000","last_became_active":"2024-08-17T02:24:29.422286+0000","last_became_peered":"2024-08-17T02:24:29.422286+0000","last_unstale":"2024-08-17T02:24:29.435766+0000","last_undegraded":"2024-08-17T02:24:29.435766+0000","last_fullsized":"2024-08-17T02:24:29.435766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:58:14.241277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.421206+0000","last_change":"2024-08-17T02:24:28.431969+0000","last_active":"2024-08-17T02:24:29.421206+0000","last_peered":"2024-08-17T02:24:29.421206+0000","last_clean":"2024-08-17T02:24:29.421206+0000","last_became_active":"2024-08-17T02:24:28.431732+0000","last_became_peered":"2024-08-17T02:24:28.431732+0000","last_unstale":"2024-08-17T02:24:29.421206+0000","last_undegraded":"2024-08-17T02:24:29.421206+0000","last_fullsized":"2024-08-17T02:24:29.421206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:46:41.928641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.438785+0000","last_change":"2024-08-17T02:24:29.428834+0000","last_active":"2024-08-17T02:24:29.438785+0000","last_peered":"2024-08-17T02:24:29.438785+0000","last_clean":"2024-08-17T02:24:29.438785+0000","last_became_active":"2024-08-17T02:24:29.428548+0000","last_became_peered":"2024-08-17T02:24:29.428548+0000","last_unstale":"2024-08-17T02:24:29.438785+0000","last_undegraded":"2024-08-17T02:24:29.438785+0000","last_fullsized":"2024-08-17T02:24:29.438785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:28:42.709190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.415880+0000","last_change":"2024-08-17T02:24:28.427384+0000","last_active":"2024-08-17T02:24:29.415880+0000","last_peered":"2024-08-17T02:24:29.415880+0000","last_clean":"2024-08-17T02:24:29.415880+0000","last_became_active":"2024-08-17T02:24:28.426523+0000","last_became_peered":"2024-08-17T02:24:28.426523+0000","last_unstale":"2024-08-17T02:24:29.415880+0000","last_undegraded":"2024-08-17T02:24:29.415880+0000","last_fullsized":"2024-08-17T02:24:29.415880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:46:41.928641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450676+0000","last_change":"2024-08-17T02:24:29.441536+0000","last_active":"2024-08-17T02:24:29.450676+0000","last_peered":"2024-08-17T02:24:29.450676+0000","last_clean":"2024-08-17T02:24:29.450676+0000","last_became_active":"2024-08-17T02:24:29.440862+0000","last_became_peered":"2024-08-17T02:24:29.440862+0000","last_unstale":"2024-08-17T02:24:29.450676+0000","last_undegraded":"2024-08-17T02:24:29.450676+0000","last_fullsized":"2024-08-17T02:24:29.450676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:59:44.626213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.424591+0000","last_change":"2024-08-17T02:24:28.441139+0000","last_active":"2024-08-17T02:24:29.424591+0000","last_peered":"2024-08-17T02:24:29.424591+0000","last_clean":"2024-08-17T02:24:29.424591+0000","last_became_active":"2024-08-17T02:24:28.440867+0000","last_became_peered":"2024-08-17T02:24:28.440867+0000","last_unstale":"2024-08-17T02:24:29.424591+0000","last_undegraded":"2024-08-17T02:24:29.424591+0000","last_fullsized":"2024-08-17T02:24:29.424591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:51.790234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.435355+0000","last_change":"2024-08-17T02:24:29.421360+0000","last_active":"2024-08-17T02:24:29.435355+0000","last_peered":"2024-08-17T02:24:29.435355+0000","last_clean":"2024-08-17T02:24:29.435355+0000","last_became_active":"2024-08-17T02:24:29.421136+0000","last_became_peered":"2024-08-17T02:24:29.421136+0000","last_unstale":"2024-08-17T02:24:29.435355+0000","last_undegraded":"2024-08-17T02:24:29.435355+0000","last_fullsized":"2024-08-17T02:24:29.435355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:16.005540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:30.427744+0000","last_change":"2024-08-17T02:24:28.435491+0000","last_active":"2024-08-17T02:24:30.427744+0000","last_peered":"2024-08-17T02:24:30.427744+0000","last_clean":"2024-08-17T02:24:30.427744+0000","last_became_active":"2024-08-17T02:24:28.435238+0000","last_became_peered":"2024-08-17T02:24:28.435238+0000","last_unstale":"2024-08-17T02:24:30.427744+0000","last_undegraded":"2024-08-17T02:24:30.427744+0000","last_fullsized":"2024-08-17T02:24:30.427744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:18:30.215083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.433516+0000","last_change":"2024-08-17T02:24:29.431357+0000","last_active":"2024-08-17T02:24:29.433516+0000","last_peered":"2024-08-17T02:24:29.433516+0000","last_clean":"2024-08-17T02:24:29.433516+0000","last_became_active":"2024-08-17T02:24:29.430069+0000","last_became_peered":"2024-08-17T02:24:29.430069+0000","last_unstale":"2024-08-17T02:24:29.433516+0000","last_undegraded":"2024-08-17T02:24:29.433516+0000","last_fullsized":"2024-08-17T02:24:29.433516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:04:59.407311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.459511+0000","last_change":"2024-08-17T02:24:28.438397+0000","last_active":"2024-08-17T02:24:29.459511+0000","last_peered":"2024-08-17T02:24:29.459511+0000","last_clean":"2024-08-17T02:24:29.459511+0000","last_became_active":"2024-08-17T02:24:28.438086+0000","last_became_peered":"2024-08-17T02:24:28.438086+0000","last_unstale":"2024-08-17T02:24:29.459511+0000","last_undegraded":"2024-08-17T02:24:29.459511+0000","last_fullsized":"2024-08-17T02:24:29.459511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:18:30.215083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.441878+0000","last_change":"2024-08-17T02:24:29.437242+0000","last_active":"2024-08-17T02:24:29.441878+0000","last_peered":"2024-08-17T02:24:29.441878+0000","last_clean":"2024-08-17T02:24:29.441878+0000","last_became_active":"2024-08-17T02:24:29.436992+0000","last_became_peered":"2024-08-17T02:24:29.436992+0000","last_unstale":"2024-08-17T02:24:29.441878+0000","last_undegraded":"2024-08-17T02:24:29.441878+0000","last_fullsized":"2024-08-17T02:24:29.441878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:18:31.217481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.423166+0000","last_change":"2024-08-17T02:24:28.432643+0000","last_active":"2024-08-17T02:24:29.423166+0000","last_peered":"2024-08-17T02:24:29.423166+0000","last_clean":"2024-08-17T02:24:29.423166+0000","last_became_active":"2024-08-17T02:24:28.432360+0000","last_became_peered":"2024-08-17T02:24:28.432360+0000","last_unstale":"2024-08-17T02:24:29.423166+0000","last_undegraded":"2024-08-17T02:24:29.423166+0000","last_fullsized":"2024-08-17T02:24:29.423166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:17:58.120433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.429296+0000","last_change":"2024-08-17T02:24:29.419416+0000","last_active":"2024-08-17T02:24:29.429296+0000","last_peered":"2024-08-17T02:24:29.429296+0000","last_clean":"2024-08-17T02:24:29.429296+0000","last_became_active":"2024-08-17T02:24:29.419140+0000","last_became_peered":"2024-08-17T02:24:29.419140+0000","last_unstale":"2024-08-17T02:24:29.429296+0000","last_undegraded":"2024-08-17T02:24:29.429296+0000","last_fullsized":"2024-08-17T02:24:29.429296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:52.792632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.415080+0000","last_change":"2024-08-17T02:24:28.428331+0000","last_active":"2024-08-17T02:24:29.415080+0000","last_peered":"2024-08-17T02:24:29.415080+0000","last_clean":"2024-08-17T02:24:29.415080+0000","last_became_active":"2024-08-17T02:24:28.428035+0000","last_became_peered":"2024-08-17T02:24:28.428035+0000","last_unstale":"2024-08-17T02:24:29.415080+0000","last_undegraded":"2024-08-17T02:24:29.415080+0000","last_fullsized":"2024-08-17T02:24:29.415080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:51.790234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.433690+0000","last_change":"2024-08-17T02:24:29.431775+0000","last_active":"2024-08-17T02:24:29.433690+0000","last_peered":"2024-08-17T02:24:29.433690+0000","last_clean":"2024-08-17T02:24:29.433690+0000","last_became_active":"2024-08-17T02:24:29.431512+0000","last_became_peered":"2024-08-17T02:24:29.431512+0000","last_unstale":"2024-08-17T02:24:29.433690+0000","last_undegraded":"2024-08-17T02:24:29.433690+0000","last_fullsized":"2024-08-17T02:24:29.433690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:58:14.241277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.415638+0000","last_change":"2024-08-17T02:24:28.431932+0000","last_active":"2024-08-17T02:24:29.415638+0000","last_peered":"2024-08-17T02:24:29.415638+0000","last_clean":"2024-08-17T02:24:29.415638+0000","last_became_active":"2024-08-17T02:24:28.431664+0000","last_became_peered":"2024-08-17T02:24:28.431664+0000","last_unstale":"2024-08-17T02:24:29.415638+0000","last_undegraded":"2024-08-17T02:24:29.415638+0000","last_fullsized":"2024-08-17T02:24:29.415638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:55:38.492426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.431119+0000","last_change":"2024-08-17T02:24:29.429444+0000","last_active":"2024-08-17T02:24:29.431119+0000","last_peered":"2024-08-17T02:24:29.431119+0000","last_clean":"2024-08-17T02:24:29.431119+0000","last_became_active":"2024-08-17T02:24:29.429091+0000","last_became_peered":"2024-08-17T02:24:29.429091+0000","last_unstale":"2024-08-17T02:24:29.431119+0000","last_undegraded":"2024-08-17T02:24:29.431119+0000","last_fullsized":"2024-08-17T02:24:29.431119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:07:03.379300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.460868+0000","last_change":"2024-08-17T02:24:28.437430+0000","last_active":"2024-08-17T02:24:29.460868+0000","last_peered":"2024-08-17T02:24:29.460868+0000","last_clean":"2024-08-17T02:24:29.460868+0000","last_became_active":"2024-08-17T02:24:28.437238+0000","last_became_peered":"2024-08-17T02:24:28.437238+0000","last_unstale":"2024-08-17T02:24:29.460868+0000","last_undegraded":"2024-08-17T02:24:29.460868+0000","last_fullsized":"2024-08-17T02:24:29.460868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:28:41.706792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.432294+0000","last_change":"2024-08-17T02:24:29.430603+0000","last_active":"2024-08-17T02:24:29.432294+0000","last_peered":"2024-08-17T02:24:29.432294+0000","last_clean":"2024-08-17T02:24:29.432294+0000","last_became_active":"2024-08-17T02:24:29.430340+0000","last_became_peered":"2024-08-17T02:24:29.430340+0000","last_unstale":"2024-08-17T02:24:29.432294+0000","last_undegraded":"2024-08-17T02:24:29.432294+0000","last_fullsized":"2024-08-17T02:24:29.432294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:23:46.771394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450807+0000","last_change":"2024-08-17T02:24:29.441738+0000","last_active":"2024-08-17T02:24:29.450807+0000","last_peered":"2024-08-17T02:24:29.450807+0000","last_clean":"2024-08-17T02:24:29.450807+0000","last_became_active":"2024-08-17T02:24:29.441181+0000","last_became_peered":"2024-08-17T02:24:29.441181+0000","last_unstale":"2024-08-17T02:24:29.450807+0000","last_undegraded":"2024-08-17T02:24:29.450807+0000","last_fullsized":"2024-08-17T02:24:29.450807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:18:37.161695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.460138+0000","last_change":"2024-08-17T02:24:28.436783+0000","last_active":"2024-08-17T02:24:29.460138+0000","last_peered":"2024-08-17T02:24:29.460138+0000","last_clean":"2024-08-17T02:24:29.460138+0000","last_became_active":"2024-08-17T02:24:28.436552+0000","last_became_peered":"2024-08-17T02:24:28.436552+0000","last_unstale":"2024-08-17T02:24:29.460138+0000","last_undegraded":"2024-08-17T02:24:29.460138+0000","last_fullsized":"2024-08-17T02:24:29.460138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:18:30.215083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450243+0000","last_change":"2024-08-17T02:24:29.440059+0000","last_active":"2024-08-17T02:24:29.450243+0000","last_peered":"2024-08-17T02:24:29.450243+0000","last_clean":"2024-08-17T02:24:29.450243+0000","last_became_active":"2024-08-17T02:24:29.439878+0000","last_became_peered":"2024-08-17T02:24:29.439878+0000","last_unstale":"2024-08-17T02:24:29.450243+0000","last_undegraded":"2024-08-17T02:24:29.450243+0000","last_fullsized":"2024-08-17T02:24:29.450243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:23:46.771394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.461971+0000","last_change":"2024-08-17T02:24:28.435398+0000","last_active":"2024-08-17T02:24:29.461971+0000","last_peered":"2024-08-17T02:24:29.461971+0000","last_clean":"2024-08-17T02:24:29.461971+0000","last_became_active":"2024-08-17T02:24:28.435119+0000","last_became_peered":"2024-08-17T02:24:28.435119+0000","last_unstale":"2024-08-17T02:24:29.461971+0000","last_undegraded":"2024-08-17T02:24:29.461971+0000","last_fullsized":"2024-08-17T02:24:29.461971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:18:02.165697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.437418+0000","last_change":"2024-08-17T02:24:29.434467+0000","last_active":"2024-08-17T02:24:29.437418+0000","last_peered":"2024-08-17T02:24:29.437418+0000","last_clean":"2024-08-17T02:24:29.437418+0000","last_became_active":"2024-08-17T02:24:29.434160+0000","last_became_peered":"2024-08-17T02:24:29.434160+0000","last_unstale":"2024-08-17T02:24:29.437418+0000","last_undegraded":"2024-08-17T02:24:29.437418+0000","last_fullsized":"2024-08-17T02:24:29.437418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:58:14.241277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.457800+0000","last_change":"2024-08-17T02:24:28.431371+0000","last_active":"2024-08-17T02:24:29.457800+0000","last_peered":"2024-08-17T02:24:29.457800+0000","last_clean":"2024-08-17T02:24:29.457800+0000","last_became_active":"2024-08-17T02:24:28.431097+0000","last_became_peered":"2024-08-17T02:24:28.431097+0000","last_unstale":"2024-08-17T02:24:29.457800+0000","last_undegraded":"2024-08-17T02:24:29.457800+0000","last_fullsized":"2024-08-17T02:24:29.457800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:34.991199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.441162+0000","last_change":"2024-08-17T02:24:29.436845+0000","last_active":"2024-08-17T02:24:29.441162+0000","last_peered":"2024-08-17T02:24:29.441162+0000","last_clean":"2024-08-17T02:24:29.441162+0000","last_became_active":"2024-08-17T02:24:29.436419+0000","last_became_peered":"2024-08-17T02:24:29.436419+0000","last_unstale":"2024-08-17T02:24:29.441162+0000","last_undegraded":"2024-08-17T02:24:29.441162+0000","last_fullsized":"2024-08-17T02:24:29.441162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:48.171179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.457139+0000","last_change":"2024-08-17T02:24:28.428299+0000","last_active":"2024-08-17T02:24:29.457139+0000","last_peered":"2024-08-17T02:24:29.457139+0000","last_clean":"2024-08-17T02:24:29.457139+0000","last_became_active":"2024-08-17T02:24:28.428067+0000","last_became_peered":"2024-08-17T02:24:28.428067+0000","last_unstale":"2024-08-17T02:24:29.457139+0000","last_undegraded":"2024-08-17T02:24:29.457139+0000","last_fullsized":"2024-08-17T02:24:29.457139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:33:27.420267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302312,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069528,"statfs":{"total":96636764160,"available":96327196672,"internally_reserved":0,"allocated":815104,"data_stored":666251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301744,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070096,"statfs":{"total":96636764160,"available":96327778304,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301736,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070104,"statfs":{"total":96636764160,"available":96327786496,"internally_reserved":0,"allocated":221184,"data_stored":75403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.119}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2559999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2229999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301744,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070096,"statfs":{"total":96636764160,"available":96327778304,"internally_reserved":0,"allocated":229376,"data_stored":75439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":217088,"data_stored":75313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":225280,"data_stored":75473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298160,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073680,"statfs":{"total":96636764160,"available":96331448320,"internally_reserved":0,"allocated":823296,"data_stored":666307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:24:38.473 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:24:38.656 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.655+0000 7f5bf4e00640 1 Processor -- start 2024-08-17T02:24:38.656 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.655+0000 7f5bf4e00640 1 -- start start 2024-08-17T02:24:38.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.656+0000 7f5bf4e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5bf0158cb0 0x7f5bf00af6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.656+0000 7f5bf4e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5bf00ac820 0x7f5bf0159080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.656+0000 7f5bf4e00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bf00abc80 con 0x7f5bf00aa910 2024-08-17T02:24:38.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.656+0000 7f5bf4e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bf00ab070 con 0x7f5bf00ac820 2024-08-17T02:24:38.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.656+0000 7f5bf4e00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bf00ab350 con 0x7f5bf0158cb0 2024-08-17T02:24:38.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.656+0000 7f5bee800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5bf00ac820 0x7f5bf0159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.657+0000 7f5bee800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5bf00ac820 0x7f5bf0159080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60876/0 (socket says 172.21.15.107:60876) 2024-08-17T02:24:38.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.657+0000 7f5bee800640 1 -- 172.21.15.107:0/624267053 learned_addr learned my addr 172.21.15.107:0/624267053 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:38.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.657+0000 7f5bede00640 1 --2- 172.21.15.107:0/624267053 >> v2:172.21.15.157:3300/0 conn(0x7f5bf0158cb0 0x7f5bf00af6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.657+0000 7f5bee800640 1 -- 172.21.15.107:0/624267053 >> v2:172.21.15.157:3300/0 conn(0x7f5bf0158cb0 msgr2=0x7f5bf00af6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:38.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.657+0000 7f5bee800640 1 --2- 172.21.15.107:0/624267053 >> v2:172.21.15.157:3300/0 conn(0x7f5bf0158cb0 0x7f5bf00af6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.657+0000 7f5bee800640 1 -- 172.21.15.107:0/624267053 >> v1:172.21.15.157:6789/0 conn(0x7f5bf00aa910 legacy=0x7f5bf00ac110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:38.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.657+0000 7f5bee800640 1 -- 172.21.15.107:0/624267053 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf00ab630 con 0x7f5bf00ac820 2024-08-17T02:24:38.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.657+0000 7f5bede00640 1 --2- 172.21.15.107:0/624267053 >> v2:172.21.15.157:3300/0 conn(0x7f5bf0158cb0 0x7f5bf00af6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:38.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.658+0000 7f5bee800640 1 --2- 172.21.15.107:0/624267053 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5bf00ac820 0x7f5bf0159080 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5bf006d930 tx=0x7f5be8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5add43e57ddcb0e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:38.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.658+0000 7f5bed400640 1 -- 172.21.15.107:0/624267053 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be8007400 con 0x7f5bf00ac820 2024-08-17T02:24:38.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.658+0000 7f5bed400640 1 -- 172.21.15.107:0/624267053 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be8007560 con 0x7f5bf00ac820 2024-08-17T02:24:38.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.658+0000 7f5bed400640 1 -- 172.21.15.107:0/624267053 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be8007940 con 0x7f5bf00ac820 2024-08-17T02:24:38.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.659+0000 7f5bf4e00640 1 -- 172.21.15.107:0/624267053 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5bf00ac820 msgr2=0x7f5bf0159080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.659+0000 7f5bf4e00640 1 --2- 172.21.15.107:0/624267053 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5bf00ac820 0x7f5bf0159080 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5bf006d930 tx=0x7f5be8009840 comp rx=0 tx=0).stop 2024-08-17T02:24:38.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.659+0000 7f5bf4e00640 1 -- 172.21.15.107:0/624267053 shutdown_connections 2024-08-17T02:24:38.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.659+0000 7f5bf4e00640 1 --2- 172.21.15.107:0/624267053 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5bf00ac820 0x7f5bf0159080 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.659+0000 7f5bf4e00640 1 --2- 172.21.15.107:0/624267053 >> v2:172.21.15.157:3300/0 conn(0x7f5bf0158cb0 0x7f5bf00af6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.659+0000 7f5bf4e00640 1 -- 172.21.15.107:0/624267053 >> 172.21.15.107:0/624267053 conn(0x7f5bf0096a70 msgr2=0x7f5bf0096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:38.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.659+0000 7f5bf4e00640 1 -- 172.21.15.107:0/624267053 shutdown_connections 2024-08-17T02:24:38.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.659+0000 7f5bf4e00640 1 -- 172.21.15.107:0/624267053 wait complete. 2024-08-17T02:24:38.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.660+0000 7f5bf4e00640 1 Processor -- start 2024-08-17T02:24:38.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.660+0000 7f5bf4e00640 1 -- start start 2024-08-17T02:24:38.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.661+0000 7f5bf4e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5bf00aa910 0x7f5bf0099f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.661+0000 7f5bf4e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5bf00ac820 0x7f5bf0155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.661+0000 7f5bf4e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bf0158cb0 0x7f5bf01558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.661+0000 7f5bf4e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf015a7a0 con 0x7f5bf00ac820 2024-08-17T02:24:38.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.661+0000 7f5bf4e00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf015aa80 con 0x7f5bf00aa910 2024-08-17T02:24:38.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.661+0000 7f5bf4e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf009a4b0 con 0x7f5bf0158cb0 2024-08-17T02:24:38.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.661+0000 7f5be7e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5bf00ac820 0x7f5bf0155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.661+0000 7f5be7e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5bf00ac820 0x7f5bf0155370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60884/0 (socket says 172.21.15.107:60884) 2024-08-17T02:24:38.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.661+0000 7f5be7e00640 1 -- 172.21.15.107:0/4117501374 learned_addr learned my addr 172.21.15.107:0/4117501374 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:38.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.661+0000 7f5bede00640 1 --2- 172.21.15.107:0/4117501374 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5bf00aa910 0x7f5bf0099f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.661+0000 7f5bee800640 1 --2- 172.21.15.107:0/4117501374 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bf0158cb0 0x7f5bf01558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.662+0000 7f5be7e00640 1 -- 172.21.15.107:0/4117501374 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bf0158cb0 msgr2=0x7f5bf01558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.662+0000 7f5be7e00640 1 --2- 172.21.15.107:0/4117501374 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bf0158cb0 0x7f5bf01558b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.662+0000 7f5be7e00640 1 -- 172.21.15.107:0/4117501374 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5bf00aa910 msgr2=0x7f5bf0099f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.662+0000 7f5be7e00640 1 --2- 172.21.15.107:0/4117501374 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5bf00aa910 0x7f5bf0099f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.662+0000 7f5be7e00640 1 -- 172.21.15.107:0/4117501374 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be8009ae0 con 0x7f5bf00ac820 2024-08-17T02:24:38.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.662+0000 7f5be7e00640 1 --2- 172.21.15.107:0/4117501374 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5bf00ac820 0x7f5bf0155370 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5bd800c5e0 tx=0x7f5bd8007ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:38.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.662+0000 7f5be5600640 1 -- 172.21.15.107:0/4117501374 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8012630 con 0x7f5bf00ac820 2024-08-17T02:24:38.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.662+0000 7f5be5600640 1 -- 172.21.15.107:0/4117501374 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd80127b0 con 0x7f5bf00ac820 2024-08-17T02:24:38.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.662+0000 7f5bf4e00640 1 -- 172.21.15.107:0/4117501374 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf0159d70 con 0x7f5bf00ac820 2024-08-17T02:24:38.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.662+0000 7f5be5600640 1 -- 172.21.15.107:0/4117501374 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8012bb0 con 0x7f5bf00ac820 2024-08-17T02:24:38.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.662+0000 7f5bf4e00640 1 -- 172.21.15.107:0/4117501374 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf015a330 con 0x7f5bf00ac820 2024-08-17T02:24:38.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.664+0000 7f5bf4e00640 1 -- 172.21.15.107:0/4117501374 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf015abf0 con 0x7f5bf00ac820 2024-08-17T02:24:38.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.664+0000 7f5be5600640 1 -- 172.21.15.107:0/4117501374 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5bd801b400 con 0x7f5bf00ac820 2024-08-17T02:24:38.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.665+0000 7f5be5600640 1 --2- 172.21.15.107:0/4117501374 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f5bcc065150 0x7f5bcc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.665+0000 7f5be5600640 1 -- 172.21.15.107:0/4117501374 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5bd8082590 con 0x7f5bf00ac820 2024-08-17T02:24:38.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.665+0000 7f5bede00640 1 --2- 172.21.15.107:0/4117501374 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f5bcc065150 0x7f5bcc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.666+0000 7f5bede00640 1 --2- 172.21.15.107:0/4117501374 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f5bcc065150 0x7f5bcc067600 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5bf009baa0 tx=0x7f5be0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:38.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.669+0000 7f5be5600640 1 -- 172.21.15.107:0/4117501374 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5bd8050720 con 0x7f5bf00ac820 2024-08-17T02:24:38.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.838+0000 7f5bf4e00640 1 -- 172.21.15.107:0/4117501374 --> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5bf015a8e0 con 0x7f5bcc065150 2024-08-17T02:24:38.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.844+0000 7f5be5600640 1 -- 172.21.15.107:0/4117501374 <== mgr.4110 v2:172.21.15.107:6832/37039 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264553 (secure 0 0 0) 0x7f5be000c040 con 0x7f5bcc065150 2024-08-17T02:24:38.848 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:24:38.850 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-08-17T02:24:38.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.848+0000 7f5bf4e00640 1 -- 172.21.15.107:0/4117501374 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f5bcc065150 msgr2=0x7f5bcc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.848+0000 7f5bf4e00640 1 --2- 172.21.15.107:0/4117501374 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f5bcc065150 0x7f5bcc067600 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5bf009baa0 tx=0x7f5be0008040 comp rx=0 tx=0).stop 2024-08-17T02:24:38.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.848+0000 7f5bf4e00640 1 -- 172.21.15.107:0/4117501374 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5bf00ac820 msgr2=0x7f5bf0155370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.848+0000 7f5bf4e00640 1 --2- 172.21.15.107:0/4117501374 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5bf00ac820 0x7f5bf0155370 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5bd800c5e0 tx=0x7f5bd8007ed0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.848+0000 7f5bf4e00640 1 -- 172.21.15.107:0/4117501374 shutdown_connections 2024-08-17T02:24:38.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.848+0000 7f5bf4e00640 1 --2- 172.21.15.107:0/4117501374 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f5bcc065150 0x7f5bcc067600 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.848+0000 7f5bf4e00640 1 --2- 172.21.15.107:0/4117501374 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bf0158cb0 0x7f5bf01558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.848+0000 7f5bf4e00640 1 --2- 172.21.15.107:0/4117501374 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5bf00ac820 0x7f5bf0155370 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.848+0000 7f5bf4e00640 1 --2- 172.21.15.107:0/4117501374 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5bf00aa910 0x7f5bf0099f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.848+0000 7f5bf4e00640 1 -- 172.21.15.107:0/4117501374 >> 172.21.15.107:0/4117501374 conn(0x7f5bf0096a70 msgr2=0x7f5bf006b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:38.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.848+0000 7f5bf4e00640 1 -- 172.21.15.107:0/4117501374 shutdown_connections 2024-08-17T02:24:38.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:38.848+0000 7f5bf4e00640 1 -- 172.21.15.107:0/4117501374 wait complete. 2024-08-17T02:24:38.865 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-08-17T02:24:37.407232+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2398432,"kb_used_data":2920,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752576288,"statfs":{"total":773094113280,"available":770638118912,"internally_reserved":0,"allocated":2990080,"data_stored":1787916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002682"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.452250+0000","last_change":"2024-08-17T02:24:29.448867+0000","last_active":"2024-08-17T02:24:29.452250+0000","last_peered":"2024-08-17T02:24:29.452250+0000","last_clean":"2024-08-17T02:24:29.452250+0000","last_became_active":"2024-08-17T02:24:29.448338+0000","last_became_peered":"2024-08-17T02:24:29.448338+0000","last_unstale":"2024-08-17T02:24:29.452250+0000","last_undegraded":"2024-08-17T02:24:29.452250+0000","last_fullsized":"2024-08-17T02:24:29.452250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:48:33.196839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.435860+0000","last_change":"2024-08-17T02:24:29.429588+0000","last_active":"2024-08-17T02:24:29.435860+0000","last_peered":"2024-08-17T02:24:29.435860+0000","last_clean":"2024-08-17T02:24:29.435860+0000","last_became_active":"2024-08-17T02:24:29.429300+0000","last_became_peered":"2024-08-17T02:24:29.429300+0000","last_unstale":"2024-08-17T02:24:29.435860+0000","last_undegraded":"2024-08-17T02:24:29.435860+0000","last_fullsized":"2024-08-17T02:24:29.435860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:40:05.110498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.435639+0000","last_change":"2024-08-17T02:24:29.428604+0000","last_active":"2024-08-17T02:24:29.435639+0000","last_peered":"2024-08-17T02:24:29.435639+0000","last_clean":"2024-08-17T02:24:29.435639+0000","last_became_active":"2024-08-17T02:24:29.428271+0000","last_became_peered":"2024-08-17T02:24:29.428271+0000","last_unstale":"2024-08-17T02:24:29.435639+0000","last_undegraded":"2024-08-17T02:24:29.435639+0000","last_fullsized":"2024-08-17T02:24:29.435639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:33.180306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.438068+0000","last_change":"2024-08-17T02:24:29.433468+0000","last_active":"2024-08-17T02:24:29.438068+0000","last_peered":"2024-08-17T02:24:29.438068+0000","last_clean":"2024-08-17T02:24:29.438068+0000","last_became_active":"2024-08-17T02:24:29.433248+0000","last_became_peered":"2024-08-17T02:24:29.433248+0000","last_unstale":"2024-08-17T02:24:29.438068+0000","last_undegraded":"2024-08-17T02:24:29.438068+0000","last_fullsized":"2024-08-17T02:24:29.438068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:46:58.314470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.451041+0000","last_change":"2024-08-17T02:24:29.444891+0000","last_active":"2024-08-17T02:24:29.451041+0000","last_peered":"2024-08-17T02:24:29.451041+0000","last_clean":"2024-08-17T02:24:29.451041+0000","last_became_active":"2024-08-17T02:24:29.444620+0000","last_became_peered":"2024-08-17T02:24:29.444620+0000","last_unstale":"2024-08-17T02:24:29.451041+0000","last_undegraded":"2024-08-17T02:24:29.451041+0000","last_fullsized":"2024-08-17T02:24:29.451041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:25:24.514567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450224+0000","last_change":"2024-08-17T02:24:29.438699+0000","last_active":"2024-08-17T02:24:29.450224+0000","last_peered":"2024-08-17T02:24:29.450224+0000","last_clean":"2024-08-17T02:24:29.450224+0000","last_became_active":"2024-08-17T02:24:29.438076+0000","last_became_peered":"2024-08-17T02:24:29.438076+0000","last_unstale":"2024-08-17T02:24:29.450224+0000","last_undegraded":"2024-08-17T02:24:29.450224+0000","last_fullsized":"2024-08-17T02:24:29.450224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:07:03.379300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.441450+0000","last_change":"2024-08-17T02:24:29.437568+0000","last_active":"2024-08-17T02:24:29.441450+0000","last_peered":"2024-08-17T02:24:29.441450+0000","last_clean":"2024-08-17T02:24:29.441450+0000","last_became_active":"2024-08-17T02:24:29.436316+0000","last_became_peered":"2024-08-17T02:24:29.436316+0000","last_unstale":"2024-08-17T02:24:29.441450+0000","last_undegraded":"2024-08-17T02:24:29.441450+0000","last_fullsized":"2024-08-17T02:24:29.441450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:46:58.314470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.442072+0000","last_change":"2024-08-17T02:24:29.438349+0000","last_active":"2024-08-17T02:24:29.442072+0000","last_peered":"2024-08-17T02:24:29.442072+0000","last_clean":"2024-08-17T02:24:29.442072+0000","last_became_active":"2024-08-17T02:24:29.438073+0000","last_became_peered":"2024-08-17T02:24:29.438073+0000","last_unstale":"2024-08-17T02:24:29.442072+0000","last_undegraded":"2024-08-17T02:24:29.442072+0000","last_fullsized":"2024-08-17T02:24:29.442072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:18.512619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.455304+0000","last_change":"2024-08-17T02:24:29.452166+0000","last_active":"2024-08-17T02:24:29.455304+0000","last_peered":"2024-08-17T02:24:29.455304+0000","last_clean":"2024-08-17T02:24:29.455304+0000","last_became_active":"2024-08-17T02:24:29.451022+0000","last_became_peered":"2024-08-17T02:24:29.451022+0000","last_unstale":"2024-08-17T02:24:29.455304+0000","last_undegraded":"2024-08-17T02:24:29.455304+0000","last_fullsized":"2024-08-17T02:24:29.455304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:29:30.041751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.447924+0000","last_change":"2024-08-17T02:24:29.443056+0000","last_active":"2024-08-17T02:24:29.447924+0000","last_peered":"2024-08-17T02:24:29.447924+0000","last_clean":"2024-08-17T02:24:29.447924+0000","last_became_active":"2024-08-17T02:24:29.442485+0000","last_became_peered":"2024-08-17T02:24:29.442485+0000","last_unstale":"2024-08-17T02:24:29.447924+0000","last_undegraded":"2024-08-17T02:24:29.447924+0000","last_fullsized":"2024-08-17T02:24:29.447924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:04:59.407311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.446564+0000","last_change":"2024-08-17T02:24:29.439275+0000","last_active":"2024-08-17T02:24:29.446564+0000","last_peered":"2024-08-17T02:24:29.446564+0000","last_clean":"2024-08-17T02:24:29.446564+0000","last_became_active":"2024-08-17T02:24:29.439101+0000","last_became_peered":"2024-08-17T02:24:29.439101+0000","last_unstale":"2024-08-17T02:24:29.446564+0000","last_undegraded":"2024-08-17T02:24:29.446564+0000","last_fullsized":"2024-08-17T02:24:29.446564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:58:14.241277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.436614+0000","last_change":"2024-08-17T02:24:29.430279+0000","last_active":"2024-08-17T02:24:29.436614+0000","last_peered":"2024-08-17T02:24:29.436614+0000","last_clean":"2024-08-17T02:24:29.436614+0000","last_became_active":"2024-08-17T02:24:29.430012+0000","last_became_peered":"2024-08-17T02:24:29.430012+0000","last_unstale":"2024-08-17T02:24:29.436614+0000","last_undegraded":"2024-08-17T02:24:29.436614+0000","last_fullsized":"2024-08-17T02:24:29.436614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:18:31.217481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.433404+0000","last_change":"2024-08-17T02:24:29.430879+0000","last_active":"2024-08-17T02:24:29.433404+0000","last_peered":"2024-08-17T02:24:29.433404+0000","last_clean":"2024-08-17T02:24:29.433404+0000","last_became_active":"2024-08-17T02:24:29.429162+0000","last_became_peered":"2024-08-17T02:24:29.429162+0000","last_unstale":"2024-08-17T02:24:29.433404+0000","last_undegraded":"2024-08-17T02:24:29.433404+0000","last_fullsized":"2024-08-17T02:24:29.433404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:59:44.626213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.442159+0000","last_change":"2024-08-17T02:24:29.438804+0000","last_active":"2024-08-17T02:24:29.442159+0000","last_peered":"2024-08-17T02:24:29.442159+0000","last_clean":"2024-08-17T02:24:29.442159+0000","last_became_active":"2024-08-17T02:24:29.438130+0000","last_became_peered":"2024-08-17T02:24:29.438130+0000","last_unstale":"2024-08-17T02:24:29.442159+0000","last_undegraded":"2024-08-17T02:24:29.442159+0000","last_fullsized":"2024-08-17T02:24:29.442159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:07:03.379300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.435960+0000","last_change":"2024-08-17T02:24:29.432494+0000","last_active":"2024-08-17T02:24:29.435960+0000","last_peered":"2024-08-17T02:24:29.435960+0000","last_clean":"2024-08-17T02:24:29.435960+0000","last_became_active":"2024-08-17T02:24:29.432128+0000","last_became_peered":"2024-08-17T02:24:29.432128+0000","last_unstale":"2024-08-17T02:24:29.435960+0000","last_undegraded":"2024-08-17T02:24:29.435960+0000","last_fullsized":"2024-08-17T02:24:29.435960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:18:37.161695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.432600+0000","last_change":"2024-08-17T02:24:29.431128+0000","last_active":"2024-08-17T02:24:29.432600+0000","last_peered":"2024-08-17T02:24:29.432600+0000","last_clean":"2024-08-17T02:24:29.432600+0000","last_became_active":"2024-08-17T02:24:29.428894+0000","last_became_peered":"2024-08-17T02:24:29.428894+0000","last_unstale":"2024-08-17T02:24:29.432600+0000","last_undegraded":"2024-08-17T02:24:29.432600+0000","last_fullsized":"2024-08-17T02:24:29.432600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:16.005540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450981+0000","last_change":"2024-08-17T02:24:29.444351+0000","last_active":"2024-08-17T02:24:29.450981+0000","last_peered":"2024-08-17T02:24:29.450981+0000","last_clean":"2024-08-17T02:24:29.450981+0000","last_became_active":"2024-08-17T02:24:29.443980+0000","last_became_peered":"2024-08-17T02:24:29.443980+0000","last_unstale":"2024-08-17T02:24:29.450981+0000","last_undegraded":"2024-08-17T02:24:29.450981+0000","last_fullsized":"2024-08-17T02:24:29.450981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:04:59.407311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.427120+0000","last_change":"2024-08-17T02:24:29.424479+0000","last_active":"2024-08-17T02:24:29.427120+0000","last_peered":"2024-08-17T02:24:29.427120+0000","last_clean":"2024-08-17T02:24:29.427120+0000","last_became_active":"2024-08-17T02:24:29.424027+0000","last_became_peered":"2024-08-17T02:24:29.424027+0000","last_unstale":"2024-08-17T02:24:29.427120+0000","last_undegraded":"2024-08-17T02:24:29.427120+0000","last_fullsized":"2024-08-17T02:24:29.427120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:18:31.217481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450896+0000","last_change":"2024-08-17T02:24:29.443271+0000","last_active":"2024-08-17T02:24:29.450896+0000","last_peered":"2024-08-17T02:24:29.450896+0000","last_clean":"2024-08-17T02:24:29.450896+0000","last_became_active":"2024-08-17T02:24:29.443006+0000","last_became_peered":"2024-08-17T02:24:29.443006+0000","last_unstale":"2024-08-17T02:24:29.450896+0000","last_undegraded":"2024-08-17T02:24:29.450896+0000","last_fullsized":"2024-08-17T02:24:29.450896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:26:09.573683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.435546+0000","last_change":"2024-08-17T02:24:29.434616+0000","last_active":"2024-08-17T02:24:29.435546+0000","last_peered":"2024-08-17T02:24:29.435546+0000","last_clean":"2024-08-17T02:24:29.435546+0000","last_became_active":"2024-08-17T02:24:29.434357+0000","last_became_peered":"2024-08-17T02:24:29.434357+0000","last_unstale":"2024-08-17T02:24:29.435546+0000","last_undegraded":"2024-08-17T02:24:29.435546+0000","last_fullsized":"2024-08-17T02:24:29.435546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:07:03.379300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.445449+0000","last_change":"2024-08-17T02:24:29.440294+0000","last_active":"2024-08-17T02:24:29.445449+0000","last_peered":"2024-08-17T02:24:29.445449+0000","last_clean":"2024-08-17T02:24:29.445449+0000","last_became_active":"2024-08-17T02:24:29.440044+0000","last_became_peered":"2024-08-17T02:24:29.440044+0000","last_unstale":"2024-08-17T02:24:29.445449+0000","last_undegraded":"2024-08-17T02:24:29.445449+0000","last_fullsized":"2024-08-17T02:24:29.445449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:18:37.161695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450245+0000","last_change":"2024-08-17T02:24:29.438981+0000","last_active":"2024-08-17T02:24:29.450245+0000","last_peered":"2024-08-17T02:24:29.450245+0000","last_clean":"2024-08-17T02:24:29.450245+0000","last_became_active":"2024-08-17T02:24:29.438545+0000","last_became_peered":"2024-08-17T02:24:29.438545+0000","last_unstale":"2024-08-17T02:24:29.450245+0000","last_undegraded":"2024-08-17T02:24:29.450245+0000","last_fullsized":"2024-08-17T02:24:29.450245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:26:09.573683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.441910+0000","last_change":"2024-08-17T02:24:29.437857+0000","last_active":"2024-08-17T02:24:29.441910+0000","last_peered":"2024-08-17T02:24:29.441910+0000","last_clean":"2024-08-17T02:24:29.441910+0000","last_became_active":"2024-08-17T02:24:29.437607+0000","last_became_peered":"2024-08-17T02:24:29.437607+0000","last_unstale":"2024-08-17T02:24:29.441910+0000","last_undegraded":"2024-08-17T02:24:29.441910+0000","last_fullsized":"2024-08-17T02:24:29.441910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:40:05.110498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.432619+0000","last_change":"2024-08-17T02:24:29.431695+0000","last_active":"2024-08-17T02:24:29.432619+0000","last_peered":"2024-08-17T02:24:29.432619+0000","last_clean":"2024-08-17T02:24:29.432619+0000","last_became_active":"2024-08-17T02:24:29.431435+0000","last_became_peered":"2024-08-17T02:24:29.431435+0000","last_unstale":"2024-08-17T02:24:29.432619+0000","last_undegraded":"2024-08-17T02:24:29.432619+0000","last_fullsized":"2024-08-17T02:24:29.432619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:39:33.176250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.437197+0000","last_change":"2024-08-17T02:24:29.435746+0000","last_active":"2024-08-17T02:24:29.437197+0000","last_peered":"2024-08-17T02:24:29.437197+0000","last_clean":"2024-08-17T02:24:29.437197+0000","last_became_active":"2024-08-17T02:24:29.435359+0000","last_became_peered":"2024-08-17T02:24:29.435359+0000","last_unstale":"2024-08-17T02:24:29.437197+0000","last_undegraded":"2024-08-17T02:24:29.437197+0000","last_fullsized":"2024-08-17T02:24:29.437197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:16.005540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.448489+0000","last_change":"2024-08-17T02:24:29.443168+0000","last_active":"2024-08-17T02:24:29.448489+0000","last_peered":"2024-08-17T02:24:29.448489+0000","last_clean":"2024-08-17T02:24:29.448489+0000","last_became_active":"2024-08-17T02:24:29.442833+0000","last_became_peered":"2024-08-17T02:24:29.442833+0000","last_unstale":"2024-08-17T02:24:29.448489+0000","last_undegraded":"2024-08-17T02:24:29.448489+0000","last_fullsized":"2024-08-17T02:24:29.448489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:48.171179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.435841+0000","last_change":"2024-08-17T02:24:29.429618+0000","last_active":"2024-08-17T02:24:29.435841+0000","last_peered":"2024-08-17T02:24:29.435841+0000","last_clean":"2024-08-17T02:24:29.435841+0000","last_became_active":"2024-08-17T02:24:29.429267+0000","last_became_peered":"2024-08-17T02:24:29.429267+0000","last_unstale":"2024-08-17T02:24:29.435841+0000","last_undegraded":"2024-08-17T02:24:29.435841+0000","last_fullsized":"2024-08-17T02:24:29.435841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:07:03.379300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.437177+0000","last_change":"2024-08-17T02:24:29.435512+0000","last_active":"2024-08-17T02:24:29.437177+0000","last_peered":"2024-08-17T02:24:29.437177+0000","last_clean":"2024-08-17T02:24:29.437177+0000","last_became_active":"2024-08-17T02:24:29.434546+0000","last_became_peered":"2024-08-17T02:24:29.434546+0000","last_unstale":"2024-08-17T02:24:29.437177+0000","last_undegraded":"2024-08-17T02:24:29.437177+0000","last_fullsized":"2024-08-17T02:24:29.437177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:23:46.771394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.437350+0000","last_change":"2024-08-17T02:24:29.434096+0000","last_active":"2024-08-17T02:24:29.437350+0000","last_peered":"2024-08-17T02:24:29.437350+0000","last_clean":"2024-08-17T02:24:29.437350+0000","last_became_active":"2024-08-17T02:24:29.432111+0000","last_became_peered":"2024-08-17T02:24:29.432111+0000","last_unstale":"2024-08-17T02:24:29.437350+0000","last_undegraded":"2024-08-17T02:24:29.437350+0000","last_fullsized":"2024-08-17T02:24:29.437350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:59:44.626213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450204+0000","last_change":"2024-08-17T02:24:29.438474+0000","last_active":"2024-08-17T02:24:29.450204+0000","last_peered":"2024-08-17T02:24:29.450204+0000","last_clean":"2024-08-17T02:24:29.450204+0000","last_became_active":"2024-08-17T02:24:29.434276+0000","last_became_peered":"2024-08-17T02:24:29.434276+0000","last_unstale":"2024-08-17T02:24:29.450204+0000","last_undegraded":"2024-08-17T02:24:29.450204+0000","last_fullsized":"2024-08-17T02:24:29.450204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:09:30.631732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.426340+0000","last_change":"2024-08-17T02:24:29.423201+0000","last_active":"2024-08-17T02:24:29.426340+0000","last_peered":"2024-08-17T02:24:29.426340+0000","last_clean":"2024-08-17T02:24:29.426340+0000","last_became_active":"2024-08-17T02:24:29.422912+0000","last_became_peered":"2024-08-17T02:24:29.422912+0000","last_unstale":"2024-08-17T02:24:29.426340+0000","last_undegraded":"2024-08-17T02:24:29.426340+0000","last_fullsized":"2024-08-17T02:24:29.426340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:52.792632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.432747+0000","last_change":"2024-08-17T02:24:29.431883+0000","last_active":"2024-08-17T02:24:29.432747+0000","last_peered":"2024-08-17T02:24:29.432747+0000","last_clean":"2024-08-17T02:24:29.432747+0000","last_became_active":"2024-08-17T02:24:29.431617+0000","last_became_peered":"2024-08-17T02:24:29.431617+0000","last_unstale":"2024-08-17T02:24:29.432747+0000","last_undegraded":"2024-08-17T02:24:29.432747+0000","last_fullsized":"2024-08-17T02:24:29.432747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:33.180306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.429731+0000","last_change":"2024-08-17T02:24:29.420479+0000","last_active":"2024-08-17T02:24:29.429731+0000","last_peered":"2024-08-17T02:24:29.429731+0000","last_clean":"2024-08-17T02:24:29.429731+0000","last_became_active":"2024-08-17T02:24:29.420224+0000","last_became_peered":"2024-08-17T02:24:29.420224+0000","last_unstale":"2024-08-17T02:24:29.429731+0000","last_undegraded":"2024-08-17T02:24:29.429731+0000","last_fullsized":"2024-08-17T02:24:29.429731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:02.260531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.457859+0000","last_change":"2024-08-17T02:24:28.436881+0000","last_active":"2024-08-17T02:24:29.457859+0000","last_peered":"2024-08-17T02:24:29.457859+0000","last_clean":"2024-08-17T02:24:29.457859+0000","last_became_active":"2024-08-17T02:24:28.436557+0000","last_became_peered":"2024-08-17T02:24:28.436557+0000","last_unstale":"2024-08-17T02:24:29.457859+0000","last_undegraded":"2024-08-17T02:24:29.457859+0000","last_fullsized":"2024-08-17T02:24:29.457859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:46:41.928641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.441803+0000","last_change":"2024-08-17T02:24:29.436940+0000","last_active":"2024-08-17T02:24:29.441803+0000","last_peered":"2024-08-17T02:24:29.441803+0000","last_clean":"2024-08-17T02:24:29.441803+0000","last_became_active":"2024-08-17T02:24:29.436582+0000","last_became_peered":"2024-08-17T02:24:29.436582+0000","last_unstale":"2024-08-17T02:24:29.441803+0000","last_undegraded":"2024-08-17T02:24:29.441803+0000","last_fullsized":"2024-08-17T02:24:29.441803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:22:20.026814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.456848+0000","last_change":"2024-08-17T02:24:28.438875+0000","last_active":"2024-08-17T02:24:29.456848+0000","last_peered":"2024-08-17T02:24:29.456848+0000","last_clean":"2024-08-17T02:24:29.456848+0000","last_became_active":"2024-08-17T02:24:28.438051+0000","last_became_peered":"2024-08-17T02:24:28.438051+0000","last_unstale":"2024-08-17T02:24:29.456848+0000","last_undegraded":"2024-08-17T02:24:29.456848+0000","last_fullsized":"2024-08-17T02:24:29.456848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:01.258133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.423658+0000","last_change":"2024-08-17T02:24:28.432912+0000","last_active":"2024-08-17T02:24:29.423658+0000","last_peered":"2024-08-17T02:24:29.423658+0000","last_clean":"2024-08-17T02:24:29.423658+0000","last_became_active":"2024-08-17T02:24:28.432676+0000","last_became_peered":"2024-08-17T02:24:28.432676+0000","last_unstale":"2024-08-17T02:24:29.423658+0000","last_undegraded":"2024-08-17T02:24:29.423658+0000","last_fullsized":"2024-08-17T02:24:29.423658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:18.717365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.433669+0000","last_change":"2024-08-17T02:24:29.431474+0000","last_active":"2024-08-17T02:24:29.433669+0000","last_peered":"2024-08-17T02:24:29.433669+0000","last_clean":"2024-08-17T02:24:29.433669+0000","last_became_active":"2024-08-17T02:24:29.429133+0000","last_became_peered":"2024-08-17T02:24:29.429133+0000","last_unstale":"2024-08-17T02:24:29.433669+0000","last_undegraded":"2024-08-17T02:24:29.433669+0000","last_fullsized":"2024-08-17T02:24:29.433669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:18:37.161695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.420882+0000","last_change":"2024-08-17T02:24:28.423819+0000","last_active":"2024-08-17T02:24:29.420882+0000","last_peered":"2024-08-17T02:24:29.420882+0000","last_clean":"2024-08-17T02:24:29.420882+0000","last_became_active":"2024-08-17T02:24:28.423549+0000","last_became_peered":"2024-08-17T02:24:28.423549+0000","last_unstale":"2024-08-17T02:24:29.420882+0000","last_undegraded":"2024-08-17T02:24:29.420882+0000","last_fullsized":"2024-08-17T02:24:29.420882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:34.991199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.435925+0000","last_change":"2024-08-17T02:24:29.432048+0000","last_active":"2024-08-17T02:24:29.435925+0000","last_peered":"2024-08-17T02:24:29.435925+0000","last_clean":"2024-08-17T02:24:29.435925+0000","last_became_active":"2024-08-17T02:24:29.431772+0000","last_became_peered":"2024-08-17T02:24:29.431772+0000","last_unstale":"2024-08-17T02:24:29.435925+0000","last_undegraded":"2024-08-17T02:24:29.435925+0000","last_fullsized":"2024-08-17T02:24:29.435925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:59:44.626213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.429707+0000","last_change":"2024-08-17T02:24:28.443065+0000","last_active":"2024-08-17T02:24:29.429707+0000","last_peered":"2024-08-17T02:24:29.429707+0000","last_clean":"2024-08-17T02:24:29.429707+0000","last_became_active":"2024-08-17T02:24:28.442641+0000","last_became_peered":"2024-08-17T02:24:28.442641+0000","last_unstale":"2024-08-17T02:24:29.429707+0000","last_undegraded":"2024-08-17T02:24:29.429707+0000","last_fullsized":"2024-08-17T02:24:29.429707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:55:38.492426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450640+0000","last_change":"2024-08-17T02:24:29.441379+0000","last_active":"2024-08-17T02:24:29.450640+0000","last_peered":"2024-08-17T02:24:29.450640+0000","last_clean":"2024-08-17T02:24:29.450640+0000","last_became_active":"2024-08-17T02:24:29.441099+0000","last_became_peered":"2024-08-17T02:24:29.441099+0000","last_unstale":"2024-08-17T02:24:29.450640+0000","last_undegraded":"2024-08-17T02:24:29.450640+0000","last_fullsized":"2024-08-17T02:24:29.450640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:18.512619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.423197+0000","last_change":"2024-08-17T02:24:28.440516+0000","last_active":"2024-08-17T02:24:29.423197+0000","last_peered":"2024-08-17T02:24:29.423197+0000","last_clean":"2024-08-17T02:24:29.423197+0000","last_became_active":"2024-08-17T02:24:28.440243+0000","last_became_peered":"2024-08-17T02:24:28.440243+0000","last_unstale":"2024-08-17T02:24:29.423197+0000","last_undegraded":"2024-08-17T02:24:29.423197+0000","last_fullsized":"2024-08-17T02:24:29.423197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:01.258133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.437435+0000","last_change":"2024-08-17T02:24:29.434837+0000","last_active":"2024-08-17T02:24:29.437435+0000","last_peered":"2024-08-17T02:24:29.437435+0000","last_clean":"2024-08-17T02:24:29.437435+0000","last_became_active":"2024-08-17T02:24:29.434528+0000","last_became_peered":"2024-08-17T02:24:29.434528+0000","last_unstale":"2024-08-17T02:24:29.437435+0000","last_undegraded":"2024-08-17T02:24:29.437435+0000","last_fullsized":"2024-08-17T02:24:29.437435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:23:46.771394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.461505+0000","last_change":"2024-08-17T02:24:28.434795+0000","last_active":"2024-08-17T02:24:29.461505+0000","last_peered":"2024-08-17T02:24:29.461505+0000","last_clean":"2024-08-17T02:24:29.461505+0000","last_became_active":"2024-08-17T02:24:28.434522+0000","last_became_peered":"2024-08-17T02:24:28.434522+0000","last_unstale":"2024-08-17T02:24:29.461505+0000","last_undegraded":"2024-08-17T02:24:29.461505+0000","last_fullsized":"2024-08-17T02:24:29.461505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:28:41.706792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450003+0000","last_change":"2024-08-17T02:24:29.443910+0000","last_active":"2024-08-17T02:24:29.450003+0000","last_peered":"2024-08-17T02:24:29.450003+0000","last_clean":"2024-08-17T02:24:29.450003+0000","last_became_active":"2024-08-17T02:24:29.443621+0000","last_became_peered":"2024-08-17T02:24:29.443621+0000","last_unstale":"2024-08-17T02:24:29.450003+0000","last_undegraded":"2024-08-17T02:24:29.450003+0000","last_fullsized":"2024-08-17T02:24:29.450003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:55:39.494824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.461687+0000","last_change":"2024-08-17T02:24:28.439962+0000","last_active":"2024-08-17T02:24:29.461687+0000","last_peered":"2024-08-17T02:24:29.461687+0000","last_clean":"2024-08-17T02:24:29.461687+0000","last_became_active":"2024-08-17T02:24:28.439277+0000","last_became_peered":"2024-08-17T02:24:28.439277+0000","last_unstale":"2024-08-17T02:24:29.461687+0000","last_undegraded":"2024-08-17T02:24:29.461687+0000","last_fullsized":"2024-08-17T02:24:29.461687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:28:41.706792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450874+0000","last_change":"2024-08-17T02:24:29.442682+0000","last_active":"2024-08-17T02:24:29.450874+0000","last_peered":"2024-08-17T02:24:29.450874+0000","last_clean":"2024-08-17T02:24:29.450874+0000","last_became_active":"2024-08-17T02:24:29.441913+0000","last_became_peered":"2024-08-17T02:24:29.441913+0000","last_unstale":"2024-08-17T02:24:29.450874+0000","last_undegraded":"2024-08-17T02:24:29.450874+0000","last_fullsized":"2024-08-17T02:24:29.450874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:26:38.223253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.457160+0000","last_change":"2024-08-17T02:24:28.423349+0000","last_active":"2024-08-17T02:24:29.457160+0000","last_peered":"2024-08-17T02:24:29.457160+0000","last_clean":"2024-08-17T02:24:29.457160+0000","last_became_active":"2024-08-17T02:24:28.423068+0000","last_became_peered":"2024-08-17T02:24:28.423068+0000","last_unstale":"2024-08-17T02:24:29.457160+0000","last_undegraded":"2024-08-17T02:24:29.457160+0000","last_fullsized":"2024-08-17T02:24:29.457160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:59.126938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.445464+0000","last_change":"2024-08-17T02:24:29.440328+0000","last_active":"2024-08-17T02:24:29.445464+0000","last_peered":"2024-08-17T02:24:29.445464+0000","last_clean":"2024-08-17T02:24:29.445464+0000","last_became_active":"2024-08-17T02:24:29.440057+0000","last_became_peered":"2024-08-17T02:24:29.440057+0000","last_unstale":"2024-08-17T02:24:29.445464+0000","last_undegraded":"2024-08-17T02:24:29.445464+0000","last_fullsized":"2024-08-17T02:24:29.445464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:16.005540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.421193+0000","last_change":"2024-08-17T02:24:28.435098+0000","last_active":"2024-08-17T02:24:29.421193+0000","last_peered":"2024-08-17T02:24:29.421193+0000","last_clean":"2024-08-17T02:24:29.421193+0000","last_became_active":"2024-08-17T02:24:28.434834+0000","last_became_peered":"2024-08-17T02:24:28.434834+0000","last_unstale":"2024-08-17T02:24:29.421193+0000","last_undegraded":"2024-08-17T02:24:29.421193+0000","last_fullsized":"2024-08-17T02:24:29.421193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:18.717365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.451653+0000","last_change":"2024-08-17T02:24:29.449862+0000","last_active":"2024-08-17T02:24:29.451653+0000","last_peered":"2024-08-17T02:24:29.451653+0000","last_clean":"2024-08-17T02:24:29.451653+0000","last_became_active":"2024-08-17T02:24:29.449560+0000","last_became_peered":"2024-08-17T02:24:29.449560+0000","last_unstale":"2024-08-17T02:24:29.451653+0000","last_undegraded":"2024-08-17T02:24:29.451653+0000","last_fullsized":"2024-08-17T02:24:29.451653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:48.171179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.420175+0000","last_change":"2024-08-17T02:24:28.438842+0000","last_active":"2024-08-17T02:24:29.420175+0000","last_peered":"2024-08-17T02:24:29.420175+0000","last_clean":"2024-08-17T02:24:29.420175+0000","last_became_active":"2024-08-17T02:24:28.438244+0000","last_became_peered":"2024-08-17T02:24:28.438244+0000","last_unstale":"2024-08-17T02:24:29.420175+0000","last_undegraded":"2024-08-17T02:24:29.420175+0000","last_fullsized":"2024-08-17T02:24:29.420175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:51.790234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.432534+0000","last_change":"2024-08-17T02:24:29.426910+0000","last_active":"2024-08-17T02:24:29.432534+0000","last_peered":"2024-08-17T02:24:29.432534+0000","last_clean":"2024-08-17T02:24:29.432534+0000","last_became_active":"2024-08-17T02:24:29.426608+0000","last_became_peered":"2024-08-17T02:24:29.426608+0000","last_unstale":"2024-08-17T02:24:29.432534+0000","last_undegraded":"2024-08-17T02:24:29.432534+0000","last_fullsized":"2024-08-17T02:24:29.432534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:02:43.252296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.460256+0000","last_change":"2024-08-17T02:24:28.426073+0000","last_active":"2024-08-17T02:24:29.460256+0000","last_peered":"2024-08-17T02:24:29.460256+0000","last_clean":"2024-08-17T02:24:29.460256+0000","last_became_active":"2024-08-17T02:24:28.425822+0000","last_became_peered":"2024-08-17T02:24:28.425822+0000","last_unstale":"2024-08-17T02:24:29.460256+0000","last_undegraded":"2024-08-17T02:24:29.460256+0000","last_fullsized":"2024-08-17T02:24:29.460256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:34.991199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.447515+0000","last_change":"2024-08-17T02:24:29.441566+0000","last_active":"2024-08-17T02:24:29.447515+0000","last_peered":"2024-08-17T02:24:29.447515+0000","last_clean":"2024-08-17T02:24:29.447515+0000","last_became_active":"2024-08-17T02:24:29.441269+0000","last_became_peered":"2024-08-17T02:24:29.441269+0000","last_unstale":"2024-08-17T02:24:29.447515+0000","last_undegraded":"2024-08-17T02:24:29.447515+0000","last_fullsized":"2024-08-17T02:24:29.447515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:39:33.176250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.460590+0000","last_change":"2024-08-17T02:24:28.423469+0000","last_active":"2024-08-17T02:24:29.460590+0000","last_peered":"2024-08-17T02:24:29.460590+0000","last_clean":"2024-08-17T02:24:29.460590+0000","last_became_active":"2024-08-17T02:24:28.423205+0000","last_became_peered":"2024-08-17T02:24:28.423205+0000","last_unstale":"2024-08-17T02:24:29.460590+0000","last_undegraded":"2024-08-17T02:24:29.460590+0000","last_fullsized":"2024-08-17T02:24:29.460590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:03:42.063288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.454737+0000","last_change":"2024-08-17T02:24:29.452111+0000","last_active":"2024-08-17T02:24:29.454737+0000","last_peered":"2024-08-17T02:24:29.454737+0000","last_clean":"2024-08-17T02:24:29.454737+0000","last_became_active":"2024-08-17T02:24:29.451873+0000","last_became_peered":"2024-08-17T02:24:29.451873+0000","last_unstale":"2024-08-17T02:24:29.454737+0000","last_undegraded":"2024-08-17T02:24:29.454737+0000","last_fullsized":"2024-08-17T02:24:29.454737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:18.512619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.459157+0000","last_change":"2024-08-17T02:24:28.436576+0000","last_active":"2024-08-17T02:24:29.459157+0000","last_peered":"2024-08-17T02:24:29.459157+0000","last_clean":"2024-08-17T02:24:29.459157+0000","last_became_active":"2024-08-17T02:24:28.436045+0000","last_became_peered":"2024-08-17T02:24:28.436045+0000","last_unstale":"2024-08-17T02:24:29.459157+0000","last_undegraded":"2024-08-17T02:24:29.459157+0000","last_fullsized":"2024-08-17T02:24:29.459157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:18.717365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.452269+0000","last_change":"2024-08-17T02:24:29.448760+0000","last_active":"2024-08-17T02:24:29.452269+0000","last_peered":"2024-08-17T02:24:29.452269+0000","last_clean":"2024-08-17T02:24:29.452269+0000","last_became_active":"2024-08-17T02:24:29.447419+0000","last_became_peered":"2024-08-17T02:24:29.447419+0000","last_unstale":"2024-08-17T02:24:29.452269+0000","last_undegraded":"2024-08-17T02:24:29.452269+0000","last_fullsized":"2024-08-17T02:24:29.452269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:09:30.631732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.460572+0000","last_change":"2024-08-17T02:24:28.423802+0000","last_active":"2024-08-17T02:24:29.460572+0000","last_peered":"2024-08-17T02:24:29.460572+0000","last_clean":"2024-08-17T02:24:29.460572+0000","last_became_active":"2024-08-17T02:24:28.423537+0000","last_became_peered":"2024-08-17T02:24:28.423537+0000","last_unstale":"2024-08-17T02:24:29.460572+0000","last_undegraded":"2024-08-17T02:24:29.460572+0000","last_fullsized":"2024-08-17T02:24:29.460572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:34.991199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.434226+0000","last_change":"2024-08-17T02:24:29.433363+0000","last_active":"2024-08-17T02:24:29.434226+0000","last_peered":"2024-08-17T02:24:29.434226+0000","last_clean":"2024-08-17T02:24:29.434226+0000","last_became_active":"2024-08-17T02:24:29.432999+0000","last_became_peered":"2024-08-17T02:24:29.432999+0000","last_unstale":"2024-08-17T02:24:29.434226+0000","last_undegraded":"2024-08-17T02:24:29.434226+0000","last_fullsized":"2024-08-17T02:24:29.434226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:48.171179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.412490+0000","last_change":"2024-08-17T02:24:28.435566+0000","last_active":"2024-08-17T02:24:29.412490+0000","last_peered":"2024-08-17T02:24:29.412490+0000","last_clean":"2024-08-17T02:24:29.412490+0000","last_became_active":"2024-08-17T02:24:28.434652+0000","last_became_peered":"2024-08-17T02:24:28.434652+0000","last_unstale":"2024-08-17T02:24:29.412490+0000","last_undegraded":"2024-08-17T02:24:29.412490+0000","last_fullsized":"2024-08-17T02:24:29.412490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:33:27.420267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.458174+0000","last_change":"2024-08-17T02:24:29.452901+0000","last_active":"2024-08-17T02:24:29.458174+0000","last_peered":"2024-08-17T02:24:29.458174+0000","last_clean":"2024-08-17T02:24:29.458174+0000","last_became_active":"2024-08-17T02:24:29.452427+0000","last_became_peered":"2024-08-17T02:24:29.452427+0000","last_unstale":"2024-08-17T02:24:29.458174+0000","last_undegraded":"2024-08-17T02:24:29.458174+0000","last_fullsized":"2024-08-17T02:24:29.458174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:51:44.570714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.423410+0000","last_change":"2024-08-17T02:24:25.092772+0000","last_active":"2024-08-17T02:24:29.423410+0000","last_peered":"2024-08-17T02:24:29.423410+0000","last_clean":"2024-08-17T02:24:29.423410+0000","last_became_active":"2024-08-17T02:24:25.091788+0000","last_became_peered":"2024-08-17T02:24:25.091788+0000","last_unstale":"2024-08-17T02:24:29.423410+0000","last_undegraded":"2024-08-17T02:24:29.423410+0000","last_fullsized":"2024-08-17T02:24:29.423410+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:24.051996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:24.051996+0000","last_clean_scrub_stamp":"2024-08-17T02:24:24.051996+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:31:45.454480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.420969+0000","last_change":"2024-08-17T02:24:28.429533+0000","last_active":"2024-08-17T02:24:29.420969+0000","last_peered":"2024-08-17T02:24:29.420969+0000","last_clean":"2024-08-17T02:24:29.420969+0000","last_became_active":"2024-08-17T02:24:28.429243+0000","last_became_peered":"2024-08-17T02:24:28.429243+0000","last_unstale":"2024-08-17T02:24:29.420969+0000","last_undegraded":"2024-08-17T02:24:29.420969+0000","last_fullsized":"2024-08-17T02:24:29.420969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:33:27.420267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.442042+0000","last_change":"2024-08-17T02:24:29.438354+0000","last_active":"2024-08-17T02:24:29.442042+0000","last_peered":"2024-08-17T02:24:29.442042+0000","last_clean":"2024-08-17T02:24:29.442042+0000","last_became_active":"2024-08-17T02:24:29.438160+0000","last_became_peered":"2024-08-17T02:24:29.438160+0000","last_unstale":"2024-08-17T02:24:29.442042+0000","last_undegraded":"2024-08-17T02:24:29.442042+0000","last_fullsized":"2024-08-17T02:24:29.442042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:26:09.573683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.423279+0000","last_change":"2024-08-17T02:24:28.438117+0000","last_active":"2024-08-17T02:24:29.423279+0000","last_peered":"2024-08-17T02:24:29.423279+0000","last_clean":"2024-08-17T02:24:29.423279+0000","last_became_active":"2024-08-17T02:24:28.437884+0000","last_became_peered":"2024-08-17T02:24:28.437884+0000","last_unstale":"2024-08-17T02:24:29.423279+0000","last_undegraded":"2024-08-17T02:24:29.423279+0000","last_fullsized":"2024-08-17T02:24:29.423279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:55:38.492426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.445436+0000","last_change":"2024-08-17T02:24:29.440285+0000","last_active":"2024-08-17T02:24:29.445436+0000","last_peered":"2024-08-17T02:24:29.445436+0000","last_clean":"2024-08-17T02:24:29.445436+0000","last_became_active":"2024-08-17T02:24:29.440027+0000","last_became_peered":"2024-08-17T02:24:29.440027+0000","last_unstale":"2024-08-17T02:24:29.445436+0000","last_undegraded":"2024-08-17T02:24:29.445436+0000","last_fullsized":"2024-08-17T02:24:29.445436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:40:05.110498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.412751+0000","last_change":"2024-08-17T02:24:28.434066+0000","last_active":"2024-08-17T02:24:29.412751+0000","last_peered":"2024-08-17T02:24:29.412751+0000","last_clean":"2024-08-17T02:24:29.412751+0000","last_became_active":"2024-08-17T02:24:28.433660+0000","last_became_peered":"2024-08-17T02:24:28.433660+0000","last_unstale":"2024-08-17T02:24:29.412751+0000","last_undegraded":"2024-08-17T02:24:29.412751+0000","last_fullsized":"2024-08-17T02:24:29.412751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:46:41.928641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.435766+0000","last_change":"2024-08-17T02:24:29.426088+0000","last_active":"2024-08-17T02:24:29.435766+0000","last_peered":"2024-08-17T02:24:29.435766+0000","last_clean":"2024-08-17T02:24:29.435766+0000","last_became_active":"2024-08-17T02:24:29.422286+0000","last_became_peered":"2024-08-17T02:24:29.422286+0000","last_unstale":"2024-08-17T02:24:29.435766+0000","last_undegraded":"2024-08-17T02:24:29.435766+0000","last_fullsized":"2024-08-17T02:24:29.435766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:58:14.241277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.421206+0000","last_change":"2024-08-17T02:24:28.431969+0000","last_active":"2024-08-17T02:24:29.421206+0000","last_peered":"2024-08-17T02:24:29.421206+0000","last_clean":"2024-08-17T02:24:29.421206+0000","last_became_active":"2024-08-17T02:24:28.431732+0000","last_became_peered":"2024-08-17T02:24:28.431732+0000","last_unstale":"2024-08-17T02:24:29.421206+0000","last_undegraded":"2024-08-17T02:24:29.421206+0000","last_fullsized":"2024-08-17T02:24:29.421206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:46:41.928641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.438785+0000","last_change":"2024-08-17T02:24:29.428834+0000","last_active":"2024-08-17T02:24:29.438785+0000","last_peered":"2024-08-17T02:24:29.438785+0000","last_clean":"2024-08-17T02:24:29.438785+0000","last_became_active":"2024-08-17T02:24:29.428548+0000","last_became_peered":"2024-08-17T02:24:29.428548+0000","last_unstale":"2024-08-17T02:24:29.438785+0000","last_undegraded":"2024-08-17T02:24:29.438785+0000","last_fullsized":"2024-08-17T02:24:29.438785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:28:42.709190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.415880+0000","last_change":"2024-08-17T02:24:28.427384+0000","last_active":"2024-08-17T02:24:29.415880+0000","last_peered":"2024-08-17T02:24:29.415880+0000","last_clean":"2024-08-17T02:24:29.415880+0000","last_became_active":"2024-08-17T02:24:28.426523+0000","last_became_peered":"2024-08-17T02:24:28.426523+0000","last_unstale":"2024-08-17T02:24:29.415880+0000","last_undegraded":"2024-08-17T02:24:29.415880+0000","last_fullsized":"2024-08-17T02:24:29.415880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:46:41.928641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450676+0000","last_change":"2024-08-17T02:24:29.441536+0000","last_active":"2024-08-17T02:24:29.450676+0000","last_peered":"2024-08-17T02:24:29.450676+0000","last_clean":"2024-08-17T02:24:29.450676+0000","last_became_active":"2024-08-17T02:24:29.440862+0000","last_became_peered":"2024-08-17T02:24:29.440862+0000","last_unstale":"2024-08-17T02:24:29.450676+0000","last_undegraded":"2024-08-17T02:24:29.450676+0000","last_fullsized":"2024-08-17T02:24:29.450676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:59:44.626213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.424591+0000","last_change":"2024-08-17T02:24:28.441139+0000","last_active":"2024-08-17T02:24:29.424591+0000","last_peered":"2024-08-17T02:24:29.424591+0000","last_clean":"2024-08-17T02:24:29.424591+0000","last_became_active":"2024-08-17T02:24:28.440867+0000","last_became_peered":"2024-08-17T02:24:28.440867+0000","last_unstale":"2024-08-17T02:24:29.424591+0000","last_undegraded":"2024-08-17T02:24:29.424591+0000","last_fullsized":"2024-08-17T02:24:29.424591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:51.790234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.435355+0000","last_change":"2024-08-17T02:24:29.421360+0000","last_active":"2024-08-17T02:24:29.435355+0000","last_peered":"2024-08-17T02:24:29.435355+0000","last_clean":"2024-08-17T02:24:29.435355+0000","last_became_active":"2024-08-17T02:24:29.421136+0000","last_became_peered":"2024-08-17T02:24:29.421136+0000","last_unstale":"2024-08-17T02:24:29.435355+0000","last_undegraded":"2024-08-17T02:24:29.435355+0000","last_fullsized":"2024-08-17T02:24:29.435355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:16.005540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:30.427744+0000","last_change":"2024-08-17T02:24:28.435491+0000","last_active":"2024-08-17T02:24:30.427744+0000","last_peered":"2024-08-17T02:24:30.427744+0000","last_clean":"2024-08-17T02:24:30.427744+0000","last_became_active":"2024-08-17T02:24:28.435238+0000","last_became_peered":"2024-08-17T02:24:28.435238+0000","last_unstale":"2024-08-17T02:24:30.427744+0000","last_undegraded":"2024-08-17T02:24:30.427744+0000","last_fullsized":"2024-08-17T02:24:30.427744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:18:30.215083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.433516+0000","last_change":"2024-08-17T02:24:29.431357+0000","last_active":"2024-08-17T02:24:29.433516+0000","last_peered":"2024-08-17T02:24:29.433516+0000","last_clean":"2024-08-17T02:24:29.433516+0000","last_became_active":"2024-08-17T02:24:29.430069+0000","last_became_peered":"2024-08-17T02:24:29.430069+0000","last_unstale":"2024-08-17T02:24:29.433516+0000","last_undegraded":"2024-08-17T02:24:29.433516+0000","last_fullsized":"2024-08-17T02:24:29.433516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:04:59.407311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.459511+0000","last_change":"2024-08-17T02:24:28.438397+0000","last_active":"2024-08-17T02:24:29.459511+0000","last_peered":"2024-08-17T02:24:29.459511+0000","last_clean":"2024-08-17T02:24:29.459511+0000","last_became_active":"2024-08-17T02:24:28.438086+0000","last_became_peered":"2024-08-17T02:24:28.438086+0000","last_unstale":"2024-08-17T02:24:29.459511+0000","last_undegraded":"2024-08-17T02:24:29.459511+0000","last_fullsized":"2024-08-17T02:24:29.459511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:18:30.215083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.441878+0000","last_change":"2024-08-17T02:24:29.437242+0000","last_active":"2024-08-17T02:24:29.441878+0000","last_peered":"2024-08-17T02:24:29.441878+0000","last_clean":"2024-08-17T02:24:29.441878+0000","last_became_active":"2024-08-17T02:24:29.436992+0000","last_became_peered":"2024-08-17T02:24:29.436992+0000","last_unstale":"2024-08-17T02:24:29.441878+0000","last_undegraded":"2024-08-17T02:24:29.441878+0000","last_fullsized":"2024-08-17T02:24:29.441878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:18:31.217481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.423166+0000","last_change":"2024-08-17T02:24:28.432643+0000","last_active":"2024-08-17T02:24:29.423166+0000","last_peered":"2024-08-17T02:24:29.423166+0000","last_clean":"2024-08-17T02:24:29.423166+0000","last_became_active":"2024-08-17T02:24:28.432360+0000","last_became_peered":"2024-08-17T02:24:28.432360+0000","last_unstale":"2024-08-17T02:24:29.423166+0000","last_undegraded":"2024-08-17T02:24:29.423166+0000","last_fullsized":"2024-08-17T02:24:29.423166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:17:58.120433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.429296+0000","last_change":"2024-08-17T02:24:29.419416+0000","last_active":"2024-08-17T02:24:29.429296+0000","last_peered":"2024-08-17T02:24:29.429296+0000","last_clean":"2024-08-17T02:24:29.429296+0000","last_became_active":"2024-08-17T02:24:29.419140+0000","last_became_peered":"2024-08-17T02:24:29.419140+0000","last_unstale":"2024-08-17T02:24:29.429296+0000","last_undegraded":"2024-08-17T02:24:29.429296+0000","last_fullsized":"2024-08-17T02:24:29.429296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:52.792632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.415080+0000","last_change":"2024-08-17T02:24:28.428331+0000","last_active":"2024-08-17T02:24:29.415080+0000","last_peered":"2024-08-17T02:24:29.415080+0000","last_clean":"2024-08-17T02:24:29.415080+0000","last_became_active":"2024-08-17T02:24:28.428035+0000","last_became_peered":"2024-08-17T02:24:28.428035+0000","last_unstale":"2024-08-17T02:24:29.415080+0000","last_undegraded":"2024-08-17T02:24:29.415080+0000","last_fullsized":"2024-08-17T02:24:29.415080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:51.790234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.433690+0000","last_change":"2024-08-17T02:24:29.431775+0000","last_active":"2024-08-17T02:24:29.433690+0000","last_peered":"2024-08-17T02:24:29.433690+0000","last_clean":"2024-08-17T02:24:29.433690+0000","last_became_active":"2024-08-17T02:24:29.431512+0000","last_became_peered":"2024-08-17T02:24:29.431512+0000","last_unstale":"2024-08-17T02:24:29.433690+0000","last_undegraded":"2024-08-17T02:24:29.433690+0000","last_fullsized":"2024-08-17T02:24:29.433690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:58:14.241277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.415638+0000","last_change":"2024-08-17T02:24:28.431932+0000","last_active":"2024-08-17T02:24:29.415638+0000","last_peered":"2024-08-17T02:24:29.415638+0000","last_clean":"2024-08-17T02:24:29.415638+0000","last_became_active":"2024-08-17T02:24:28.431664+0000","last_became_peered":"2024-08-17T02:24:28.431664+0000","last_unstale":"2024-08-17T02:24:29.415638+0000","last_undegraded":"2024-08-17T02:24:29.415638+0000","last_fullsized":"2024-08-17T02:24:29.415638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:55:38.492426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.431119+0000","last_change":"2024-08-17T02:24:29.429444+0000","last_active":"2024-08-17T02:24:29.431119+0000","last_peered":"2024-08-17T02:24:29.431119+0000","last_clean":"2024-08-17T02:24:29.431119+0000","last_became_active":"2024-08-17T02:24:29.429091+0000","last_became_peered":"2024-08-17T02:24:29.429091+0000","last_unstale":"2024-08-17T02:24:29.431119+0000","last_undegraded":"2024-08-17T02:24:29.431119+0000","last_fullsized":"2024-08-17T02:24:29.431119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:07:03.379300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.460868+0000","last_change":"2024-08-17T02:24:28.437430+0000","last_active":"2024-08-17T02:24:29.460868+0000","last_peered":"2024-08-17T02:24:29.460868+0000","last_clean":"2024-08-17T02:24:29.460868+0000","last_became_active":"2024-08-17T02:24:28.437238+0000","last_became_peered":"2024-08-17T02:24:28.437238+0000","last_unstale":"2024-08-17T02:24:29.460868+0000","last_undegraded":"2024-08-17T02:24:29.460868+0000","last_fullsized":"2024-08-17T02:24:29.460868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:28:41.706792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.432294+0000","last_change":"2024-08-17T02:24:29.430603+0000","last_active":"2024-08-17T02:24:29.432294+0000","last_peered":"2024-08-17T02:24:29.432294+0000","last_clean":"2024-08-17T02:24:29.432294+0000","last_became_active":"2024-08-17T02:24:29.430340+0000","last_became_peered":"2024-08-17T02:24:29.430340+0000","last_unstale":"2024-08-17T02:24:29.432294+0000","last_undegraded":"2024-08-17T02:24:29.432294+0000","last_fullsized":"2024-08-17T02:24:29.432294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:23:46.771394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450807+0000","last_change":"2024-08-17T02:24:29.441738+0000","last_active":"2024-08-17T02:24:29.450807+0000","last_peered":"2024-08-17T02:24:29.450807+0000","last_clean":"2024-08-17T02:24:29.450807+0000","last_became_active":"2024-08-17T02:24:29.441181+0000","last_became_peered":"2024-08-17T02:24:29.441181+0000","last_unstale":"2024-08-17T02:24:29.450807+0000","last_undegraded":"2024-08-17T02:24:29.450807+0000","last_fullsized":"2024-08-17T02:24:29.450807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:18:37.161695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.460138+0000","last_change":"2024-08-17T02:24:28.436783+0000","last_active":"2024-08-17T02:24:29.460138+0000","last_peered":"2024-08-17T02:24:29.460138+0000","last_clean":"2024-08-17T02:24:29.460138+0000","last_became_active":"2024-08-17T02:24:28.436552+0000","last_became_peered":"2024-08-17T02:24:28.436552+0000","last_unstale":"2024-08-17T02:24:29.460138+0000","last_undegraded":"2024-08-17T02:24:29.460138+0000","last_fullsized":"2024-08-17T02:24:29.460138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:18:30.215083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.450243+0000","last_change":"2024-08-17T02:24:29.440059+0000","last_active":"2024-08-17T02:24:29.450243+0000","last_peered":"2024-08-17T02:24:29.450243+0000","last_clean":"2024-08-17T02:24:29.450243+0000","last_became_active":"2024-08-17T02:24:29.439878+0000","last_became_peered":"2024-08-17T02:24:29.439878+0000","last_unstale":"2024-08-17T02:24:29.450243+0000","last_undegraded":"2024-08-17T02:24:29.450243+0000","last_fullsized":"2024-08-17T02:24:29.450243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:23:46.771394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.461971+0000","last_change":"2024-08-17T02:24:28.435398+0000","last_active":"2024-08-17T02:24:29.461971+0000","last_peered":"2024-08-17T02:24:29.461971+0000","last_clean":"2024-08-17T02:24:29.461971+0000","last_became_active":"2024-08-17T02:24:28.435119+0000","last_became_peered":"2024-08-17T02:24:28.435119+0000","last_unstale":"2024-08-17T02:24:29.461971+0000","last_undegraded":"2024-08-17T02:24:29.461971+0000","last_fullsized":"2024-08-17T02:24:29.461971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:18:02.165697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.437418+0000","last_change":"2024-08-17T02:24:29.434467+0000","last_active":"2024-08-17T02:24:29.437418+0000","last_peered":"2024-08-17T02:24:29.437418+0000","last_clean":"2024-08-17T02:24:29.437418+0000","last_became_active":"2024-08-17T02:24:29.434160+0000","last_became_peered":"2024-08-17T02:24:29.434160+0000","last_unstale":"2024-08-17T02:24:29.437418+0000","last_undegraded":"2024-08-17T02:24:29.437418+0000","last_fullsized":"2024-08-17T02:24:29.437418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:58:14.241277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.457800+0000","last_change":"2024-08-17T02:24:28.431371+0000","last_active":"2024-08-17T02:24:29.457800+0000","last_peered":"2024-08-17T02:24:29.457800+0000","last_clean":"2024-08-17T02:24:29.457800+0000","last_became_active":"2024-08-17T02:24:28.431097+0000","last_became_peered":"2024-08-17T02:24:28.431097+0000","last_unstale":"2024-08-17T02:24:29.457800+0000","last_undegraded":"2024-08-17T02:24:29.457800+0000","last_fullsized":"2024-08-17T02:24:29.457800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:34.991199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.441162+0000","last_change":"2024-08-17T02:24:29.436845+0000","last_active":"2024-08-17T02:24:29.441162+0000","last_peered":"2024-08-17T02:24:29.441162+0000","last_clean":"2024-08-17T02:24:29.441162+0000","last_became_active":"2024-08-17T02:24:29.436419+0000","last_became_peered":"2024-08-17T02:24:29.436419+0000","last_unstale":"2024-08-17T02:24:29.441162+0000","last_undegraded":"2024-08-17T02:24:29.441162+0000","last_fullsized":"2024-08-17T02:24:29.441162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:28.402055+0000","last_clean_scrub_stamp":"2024-08-17T02:24:28.402055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:48.171179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:24:29.457139+0000","last_change":"2024-08-17T02:24:28.428299+0000","last_active":"2024-08-17T02:24:29.457139+0000","last_peered":"2024-08-17T02:24:29.457139+0000","last_clean":"2024-08-17T02:24:29.457139+0000","last_became_active":"2024-08-17T02:24:28.428067+0000","last_became_peered":"2024-08-17T02:24:28.428067+0000","last_unstale":"2024-08-17T02:24:29.457139+0000","last_undegraded":"2024-08-17T02:24:29.457139+0000","last_fullsized":"2024-08-17T02:24:29.457139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:27.399657+0000","last_clean_scrub_stamp":"2024-08-17T02:24:27.399657+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:33:27.420267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302312,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069528,"statfs":{"total":96636764160,"available":96327196672,"internally_reserved":0,"allocated":815104,"data_stored":666251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301744,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070096,"statfs":{"total":96636764160,"available":96327778304,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301736,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070104,"statfs":{"total":96636764160,"available":96327786496,"internally_reserved":0,"allocated":221184,"data_stored":75403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.119}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2559999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2229999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301744,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070096,"statfs":{"total":96636764160,"available":96327778304,"internally_reserved":0,"allocated":229376,"data_stored":75439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":217088,"data_stored":75313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":225280,"data_stored":75473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298160,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073680,"statfs":{"total":96636764160,"available":96331448320,"internally_reserved":0,"allocated":823296,"data_stored":666307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:24:38.869 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-17T02:24:38.869 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-17T02:24:38.869 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-08-17T02:24:38.870 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-08-17T02:24:39.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.050+0000 7f239a000640 1 Processor -- start 2024-08-17T02:24:39.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.050+0000 7f239a000640 1 -- start start 2024-08-17T02:24:39.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.051+0000 7f239a000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f23940c67e0 0x7f2394159060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:39.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.051+0000 7f239a000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f23940d06e0 0x7f23940b2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:39.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.051+0000 7f239a000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23940cee10 con 0x7f2394158c90 2024-08-17T02:24:39.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.051+0000 7f239a000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23940cbd70 con 0x7f23940c67e0 2024-08-17T02:24:39.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.051+0000 7f239a000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23940ceb30 con 0x7f23940d06e0 2024-08-17T02:24:39.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.051+0000 7f2398c00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f2394158c90 0x7f23940caa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:33922/0 (socket says 172.21.15.107:33922) 2024-08-17T02:24:39.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.051+0000 7f2398c00640 1 -- 172.21.15.107:0/2654430000 learned_addr learned my addr 172.21.15.107:0/2654430000 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:39.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.051+0000 7f2393e00640 1 --2- 172.21.15.107:0/2654430000 >> v2:172.21.15.107:3300/0 conn(0x7f23940c67e0 0x7f2394159060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:39.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.052+0000 7f2399600640 1 --2- 172.21.15.107:0/2654430000 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f23940d06e0 0x7f23940b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:39.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.052+0000 7f2393400640 1 -- 172.21.15.107:0/2654430000 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3748857651 0 0) 0x7f23940cee10 con 0x7f2394158c90 2024-08-17T02:24:39.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.052+0000 7f2393400640 1 -- 172.21.15.107:0/2654430000 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f237c0034e0 con 0x7f2394158c90 2024-08-17T02:24:39.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.052+0000 7f2393e00640 1 -- 172.21.15.107:0/2654430000 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f23940d06e0 msgr2=0x7f23940b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:39.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.052+0000 7f2393e00640 1 --2- 172.21.15.107:0/2654430000 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f23940d06e0 0x7f23940b2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.052+0000 7f2393e00640 1 -- 172.21.15.107:0/2654430000 >> v1:172.21.15.107:6789/0 conn(0x7f2394158c90 legacy=0x7f23940caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:39.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.052+0000 7f2393e00640 1 -- 172.21.15.107:0/2654430000 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23940cb720 con 0x7f23940c67e0 2024-08-17T02:24:39.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.053+0000 7f2393e00640 1 --2- 172.21.15.107:0/2654430000 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23940c67e0 0x7f2394159060 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2380009850 tx=0x7f23800090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d6a9e270fc04dbf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:39.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.053+0000 7f2393400640 1 -- 172.21.15.107:0/2654430000 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238002ad00 con 0x7f23940c67e0 2024-08-17T02:24:39.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.053+0000 7f2393400640 1 -- 172.21.15.107:0/2654430000 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238002ae60 con 0x7f23940c67e0 2024-08-17T02:24:39.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.053+0000 7f2393400640 1 -- 172.21.15.107:0/2654430000 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2380032670 con 0x7f23940c67e0 2024-08-17T02:24:39.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.054+0000 7f239a000640 1 -- 172.21.15.107:0/2654430000 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23940c67e0 msgr2=0x7f2394159060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:39.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.054+0000 7f239a000640 1 --2- 172.21.15.107:0/2654430000 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23940c67e0 0x7f2394159060 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2380009850 tx=0x7f23800090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.054+0000 7f239a000640 1 -- 172.21.15.107:0/2654430000 shutdown_connections 2024-08-17T02:24:39.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.054+0000 7f239a000640 1 --2- 172.21.15.107:0/2654430000 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f23940d06e0 0x7f23940b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.054+0000 7f239a000640 1 --2- 172.21.15.107:0/2654430000 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23940c67e0 0x7f2394159060 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.054+0000 7f239a000640 1 -- 172.21.15.107:0/2654430000 >> 172.21.15.107:0/2654430000 conn(0x7f23940cfbd0 msgr2=0x7f23940cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:39.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.054+0000 7f239a000640 1 -- 172.21.15.107:0/2654430000 shutdown_connections 2024-08-17T02:24:39.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.054+0000 7f239a000640 1 -- 172.21.15.107:0/2654430000 wait complete. 2024-08-17T02:24:39.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.055+0000 7f239a000640 1 Processor -- start 2024-08-17T02:24:39.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.055+0000 7f239a000640 1 -- start start 2024-08-17T02:24:39.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.056+0000 7f239a000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23940c67e0 0x7f239413e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:39.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.056+0000 7f239a000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23940d06e0 0x7f23940c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:39.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.056+0000 7f239a000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2394158c90 0x7f23940c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:39.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.056+0000 7f239a000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23940c91d0 con 0x7f23940d06e0 2024-08-17T02:24:39.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.056+0000 7f239a000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239413ee90 con 0x7f23940c67e0 2024-08-17T02:24:39.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.056+0000 7f239a000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23940c85c0 con 0x7f2394158c90 2024-08-17T02:24:39.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.057+0000 7f2393e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23940d06e0 0x7f23940c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:39.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.057+0000 7f2393e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23940d06e0 0x7f23940c7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60896/0 (socket says 172.21.15.107:60896) 2024-08-17T02:24:39.059 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.057+0000 7f2393e00640 1 -- 172.21.15.107:0/225324293 learned_addr learned my addr 172.21.15.107:0/225324293 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:39.059 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.057+0000 7f2398c00640 1 --2- 172.21.15.107:0/225324293 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23940c67e0 0x7f239413e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:39.059 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.057+0000 7f2399600640 1 --2- 172.21.15.107:0/225324293 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2394158c90 0x7f23940c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:39.059 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.057+0000 7f2393e00640 1 -- 172.21.15.107:0/225324293 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2394158c90 msgr2=0x7f23940c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:39.059 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.057+0000 7f2393e00640 1 --2- 172.21.15.107:0/225324293 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2394158c90 0x7f23940c9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.059 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.057+0000 7f2393e00640 1 -- 172.21.15.107:0/225324293 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23940c67e0 msgr2=0x7f239413e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:39.059 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.057+0000 7f2393e00640 1 --2- 172.21.15.107:0/225324293 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23940c67e0 0x7f239413e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.059 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.057+0000 7f2393e00640 1 -- 172.21.15.107:0/225324293 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2380009390 con 0x7f23940d06e0 2024-08-17T02:24:39.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.057+0000 7f2393e00640 1 --2- 172.21.15.107:0/225324293 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23940d06e0 0x7f23940c7c90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2380009850 tx=0x7f2380032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:39.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.058+0000 7f2387e00640 1 -- 172.21.15.107:0/225324293 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238003b6e0 con 0x7f23940d06e0 2024-08-17T02:24:39.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.058+0000 7f2387e00640 1 -- 172.21.15.107:0/225324293 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238003b840 con 0x7f23940d06e0 2024-08-17T02:24:39.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.058+0000 7f239a000640 1 -- 172.21.15.107:0/225324293 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23940c88a0 con 0x7f23940d06e0 2024-08-17T02:24:39.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.058+0000 7f2387e00640 1 -- 172.21.15.107:0/225324293 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238003bc00 con 0x7f23940d06e0 2024-08-17T02:24:39.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.058+0000 7f239a000640 1 -- 172.21.15.107:0/225324293 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23940c8e60 con 0x7f23940d06e0 2024-08-17T02:24:39.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.059+0000 7f239a000640 1 -- 172.21.15.107:0/225324293 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23940c9380 con 0x7f23940d06e0 2024-08-17T02:24:39.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.059+0000 7f2387e00640 1 -- 172.21.15.107:0/225324293 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2380043030 con 0x7f23940d06e0 2024-08-17T02:24:39.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.060+0000 7f2387e00640 1 --2- 172.21.15.107:0/225324293 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f2374065150 0x7f2374067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:39.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.060+0000 7f2387e00640 1 -- 172.21.15.107:0/225324293 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2380041070 con 0x7f23940d06e0 2024-08-17T02:24:39.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.060+0000 7f2398c00640 1 --2- 172.21.15.107:0/225324293 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f2374065150 0x7f2374067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:39.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.061+0000 7f2398c00640 1 --2- 172.21.15.107:0/225324293 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f2374065150 0x7f2374067600 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2388005840 tx=0x7f2388009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:39.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.064+0000 7f2387e00640 1 -- 172.21.15.107:0/225324293 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f23940c9380 con 0x7f23940d06e0 2024-08-17T02:24:39.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.271+0000 7f239a000640 1 -- 172.21.15.107:0/225324293 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f23940c9380 con 0x7f23940d06e0 2024-08-17T02:24:39.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.272+0000 7f2387e00640 1 -- 172.21.15.107:0/225324293 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f23940c9380 con 0x7f23940d06e0 2024-08-17T02:24:39.273 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:24:39.273 INFO:teuthology.orchestra.run.smithi107.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-17T02:24:39.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.274+0000 7f239a000640 1 -- 172.21.15.107:0/225324293 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f2374065150 msgr2=0x7f2374067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:39.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.274+0000 7f239a000640 1 --2- 172.21.15.107:0/225324293 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f2374065150 0x7f2374067600 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2388005840 tx=0x7f2388009040 comp rx=0 tx=0).stop 2024-08-17T02:24:39.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.274+0000 7f239a000640 1 -- 172.21.15.107:0/225324293 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23940d06e0 msgr2=0x7f23940c7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:39.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.274+0000 7f239a000640 1 --2- 172.21.15.107:0/225324293 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23940d06e0 0x7f23940c7c90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2380009850 tx=0x7f2380032000 comp rx=0 tx=0).stop 2024-08-17T02:24:39.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.274+0000 7f239a000640 1 -- 172.21.15.107:0/225324293 shutdown_connections 2024-08-17T02:24:39.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.274+0000 7f239a000640 1 --2- 172.21.15.107:0/225324293 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f2374065150 0x7f2374067600 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.274+0000 7f239a000640 1 --2- 172.21.15.107:0/225324293 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2394158c90 0x7f23940c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.274+0000 7f239a000640 1 --2- 172.21.15.107:0/225324293 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23940d06e0 0x7f23940c7c90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.274+0000 7f239a000640 1 --2- 172.21.15.107:0/225324293 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23940c67e0 0x7f239413e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.274+0000 7f239a000640 1 -- 172.21.15.107:0/225324293 >> 172.21.15.107:0/225324293 conn(0x7f23940cfbd0 msgr2=0x7f23940c55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:39.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.274+0000 7f239a000640 1 -- 172.21.15.107:0/225324293 shutdown_connections 2024-08-17T02:24:39.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.274+0000 7f239a000640 1 -- 172.21.15.107:0/225324293 wait complete. 2024-08-17T02:24:39.290 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-08-17T02:24:39.290 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:39.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.437+0000 7f0e67800640 1 Processor -- start 2024-08-17T02:24:39.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.437+0000 7f0e67800640 1 -- start start 2024-08-17T02:24:39.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.439+0000 7f0e67800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0e600b1440 0x7f0e600caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:39.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.439+0000 7f0e67800640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0e60140580 0x7f0e600c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:39.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.439+0000 7f0e67800640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e600caa80 con 0x7f0e601401b0 2024-08-17T02:24:39.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.439+0000 7f0e67800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e600cb450 con 0x7f0e600b1440 2024-08-17T02:24:39.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.439+0000 7f0e67800640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e600c9e70 con 0x7f0e60140580 2024-08-17T02:24:39.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.439+0000 7f0e57e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0e600b1440 0x7f0e600caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:39.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.439+0000 7f0e57e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0e600b1440 0x7f0e600caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60900/0 (socket says 172.21.15.107:60900) 2024-08-17T02:24:39.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.439+0000 7f0e57e00640 1 -- 172.21.15.107:0/1396712497 learned_addr learned my addr 172.21.15.107:0/1396712497 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:39.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.439+0000 7f0e65800640 1 --2- 172.21.15.107:0/1396712497 >> v2:172.21.15.157:3300/0 conn(0x7f0e60140580 0x7f0e600c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:39.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.439+0000 7f0e57e00640 1 -- 172.21.15.107:0/1396712497 >> v2:172.21.15.157:3300/0 conn(0x7f0e60140580 msgr2=0x7f0e600c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:39.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.439+0000 7f0e57e00640 1 --2- 172.21.15.107:0/1396712497 >> v2:172.21.15.157:3300/0 conn(0x7f0e60140580 0x7f0e600c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.439+0000 7f0e57e00640 1 -- 172.21.15.107:0/1396712497 >> v1:172.21.15.157:6789/0 conn(0x7f0e601401b0 legacy=0x7f0e600b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:39.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.439+0000 7f0e57e00640 1 -- 172.21.15.107:0/1396712497 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e600ca150 con 0x7f0e600b1440 2024-08-17T02:24:39.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.439+0000 7f0e5fe00640 1 -- 172.21.15.107:0/1396712497 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2957057073 0 0) 0x7f0e600caa80 con 0x7f0e601401b0 2024-08-17T02:24:39.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.440+0000 7f0e57e00640 1 --2- 172.21.15.107:0/1396712497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e600b1440 0x7f0e600caf10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0e600ca9f0 tx=0x7f0e480091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce9bafe4640629f8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:39.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.441+0000 7f0e5fe00640 1 -- 172.21.15.107:0/1396712497 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4802ae80 con 0x7f0e600b1440 2024-08-17T02:24:39.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.441+0000 7f0e5fe00640 1 -- 172.21.15.107:0/1396712497 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e48032440 con 0x7f0e600b1440 2024-08-17T02:24:39.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.441+0000 7f0e5fe00640 1 -- 172.21.15.107:0/1396712497 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e480327c0 con 0x7f0e600b1440 2024-08-17T02:24:39.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.441+0000 7f0e67800640 1 -- 172.21.15.107:0/1396712497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e600b1440 msgr2=0x7f0e600caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:39.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.441+0000 7f0e67800640 1 --2- 172.21.15.107:0/1396712497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e600b1440 0x7f0e600caf10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0e600ca9f0 tx=0x7f0e480091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.441+0000 7f0e67800640 1 -- 172.21.15.107:0/1396712497 shutdown_connections 2024-08-17T02:24:39.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.441+0000 7f0e67800640 1 --2- 172.21.15.107:0/1396712497 >> v2:172.21.15.157:3300/0 conn(0x7f0e60140580 0x7f0e600c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.441+0000 7f0e67800640 1 --2- 172.21.15.107:0/1396712497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e600b1440 0x7f0e600caf10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.441+0000 7f0e67800640 1 -- 172.21.15.107:0/1396712497 >> 172.21.15.107:0/1396712497 conn(0x7f0e600cb9b0 msgr2=0x7f0e600cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:39.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.441+0000 7f0e67800640 1 -- 172.21.15.107:0/1396712497 shutdown_connections 2024-08-17T02:24:39.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.441+0000 7f0e67800640 1 -- 172.21.15.107:0/1396712497 wait complete. 2024-08-17T02:24:39.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.443+0000 7f0e67800640 1 Processor -- start 2024-08-17T02:24:39.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.443+0000 7f0e67800640 1 -- start start 2024-08-17T02:24:39.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.443+0000 7f0e67800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e600b1440 0x7f0e6012cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:39.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.443+0000 7f0e67800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0e601401b0 0x7f0e6015ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:39.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.443+0000 7f0e67800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e60140580 0x7f0e600c4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:39.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.444+0000 7f0e67800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6012d300 con 0x7f0e600b1440 2024-08-17T02:24:39.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.444+0000 7f0e67800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6013d260 con 0x7f0e60140580 2024-08-17T02:24:39.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.444+0000 7f0e67800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e600c4c70 con 0x7f0e601401b0 2024-08-17T02:24:39.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.444+0000 7f0e64e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e600b1440 0x7f0e6012cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:39.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.444+0000 7f0e64e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e600b1440 0x7f0e6012cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60912/0 (socket says 172.21.15.107:60912) 2024-08-17T02:24:39.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.444+0000 7f0e64e00640 1 -- 172.21.15.107:0/2239177806 learned_addr learned my addr 172.21.15.107:0/2239177806 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:39.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.444+0000 7f0e65800640 1 --2- 172.21.15.107:0/2239177806 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e60140580 0x7f0e600c4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:39.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.444+0000 7f0e57e00640 1 --2- 172.21.15.107:0/2239177806 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0e601401b0 0x7f0e6015ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:39.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.444+0000 7f0e64e00640 1 -- 172.21.15.107:0/2239177806 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0e601401b0 msgr2=0x7f0e6015ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:39.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.444+0000 7f0e64e00640 1 --2- 172.21.15.107:0/2239177806 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0e601401b0 0x7f0e6015ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.444+0000 7f0e64e00640 1 -- 172.21.15.107:0/2239177806 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e60140580 msgr2=0x7f0e600c4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:39.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.444+0000 7f0e64e00640 1 --2- 172.21.15.107:0/2239177806 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e60140580 0x7f0e600c4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.444+0000 7f0e64e00640 1 -- 172.21.15.107:0/2239177806 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e48009450 con 0x7f0e600b1440 2024-08-17T02:24:39.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.444+0000 7f0e57e00640 1 --2- 172.21.15.107:0/2239177806 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0e601401b0 0x7f0e6015ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:39.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.444+0000 7f0e64e00640 1 --2- 172.21.15.107:0/2239177806 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e600b1440 0x7f0e6012cdc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0e5000c5b0 tx=0x7f0e50007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:39.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.445+0000 7f0e5cc00640 1 -- 172.21.15.107:0/2239177806 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e50012630 con 0x7f0e600b1440 2024-08-17T02:24:39.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.445+0000 7f0e5cc00640 1 -- 172.21.15.107:0/2239177806 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e500127d0 con 0x7f0e600b1440 2024-08-17T02:24:39.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.445+0000 7f0e5cc00640 1 -- 172.21.15.107:0/2239177806 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e50012b90 con 0x7f0e600b1440 2024-08-17T02:24:39.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.445+0000 7f0e67800640 1 -- 172.21.15.107:0/2239177806 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e600c4f50 con 0x7f0e600b1440 2024-08-17T02:24:39.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.445+0000 7f0e67800640 1 -- 172.21.15.107:0/2239177806 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e600c5510 con 0x7f0e600b1440 2024-08-17T02:24:39.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.446+0000 7f0e67800640 1 -- 172.21.15.107:0/2239177806 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e60064db0 con 0x7f0e600b1440 2024-08-17T02:24:39.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.446+0000 7f0e5cc00640 1 -- 172.21.15.107:0/2239177806 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0e5001b400 con 0x7f0e600b1440 2024-08-17T02:24:39.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.447+0000 7f0e5cc00640 1 --2- 172.21.15.107:0/2239177806 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f0e3c065150 0x7f0e3c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:39.449 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.447+0000 7f0e5cc00640 1 -- 172.21.15.107:0/2239177806 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0e50082070 con 0x7f0e600b1440 2024-08-17T02:24:39.449 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.447+0000 7f0e57e00640 1 --2- 172.21.15.107:0/2239177806 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f0e3c065150 0x7f0e3c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:39.449 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.448+0000 7f0e57e00640 1 --2- 172.21.15.107:0/2239177806 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f0e3c065150 0x7f0e3c067600 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0e48034000 tx=0x7f0e48032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:39.452 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.451+0000 7f0e5cc00640 1 -- 172.21.15.107:0/2239177806 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0e50050090 con 0x7f0e600b1440 2024-08-17T02:24:39.628 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.627+0000 7f0e67800640 1 -- 172.21.15.107:0/2239177806 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e6006a120 con 0x7f0e600b1440 2024-08-17T02:24:39.629 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.628+0000 7f0e5cc00640 1 -- 172.21.15.107:0/2239177806 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f0e500536b0 con 0x7f0e600b1440 2024-08-17T02:24:39.629 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:24:39.629 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":21,"fsid":"f207b4c0-329d-46b8-b83f-aaf30bdb6ce3","created":"2024-08-17T02:24:11.038049+0000","modified":"2024-08-17T02:24:30.420018+0000","last_up_change":"2024-08-17T02:24:22.047790+0000","last_in_change":"2024-08-17T02:24:13.892720+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:23.456166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:27.078670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:27.804418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"376363f3-b8bf-4f1e-b691-51cdd39171ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37302},{"type":"v1","addr":"172.21.15.107:6801","nonce":37302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37302},{"type":"v1","addr":"172.21.15.107:6803","nonce":37302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37302},{"type":"v1","addr":"172.21.15.107:6807","nonce":37302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37302},{"type":"v1","addr":"172.21.15.107:6805","nonce":37302}]},"public_addr":"172.21.15.107:6801/37302","cluster_addr":"172.21.15.107:6803/37302","heartbeat_back_addr":"172.21.15.107:6807/37302","heartbeat_front_addr":"172.21.15.107:6805/37302","state":["exists","up"]},{"osd":1,"uuid":"cc6624e3-2ad4-4db4-b377-05dfe57424e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37305},{"type":"v1","addr":"172.21.15.107:6824","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37305},{"type":"v1","addr":"172.21.15.107:6827","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37305},{"type":"v1","addr":"172.21.15.107:6831","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37305},{"type":"v1","addr":"172.21.15.107:6829","nonce":37305}]},"public_addr":"172.21.15.107:6824/37305","cluster_addr":"172.21.15.107:6827/37305","heartbeat_back_addr":"172.21.15.107:6831/37305","heartbeat_front_addr":"172.21.15.107:6829/37305","state":["exists","up"]},{"osd":2,"uuid":"25229542-29b5-4281-bcb0-798ae0930aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37307},{"type":"v1","addr":"172.21.15.107:6817","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37307},{"type":"v1","addr":"172.21.15.107:6819","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6823","nonce":37307},{"type":"v1","addr":"172.21.15.107:6825","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37307},{"type":"v1","addr":"172.21.15.107:6821","nonce":37307}]},"public_addr":"172.21.15.107:6817/37307","cluster_addr":"172.21.15.107:6819/37307","heartbeat_back_addr":"172.21.15.107:6825/37307","heartbeat_front_addr":"172.21.15.107:6821/37307","state":["exists","up"]},{"osd":3,"uuid":"5f16aee8-8950-4268-a61a-5cf6ebd670e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37306},{"type":"v1","addr":"172.21.15.107:6809","nonce":37306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37306},{"type":"v1","addr":"172.21.15.107:6811","nonce":37306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37306},{"type":"v1","addr":"172.21.15.107:6815","nonce":37306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37306},{"type":"v1","addr":"172.21.15.107:6813","nonce":37306}]},"public_addr":"172.21.15.107:6809/37306","cluster_addr":"172.21.15.107:6811/37306","heartbeat_back_addr":"172.21.15.107:6815/37306","heartbeat_front_addr":"172.21.15.107:6813/37306","state":["exists","up"]},{"osd":4,"uuid":"23232e28-e23b-4b4e-a531-4939246dbbde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":37329},{"type":"v1","addr":"172.21.15.157:6817","nonce":37329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":37329},{"type":"v1","addr":"172.21.15.157:6819","nonce":37329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":37329},{"type":"v1","addr":"172.21.15.157:6823","nonce":37329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":37329},{"type":"v1","addr":"172.21.15.157:6821","nonce":37329}]},"public_addr":"172.21.15.157:6817/37329","cluster_addr":"172.21.15.157:6819/37329","heartbeat_back_addr":"172.21.15.157:6823/37329","heartbeat_front_addr":"172.21.15.157:6821/37329","state":["exists","up"]},{"osd":5,"uuid":"f87ec331-3e59-4886-a317-6f7e26ec8e21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":37328},{"type":"v1","addr":"172.21.15.157:6804","nonce":37328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":37328},{"type":"v1","addr":"172.21.15.157:6808","nonce":37328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":37328},{"type":"v1","addr":"172.21.15.157:6815","nonce":37328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":37328},{"type":"v1","addr":"172.21.15.157:6812","nonce":37328}]},"public_addr":"172.21.15.157:6804/37328","cluster_addr":"172.21.15.157:6808/37328","heartbeat_back_addr":"172.21.15.157:6815/37328","heartbeat_front_addr":"172.21.15.157:6812/37328","state":["exists","up"]},{"osd":6,"uuid":"92852235-ce49-4d96-a940-6f18d97b13ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":37330},{"type":"v1","addr":"172.21.15.157:6801","nonce":37330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6803","nonce":37330},{"type":"v1","addr":"172.21.15.157:6805","nonce":37330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":37330},{"type":"v1","addr":"172.21.15.157:6813","nonce":37330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":37330},{"type":"v1","addr":"172.21.15.157:6809","nonce":37330}]},"public_addr":"172.21.15.157:6801/37330","cluster_addr":"172.21.15.157:6805/37330","heartbeat_back_addr":"172.21.15.157:6813/37330","heartbeat_front_addr":"172.21.15.157:6809/37330","state":["exists","up"]},{"osd":7,"uuid":"7484a061-723d-4663-b28f-b01766d62f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":37373},{"type":"v1","addr":"172.21.15.157:6825","nonce":37373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":37373},{"type":"v1","addr":"172.21.15.157:6827","nonce":37373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":37373},{"type":"v1","addr":"172.21.15.157:6831","nonce":37373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":37373},{"type":"v1","addr":"172.21.15.157:6829","nonce":37373}]},"public_addr":"172.21.15.157:6825/37373","cluster_addr":"172.21.15.157:6827/37373","heartbeat_back_addr":"172.21.15.157:6831/37373","heartbeat_front_addr":"172.21.15.157:6829/37373","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.110188+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.280265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.252119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.267996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.284582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.144420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.174764+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.308002+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:39.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.630+0000 7f0e67800640 1 -- 172.21.15.107:0/2239177806 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f0e3c065150 msgr2=0x7f0e3c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:39.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.630+0000 7f0e67800640 1 --2- 172.21.15.107:0/2239177806 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f0e3c065150 0x7f0e3c067600 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0e48034000 tx=0x7f0e48032000 comp rx=0 tx=0).stop 2024-08-17T02:24:39.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.630+0000 7f0e67800640 1 -- 172.21.15.107:0/2239177806 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e600b1440 msgr2=0x7f0e6012cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:39.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.630+0000 7f0e67800640 1 --2- 172.21.15.107:0/2239177806 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e600b1440 0x7f0e6012cdc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0e5000c5b0 tx=0x7f0e50007d60 comp rx=0 tx=0).stop 2024-08-17T02:24:39.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.630+0000 7f0e67800640 1 -- 172.21.15.107:0/2239177806 shutdown_connections 2024-08-17T02:24:39.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.630+0000 7f0e67800640 1 --2- 172.21.15.107:0/2239177806 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f0e3c065150 0x7f0e3c067600 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.630+0000 7f0e67800640 1 --2- 172.21.15.107:0/2239177806 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e60140580 0x7f0e600c4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.630+0000 7f0e67800640 1 --2- 172.21.15.107:0/2239177806 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0e601401b0 0x7f0e6015ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.630+0000 7f0e67800640 1 --2- 172.21.15.107:0/2239177806 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e600b1440 0x7f0e6012cdc0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.630+0000 7f0e67800640 1 -- 172.21.15.107:0/2239177806 >> 172.21.15.107:0/2239177806 conn(0x7f0e600cb9b0 msgr2=0x7f0e601591a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:39.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.630+0000 7f0e67800640 1 -- 172.21.15.107:0/2239177806 shutdown_connections 2024-08-17T02:24:39.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.630+0000 7f0e67800640 1 -- 172.21.15.107:0/2239177806 wait complete. 2024-08-17T02:24:39.647 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:24:23.456166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:24:27.078670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:24:27.804418+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:24:39.647 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:24:39.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.797+0000 7f328ae00640 1 Processor -- start 2024-08-17T02:24:39.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.797+0000 7f328ae00640 1 -- start start 2024-08-17T02:24:39.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.798+0000 7f328ae00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3284158c20 0x7f32840ac040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:39.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.798+0000 7f328ae00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f32840ac580 0x7f3284068fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:39.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.798+0000 7f328ae00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3284069510 0x7f32840aa7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:39.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.798+0000 7f328ae00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32840aeca0 con 0x7f3284158c20 2024-08-17T02:24:39.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.798+0000 7f328ae00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32840ac9d0 con 0x7f32840ac580 2024-08-17T02:24:39.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.798+0000 7f328ae00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32840ae3e0 con 0x7f3284069510 2024-08-17T02:24:39.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.798+0000 7f3289a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3284158c20 0x7f32840ac040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:39.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.798+0000 7f3289a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3284158c20 0x7f32840ac040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60928/0 (socket says 172.21.15.107:60928) 2024-08-17T02:24:39.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.798+0000 7f3289a00640 1 -- 172.21.15.107:0/597902430 learned_addr learned my addr 172.21.15.107:0/597902430 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:39.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.799+0000 7f328a400640 1 --2- 172.21.15.107:0/597902430 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3284069510 0x7f32840aa7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:39.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.799+0000 7f3289000640 1 --2- 172.21.15.107:0/597902430 >> v2:172.21.15.157:3300/0 conn(0x7f32840ac580 0x7f3284068fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:39.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.799+0000 7f3289a00640 1 -- 172.21.15.107:0/597902430 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3284069510 msgr2=0x7f32840aa7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:39.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.799+0000 7f3289a00640 1 --2- 172.21.15.107:0/597902430 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3284069510 0x7f32840aa7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.799+0000 7f3289a00640 1 -- 172.21.15.107:0/597902430 >> v2:172.21.15.157:3300/0 conn(0x7f32840ac580 msgr2=0x7f3284068fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:39.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.799+0000 7f3289a00640 1 --2- 172.21.15.107:0/597902430 >> v2:172.21.15.157:3300/0 conn(0x7f32840ac580 0x7f3284068fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.799+0000 7f3289a00640 1 -- 172.21.15.107:0/597902430 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32840ae650 con 0x7f3284158c20 2024-08-17T02:24:39.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.799+0000 7f328a400640 1 --2- 172.21.15.107:0/597902430 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3284069510 0x7f32840aa7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:39.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.799+0000 7f3289000640 1 --2- 172.21.15.107:0/597902430 >> v2:172.21.15.157:3300/0 conn(0x7f32840ac580 0x7f3284068fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:39.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.800+0000 7f3289a00640 1 --2- 172.21.15.107:0/597902430 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3284158c20 0x7f32840ac040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f328406d250 tx=0x7f32780091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb0a246d6195f0e9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:39.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.800+0000 7f3283e00640 1 -- 172.21.15.107:0/597902430 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327802ad40 con 0x7f3284158c20 2024-08-17T02:24:39.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.800+0000 7f3283e00640 1 -- 172.21.15.107:0/597902430 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3278032440 con 0x7f3284158c20 2024-08-17T02:24:39.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.800+0000 7f3283e00640 1 -- 172.21.15.107:0/597902430 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327802aea0 con 0x7f3284158c20 2024-08-17T02:24:39.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.800+0000 7f328ae00640 1 -- 172.21.15.107:0/597902430 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3284158c20 msgr2=0x7f32840ac040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:39.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.800+0000 7f328ae00640 1 --2- 172.21.15.107:0/597902430 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3284158c20 0x7f32840ac040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f328406d250 tx=0x7f32780091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.800+0000 7f328ae00640 1 -- 172.21.15.107:0/597902430 shutdown_connections 2024-08-17T02:24:39.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.800+0000 7f328ae00640 1 --2- 172.21.15.107:0/597902430 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3284069510 0x7f32840aa7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.801+0000 7f328ae00640 1 --2- 172.21.15.107:0/597902430 >> v2:172.21.15.157:3300/0 conn(0x7f32840ac580 0x7f3284068fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.801+0000 7f328ae00640 1 --2- 172.21.15.107:0/597902430 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3284158c20 0x7f32840ac040 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.801+0000 7f328ae00640 1 -- 172.21.15.107:0/597902430 >> 172.21.15.107:0/597902430 conn(0x7f3284096a70 msgr2=0x7f3284096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:39.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.801+0000 7f328ae00640 1 -- 172.21.15.107:0/597902430 shutdown_connections 2024-08-17T02:24:39.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.801+0000 7f328ae00640 1 -- 172.21.15.107:0/597902430 wait complete. 2024-08-17T02:24:39.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.802+0000 7f328ae00640 1 Processor -- start 2024-08-17T02:24:39.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.802+0000 7f328ae00640 1 -- start start 2024-08-17T02:24:39.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.803+0000 7f328ae00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3284069510 0x7f32841595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:39.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.803+0000 7f328ae00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f32840ac580 0x7f328415ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:39.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.803+0000 7f328ae00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3284158c20 0x7f328416cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:39.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.803+0000 7f328ae00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328415b750 con 0x7f32840ac580 2024-08-17T02:24:39.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.803+0000 7f328ae00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328415ba30 con 0x7f3284069510 2024-08-17T02:24:39.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.803+0000 7f328ae00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f328415bd10 con 0x7f3284158c20 2024-08-17T02:24:39.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.803+0000 7f3289000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f32840ac580 0x7f328415ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:39.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.803+0000 7f3289000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f32840ac580 0x7f328415ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60942/0 (socket says 172.21.15.107:60942) 2024-08-17T02:24:39.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.803+0000 7f3289000640 1 -- 172.21.15.107:0/253049975 learned_addr learned my addr 172.21.15.107:0/253049975 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:39.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.803+0000 7f3289a00640 1 --2- 172.21.15.107:0/253049975 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3284069510 0x7f32841595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:39.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.803+0000 7f328a400640 1 --2- 172.21.15.107:0/253049975 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3284158c20 0x7f328416cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:39.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.804+0000 7f3289000640 1 -- 172.21.15.107:0/253049975 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3284158c20 msgr2=0x7f328416cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:39.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.804+0000 7f3289000640 1 --2- 172.21.15.107:0/253049975 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3284158c20 0x7f328416cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.804+0000 7f3289000640 1 -- 172.21.15.107:0/253049975 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3284069510 msgr2=0x7f32841595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:39.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.804+0000 7f3289000640 1 --2- 172.21.15.107:0/253049975 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3284069510 0x7f32841595e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.804+0000 7f3289000640 1 -- 172.21.15.107:0/253049975 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3278009450 con 0x7f32840ac580 2024-08-17T02:24:39.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.804+0000 7f328a400640 1 --2- 172.21.15.107:0/253049975 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3284158c20 0x7f328416cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:39.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.804+0000 7f3289000640 1 --2- 172.21.15.107:0/253049975 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f32840ac580 0x7f328415ae90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f327000c880 tx=0x7f3270008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:39.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.804+0000 7f3280c00640 1 -- 172.21.15.107:0/253049975 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327000ce10 con 0x7f32840ac580 2024-08-17T02:24:39.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.804+0000 7f3280c00640 1 -- 172.21.15.107:0/253049975 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3270007890 con 0x7f32840ac580 2024-08-17T02:24:39.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.804+0000 7f3280c00640 1 -- 172.21.15.107:0/253049975 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3270007c10 con 0x7f32840ac580 2024-08-17T02:24:39.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.804+0000 7f328ae00640 1 -- 172.21.15.107:0/253049975 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f328415bff0 con 0x7f32840ac580 2024-08-17T02:24:39.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.804+0000 7f328ae00640 1 -- 172.21.15.107:0/253049975 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f328415b3d0 con 0x7f32840ac580 2024-08-17T02:24:39.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.805+0000 7f328ae00640 1 -- 172.21.15.107:0/253049975 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32840abbb0 con 0x7f32840ac580 2024-08-17T02:24:39.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.806+0000 7f3280c00640 1 -- 172.21.15.107:0/253049975 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f32700113f0 con 0x7f32840ac580 2024-08-17T02:24:39.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.807+0000 7f3280c00640 1 --2- 172.21.15.107:0/253049975 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3264065150 0x7f3264067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:39.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.807+0000 7f3280c00640 1 -- 172.21.15.107:0/253049975 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f32700823c0 con 0x7f32840ac580 2024-08-17T02:24:39.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.808+0000 7f3289a00640 1 --2- 172.21.15.107:0/253049975 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3264065150 0x7f3264067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:39.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.808+0000 7f3289a00640 1 --2- 172.21.15.107:0/253049975 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3264065150 0x7f3264067600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3278034000 tx=0x7f3278032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:39.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.811+0000 7f3280c00640 1 -- 172.21.15.107:0/253049975 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f32840abbb0 con 0x7f32840ac580 2024-08-17T02:24:39.984 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.983+0000 7f328ae00640 1 -- 172.21.15.107:0/253049975 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f32840ad330 con 0x7f32840ac580 2024-08-17T02:24:39.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.983+0000 7f3280c00640 1 -- 172.21.15.107:0/253049975 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f32840ad330 con 0x7f32840ac580 2024-08-17T02:24:39.985 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2024-08-17T02:24:39.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.985+0000 7f328ae00640 1 -- 172.21.15.107:0/253049975 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3264065150 msgr2=0x7f3264067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:39.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.985+0000 7f328ae00640 1 --2- 172.21.15.107:0/253049975 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3264065150 0x7f3264067600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3278034000 tx=0x7f3278032000 comp rx=0 tx=0).stop 2024-08-17T02:24:39.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.985+0000 7f328ae00640 1 -- 172.21.15.107:0/253049975 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f32840ac580 msgr2=0x7f328415ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:39.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.985+0000 7f328ae00640 1 --2- 172.21.15.107:0/253049975 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f32840ac580 0x7f328415ae90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f327000c880 tx=0x7f3270008040 comp rx=0 tx=0).stop 2024-08-17T02:24:39.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.986+0000 7f328ae00640 1 -- 172.21.15.107:0/253049975 shutdown_connections 2024-08-17T02:24:39.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.986+0000 7f328ae00640 1 --2- 172.21.15.107:0/253049975 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3264065150 0x7f3264067600 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.986+0000 7f328ae00640 1 --2- 172.21.15.107:0/253049975 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3284158c20 0x7f328416cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.986+0000 7f328ae00640 1 --2- 172.21.15.107:0/253049975 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f32840ac580 0x7f328415ae90 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.986+0000 7f328ae00640 1 --2- 172.21.15.107:0/253049975 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3284069510 0x7f32841595e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.986+0000 7f328ae00640 1 -- 172.21.15.107:0/253049975 >> 172.21.15.107:0/253049975 conn(0x7f3284096a70 msgr2=0x7f3284068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:39.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.986+0000 7f328ae00640 1 -- 172.21.15.107:0/253049975 shutdown_connections 2024-08-17T02:24:39.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:39.986+0000 7f328ae00640 1 -- 172.21.15.107:0/253049975 wait complete. 2024-08-17T02:24:40.001 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:24:40.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.149+0000 7fbd5ec00640 1 Processor -- start 2024-08-17T02:24:40.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.150+0000 7fbd5ec00640 1 -- start start 2024-08-17T02:24:40.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.151+0000 7fbd5ec00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fbd580adfb0 0x7fbd580ae750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:40.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.151+0000 7fbd5ec00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbd58155a30 0x7fbd5806dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:40.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.151+0000 7fbd5ec00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd580afc40 con 0x7fbd58155660 2024-08-17T02:24:40.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.151+0000 7fbd5ec00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd580af030 con 0x7fbd58155a30 2024-08-17T02:24:40.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.151+0000 7fbd5ec00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd580af310 con 0x7fbd580adfb0 2024-08-17T02:24:40.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.151+0000 7fbd5e200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbd58155a30 0x7fbd5806dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:40.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.151+0000 7fbd5e200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbd58155a30 0x7fbd5806dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60950/0 (socket says 172.21.15.107:60950) 2024-08-17T02:24:40.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.151+0000 7fbd5e200640 1 -- 172.21.15.107:0/253041893 learned_addr learned my addr 172.21.15.107:0/253041893 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:40.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.151+0000 7fbd5ce00640 1 --2- 172.21.15.107:0/253041893 >> v2:172.21.15.157:3300/0 conn(0x7fbd580adfb0 0x7fbd580ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:40.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.151+0000 7fbd5e200640 1 -- 172.21.15.107:0/253041893 >> v2:172.21.15.157:3300/0 conn(0x7fbd580adfb0 msgr2=0x7fbd580ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:40.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.151+0000 7fbd5e200640 1 --2- 172.21.15.107:0/253041893 >> v2:172.21.15.157:3300/0 conn(0x7fbd580adfb0 0x7fbd580ae750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:40.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.151+0000 7fbd5e200640 1 -- 172.21.15.107:0/253041893 >> v1:172.21.15.157:6789/0 conn(0x7fbd58155660 legacy=0x7fbd580c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:40.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.151+0000 7fbd5e200640 1 -- 172.21.15.107:0/253041893 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd580af5f0 con 0x7fbd58155a30 2024-08-17T02:24:40.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.152+0000 7fbd5e200640 1 --2- 172.21.15.107:0/253041893 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd58155a30 0x7fbd5806dec0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbd580cb2e0 tx=0x7fbd50009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a9e954b983ed1fe server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:40.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.153+0000 7fbd57e00640 1 -- 172.21.15.107:0/253041893 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5002e050 con 0x7fbd58155a30 2024-08-17T02:24:40.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.153+0000 7fbd57e00640 1 -- 172.21.15.107:0/253041893 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd50007400 con 0x7fbd58155a30 2024-08-17T02:24:40.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.153+0000 7fbd57e00640 1 -- 172.21.15.107:0/253041893 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd500077e0 con 0x7fbd58155a30 2024-08-17T02:24:40.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.153+0000 7fbd5ec00640 1 -- 172.21.15.107:0/253041893 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd58155a30 msgr2=0x7fbd5806dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:40.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.153+0000 7fbd5ec00640 1 --2- 172.21.15.107:0/253041893 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd58155a30 0x7fbd5806dec0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbd580cb2e0 tx=0x7fbd50009840 comp rx=0 tx=0).stop 2024-08-17T02:24:40.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.153+0000 7fbd5ec00640 1 -- 172.21.15.107:0/253041893 shutdown_connections 2024-08-17T02:24:40.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.153+0000 7fbd5ec00640 1 --2- 172.21.15.107:0/253041893 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd58155a30 0x7fbd5806dec0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:40.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.153+0000 7fbd5ec00640 1 --2- 172.21.15.107:0/253041893 >> v2:172.21.15.157:3300/0 conn(0x7fbd580adfb0 0x7fbd580ae750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:40.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.153+0000 7fbd5ec00640 1 -- 172.21.15.107:0/253041893 >> 172.21.15.107:0/253041893 conn(0x7fbd58066cd0 msgr2=0x7fbd580670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:40.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.153+0000 7fbd5ec00640 1 -- 172.21.15.107:0/253041893 shutdown_connections 2024-08-17T02:24:40.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.153+0000 7fbd5ec00640 1 -- 172.21.15.107:0/253041893 wait complete. 2024-08-17T02:24:40.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.155+0000 7fbd5ec00640 1 Processor -- start 2024-08-17T02:24:40.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.155+0000 7fbd5ec00640 1 -- start start 2024-08-17T02:24:40.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.156+0000 7fbd5ec00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd580adfb0 0x7fbd58140f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:40.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.156+0000 7fbd5ec00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd58155660 0x7fbd580c5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:40.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.156+0000 7fbd5ec00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd58155a30 0x7fbd580c5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:40.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.156+0000 7fbd5ec00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd58144bd0 con 0x7fbd580adfb0 2024-08-17T02:24:40.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.156+0000 7fbd5ec00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd581459c0 con 0x7fbd58155660 2024-08-17T02:24:40.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.156+0000 7fbd5ec00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd58141470 con 0x7fbd58155a30 2024-08-17T02:24:40.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.156+0000 7fbd5d800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd580adfb0 0x7fbd58140f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:40.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.156+0000 7fbd5d800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd580adfb0 0x7fbd58140f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60964/0 (socket says 172.21.15.107:60964) 2024-08-17T02:24:40.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.156+0000 7fbd5d800640 1 -- 172.21.15.107:0/185869642 learned_addr learned my addr 172.21.15.107:0/185869642 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:40.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.156+0000 7fbd5ce00640 1 --2- 172.21.15.107:0/185869642 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd58155660 0x7fbd580c5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:40.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.156+0000 7fbd5e200640 1 --2- 172.21.15.107:0/185869642 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd58155a30 0x7fbd580c5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:40.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.156+0000 7fbd5d800640 1 -- 172.21.15.107:0/185869642 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd58155a30 msgr2=0x7fbd580c5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:40.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.156+0000 7fbd5d800640 1 --2- 172.21.15.107:0/185869642 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd58155a30 0x7fbd580c5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:40.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.156+0000 7fbd5d800640 1 -- 172.21.15.107:0/185869642 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd58155660 msgr2=0x7fbd580c5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:40.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.156+0000 7fbd5d800640 1 --2- 172.21.15.107:0/185869642 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd58155660 0x7fbd580c5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:40.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.156+0000 7fbd5d800640 1 -- 172.21.15.107:0/185869642 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd50009ae0 con 0x7fbd580adfb0 2024-08-17T02:24:40.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.157+0000 7fbd5d800640 1 --2- 172.21.15.107:0/185869642 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd580adfb0 0x7fbd58140f30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c00c560 tx=0x7fbd4c007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:40.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.157+0000 7fbd54c00640 1 -- 172.21.15.107:0/185869642 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c011590 con 0x7fbd580adfb0 2024-08-17T02:24:40.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.157+0000 7fbd54c00640 1 -- 172.21.15.107:0/185869642 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4c011710 con 0x7fbd580adfb0 2024-08-17T02:24:40.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.157+0000 7fbd5ec00640 1 -- 172.21.15.107:0/185869642 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd580c2d60 con 0x7fbd580adfb0 2024-08-17T02:24:40.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.157+0000 7fbd54c00640 1 -- 172.21.15.107:0/185869642 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c011ad0 con 0x7fbd580adfb0 2024-08-17T02:24:40.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.157+0000 7fbd5ec00640 1 -- 172.21.15.107:0/185869642 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd58145090 con 0x7fbd580adfb0 2024-08-17T02:24:40.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.158+0000 7fbd5ec00640 1 -- 172.21.15.107:0/185869642 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd58071050 con 0x7fbd580adfb0 2024-08-17T02:24:40.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.159+0000 7fbd54c00640 1 -- 172.21.15.107:0/185869642 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbd4c01b3b0 con 0x7fbd580adfb0 2024-08-17T02:24:40.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.159+0000 7fbd54c00640 1 --2- 172.21.15.107:0/185869642 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbd38065150 0x7fbd38067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:40.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.159+0000 7fbd54c00640 1 -- 172.21.15.107:0/185869642 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbd4c0819e0 con 0x7fbd580adfb0 2024-08-17T02:24:40.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.160+0000 7fbd5ce00640 1 --2- 172.21.15.107:0/185869642 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbd38065150 0x7fbd38067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:40.162 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.160+0000 7fbd5ce00640 1 --2- 172.21.15.107:0/185869642 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbd38065150 0x7fbd38067600 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbd580c7920 tx=0x7fbd440090f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:40.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.163+0000 7fbd54c00640 1 -- 172.21.15.107:0/185869642 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbd4c04fab0 con 0x7fbd580adfb0 2024-08-17T02:24:40.339 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.338+0000 7fbd5ec00640 1 -- 172.21.15.107:0/185869642 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbd5806c5f0 con 0x7fbd580adfb0 2024-08-17T02:24:40.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.338+0000 7fbd54c00640 1 -- 172.21.15.107:0/185869642 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbd4c017020 con 0x7fbd580adfb0 2024-08-17T02:24:40.340 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2024-08-17T02:24:40.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.341+0000 7fbd5ec00640 1 -- 172.21.15.107:0/185869642 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbd38065150 msgr2=0x7fbd38067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:40.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.341+0000 7fbd5ec00640 1 --2- 172.21.15.107:0/185869642 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbd38065150 0x7fbd38067600 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbd580c7920 tx=0x7fbd440090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:40.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.341+0000 7fbd5ec00640 1 -- 172.21.15.107:0/185869642 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd580adfb0 msgr2=0x7fbd58140f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:40.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.341+0000 7fbd5ec00640 1 --2- 172.21.15.107:0/185869642 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd580adfb0 0x7fbd58140f30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c00c560 tx=0x7fbd4c007ef0 comp rx=0 tx=0).stop 2024-08-17T02:24:40.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.341+0000 7fbd5ec00640 1 -- 172.21.15.107:0/185869642 shutdown_connections 2024-08-17T02:24:40.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.341+0000 7fbd5ec00640 1 --2- 172.21.15.107:0/185869642 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbd38065150 0x7fbd38067600 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:40.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.341+0000 7fbd5ec00640 1 --2- 172.21.15.107:0/185869642 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd58155a30 0x7fbd580c5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:40.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.341+0000 7fbd5ec00640 1 --2- 172.21.15.107:0/185869642 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd58155660 0x7fbd580c5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:40.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.341+0000 7fbd5ec00640 1 --2- 172.21.15.107:0/185869642 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd580adfb0 0x7fbd58140f30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:40.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.341+0000 7fbd5ec00640 1 -- 172.21.15.107:0/185869642 >> 172.21.15.107:0/185869642 conn(0x7fbd58066cd0 msgr2=0x7fbd58069820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:40.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.341+0000 7fbd5ec00640 1 -- 172.21.15.107:0/185869642 shutdown_connections 2024-08-17T02:24:40.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.341+0000 7fbd5ec00640 1 -- 172.21.15.107:0/185869642 wait complete. 2024-08-17T02:24:40.357 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:24:40.508 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.506+0000 7fbd3be00640 1 Processor -- start 2024-08-17T02:24:40.508 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.507+0000 7fbd3be00640 1 -- start start 2024-08-17T02:24:40.509 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.508+0000 7fbd3be00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fbd3c155660 0x7fbd3c0c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:40.509 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.508+0000 7fbd3be00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbd3c0adfb0 0x7fbd3c0ae750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:40.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.508+0000 7fbd3be00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd3c155a30 0x7fbd3c06dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:40.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.508+0000 7fbd3be00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd3c0afc40 con 0x7fbd3c0adfb0 2024-08-17T02:24:40.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.508+0000 7fbd3be00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd3c0af030 con 0x7fbd3c155660 2024-08-17T02:24:40.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.508+0000 7fbd3be00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3c0af310 con 0x7fbd3c155a30 2024-08-17T02:24:40.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.508+0000 7fbd32000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbd3c0adfb0 0x7fbd3c0ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:40.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.508+0000 7fbd32000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbd3c0adfb0 0x7fbd3c0ae750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60970/0 (socket says 172.21.15.107:60970) 2024-08-17T02:24:40.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.508+0000 7fbd32000640 1 -- 172.21.15.107:0/3956123891 learned_addr learned my addr 172.21.15.107:0/3956123891 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:40.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.508+0000 7fbd3aa00640 1 --2- 172.21.15.107:0/3956123891 >> v2:172.21.15.157:3300/0 conn(0x7fbd3c155660 0x7fbd3c0c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:40.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.508+0000 7fbd3b400640 1 --2- 172.21.15.107:0/3956123891 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd3c155a30 0x7fbd3c06dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:40.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.508+0000 7fbd32000640 1 -- 172.21.15.107:0/3956123891 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd3c155a30 msgr2=0x7fbd3c06dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:40.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.508+0000 7fbd32000640 1 --2- 172.21.15.107:0/3956123891 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd3c155a30 0x7fbd3c06dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:40.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.508+0000 7fbd32000640 1 -- 172.21.15.107:0/3956123891 >> v2:172.21.15.157:3300/0 conn(0x7fbd3c155660 msgr2=0x7fbd3c0c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:40.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.508+0000 7fbd32000640 1 --2- 172.21.15.107:0/3956123891 >> v2:172.21.15.157:3300/0 conn(0x7fbd3c155660 0x7fbd3c0c7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:40.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.508+0000 7fbd32000640 1 -- 172.21.15.107:0/3956123891 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd3c0af5f0 con 0x7fbd3c0adfb0 2024-08-17T02:24:40.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.509+0000 7fbd32000640 1 --2- 172.21.15.107:0/3956123891 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd3c0adfb0 0x7fbd3c0ae750 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c06aa30 tx=0x7fbd240091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1ef0d96a313b82 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:40.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.510+0000 7fbd3a000640 1 -- 172.21.15.107:0/3956123891 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2402add0 con 0x7fbd3c0adfb0 2024-08-17T02:24:40.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.510+0000 7fbd3a000640 1 -- 172.21.15.107:0/3956123891 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd24032440 con 0x7fbd3c0adfb0 2024-08-17T02:24:40.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.510+0000 7fbd3a000640 1 -- 172.21.15.107:0/3956123891 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd24032820 con 0x7fbd3c0adfb0 2024-08-17T02:24:40.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.510+0000 7fbd3be00640 1 -- 172.21.15.107:0/3956123891 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd3c0adfb0 msgr2=0x7fbd3c0ae750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:40.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.510+0000 7fbd3be00640 1 --2- 172.21.15.107:0/3956123891 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd3c0adfb0 0x7fbd3c0ae750 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c06aa30 tx=0x7fbd240091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:40.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.510+0000 7fbd3be00640 1 -- 172.21.15.107:0/3956123891 shutdown_connections 2024-08-17T02:24:40.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.510+0000 7fbd3be00640 1 --2- 172.21.15.107:0/3956123891 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd3c0adfb0 0x7fbd3c0ae750 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:40.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.510+0000 7fbd3be00640 1 --2- 172.21.15.107:0/3956123891 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd3c155a30 0x7fbd3c06dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:40.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.510+0000 7fbd3be00640 1 --2- 172.21.15.107:0/3956123891 >> v2:172.21.15.157:3300/0 conn(0x7fbd3c155660 0x7fbd3c0c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:40.513 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.510+0000 7fbd3be00640 1 -- 172.21.15.107:0/3956123891 >> 172.21.15.107:0/3956123891 conn(0x7fbd3c066cd0 msgr2=0x7fbd3c0670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:40.513 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.510+0000 7fbd3be00640 1 -- 172.21.15.107:0/3956123891 shutdown_connections 2024-08-17T02:24:40.513 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.510+0000 7fbd3be00640 1 -- 172.21.15.107:0/3956123891 wait complete. 2024-08-17T02:24:40.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.512+0000 7fbd3be00640 1 Processor -- start 2024-08-17T02:24:40.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.512+0000 7fbd3be00640 1 -- start start 2024-08-17T02:24:40.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.513+0000 7fbd3be00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd3c0adfb0 0x7fbd3c151260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:40.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.513+0000 7fbd3be00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd3c155660 0x7fbd3c169740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:40.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.513+0000 7fbd3be00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd3c155a30 0x7fbd3c0693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:40.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.513+0000 7fbd3be00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3c169c80 con 0x7fbd3c155660 2024-08-17T02:24:40.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.513+0000 7fbd3be00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3c1507a0 con 0x7fbd3c155a30 2024-08-17T02:24:40.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.513+0000 7fbd3be00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3c16af40 con 0x7fbd3c0adfb0 2024-08-17T02:24:40.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.513+0000 7fbd32000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd3c155660 0x7fbd3c169740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:40.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.513+0000 7fbd32000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd3c155660 0x7fbd3c169740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60972/0 (socket says 172.21.15.107:60972) 2024-08-17T02:24:40.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.513+0000 7fbd32000640 1 -- 172.21.15.107:0/3750516389 learned_addr learned my addr 172.21.15.107:0/3750516389 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:40.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.513+0000 7fbd3b400640 1 --2- 172.21.15.107:0/3750516389 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd3c155a30 0x7fbd3c0693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:40.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.513+0000 7fbd3aa00640 1 --2- 172.21.15.107:0/3750516389 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd3c0adfb0 0x7fbd3c151260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:40.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.513+0000 7fbd32000640 1 -- 172.21.15.107:0/3750516389 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd3c0adfb0 msgr2=0x7fbd3c151260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:40.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.513+0000 7fbd32000640 1 --2- 172.21.15.107:0/3750516389 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd3c0adfb0 0x7fbd3c151260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:40.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.513+0000 7fbd32000640 1 -- 172.21.15.107:0/3750516389 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd3c155a30 msgr2=0x7fbd3c0693b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:40.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.513+0000 7fbd32000640 1 --2- 172.21.15.107:0/3750516389 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd3c155a30 0x7fbd3c0693b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:40.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.513+0000 7fbd32000640 1 -- 172.21.15.107:0/3750516389 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd24009450 con 0x7fbd3c155660 2024-08-17T02:24:40.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.513+0000 7fbd32000640 1 --2- 172.21.15.107:0/3750516389 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd3c155660 0x7fbd3c169740 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbd24009940 tx=0x7fbd24032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:40.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.514+0000 7fbd32a00640 1 -- 172.21.15.107:0/3750516389 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd24000d10 con 0x7fbd3c155660 2024-08-17T02:24:40.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.514+0000 7fbd32a00640 1 -- 172.21.15.107:0/3750516389 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd24031de0 con 0x7fbd3c155660 2024-08-17T02:24:40.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.514+0000 7fbd32a00640 1 -- 172.21.15.107:0/3750516389 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2403d650 con 0x7fbd3c155660 2024-08-17T02:24:40.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.514+0000 7fbd3be00640 1 -- 172.21.15.107:0/3750516389 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd3c153f40 con 0x7fbd3c155660 2024-08-17T02:24:40.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.514+0000 7fbd3be00640 1 -- 172.21.15.107:0/3750516389 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd3c16a610 con 0x7fbd3c155660 2024-08-17T02:24:40.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.515+0000 7fbd3be00640 1 -- 172.21.15.107:0/3750516389 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd3c071050 con 0x7fbd3c155660 2024-08-17T02:24:40.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.516+0000 7fbd32a00640 1 -- 172.21.15.107:0/3750516389 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbd24039040 con 0x7fbd3c155660 2024-08-17T02:24:40.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.516+0000 7fbd32a00640 1 --2- 172.21.15.107:0/3750516389 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbd18065150 0x7fbd18067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:40.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.516+0000 7fbd32a00640 1 -- 172.21.15.107:0/3750516389 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbd240a2700 con 0x7fbd3c155660 2024-08-17T02:24:40.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.517+0000 7fbd3aa00640 1 --2- 172.21.15.107:0/3750516389 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbd18065150 0x7fbd18067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:40.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.517+0000 7fbd3aa00640 1 --2- 172.21.15.107:0/3750516389 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbd18065150 0x7fbd18067600 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c150fb0 tx=0x7fbd2c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:40.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.520+0000 7fbd32a00640 1 -- 172.21.15.107:0/3750516389 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbd240707c0 con 0x7fbd3c155660 2024-08-17T02:24:40.692 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.691+0000 7fbd3be00640 1 -- 172.21.15.107:0/3750516389 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbd3c16b080 con 0x7fbd3c155660 2024-08-17T02:24:40.692 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.691+0000 7fbd32a00640 1 -- 172.21.15.107:0/3750516389 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbd24037020 con 0x7fbd3c155660 2024-08-17T02:24:40.692 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 64 2024-08-17T02:24:40.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.693+0000 7fbd3be00640 1 -- 172.21.15.107:0/3750516389 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbd18065150 msgr2=0x7fbd18067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:40.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.693+0000 7fbd3be00640 1 --2- 172.21.15.107:0/3750516389 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbd18065150 0x7fbd18067600 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c150fb0 tx=0x7fbd2c008040 comp rx=0 tx=0).stop 2024-08-17T02:24:40.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.693+0000 7fbd3be00640 1 -- 172.21.15.107:0/3750516389 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd3c155660 msgr2=0x7fbd3c169740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:40.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.693+0000 7fbd3be00640 1 --2- 172.21.15.107:0/3750516389 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd3c155660 0x7fbd3c169740 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbd24009940 tx=0x7fbd24032000 comp rx=0 tx=0).stop 2024-08-17T02:24:40.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.693+0000 7fbd3be00640 1 -- 172.21.15.107:0/3750516389 shutdown_connections 2024-08-17T02:24:40.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.693+0000 7fbd3be00640 1 --2- 172.21.15.107:0/3750516389 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbd18065150 0x7fbd18067600 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:40.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.693+0000 7fbd3be00640 1 --2- 172.21.15.107:0/3750516389 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd3c155a30 0x7fbd3c0693b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:40.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.693+0000 7fbd3be00640 1 --2- 172.21.15.107:0/3750516389 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd3c155660 0x7fbd3c169740 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:40.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.693+0000 7fbd3be00640 1 --2- 172.21.15.107:0/3750516389 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd3c0adfb0 0x7fbd3c151260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:40.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.693+0000 7fbd3be00640 1 -- 172.21.15.107:0/3750516389 >> 172.21.15.107:0/3750516389 conn(0x7fbd3c066cd0 msgr2=0x7fbd3c068560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:40.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.693+0000 7fbd3be00640 1 -- 172.21.15.107:0/3750516389 shutdown_connections 2024-08-17T02:24:40.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.693+0000 7fbd3be00640 1 -- 172.21.15.107:0/3750516389 wait complete. 2024-08-17T02:24:40.709 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:24:40.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.856+0000 7f4594800640 1 Processor -- start 2024-08-17T02:24:40.858 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.856+0000 7f4594800640 1 -- start start 2024-08-17T02:24:40.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.857+0000 7f4594800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f458c155a20 0x7f458c0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:40.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.857+0000 7f4594800640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f458c155df0 0x7f458c0ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:40.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.858+0000 7f4594800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f458c156670 con 0x7f458c06d7f0 2024-08-17T02:24:40.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.858+0000 7f4594800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f458c0b0350 con 0x7f458c155a20 2024-08-17T02:24:40.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.858+0000 7f4594800640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f458c06e5e0 con 0x7f458c155df0 2024-08-17T02:24:40.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.858+0000 7f4591e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f458c155a20 0x7f458c0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:40.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.858+0000 7f4591e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f458c155a20 0x7f458c0adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60988/0 (socket says 172.21.15.107:60988) 2024-08-17T02:24:40.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.858+0000 7f4591e00640 1 -- 172.21.15.107:0/2359410648 learned_addr learned my addr 172.21.15.107:0/2359410648 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:40.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.858+0000 7f4592800640 1 --1- 172.21.15.107:0/2359410648 >> v1:172.21.15.107:6789/0 conn(0x7f458c06d7f0 0x7f458c0ac790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:33926/0 (socket says 172.21.15.107:33926) 2024-08-17T02:24:40.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.858+0000 7f4591400640 1 --2- 172.21.15.107:0/2359410648 >> v2:172.21.15.157:3300/0 conn(0x7f458c155df0 0x7f458c0ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:40.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.858+0000 7f4591e00640 1 -- 172.21.15.107:0/2359410648 >> v2:172.21.15.157:3300/0 conn(0x7f458c155df0 msgr2=0x7f458c0ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:40.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.858+0000 7f4591e00640 1 --2- 172.21.15.107:0/2359410648 >> v2:172.21.15.157:3300/0 conn(0x7f458c155df0 0x7f458c0ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:40.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.858+0000 7f4591e00640 1 -- 172.21.15.107:0/2359410648 >> v1:172.21.15.107:6789/0 conn(0x7f458c06d7f0 legacy=0x7f458c0ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:40.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.858+0000 7f4591e00640 1 -- 172.21.15.107:0/2359410648 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f458c06e8c0 con 0x7f458c155a20 2024-08-17T02:24:40.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.859+0000 7f4591e00640 1 --2- 172.21.15.107:0/2359410648 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f458c155a20 0x7f458c0adf10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f458c06aa10 tx=0x7f45800091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87cae97c16248a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:40.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.859+0000 7f4590a00640 1 -- 172.21.15.107:0/2359410648 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458002ae80 con 0x7f458c155a20 2024-08-17T02:24:40.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.859+0000 7f4590a00640 1 -- 172.21.15.107:0/2359410648 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4580032440 con 0x7f458c155a20 2024-08-17T02:24:40.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.859+0000 7f4590a00640 1 -- 172.21.15.107:0/2359410648 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4580032800 con 0x7f458c155a20 2024-08-17T02:24:40.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.860+0000 7f4594800640 1 -- 172.21.15.107:0/2359410648 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f458c155a20 msgr2=0x7f458c0adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:40.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.860+0000 7f4594800640 1 --2- 172.21.15.107:0/2359410648 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f458c155a20 0x7f458c0adf10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f458c06aa10 tx=0x7f45800091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:40.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.860+0000 7f4594800640 1 -- 172.21.15.107:0/2359410648 shutdown_connections 2024-08-17T02:24:40.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.860+0000 7f4594800640 1 --2- 172.21.15.107:0/2359410648 >> v2:172.21.15.157:3300/0 conn(0x7f458c155df0 0x7f458c0ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:40.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.860+0000 7f4594800640 1 --2- 172.21.15.107:0/2359410648 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f458c155a20 0x7f458c0adf10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:40.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.860+0000 7f4594800640 1 -- 172.21.15.107:0/2359410648 >> 172.21.15.107:0/2359410648 conn(0x7f458c0cb9b0 msgr2=0x7f458c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:40.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.860+0000 7f4594800640 1 -- 172.21.15.107:0/2359410648 shutdown_connections 2024-08-17T02:24:40.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.860+0000 7f4594800640 1 -- 172.21.15.107:0/2359410648 wait complete. 2024-08-17T02:24:40.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.861+0000 7f4594800640 1 Processor -- start 2024-08-17T02:24:40.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.862+0000 7f4594800640 1 -- start start 2024-08-17T02:24:40.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.862+0000 7f4594800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f458c06d7f0 0x7f458c069250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:40.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.862+0000 7f4594800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f458c155a20 0x7f458c14e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:40.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.862+0000 7f4594800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f458c155df0 0x7f458c14eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:40.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.862+0000 7f4594800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458c1501f0 con 0x7f458c06d7f0 2024-08-17T02:24:40.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.862+0000 7f4594800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458c14fc10 con 0x7f458c155a20 2024-08-17T02:24:40.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.862+0000 7f4594800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f458c148af0 con 0x7f458c155df0 2024-08-17T02:24:40.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.863+0000 7f4591e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f458c06d7f0 0x7f458c069250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:40.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.863+0000 7f4591e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f458c06d7f0 0x7f458c069250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:32770/0 (socket says 172.21.15.107:32770) 2024-08-17T02:24:40.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.863+0000 7f4591e00640 1 -- 172.21.15.107:0/3828419988 learned_addr learned my addr 172.21.15.107:0/3828419988 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:40.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.863+0000 7f4591400640 1 --2- 172.21.15.107:0/3828419988 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f458c155a20 0x7f458c14e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:40.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.863+0000 7f4592800640 1 --2- 172.21.15.107:0/3828419988 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f458c155df0 0x7f458c14eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:40.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.863+0000 7f4591e00640 1 -- 172.21.15.107:0/3828419988 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f458c155df0 msgr2=0x7f458c14eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:40.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.863+0000 7f4591e00640 1 --2- 172.21.15.107:0/3828419988 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f458c155df0 0x7f458c14eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:40.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.863+0000 7f4591e00640 1 -- 172.21.15.107:0/3828419988 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f458c155a20 msgr2=0x7f458c14e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:40.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.863+0000 7f4591e00640 1 --2- 172.21.15.107:0/3828419988 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f458c155a20 0x7f458c14e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:40.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.863+0000 7f4591e00640 1 -- 172.21.15.107:0/3828419988 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4580009450 con 0x7f458c06d7f0 2024-08-17T02:24:40.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.863+0000 7f4592800640 1 --2- 172.21.15.107:0/3828419988 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f458c155df0 0x7f458c14eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:40.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.863+0000 7f4591e00640 1 --2- 172.21.15.107:0/3828419988 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f458c06d7f0 0x7f458c069250 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4580009940 tx=0x7f4580032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:40.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.863+0000 7f4585600640 1 -- 172.21.15.107:0/3828419988 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4580031de0 con 0x7f458c06d7f0 2024-08-17T02:24:40.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.863+0000 7f4585600640 1 -- 172.21.15.107:0/3828419988 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4580000c40 con 0x7f458c06d7f0 2024-08-17T02:24:40.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.863+0000 7f4594800640 1 -- 172.21.15.107:0/3828419988 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f458c14fe80 con 0x7f458c06d7f0 2024-08-17T02:24:40.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.864+0000 7f4585600640 1 -- 172.21.15.107:0/3828419988 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458003d670 con 0x7f458c06d7f0 2024-08-17T02:24:40.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.864+0000 7f4594800640 1 -- 172.21.15.107:0/3828419988 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f458c149670 con 0x7f458c06d7f0 2024-08-17T02:24:40.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.865+0000 7f4594800640 1 -- 172.21.15.107:0/3828419988 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f458c064db0 con 0x7f458c06d7f0 2024-08-17T02:24:40.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.865+0000 7f4585600640 1 -- 172.21.15.107:0/3828419988 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4580039040 con 0x7f458c06d7f0 2024-08-17T02:24:40.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.866+0000 7f4585600640 1 --2- 172.21.15.107:0/3828419988 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4570065150 0x7f4570067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:40.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.866+0000 7f4585600640 1 -- 172.21.15.107:0/3828419988 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f45800a2750 con 0x7f458c06d7f0 2024-08-17T02:24:40.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.866+0000 7f4591400640 1 --2- 172.21.15.107:0/3828419988 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4570065150 0x7f4570067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:40.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.867+0000 7f4591400640 1 --2- 172.21.15.107:0/3828419988 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4570065150 0x7f4570067600 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f458c161730 tx=0x7f457c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:40.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:40.870+0000 7f4585600640 1 -- 172.21.15.107:0/3828419988 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4580070770 con 0x7f458c06d7f0 2024-08-17T02:24:41.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.078+0000 7f4594800640 1 -- 172.21.15.107:0/3828419988 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f458c0af040 con 0x7f458c06d7f0 2024-08-17T02:24:41.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.079+0000 7f4585600640 1 -- 172.21.15.107:0/3828419988 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f4580042090 con 0x7f458c06d7f0 2024-08-17T02:24:41.080 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:24:41.080 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1386798018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1386798018},{"type":"v1","addr":"172.21.15.107:6835","nonce":1386798018}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6834/287524804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":287524804},{"type":"v1","addr":"172.21.15.157:6834","nonce":287524804}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1183198496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1183198496},{"type":"v1","addr":"172.21.15.107:6837","nonce":1183198496}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:28.816556+0000","modified":"2024-08-17T02:24:32.431137+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6835/1985555291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6833","nonce":1985555291},{"type":"v1","addr":"172.21.15.157:6835","nonce":1985555291}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:24:41.080 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 8 2024-08-17T02:24:41.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.081+0000 7f4594800640 1 -- 172.21.15.107:0/3828419988 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4570065150 msgr2=0x7f4570067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:41.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.081+0000 7f4594800640 1 --2- 172.21.15.107:0/3828419988 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4570065150 0x7f4570067600 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f458c161730 tx=0x7f457c008040 comp rx=0 tx=0).stop 2024-08-17T02:24:41.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.081+0000 7f4594800640 1 -- 172.21.15.107:0/3828419988 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f458c06d7f0 msgr2=0x7f458c069250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:41.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.081+0000 7f4594800640 1 --2- 172.21.15.107:0/3828419988 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f458c06d7f0 0x7f458c069250 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4580009940 tx=0x7f4580032000 comp rx=0 tx=0).stop 2024-08-17T02:24:41.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.081+0000 7f4594800640 1 -- 172.21.15.107:0/3828419988 shutdown_connections 2024-08-17T02:24:41.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.081+0000 7f4594800640 1 --2- 172.21.15.107:0/3828419988 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4570065150 0x7f4570067600 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.081+0000 7f4594800640 1 --2- 172.21.15.107:0/3828419988 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f458c155df0 0x7f458c14eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.081+0000 7f4594800640 1 --2- 172.21.15.107:0/3828419988 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f458c155a20 0x7f458c14e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.081+0000 7f4594800640 1 --2- 172.21.15.107:0/3828419988 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f458c06d7f0 0x7f458c069250 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.081+0000 7f4594800640 1 -- 172.21.15.107:0/3828419988 >> 172.21.15.107:0/3828419988 conn(0x7f458c0cb9b0 msgr2=0x7f458c153230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:41.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.081+0000 7f4594800640 1 -- 172.21.15.107:0/3828419988 shutdown_connections 2024-08-17T02:24:41.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.081+0000 7f4594800640 1 -- 172.21.15.107:0/3828419988 wait complete. 2024-08-17T02:24:41.099 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:41.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.244+0000 7ff0d3600640 1 Processor -- start 2024-08-17T02:24:41.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.244+0000 7ff0d3600640 1 -- start start 2024-08-17T02:24:41.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.246+0000 7ff0d3600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff0cc155a20 0x7ff0cc0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:41.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.246+0000 7ff0d3600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff0cc06df00 0x7ff0cc0ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:41.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.246+0000 7ff0d3600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0cc156670 con 0x7ff0cc155df0 2024-08-17T02:24:41.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.246+0000 7ff0d3600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0cc0b0350 con 0x7ff0cc155a20 2024-08-17T02:24:41.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.246+0000 7ff0d3600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0cc06e5e0 con 0x7ff0cc06df00 2024-08-17T02:24:41.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.246+0000 7ff0d0c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff0cc155a20 0x7ff0cc0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:41.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.246+0000 7ff0c3e00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7ff0cc155df0 0x7ff0cc06d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:33942/0 (socket says 172.21.15.107:33942) 2024-08-17T02:24:41.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.246+0000 7ff0c3e00640 1 -- 172.21.15.107:0/3611495692 learned_addr learned my addr 172.21.15.107:0/3611495692 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:41.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.246+0000 7ff0d1600640 1 --2- 172.21.15.107:0/3611495692 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff0cc06df00 0x7ff0cc0ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:41.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.246+0000 7ff0d0c00640 1 -- 172.21.15.107:0/3611495692 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff0cc06df00 msgr2=0x7ff0cc0ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:41.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.246+0000 7ff0d0c00640 1 --2- 172.21.15.107:0/3611495692 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff0cc06df00 0x7ff0cc0ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.246+0000 7ff0d0c00640 1 -- 172.21.15.107:0/3611495692 >> v1:172.21.15.107:6789/0 conn(0x7ff0cc155df0 legacy=0x7ff0cc06d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:41.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.246+0000 7ff0cbe00640 1 -- 172.21.15.107:0/3611495692 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3483517163 0 0) 0x7ff0cc156670 con 0x7ff0cc155df0 2024-08-17T02:24:41.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.247+0000 7ff0d0c00640 1 -- 172.21.15.107:0/3611495692 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0cc06e8c0 con 0x7ff0cc155a20 2024-08-17T02:24:41.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.247+0000 7ff0d0c00640 1 --2- 172.21.15.107:0/3611495692 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0cc155a20 0x7ff0cc0adf10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc009850 tx=0x7ff0bc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49bd6578bbad5091 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:41.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.248+0000 7ff0cbe00640 1 -- 172.21.15.107:0/3611495692 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc02ad90 con 0x7ff0cc155a20 2024-08-17T02:24:41.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.248+0000 7ff0cbe00640 1 -- 172.21.15.107:0/3611495692 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0bc032440 con 0x7ff0cc155a20 2024-08-17T02:24:41.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.248+0000 7ff0cbe00640 1 -- 172.21.15.107:0/3611495692 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc0327e0 con 0x7ff0cc155a20 2024-08-17T02:24:41.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.248+0000 7ff0d3600640 1 -- 172.21.15.107:0/3611495692 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0cc155a20 msgr2=0x7ff0cc0adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:41.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.248+0000 7ff0d3600640 1 --2- 172.21.15.107:0/3611495692 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0cc155a20 0x7ff0cc0adf10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc009850 tx=0x7ff0bc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.248+0000 7ff0d3600640 1 -- 172.21.15.107:0/3611495692 shutdown_connections 2024-08-17T02:24:41.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.248+0000 7ff0d3600640 1 --2- 172.21.15.107:0/3611495692 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff0cc06df00 0x7ff0cc0ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.248+0000 7ff0d3600640 1 --2- 172.21.15.107:0/3611495692 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0cc155a20 0x7ff0cc0adf10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.248+0000 7ff0d3600640 1 -- 172.21.15.107:0/3611495692 >> 172.21.15.107:0/3611495692 conn(0x7ff0cc0cb9b0 msgr2=0x7ff0cc0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:41.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.248+0000 7ff0d3600640 1 -- 172.21.15.107:0/3611495692 shutdown_connections 2024-08-17T02:24:41.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.248+0000 7ff0d3600640 1 -- 172.21.15.107:0/3611495692 wait complete. 2024-08-17T02:24:41.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.250+0000 7ff0d3600640 1 Processor -- start 2024-08-17T02:24:41.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.250+0000 7ff0d3600640 1 -- start start 2024-08-17T02:24:41.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.251+0000 7ff0d3600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff0cc06df00 0x7ff0cc148620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:41.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.251+0000 7ff0d3600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0cc155a20 0x7ff0cc14aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:41.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.251+0000 7ff0d3600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0cc155df0 0x7ff0cc168ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:41.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.251+0000 7ff0d3600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0cc1691e0 con 0x7ff0cc155a20 2024-08-17T02:24:41.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.251+0000 7ff0d3600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0cc148c00 con 0x7ff0cc155df0 2024-08-17T02:24:41.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.251+0000 7ff0d3600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0cc14c0b0 con 0x7ff0cc06df00 2024-08-17T02:24:41.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.251+0000 7ff0c3e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0cc155a20 0x7ff0cc14aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:41.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.251+0000 7ff0c3e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0cc155a20 0x7ff0cc14aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:32784/0 (socket says 172.21.15.107:32784) 2024-08-17T02:24:41.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.251+0000 7ff0c3e00640 1 -- 172.21.15.107:0/331761872 learned_addr learned my addr 172.21.15.107:0/331761872 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:41.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.251+0000 7ff0d1600640 1 --2- 172.21.15.107:0/331761872 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0cc155df0 0x7ff0cc168ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:41.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.251+0000 7ff0d0c00640 1 --2- 172.21.15.107:0/331761872 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff0cc06df00 0x7ff0cc148620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:41.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.251+0000 7ff0c3e00640 1 -- 172.21.15.107:0/331761872 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff0cc06df00 msgr2=0x7ff0cc148620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:41.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.251+0000 7ff0c3e00640 1 --2- 172.21.15.107:0/331761872 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff0cc06df00 0x7ff0cc148620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.251+0000 7ff0c3e00640 1 -- 172.21.15.107:0/331761872 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0cc155df0 msgr2=0x7ff0cc168ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:41.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.251+0000 7ff0c3e00640 1 --2- 172.21.15.107:0/331761872 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0cc155df0 0x7ff0cc168ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.251+0000 7ff0c3e00640 1 -- 172.21.15.107:0/331761872 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0bc009390 con 0x7ff0cc155a20 2024-08-17T02:24:41.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.252+0000 7ff0c3e00640 1 --2- 172.21.15.107:0/331761872 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0cc155a20 0x7ff0cc14aad0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff0b400c4f0 tx=0x7ff0b4007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:41.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.252+0000 7ff0c8c00640 1 -- 172.21.15.107:0/331761872 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b4005aa0 con 0x7ff0cc155a20 2024-08-17T02:24:41.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.252+0000 7ff0c8c00640 1 -- 172.21.15.107:0/331761872 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0b4005c00 con 0x7ff0cc155a20 2024-08-17T02:24:41.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.252+0000 7ff0d3600640 1 -- 172.21.15.107:0/331761872 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0cc14cbf0 con 0x7ff0cc155a20 2024-08-17T02:24:41.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.252+0000 7ff0c8c00640 1 -- 172.21.15.107:0/331761872 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b40070d0 con 0x7ff0cc155a20 2024-08-17T02:24:41.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.252+0000 7ff0d3600640 1 -- 172.21.15.107:0/331761872 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0cc14c5a0 con 0x7ff0cc155a20 2024-08-17T02:24:41.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.253+0000 7ff0d3600640 1 -- 172.21.15.107:0/331761872 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0cc064db0 con 0x7ff0cc155a20 2024-08-17T02:24:41.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.254+0000 7ff0c8c00640 1 -- 172.21.15.107:0/331761872 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff0b4007500 con 0x7ff0cc155a20 2024-08-17T02:24:41.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.254+0000 7ff0c8c00640 1 --2- 172.21.15.107:0/331761872 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ff0a8065150 0x7ff0a8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:41.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.254+0000 7ff0c8c00640 1 -- 172.21.15.107:0/331761872 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff0b40818a0 con 0x7ff0cc155a20 2024-08-17T02:24:41.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.255+0000 7ff0d0c00640 1 --2- 172.21.15.107:0/331761872 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ff0a8065150 0x7ff0a8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:41.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.255+0000 7ff0d0c00640 1 --2- 172.21.15.107:0/331761872 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ff0a8065150 0x7ff0a8067600 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc034000 tx=0x7ff0bc032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:41.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.258+0000 7ff0c8c00640 1 -- 172.21.15.107:0/331761872 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff0b404f970 con 0x7ff0cc155a20 2024-08-17T02:24:41.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.434+0000 7ff0d3600640 1 -- 172.21.15.107:0/331761872 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0cc0696b0 con 0x7ff0cc155a20 2024-08-17T02:24:41.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.434+0000 7ff0c8c00640 1 -- 172.21.15.107:0/331761872 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7ff0b4052f90 con 0x7ff0cc155a20 2024-08-17T02:24:41.436 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:24:41.436 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":21,"fsid":"f207b4c0-329d-46b8-b83f-aaf30bdb6ce3","created":"2024-08-17T02:24:11.038049+0000","modified":"2024-08-17T02:24:30.420018+0000","last_up_change":"2024-08-17T02:24:22.047790+0000","last_in_change":"2024-08-17T02:24:13.892720+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:23.456166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:27.078670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:27.804418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"376363f3-b8bf-4f1e-b691-51cdd39171ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37302},{"type":"v1","addr":"172.21.15.107:6801","nonce":37302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37302},{"type":"v1","addr":"172.21.15.107:6803","nonce":37302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37302},{"type":"v1","addr":"172.21.15.107:6807","nonce":37302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37302},{"type":"v1","addr":"172.21.15.107:6805","nonce":37302}]},"public_addr":"172.21.15.107:6801/37302","cluster_addr":"172.21.15.107:6803/37302","heartbeat_back_addr":"172.21.15.107:6807/37302","heartbeat_front_addr":"172.21.15.107:6805/37302","state":["exists","up"]},{"osd":1,"uuid":"cc6624e3-2ad4-4db4-b377-05dfe57424e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37305},{"type":"v1","addr":"172.21.15.107:6824","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37305},{"type":"v1","addr":"172.21.15.107:6827","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37305},{"type":"v1","addr":"172.21.15.107:6831","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37305},{"type":"v1","addr":"172.21.15.107:6829","nonce":37305}]},"public_addr":"172.21.15.107:6824/37305","cluster_addr":"172.21.15.107:6827/37305","heartbeat_back_addr":"172.21.15.107:6831/37305","heartbeat_front_addr":"172.21.15.107:6829/37305","state":["exists","up"]},{"osd":2,"uuid":"25229542-29b5-4281-bcb0-798ae0930aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37307},{"type":"v1","addr":"172.21.15.107:6817","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37307},{"type":"v1","addr":"172.21.15.107:6819","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6823","nonce":37307},{"type":"v1","addr":"172.21.15.107:6825","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37307},{"type":"v1","addr":"172.21.15.107:6821","nonce":37307}]},"public_addr":"172.21.15.107:6817/37307","cluster_addr":"172.21.15.107:6819/37307","heartbeat_back_addr":"172.21.15.107:6825/37307","heartbeat_front_addr":"172.21.15.107:6821/37307","state":["exists","up"]},{"osd":3,"uuid":"5f16aee8-8950-4268-a61a-5cf6ebd670e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37306},{"type":"v1","addr":"172.21.15.107:6809","nonce":37306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37306},{"type":"v1","addr":"172.21.15.107:6811","nonce":37306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37306},{"type":"v1","addr":"172.21.15.107:6815","nonce":37306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37306},{"type":"v1","addr":"172.21.15.107:6813","nonce":37306}]},"public_addr":"172.21.15.107:6809/37306","cluster_addr":"172.21.15.107:6811/37306","heartbeat_back_addr":"172.21.15.107:6815/37306","heartbeat_front_addr":"172.21.15.107:6813/37306","state":["exists","up"]},{"osd":4,"uuid":"23232e28-e23b-4b4e-a531-4939246dbbde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":37329},{"type":"v1","addr":"172.21.15.157:6817","nonce":37329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":37329},{"type":"v1","addr":"172.21.15.157:6819","nonce":37329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":37329},{"type":"v1","addr":"172.21.15.157:6823","nonce":37329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":37329},{"type":"v1","addr":"172.21.15.157:6821","nonce":37329}]},"public_addr":"172.21.15.157:6817/37329","cluster_addr":"172.21.15.157:6819/37329","heartbeat_back_addr":"172.21.15.157:6823/37329","heartbeat_front_addr":"172.21.15.157:6821/37329","state":["exists","up"]},{"osd":5,"uuid":"f87ec331-3e59-4886-a317-6f7e26ec8e21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":37328},{"type":"v1","addr":"172.21.15.157:6804","nonce":37328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":37328},{"type":"v1","addr":"172.21.15.157:6808","nonce":37328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":37328},{"type":"v1","addr":"172.21.15.157:6815","nonce":37328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":37328},{"type":"v1","addr":"172.21.15.157:6812","nonce":37328}]},"public_addr":"172.21.15.157:6804/37328","cluster_addr":"172.21.15.157:6808/37328","heartbeat_back_addr":"172.21.15.157:6815/37328","heartbeat_front_addr":"172.21.15.157:6812/37328","state":["exists","up"]},{"osd":6,"uuid":"92852235-ce49-4d96-a940-6f18d97b13ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":37330},{"type":"v1","addr":"172.21.15.157:6801","nonce":37330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6803","nonce":37330},{"type":"v1","addr":"172.21.15.157:6805","nonce":37330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":37330},{"type":"v1","addr":"172.21.15.157:6813","nonce":37330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":37330},{"type":"v1","addr":"172.21.15.157:6809","nonce":37330}]},"public_addr":"172.21.15.157:6801/37330","cluster_addr":"172.21.15.157:6805/37330","heartbeat_back_addr":"172.21.15.157:6813/37330","heartbeat_front_addr":"172.21.15.157:6809/37330","state":["exists","up"]},{"osd":7,"uuid":"7484a061-723d-4663-b28f-b01766d62f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":37373},{"type":"v1","addr":"172.21.15.157:6825","nonce":37373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":37373},{"type":"v1","addr":"172.21.15.157:6827","nonce":37373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":37373},{"type":"v1","addr":"172.21.15.157:6831","nonce":37373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":37373},{"type":"v1","addr":"172.21.15.157:6829","nonce":37373}]},"public_addr":"172.21.15.157:6825/37373","cluster_addr":"172.21.15.157:6827/37373","heartbeat_back_addr":"172.21.15.157:6831/37373","heartbeat_front_addr":"172.21.15.157:6829/37373","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.110188+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.280265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.252119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.267996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.284582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.144420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.174764+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.308002+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:41.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.436+0000 7ff0d3600640 1 -- 172.21.15.107:0/331761872 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ff0a8065150 msgr2=0x7ff0a8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:41.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.436+0000 7ff0d3600640 1 --2- 172.21.15.107:0/331761872 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ff0a8065150 0x7ff0a8067600 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc034000 tx=0x7ff0bc032000 comp rx=0 tx=0).stop 2024-08-17T02:24:41.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.436+0000 7ff0d3600640 1 -- 172.21.15.107:0/331761872 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0cc155a20 msgr2=0x7ff0cc14aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:41.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.436+0000 7ff0d3600640 1 --2- 172.21.15.107:0/331761872 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0cc155a20 0x7ff0cc14aad0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff0b400c4f0 tx=0x7ff0b4007f50 comp rx=0 tx=0).stop 2024-08-17T02:24:41.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.437+0000 7ff0d3600640 1 -- 172.21.15.107:0/331761872 shutdown_connections 2024-08-17T02:24:41.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.437+0000 7ff0d3600640 1 --2- 172.21.15.107:0/331761872 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ff0a8065150 0x7ff0a8067600 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.437+0000 7ff0d3600640 1 --2- 172.21.15.107:0/331761872 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0cc155df0 0x7ff0cc168ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.437+0000 7ff0d3600640 1 --2- 172.21.15.107:0/331761872 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0cc155a20 0x7ff0cc14aad0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.437+0000 7ff0d3600640 1 --2- 172.21.15.107:0/331761872 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff0cc06df00 0x7ff0cc148620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.437+0000 7ff0d3600640 1 -- 172.21.15.107:0/331761872 >> 172.21.15.107:0/331761872 conn(0x7ff0cc0cb9b0 msgr2=0x7ff0cc0cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:41.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.437+0000 7ff0d3600640 1 -- 172.21.15.107:0/331761872 shutdown_connections 2024-08-17T02:24:41.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.437+0000 7ff0d3600640 1 -- 172.21.15.107:0/331761872 wait complete. 2024-08-17T02:24:41.453 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:24:23.456166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:24:27.078670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:24:27.804418+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:24:41.453 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:24:41.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.603+0000 7f80d3000640 1 Processor -- start 2024-08-17T02:24:41.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.603+0000 7f80d3000640 1 -- start start 2024-08-17T02:24:41.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.604+0000 7f80d3000640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f80cc157e10 0x7f80cc0b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:41.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.604+0000 7f80d3000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80cc157070 con 0x7f80cc0adec0 2024-08-17T02:24:41.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.604+0000 7f80d3000640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80cc15b410 con 0x7f80cc0b0a80 2024-08-17T02:24:41.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.604+0000 7f80d3000640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80cc0b1390 con 0x7f80cc157e10 2024-08-17T02:24:41.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.605+0000 7f80d1000640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f80cc0adec0 0x7f80cc15a6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:33954/0 (socket says 172.21.15.107:33954) 2024-08-17T02:24:41.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.605+0000 7f80d1000640 1 -- 172.21.15.107:0/2644468959 learned_addr learned my addr 172.21.15.107:0/2644468959 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:41.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.605+0000 7f80c3400640 1 --2- 172.21.15.107:0/2644468959 >> v2:172.21.15.157:3300/0 conn(0x7f80cc157e10 0x7f80cc0b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:41.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.605+0000 7f80cb400640 1 -- 172.21.15.107:0/2644468959 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 659403788 0 0) 0x7f80cc157070 con 0x7f80cc0adec0 2024-08-17T02:24:41.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.605+0000 7f80cb400640 1 -- 172.21.15.107:0/2644468959 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80b00034e0 con 0x7f80cc0adec0 2024-08-17T02:24:41.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.605+0000 7f80cb400640 1 -- 172.21.15.107:0/2644468959 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1608205761 0 0) 0x7f80cc15b410 con 0x7f80cc0b0a80 2024-08-17T02:24:41.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.605+0000 7f80cb400640 1 -- 172.21.15.107:0/2644468959 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80cc157070 con 0x7f80cc0b0a80 2024-08-17T02:24:41.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.605+0000 7f80c3400640 1 -- 172.21.15.107:0/2644468959 >> v1:172.21.15.157:6789/0 conn(0x7f80cc0b0a80 legacy=0x7f80cc0ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:41.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.605+0000 7f80c3400640 1 -- 172.21.15.107:0/2644468959 >> v1:172.21.15.107:6789/0 conn(0x7f80cc0adec0 legacy=0x7f80cc15a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:41.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.605+0000 7f80c3400640 1 -- 172.21.15.107:0/2644468959 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80cc157330 con 0x7f80cc157e10 2024-08-17T02:24:41.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.606+0000 7f80c3400640 1 --2- 172.21.15.107:0/2644468959 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80cc157e10 0x7f80cc0b0e50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f80b4009850 tx=0x7f80b40090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6667fd8250ca7edd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:41.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.607+0000 7f80cb400640 1 -- 172.21.15.107:0/2644468959 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b402ad90 con 0x7f80cc157e10 2024-08-17T02:24:41.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.607+0000 7f80cb400640 1 -- 172.21.15.107:0/2644468959 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b4032440 con 0x7f80cc157e10 2024-08-17T02:24:41.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.607+0000 7f80cb400640 1 -- 172.21.15.107:0/2644468959 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b40327e0 con 0x7f80cc157e10 2024-08-17T02:24:41.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.607+0000 7f80d3000640 1 -- 172.21.15.107:0/2644468959 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80cc157e10 msgr2=0x7f80cc0b0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:41.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.607+0000 7f80d3000640 1 --2- 172.21.15.107:0/2644468959 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80cc157e10 0x7f80cc0b0e50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f80b4009850 tx=0x7f80b40090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.607+0000 7f80d3000640 1 -- 172.21.15.107:0/2644468959 shutdown_connections 2024-08-17T02:24:41.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.607+0000 7f80d3000640 1 --2- 172.21.15.107:0/2644468959 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80cc157e10 0x7f80cc0b0e50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.607+0000 7f80d3000640 1 -- 172.21.15.107:0/2644468959 >> 172.21.15.107:0/2644468959 conn(0x7f80cc067750 msgr2=0x7f80cc0cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:41.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.607+0000 7f80d3000640 1 -- 172.21.15.107:0/2644468959 shutdown_connections 2024-08-17T02:24:41.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.607+0000 7f80d3000640 1 -- 172.21.15.107:0/2644468959 wait complete. 2024-08-17T02:24:41.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.609+0000 7f80d3000640 1 Processor -- start 2024-08-17T02:24:41.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.609+0000 7f80d3000640 1 -- start start 2024-08-17T02:24:41.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.610+0000 7f80d3000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f80cc0adec0 0x7f80cc16d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:41.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.610+0000 7f80d3000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80cc0b0a80 0x7f80cc140200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:41.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.610+0000 7f80d3000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80cc157e10 0x7f80cc150a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:41.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.610+0000 7f80d3000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc16d590 con 0x7f80cc157e10 2024-08-17T02:24:41.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.610+0000 7f80d3000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc16c600 con 0x7f80cc0b0a80 2024-08-17T02:24:41.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.610+0000 7f80d3000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc16cbc0 con 0x7f80cc0adec0 2024-08-17T02:24:41.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.610+0000 7f80d1000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80cc157e10 0x7f80cc150a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:41.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.610+0000 7f80d1000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80cc157e10 0x7f80cc150a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:32790/0 (socket says 172.21.15.107:32790) 2024-08-17T02:24:41.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.610+0000 7f80d1000640 1 -- 172.21.15.107:0/1048617493 learned_addr learned my addr 172.21.15.107:0/1048617493 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:41.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.610+0000 7f80c3400640 1 --2- 172.21.15.107:0/1048617493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80cc0b0a80 0x7f80cc140200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:41.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.610+0000 7f80cbe00640 1 --2- 172.21.15.107:0/1048617493 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f80cc0adec0 0x7f80cc16d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:41.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.610+0000 7f80d1000640 1 -- 172.21.15.107:0/1048617493 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f80cc0adec0 msgr2=0x7f80cc16d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:41.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.610+0000 7f80d1000640 1 --2- 172.21.15.107:0/1048617493 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f80cc0adec0 0x7f80cc16d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.610+0000 7f80d1000640 1 -- 172.21.15.107:0/1048617493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80cc0b0a80 msgr2=0x7f80cc140200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:41.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.610+0000 7f80d1000640 1 --2- 172.21.15.107:0/1048617493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80cc0b0a80 0x7f80cc140200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.610+0000 7f80d1000640 1 -- 172.21.15.107:0/1048617493 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b4009390 con 0x7f80cc157e10 2024-08-17T02:24:41.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.611+0000 7f80d1000640 1 --2- 172.21.15.107:0/1048617493 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80cc157e10 0x7f80cc150a90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f80c4001460 tx=0x7f80c4001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:41.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.611+0000 7f80c3e00640 1 -- 172.21.15.107:0/1048617493 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c400a640 con 0x7f80cc157e10 2024-08-17T02:24:41.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.611+0000 7f80c3e00640 1 -- 172.21.15.107:0/1048617493 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c400a7a0 con 0x7f80cc157e10 2024-08-17T02:24:41.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.611+0000 7f80c3e00640 1 -- 172.21.15.107:0/1048617493 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c400ab60 con 0x7f80cc157e10 2024-08-17T02:24:41.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.611+0000 7f80d3000640 1 -- 172.21.15.107:0/1048617493 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80cc15baa0 con 0x7f80cc157e10 2024-08-17T02:24:41.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.611+0000 7f80d3000640 1 -- 172.21.15.107:0/1048617493 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80cc15c020 con 0x7f80cc157e10 2024-08-17T02:24:41.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.612+0000 7f80d3000640 1 -- 172.21.15.107:0/1048617493 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80cc064db0 con 0x7f80cc157e10 2024-08-17T02:24:41.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.613+0000 7f80c3e00640 1 -- 172.21.15.107:0/1048617493 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f80c40070f0 con 0x7f80cc157e10 2024-08-17T02:24:41.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.613+0000 7f80c3e00640 1 --2- 172.21.15.107:0/1048617493 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f80a8065150 0x7f80a8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:41.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.614+0000 7f80c3e00640 1 -- 172.21.15.107:0/1048617493 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f80c4082450 con 0x7f80cc157e10 2024-08-17T02:24:41.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.614+0000 7f80cbe00640 1 --2- 172.21.15.107:0/1048617493 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f80a8065150 0x7f80a8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:41.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.614+0000 7f80cbe00640 1 --2- 172.21.15.107:0/1048617493 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f80a8065150 0x7f80a8067600 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f80bc003a10 tx=0x7f80bc007cc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:41.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.617+0000 7f80c3e00640 1 -- 172.21.15.107:0/1048617493 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f80c4050660 con 0x7f80cc157e10 2024-08-17T02:24:41.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.789+0000 7f80d3000640 1 -- 172.21.15.107:0/1048617493 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f80cc16c910 con 0x7f80cc157e10 2024-08-17T02:24:41.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.790+0000 7f80c3e00640 1 -- 172.21.15.107:0/1048617493 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f80c4053c80 con 0x7f80cc157e10 2024-08-17T02:24:41.791 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2024-08-17T02:24:41.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.792+0000 7f80d3000640 1 -- 172.21.15.107:0/1048617493 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f80a8065150 msgr2=0x7f80a8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:41.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.792+0000 7f80d3000640 1 --2- 172.21.15.107:0/1048617493 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f80a8065150 0x7f80a8067600 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f80bc003a10 tx=0x7f80bc007cc0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.792+0000 7f80d3000640 1 -- 172.21.15.107:0/1048617493 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80cc157e10 msgr2=0x7f80cc150a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:41.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.792+0000 7f80d3000640 1 --2- 172.21.15.107:0/1048617493 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80cc157e10 0x7f80cc150a90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f80c4001460 tx=0x7f80c4001a20 comp rx=0 tx=0).stop 2024-08-17T02:24:41.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.792+0000 7f80d3000640 1 -- 172.21.15.107:0/1048617493 shutdown_connections 2024-08-17T02:24:41.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.792+0000 7f80d3000640 1 --2- 172.21.15.107:0/1048617493 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f80a8065150 0x7f80a8067600 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.792+0000 7f80d3000640 1 --2- 172.21.15.107:0/1048617493 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80cc157e10 0x7f80cc150a90 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.792+0000 7f80d3000640 1 --2- 172.21.15.107:0/1048617493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80cc0b0a80 0x7f80cc140200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.792+0000 7f80d3000640 1 --2- 172.21.15.107:0/1048617493 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f80cc0adec0 0x7f80cc16d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.792+0000 7f80d3000640 1 -- 172.21.15.107:0/1048617493 >> 172.21.15.107:0/1048617493 conn(0x7f80cc067750 msgr2=0x7f80cc0691c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:41.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.792+0000 7f80d3000640 1 -- 172.21.15.107:0/1048617493 shutdown_connections 2024-08-17T02:24:41.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.792+0000 7f80d3000640 1 -- 172.21.15.107:0/1048617493 wait complete. 2024-08-17T02:24:41.808 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:24:41.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.957+0000 7ff9d7e00640 1 Processor -- start 2024-08-17T02:24:41.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.957+0000 7ff9d7e00640 1 -- start start 2024-08-17T02:24:41.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.958+0000 7ff9d7e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff9d00adcf0 0x7ff9d00ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:41.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.959+0000 7ff9d7e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff9d00abb00 0x7ff9d00c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:41.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.959+0000 7ff9d7e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9d00ab130 con 0x7ff9d0156c50 2024-08-17T02:24:41.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.959+0000 7ff9d7e00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9d00ae5a0 con 0x7ff9d00adcf0 2024-08-17T02:24:41.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.959+0000 7ff9d7e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d00ae2c0 con 0x7ff9d00abb00 2024-08-17T02:24:41.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.959+0000 7ff9d5400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7ff9d0156c50 0x7ff9d00c7cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:33970/0 (socket says 172.21.15.107:33970) 2024-08-17T02:24:41.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.959+0000 7ff9d5400640 1 -- 172.21.15.107:0/3966275170 learned_addr learned my addr 172.21.15.107:0/3966275170 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:41.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.959+0000 7ff9d5e00640 1 --2- 172.21.15.107:0/3966275170 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff9d00abb00 0x7ff9d00c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:41.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.959+0000 7ff9d4a00640 1 --2- 172.21.15.107:0/3966275170 >> v2:172.21.15.157:3300/0 conn(0x7ff9d00adcf0 0x7ff9d00ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:41.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.959+0000 7ff9cfe00640 1 -- 172.21.15.107:0/3966275170 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1758037490 0 0) 0x7ff9d00ab130 con 0x7ff9d0156c50 2024-08-17T02:24:41.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.959+0000 7ff9cfe00640 1 -- 172.21.15.107:0/3966275170 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9b80034e0 con 0x7ff9d0156c50 2024-08-17T02:24:41.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.960+0000 7ff9cfe00640 1 -- 172.21.15.107:0/3966275170 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2881913825 0 0) 0x7ff9b80034e0 con 0x7ff9d0156c50 2024-08-17T02:24:41.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.960+0000 7ff9d5e00640 1 -- 172.21.15.107:0/3966275170 >> v2:172.21.15.157:3300/0 conn(0x7ff9d00adcf0 msgr2=0x7ff9d00ab5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:41.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.960+0000 7ff9d5e00640 1 --2- 172.21.15.107:0/3966275170 >> v2:172.21.15.157:3300/0 conn(0x7ff9d00adcf0 0x7ff9d00ab5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.960+0000 7ff9d5e00640 1 -- 172.21.15.107:0/3966275170 >> v1:172.21.15.107:6789/0 conn(0x7ff9d0156c50 legacy=0x7ff9d00c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:41.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.960+0000 7ff9d5e00640 1 -- 172.21.15.107:0/3966275170 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d00aaae0 con 0x7ff9d00abb00 2024-08-17T02:24:41.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.960+0000 7ff9d4a00640 1 --2- 172.21.15.107:0/3966275170 >> v2:172.21.15.157:3300/0 conn(0x7ff9d00adcf0 0x7ff9d00ab5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:41.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.961+0000 7ff9d5e00640 1 --2- 172.21.15.107:0/3966275170 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff9d00abb00 0x7ff9d00c8bd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8009e60 tx=0x7ff9c8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa7629c53d8a9dfc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:41.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.961+0000 7ff9cfe00640 1 -- 172.21.15.107:0/3966275170 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c4001470 con 0x7ff9d00abb00 2024-08-17T02:24:41.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.961+0000 7ff9cfe00640 1 -- 172.21.15.107:0/3966275170 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c802d050 con 0x7ff9d00abb00 2024-08-17T02:24:41.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.961+0000 7ff9cfe00640 1 -- 172.21.15.107:0/3966275170 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8031630 con 0x7ff9d00abb00 2024-08-17T02:24:41.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.962+0000 7ff9d7e00640 1 -- 172.21.15.107:0/3966275170 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff9d00abb00 msgr2=0x7ff9d00c8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:41.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.962+0000 7ff9d7e00640 1 --2- 172.21.15.107:0/3966275170 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff9d00abb00 0x7ff9d00c8bd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8009e60 tx=0x7ff9c8009780 comp rx=0 tx=0).stop 2024-08-17T02:24:41.964 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.962+0000 7ff9d7e00640 1 -- 172.21.15.107:0/3966275170 shutdown_connections 2024-08-17T02:24:41.964 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.962+0000 7ff9d7e00640 1 --2- 172.21.15.107:0/3966275170 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff9d00abb00 0x7ff9d00c8bd0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.964 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.962+0000 7ff9d7e00640 1 --2- 172.21.15.107:0/3966275170 >> v2:172.21.15.157:3300/0 conn(0x7ff9d00adcf0 0x7ff9d00ab5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.964 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.962+0000 7ff9d7e00640 1 -- 172.21.15.107:0/3966275170 >> 172.21.15.107:0/3966275170 conn(0x7ff9d0067750 msgr2=0x7ff9d00c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:41.964 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.962+0000 7ff9d7e00640 1 -- 172.21.15.107:0/3966275170 shutdown_connections 2024-08-17T02:24:41.964 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.962+0000 7ff9d7e00640 1 -- 172.21.15.107:0/3966275170 wait complete. 2024-08-17T02:24:41.964 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.963+0000 7ff9d7e00640 1 Processor -- start 2024-08-17T02:24:41.965 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.964+0000 7ff9d7e00640 1 -- start start 2024-08-17T02:24:41.967 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.964+0000 7ff9d7e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9d00abb00 0x7ff9d014f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:41.967 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.964+0000 7ff9d7e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff9d00adcf0 0x7ff9d0168c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:41.967 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.964+0000 7ff9d7e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9d0156c50 0x7ff9d0154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:41.967 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.965+0000 7ff9d7e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d015f590 con 0x7ff9d00abb00 2024-08-17T02:24:41.967 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.965+0000 7ff9d7e00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d01580c0 con 0x7ff9d0156c50 2024-08-17T02:24:41.967 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.965+0000 7ff9d7e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d0158c40 con 0x7ff9d00adcf0 2024-08-17T02:24:41.967 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.965+0000 7ff9d5400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9d00abb00 0x7ff9d014f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:41.967 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.965+0000 7ff9d5400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9d00abb00 0x7ff9d014f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:32798/0 (socket says 172.21.15.107:32798) 2024-08-17T02:24:41.967 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.965+0000 7ff9d5400640 1 -- 172.21.15.107:0/3548340991 learned_addr learned my addr 172.21.15.107:0/3548340991 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:41.968 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.965+0000 7ff9d4a00640 1 --2- 172.21.15.107:0/3548340991 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff9d00adcf0 0x7ff9d0168c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:41.968 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.965+0000 7ff9d5e00640 1 --2- 172.21.15.107:0/3548340991 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9d0156c50 0x7ff9d0154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:41.968 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.965+0000 7ff9d5400640 1 -- 172.21.15.107:0/3548340991 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff9d00adcf0 msgr2=0x7ff9d0168c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:41.968 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.965+0000 7ff9d5400640 1 --2- 172.21.15.107:0/3548340991 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff9d00adcf0 0x7ff9d0168c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.968 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.965+0000 7ff9d5400640 1 -- 172.21.15.107:0/3548340991 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9d0156c50 msgr2=0x7ff9d0154ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:41.968 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.965+0000 7ff9d5400640 1 --2- 172.21.15.107:0/3548340991 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9d0156c50 0x7ff9d0154ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:41.968 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.965+0000 7ff9d5400640 1 -- 172.21.15.107:0/3548340991 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9bc009390 con 0x7ff9d00abb00 2024-08-17T02:24:41.968 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.965+0000 7ff9d5400640 1 --2- 172.21.15.107:0/3548340991 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9d00abb00 0x7ff9d014f4e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff9c400cb60 tx=0x7ff9c4001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:41.968 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.966+0000 7ff9ccc00640 1 -- 172.21.15.107:0/3548340991 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c4007360 con 0x7ff9d00abb00 2024-08-17T02:24:41.968 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.966+0000 7ff9ccc00640 1 -- 172.21.15.107:0/3548340991 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c40074c0 con 0x7ff9d00abb00 2024-08-17T02:24:41.968 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.966+0000 7ff9ccc00640 1 -- 172.21.15.107:0/3548340991 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c40049b0 con 0x7ff9d00abb00 2024-08-17T02:24:41.968 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.966+0000 7ff9d7e00640 1 -- 172.21.15.107:0/3548340991 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9c8009a20 con 0x7ff9d00abb00 2024-08-17T02:24:41.969 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.966+0000 7ff9d7e00640 1 -- 172.21.15.107:0/3548340991 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d01585f0 con 0x7ff9d00abb00 2024-08-17T02:24:41.969 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.967+0000 7ff9d7e00640 1 -- 172.21.15.107:0/3548340991 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d0071050 con 0x7ff9d00abb00 2024-08-17T02:24:41.970 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.967+0000 7ff9ccc00640 1 -- 172.21.15.107:0/3548340991 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff9c4004d20 con 0x7ff9d00abb00 2024-08-17T02:24:41.970 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.968+0000 7ff9ccc00640 1 --2- 172.21.15.107:0/3548340991 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ff9b0065150 0x7ff9b0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:41.970 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.968+0000 7ff9ccc00640 1 -- 172.21.15.107:0/3548340991 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff9c4081c10 con 0x7ff9d00abb00 2024-08-17T02:24:41.970 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.968+0000 7ff9d4a00640 1 --2- 172.21.15.107:0/3548340991 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ff9b0065150 0x7ff9b0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:41.970 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.969+0000 7ff9d4a00640 1 --2- 172.21.15.107:0/3548340991 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ff9b0065150 0x7ff9b0067600 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0150140 tx=0x7ff9bc0090f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:41.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:41.972+0000 7ff9ccc00640 1 -- 172.21.15.107:0/3548340991 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff9c404ce40 con 0x7ff9d00abb00 2024-08-17T02:24:42.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.142+0000 7ff9d7e00640 1 -- 172.21.15.107:0/3548340991 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff9d01537a0 con 0x7ff9d00abb00 2024-08-17T02:24:42.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.143+0000 7ff9ccc00640 1 -- 172.21.15.107:0/3548340991 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff9c4018020 con 0x7ff9d00abb00 2024-08-17T02:24:42.144 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2024-08-17T02:24:42.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.145+0000 7ff9d7e00640 1 -- 172.21.15.107:0/3548340991 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ff9b0065150 msgr2=0x7ff9b0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:42.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.145+0000 7ff9d7e00640 1 --2- 172.21.15.107:0/3548340991 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ff9b0065150 0x7ff9b0067600 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0150140 tx=0x7ff9bc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.145+0000 7ff9d7e00640 1 -- 172.21.15.107:0/3548340991 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9d00abb00 msgr2=0x7ff9d014f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:42.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.145+0000 7ff9d7e00640 1 --2- 172.21.15.107:0/3548340991 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9d00abb00 0x7ff9d014f4e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff9c400cb60 tx=0x7ff9c4001b10 comp rx=0 tx=0).stop 2024-08-17T02:24:42.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.145+0000 7ff9d7e00640 1 -- 172.21.15.107:0/3548340991 shutdown_connections 2024-08-17T02:24:42.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.145+0000 7ff9d7e00640 1 --2- 172.21.15.107:0/3548340991 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ff9b0065150 0x7ff9b0067600 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.145+0000 7ff9d7e00640 1 --2- 172.21.15.107:0/3548340991 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9d0156c50 0x7ff9d0154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.145+0000 7ff9d7e00640 1 --2- 172.21.15.107:0/3548340991 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff9d00adcf0 0x7ff9d0168c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.145+0000 7ff9d7e00640 1 --2- 172.21.15.107:0/3548340991 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9d00abb00 0x7ff9d014f4e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.145+0000 7ff9d7e00640 1 -- 172.21.15.107:0/3548340991 >> 172.21.15.107:0/3548340991 conn(0x7ff9d0067750 msgr2=0x7ff9d006c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:42.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.145+0000 7ff9d7e00640 1 -- 172.21.15.107:0/3548340991 shutdown_connections 2024-08-17T02:24:42.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.145+0000 7ff9d7e00640 1 -- 172.21.15.107:0/3548340991 wait complete. 2024-08-17T02:24:42.161 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:24:42.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.309+0000 7fa3b2e00640 1 Processor -- start 2024-08-17T02:24:42.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.309+0000 7fa3b2e00640 1 -- start start 2024-08-17T02:24:42.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.310+0000 7fa3b2e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa3ac096e70 0x7fa3ac069600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:42.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.310+0000 7fa3b2e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa3ac0aeb60 0x7fa3ac0aef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:42.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.310+0000 7fa3b2e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3ac0ae3a0 con 0x7fa3ac069230 2024-08-17T02:24:42.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.310+0000 7fa3b2e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3ac0ad010 con 0x7fa3ac0aeb60 2024-08-17T02:24:42.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.310+0000 7fa3b2e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac0ac770 con 0x7fa3ac096e70 2024-08-17T02:24:42.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.310+0000 7fa3b1a00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fa3ac069230 0x7fa3ac0abfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:33978/0 (socket says 172.21.15.107:33978) 2024-08-17T02:24:42.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.310+0000 7fa3b2400640 1 --2- 172.21.15.107:0/2828992817 >> v2:172.21.15.107:3300/0 conn(0x7fa3ac0aeb60 0x7fa3ac0aef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:42.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.310+0000 7fa3b1a00640 1 -- 172.21.15.107:0/2828992817 learned_addr learned my addr 172.21.15.107:0/2828992817 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:42.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.310+0000 7fa3b1000640 1 --2- 172.21.15.107:0/2828992817 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa3ac096e70 0x7fa3ac069600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:42.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.311+0000 7fa3b2400640 1 -- 172.21.15.107:0/2828992817 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa3ac096e70 msgr2=0x7fa3ac069600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:42.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.311+0000 7fa3b2400640 1 --2- 172.21.15.107:0/2828992817 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa3ac096e70 0x7fa3ac069600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.311+0000 7fa3b2400640 1 -- 172.21.15.107:0/2828992817 >> v1:172.21.15.107:6789/0 conn(0x7fa3ac069230 legacy=0x7fa3ac0abfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:42.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.311+0000 7fa3b2400640 1 -- 172.21.15.107:0/2828992817 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ac0aca50 con 0x7fa3ac0aeb60 2024-08-17T02:24:42.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.311+0000 7fa3abe00640 1 -- 172.21.15.107:0/2828992817 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 838800174 0 0) 0x7fa3ac0ae3a0 con 0x7fa3ac069230 2024-08-17T02:24:42.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.312+0000 7fa3b2400640 1 --2- 172.21.15.107:0/2828992817 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3ac0aeb60 0x7fa3ac0aef80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4009e60 tx=0x7fa3a4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc25259304fa7762 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:42.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.312+0000 7fa3abe00640 1 -- 172.21.15.107:0/2828992817 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4007550 con 0x7fa3ac0aeb60 2024-08-17T02:24:42.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.312+0000 7fa3abe00640 1 -- 172.21.15.107:0/2828992817 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a402d050 con 0x7fa3ac0aeb60 2024-08-17T02:24:42.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.312+0000 7fa3abe00640 1 -- 172.21.15.107:0/2828992817 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a40078e0 con 0x7fa3ac0aeb60 2024-08-17T02:24:42.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.312+0000 7fa3b2e00640 1 -- 172.21.15.107:0/2828992817 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3ac0aeb60 msgr2=0x7fa3ac0aef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:42.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.312+0000 7fa3b2e00640 1 --2- 172.21.15.107:0/2828992817 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3ac0aeb60 0x7fa3ac0aef80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4009e60 tx=0x7fa3a4009780 comp rx=0 tx=0).stop 2024-08-17T02:24:42.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.313+0000 7fa3b2e00640 1 -- 172.21.15.107:0/2828992817 shutdown_connections 2024-08-17T02:24:42.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.313+0000 7fa3b2e00640 1 --2- 172.21.15.107:0/2828992817 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3ac0aeb60 0x7fa3ac0aef80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.313+0000 7fa3b2e00640 1 --2- 172.21.15.107:0/2828992817 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa3ac096e70 0x7fa3ac069600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.313+0000 7fa3b2e00640 1 -- 172.21.15.107:0/2828992817 >> 172.21.15.107:0/2828992817 conn(0x7fa3ac096a70 msgr2=0x7fa3ac0cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:42.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.313+0000 7fa3b2e00640 1 -- 172.21.15.107:0/2828992817 shutdown_connections 2024-08-17T02:24:42.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.313+0000 7fa3b2e00640 1 -- 172.21.15.107:0/2828992817 wait complete. 2024-08-17T02:24:42.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.314+0000 7fa3b2e00640 1 Processor -- start 2024-08-17T02:24:42.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.314+0000 7fa3b2e00640 1 -- start start 2024-08-17T02:24:42.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.315+0000 7fa3b2e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa3ac069230 0x7fa3ac16bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:42.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.315+0000 7fa3b2e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa3ac096e70 0x7fa3ac154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:42.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.315+0000 7fa3b2e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3ac0aeb60 0x7fa3ac14d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:42.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.315+0000 7fa3b2e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac16c1c0 con 0x7fa3ac0aeb60 2024-08-17T02:24:42.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.315+0000 7fa3b2e00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac155890 con 0x7fa3ac096e70 2024-08-17T02:24:42.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.315+0000 7fa3b2e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac155b70 con 0x7fa3ac069230 2024-08-17T02:24:42.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.315+0000 7fa3b2400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3ac0aeb60 0x7fa3ac14d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:42.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.316+0000 7fa3b2400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3ac0aeb60 0x7fa3ac14d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:32804/0 (socket says 172.21.15.107:32804) 2024-08-17T02:24:42.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.316+0000 7fa3b2400640 1 -- 172.21.15.107:0/1524506610 learned_addr learned my addr 172.21.15.107:0/1524506610 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:42.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.316+0000 7fa3b1a00640 1 --2- 172.21.15.107:0/1524506610 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa3ac069230 0x7fa3ac16bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:42.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.316+0000 7fa3b1000640 1 --2- 172.21.15.107:0/1524506610 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa3ac096e70 0x7fa3ac154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:42.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.316+0000 7fa3b2400640 1 -- 172.21.15.107:0/1524506610 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa3ac069230 msgr2=0x7fa3ac16bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:42.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.316+0000 7fa3b2400640 1 --2- 172.21.15.107:0/1524506610 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa3ac069230 0x7fa3ac16bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.316+0000 7fa3b2400640 1 -- 172.21.15.107:0/1524506610 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa3ac096e70 msgr2=0x7fa3ac154ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:42.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.316+0000 7fa3b2400640 1 --2- 172.21.15.107:0/1524506610 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa3ac096e70 0x7fa3ac154ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.316+0000 7fa3b2400640 1 -- 172.21.15.107:0/1524506610 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a4009a20 con 0x7fa3ac0aeb60 2024-08-17T02:24:42.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.316+0000 7fa3b1a00640 1 --2- 172.21.15.107:0/1524506610 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa3ac069230 0x7fa3ac16bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:42.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.316+0000 7fa3b1000640 1 --2- 172.21.15.107:0/1524506610 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa3ac096e70 0x7fa3ac154ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:42.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.316+0000 7fa3b2400640 1 --2- 172.21.15.107:0/1524506610 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3ac0aeb60 0x7fa3ac14d2f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa3a40099f0 tx=0x7fa3a4037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:42.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.316+0000 7fa3a8c00640 1 -- 172.21.15.107:0/1524506610 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4031b70 con 0x7fa3ac0aeb60 2024-08-17T02:24:42.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.316+0000 7fa3a8c00640 1 -- 172.21.15.107:0/1524506610 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a4031cd0 con 0x7fa3ac0aeb60 2024-08-17T02:24:42.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.316+0000 7fa3a8c00640 1 -- 172.21.15.107:0/1524506610 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4045690 con 0x7fa3ac0aeb60 2024-08-17T02:24:42.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.316+0000 7fa3b2e00640 1 -- 172.21.15.107:0/1524506610 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3ac155e50 con 0x7fa3ac0aeb60 2024-08-17T02:24:42.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.317+0000 7fa3b2e00640 1 -- 172.21.15.107:0/1524506610 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3ac156410 con 0x7fa3ac0aeb60 2024-08-17T02:24:42.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.318+0000 7fa3b2e00640 1 -- 172.21.15.107:0/1524506610 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3ac156630 con 0x7fa3ac0aeb60 2024-08-17T02:24:42.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.318+0000 7fa3a8c00640 1 -- 172.21.15.107:0/1524506610 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa3a403c420 con 0x7fa3ac0aeb60 2024-08-17T02:24:42.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.319+0000 7fa3a8c00640 1 --2- 172.21.15.107:0/1524506610 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fa38c065180 0x7fa38c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:42.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.319+0000 7fa3a8c00640 1 -- 172.21.15.107:0/1524506610 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa3a40a4190 con 0x7fa3ac0aeb60 2024-08-17T02:24:42.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.319+0000 7fa3b1a00640 1 --2- 172.21.15.107:0/1524506610 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fa38c065180 0x7fa38c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:42.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.320+0000 7fa3b1a00640 1 --2- 172.21.15.107:0/1524506610 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fa38c065180 0x7fa38c067630 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa3a00011e0 tx=0x7fa3a0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:42.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.323+0000 7fa3a8c00640 1 -- 172.21.15.107:0/1524506610 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa3a40721b0 con 0x7fa3ac0aeb60 2024-08-17T02:24:42.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.499+0000 7fa3b2e00640 1 -- 172.21.15.107:0/1524506610 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa3ac071050 con 0x7fa3ac0aeb60 2024-08-17T02:24:42.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.500+0000 7fa3a8c00640 1 -- 172.21.15.107:0/1524506610 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa3a40757d0 con 0x7fa3ac0aeb60 2024-08-17T02:24:42.501 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 64 2024-08-17T02:24:42.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.502+0000 7fa3b2e00640 1 -- 172.21.15.107:0/1524506610 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fa38c065180 msgr2=0x7fa38c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:42.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.502+0000 7fa3b2e00640 1 --2- 172.21.15.107:0/1524506610 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fa38c065180 0x7fa38c067630 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa3a00011e0 tx=0x7fa3a0009040 comp rx=0 tx=0).stop 2024-08-17T02:24:42.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.502+0000 7fa3b2e00640 1 -- 172.21.15.107:0/1524506610 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3ac0aeb60 msgr2=0x7fa3ac14d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:42.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.502+0000 7fa3b2e00640 1 --2- 172.21.15.107:0/1524506610 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3ac0aeb60 0x7fa3ac14d2f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa3a40099f0 tx=0x7fa3a4037000 comp rx=0 tx=0).stop 2024-08-17T02:24:42.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.502+0000 7fa3b2e00640 1 -- 172.21.15.107:0/1524506610 shutdown_connections 2024-08-17T02:24:42.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.502+0000 7fa3b2e00640 1 --2- 172.21.15.107:0/1524506610 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fa38c065180 0x7fa38c067630 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.502+0000 7fa3b2e00640 1 --2- 172.21.15.107:0/1524506610 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3ac0aeb60 0x7fa3ac14d2f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.502+0000 7fa3b2e00640 1 --2- 172.21.15.107:0/1524506610 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa3ac096e70 0x7fa3ac154ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.502+0000 7fa3b2e00640 1 --2- 172.21.15.107:0/1524506610 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa3ac069230 0x7fa3ac16bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.502+0000 7fa3b2e00640 1 -- 172.21.15.107:0/1524506610 >> 172.21.15.107:0/1524506610 conn(0x7fa3ac096a70 msgr2=0x7fa3ac068580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:42.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.502+0000 7fa3b2e00640 1 -- 172.21.15.107:0/1524506610 shutdown_connections 2024-08-17T02:24:42.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.502+0000 7fa3b2e00640 1 -- 172.21.15.107:0/1524506610 wait complete. 2024-08-17T02:24:42.518 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:24:42.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.664+0000 7f1a88e00640 1 Processor -- start 2024-08-17T02:24:42.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.664+0000 7f1a88e00640 1 -- start start 2024-08-17T02:24:42.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.665+0000 7f1a88e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1a841401b0 0x7f1a840caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:42.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.665+0000 7f1a88e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1a84140580 0x7f1a840b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:42.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.665+0000 7f1a88e00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a840b16d0 con 0x7f1a840b1270 2024-08-17T02:24:42.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.665+0000 7f1a88e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a840cb450 con 0x7f1a84140580 2024-08-17T02:24:42.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.665+0000 7f1a88e00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a840caa80 con 0x7f1a841401b0 2024-08-17T02:24:42.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.666+0000 7f1a81400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1a84140580 0x7f1a840b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:42.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.666+0000 7f1a81400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1a84140580 0x7f1a840b0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:32814/0 (socket says 172.21.15.107:32814) 2024-08-17T02:24:42.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.666+0000 7f1a81400640 1 -- 172.21.15.107:0/253511974 learned_addr learned my addr 172.21.15.107:0/253511974 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:42.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.666+0000 7f1a81400640 1 -- 172.21.15.107:0/253511974 >> v2:172.21.15.157:3300/0 conn(0x7f1a841401b0 msgr2=0x7f1a840caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:42.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.666+0000 7f1a81e00640 1 --2- 172.21.15.107:0/253511974 >> v2:172.21.15.157:3300/0 conn(0x7f1a841401b0 0x7f1a840caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:42.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.666+0000 7f1a81400640 1 --2- 172.21.15.107:0/253511974 >> v2:172.21.15.157:3300/0 conn(0x7f1a841401b0 0x7f1a840caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.666+0000 7f1a81400640 1 -- 172.21.15.107:0/253511974 >> v1:172.21.15.157:6789/0 conn(0x7f1a840b1270 legacy=0x7f1a840c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:42.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.666+0000 7f1a81400640 1 -- 172.21.15.107:0/253511974 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a840c9e70 con 0x7f1a84140580 2024-08-17T02:24:42.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.667+0000 7f1a81400640 1 --2- 172.21.15.107:0/253511974 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a84140580 0x7f1a840b0d30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1a84068650 tx=0x7f1a700091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32993e830b4bdf5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:42.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.667+0000 7f1a80a00640 1 -- 172.21.15.107:0/253511974 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7002ad50 con 0x7f1a84140580 2024-08-17T02:24:42.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.668+0000 7f1a80a00640 1 -- 172.21.15.107:0/253511974 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a70032440 con 0x7f1a84140580 2024-08-17T02:24:42.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.668+0000 7f1a80a00640 1 -- 172.21.15.107:0/253511974 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a70032820 con 0x7f1a84140580 2024-08-17T02:24:42.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.668+0000 7f1a88e00640 1 -- 172.21.15.107:0/253511974 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a84140580 msgr2=0x7f1a840b0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:42.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.668+0000 7f1a88e00640 1 --2- 172.21.15.107:0/253511974 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a84140580 0x7f1a840b0d30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1a84068650 tx=0x7f1a700091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.668+0000 7f1a88e00640 1 -- 172.21.15.107:0/253511974 shutdown_connections 2024-08-17T02:24:42.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.668+0000 7f1a88e00640 1 --2- 172.21.15.107:0/253511974 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a84140580 0x7f1a840b0d30 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.668+0000 7f1a88e00640 1 --2- 172.21.15.107:0/253511974 >> v2:172.21.15.157:3300/0 conn(0x7f1a841401b0 0x7f1a840caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.668+0000 7f1a88e00640 1 -- 172.21.15.107:0/253511974 >> 172.21.15.107:0/253511974 conn(0x7f1a840cb9b0 msgr2=0x7f1a840cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:42.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.668+0000 7f1a88e00640 1 -- 172.21.15.107:0/253511974 shutdown_connections 2024-08-17T02:24:42.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.668+0000 7f1a88e00640 1 -- 172.21.15.107:0/253511974 wait complete. 2024-08-17T02:24:42.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.669+0000 7f1a88e00640 1 Processor -- start 2024-08-17T02:24:42.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.670+0000 7f1a88e00640 1 -- start start 2024-08-17T02:24:42.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.670+0000 7f1a88e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a840b1270 0x7f1a8413e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:42.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.670+0000 7f1a88e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a841401b0 0x7f1a840a93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:42.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.671+0000 7f1a88e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1a84140580 0x7f1a840aa870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:42.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.671+0000 7f1a88e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a840a7430 con 0x7f1a841401b0 2024-08-17T02:24:42.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.671+0000 7f1a88e00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a840a9e10 con 0x7f1a840b1270 2024-08-17T02:24:42.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.671+0000 7f1a88e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a840aa0f0 con 0x7f1a84140580 2024-08-17T02:24:42.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.671+0000 7f1a81400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a841401b0 0x7f1a840a93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:42.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.671+0000 7f1a81400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a841401b0 0x7f1a840a93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:32830/0 (socket says 172.21.15.107:32830) 2024-08-17T02:24:42.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.671+0000 7f1a81400640 1 -- 172.21.15.107:0/2389959443 learned_addr learned my addr 172.21.15.107:0/2389959443 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:42.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.671+0000 7f1a81e00640 1 --2- 172.21.15.107:0/2389959443 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a840b1270 0x7f1a8413e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:42.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.671+0000 7f1a82800640 1 --2- 172.21.15.107:0/2389959443 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1a84140580 0x7f1a840aa870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:42.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.671+0000 7f1a81400640 1 -- 172.21.15.107:0/2389959443 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1a84140580 msgr2=0x7f1a840aa870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:42.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.671+0000 7f1a81400640 1 --2- 172.21.15.107:0/2389959443 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1a84140580 0x7f1a840aa870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.671+0000 7f1a81400640 1 -- 172.21.15.107:0/2389959443 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a840b1270 msgr2=0x7f1a8413e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:42.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.671+0000 7f1a81400640 1 --2- 172.21.15.107:0/2389959443 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a840b1270 0x7f1a8413e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.671+0000 7f1a81400640 1 -- 172.21.15.107:0/2389959443 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a70009450 con 0x7f1a841401b0 2024-08-17T02:24:42.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.671+0000 7f1a81400640 1 --2- 172.21.15.107:0/2389959443 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a841401b0 0x7f1a840a93e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1a70035040 tx=0x7f1a70032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:42.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.672+0000 7f1a79600640 1 -- 172.21.15.107:0/2389959443 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a70031de0 con 0x7f1a841401b0 2024-08-17T02:24:42.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.672+0000 7f1a79600640 1 -- 172.21.15.107:0/2389959443 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7003d420 con 0x7f1a841401b0 2024-08-17T02:24:42.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.672+0000 7f1a88e00640 1 -- 172.21.15.107:0/2389959443 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a840aa3d0 con 0x7f1a841401b0 2024-08-17T02:24:42.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.672+0000 7f1a79600640 1 -- 172.21.15.107:0/2389959443 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7003d7e0 con 0x7f1a841401b0 2024-08-17T02:24:42.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.672+0000 7f1a88e00640 1 -- 172.21.15.107:0/2389959443 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a840a8e40 con 0x7f1a841401b0 2024-08-17T02:24:42.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.673+0000 7f1a88e00640 1 -- 172.21.15.107:0/2389959443 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a840a75a0 con 0x7f1a841401b0 2024-08-17T02:24:42.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.674+0000 7f1a79600640 1 -- 172.21.15.107:0/2389959443 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1a70039040 con 0x7f1a841401b0 2024-08-17T02:24:42.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.674+0000 7f1a79600640 1 --2- 172.21.15.107:0/2389959443 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f1a64065180 0x7f1a64067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:42.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.675+0000 7f1a79600640 1 -- 172.21.15.107:0/2389959443 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1a700a26d0 con 0x7f1a841401b0 2024-08-17T02:24:42.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.675+0000 7f1a81e00640 1 --2- 172.21.15.107:0/2389959443 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f1a64065180 0x7f1a64067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:42.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.675+0000 7f1a81e00640 1 --2- 172.21.15.107:0/2389959443 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f1a64065180 0x7f1a64067630 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1a7400ac20 tx=0x7f1a74008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:42.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.678+0000 7f1a79600640 1 -- 172.21.15.107:0/2389959443 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1a70070820 con 0x7f1a841401b0 2024-08-17T02:24:42.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.886+0000 7f1a88e00640 1 -- 172.21.15.107:0/2389959443 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a840b16d0 con 0x7f1a841401b0 2024-08-17T02:24:42.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.886+0000 7f1a79600640 1 -- 172.21.15.107:0/2389959443 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f1a840b16d0 con 0x7f1a841401b0 2024-08-17T02:24:42.888 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:24:42.888 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1386798018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1386798018},{"type":"v1","addr":"172.21.15.107:6835","nonce":1386798018}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6834/287524804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":287524804},{"type":"v1","addr":"172.21.15.157:6834","nonce":287524804}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1183198496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1183198496},{"type":"v1","addr":"172.21.15.107:6837","nonce":1183198496}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:28.816556+0000","modified":"2024-08-17T02:24:32.431137+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6835/1985555291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6833","nonce":1985555291},{"type":"v1","addr":"172.21.15.157:6835","nonce":1985555291}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:24:42.888 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 8 2024-08-17T02:24:42.890 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.888+0000 7f1a88e00640 1 -- 172.21.15.107:0/2389959443 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f1a64065180 msgr2=0x7f1a64067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:42.890 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.888+0000 7f1a88e00640 1 --2- 172.21.15.107:0/2389959443 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f1a64065180 0x7f1a64067630 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1a7400ac20 tx=0x7f1a74008040 comp rx=0 tx=0).stop 2024-08-17T02:24:42.890 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.888+0000 7f1a88e00640 1 -- 172.21.15.107:0/2389959443 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a841401b0 msgr2=0x7f1a840a93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:42.890 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.888+0000 7f1a88e00640 1 --2- 172.21.15.107:0/2389959443 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a841401b0 0x7f1a840a93e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1a70035040 tx=0x7f1a70032000 comp rx=0 tx=0).stop 2024-08-17T02:24:42.890 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.888+0000 7f1a88e00640 1 -- 172.21.15.107:0/2389959443 shutdown_connections 2024-08-17T02:24:42.890 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.888+0000 7f1a88e00640 1 --2- 172.21.15.107:0/2389959443 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f1a64065180 0x7f1a64067630 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.890 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.888+0000 7f1a88e00640 1 --2- 172.21.15.107:0/2389959443 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1a84140580 0x7f1a840aa870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.890 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.888+0000 7f1a88e00640 1 --2- 172.21.15.107:0/2389959443 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a841401b0 0x7f1a840a93e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.890 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.888+0000 7f1a88e00640 1 --2- 172.21.15.107:0/2389959443 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a840b1270 0x7f1a8413e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.890 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.888+0000 7f1a88e00640 1 -- 172.21.15.107:0/2389959443 >> 172.21.15.107:0/2389959443 conn(0x7f1a840cb9b0 msgr2=0x7f1a84069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:42.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.888+0000 7f1a88e00640 1 -- 172.21.15.107:0/2389959443 shutdown_connections 2024-08-17T02:24:42.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:42.889+0000 7f1a88e00640 1 -- 172.21.15.107:0/2389959443 wait complete. 2024-08-17T02:24:42.905 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:43.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.052+0000 7f173aa00640 1 Processor -- start 2024-08-17T02:24:43.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.052+0000 7f173aa00640 1 -- start start 2024-08-17T02:24:43.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.053+0000 7f173aa00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17340ce8a0 0x7f17340ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:43.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.053+0000 7f173aa00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f17340c5c40 0x7f17340cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:43.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.053+0000 7f173aa00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17340cc890 con 0x7f17340aed50 2024-08-17T02:24:43.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.053+0000 7f173aa00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17340cb230 con 0x7f17340c5c40 2024-08-17T02:24:43.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.053+0000 7f173aa00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17340cb4c0 con 0x7f17340ce8a0 2024-08-17T02:24:43.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.053+0000 7f1738c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17340ce8a0 0x7f17340ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:43.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.053+0000 7f1739600640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f17340aed50 0x7f17340ce190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:34242/0 (socket says 172.21.15.107:34242) 2024-08-17T02:24:43.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.053+0000 7f1739600640 1 -- 172.21.15.107:0/3353159492 learned_addr learned my addr 172.21.15.107:0/3353159492 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:43.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.053+0000 7f173a000640 1 --2- 172.21.15.107:0/3353159492 >> v2:172.21.15.157:3300/0 conn(0x7f17340c5c40 0x7f17340cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:43.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.054+0000 7f1738c00640 1 -- 172.21.15.107:0/3353159492 >> v2:172.21.15.157:3300/0 conn(0x7f17340c5c40 msgr2=0x7f17340cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:43.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.054+0000 7f1738c00640 1 --2- 172.21.15.107:0/3353159492 >> v2:172.21.15.157:3300/0 conn(0x7f17340c5c40 0x7f17340cacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:43.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.054+0000 7f1738c00640 1 -- 172.21.15.107:0/3353159492 >> v1:172.21.15.157:6789/0 conn(0x7f17340aed50 legacy=0x7f17340ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:43.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.054+0000 7f1738c00640 1 -- 172.21.15.107:0/3353159492 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17340cb7a0 con 0x7f17340ce8a0 2024-08-17T02:24:43.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.055+0000 7f1738c00640 1 --2- 172.21.15.107:0/3353159492 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17340ce8a0 0x7f17340ca7b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1720009850 tx=0x7f17200090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5a0de36b238d656 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:43.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.055+0000 7f1733e00640 1 -- 172.21.15.107:0/3353159492 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172002ad80 con 0x7f17340ce8a0 2024-08-17T02:24:43.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.055+0000 7f1733e00640 1 -- 172.21.15.107:0/3353159492 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1720032440 con 0x7f17340ce8a0 2024-08-17T02:24:43.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.055+0000 7f1733e00640 1 -- 172.21.15.107:0/3353159492 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1720032820 con 0x7f17340ce8a0 2024-08-17T02:24:43.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.056+0000 7f173aa00640 1 -- 172.21.15.107:0/3353159492 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17340ce8a0 msgr2=0x7f17340ca7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:43.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.056+0000 7f173aa00640 1 --2- 172.21.15.107:0/3353159492 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17340ce8a0 0x7f17340ca7b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1720009850 tx=0x7f17200090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:43.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.056+0000 7f173aa00640 1 -- 172.21.15.107:0/3353159492 shutdown_connections 2024-08-17T02:24:43.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.056+0000 7f173aa00640 1 --2- 172.21.15.107:0/3353159492 >> v2:172.21.15.157:3300/0 conn(0x7f17340c5c40 0x7f17340cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:43.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.056+0000 7f173aa00640 1 --2- 172.21.15.107:0/3353159492 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17340ce8a0 0x7f17340ca7b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:43.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.056+0000 7f173aa00640 1 -- 172.21.15.107:0/3353159492 >> 172.21.15.107:0/3353159492 conn(0x7f1734098e30 msgr2=0x7f173406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:43.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.056+0000 7f173aa00640 1 -- 172.21.15.107:0/3353159492 shutdown_connections 2024-08-17T02:24:43.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.056+0000 7f173aa00640 1 -- 172.21.15.107:0/3353159492 wait complete. 2024-08-17T02:24:43.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.057+0000 7f173aa00640 1 Processor -- start 2024-08-17T02:24:43.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.057+0000 7f173aa00640 1 -- start start 2024-08-17T02:24:43.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.058+0000 7f173aa00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17340aed50 0x7f173414d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:43.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.058+0000 7f173aa00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17340c5c40 0x7f17340b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:43.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.058+0000 7f173aa00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17340ce8a0 0x7f17340b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:43.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.058+0000 7f173aa00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17340b3060 con 0x7f17340aed50 2024-08-17T02:24:43.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.058+0000 7f173aa00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17340b5490 con 0x7f17340ce8a0 2024-08-17T02:24:43.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.058+0000 7f173aa00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17340b5770 con 0x7f17340c5c40 2024-08-17T02:24:43.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.058+0000 7f1739600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17340aed50 0x7f173414d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:43.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.058+0000 7f1739600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17340aed50 0x7f173414d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:32844/0 (socket says 172.21.15.107:32844) 2024-08-17T02:24:43.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.058+0000 7f1739600640 1 -- 172.21.15.107:0/599472994 learned_addr learned my addr 172.21.15.107:0/599472994 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:43.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.058+0000 7f173a000640 1 --2- 172.21.15.107:0/599472994 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17340ce8a0 0x7f17340b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:43.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.058+0000 7f1738c00640 1 --2- 172.21.15.107:0/599472994 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17340c5c40 0x7f17340b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:43.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.059+0000 7f1739600640 1 -- 172.21.15.107:0/599472994 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17340c5c40 msgr2=0x7f17340b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:43.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.059+0000 7f1739600640 1 --2- 172.21.15.107:0/599472994 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17340c5c40 0x7f17340b4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:43.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.059+0000 7f1739600640 1 -- 172.21.15.107:0/599472994 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17340ce8a0 msgr2=0x7f17340b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:43.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.059+0000 7f1739600640 1 --2- 172.21.15.107:0/599472994 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17340ce8a0 0x7f17340b0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:43.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.059+0000 7f1739600640 1 -- 172.21.15.107:0/599472994 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1720009390 con 0x7f17340aed50 2024-08-17T02:24:43.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.059+0000 7f1739600640 1 --2- 172.21.15.107:0/599472994 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17340aed50 0x7f173414d5f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f172800c560 tx=0x7f1728007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:43.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.059+0000 7f1730c00640 1 -- 172.21.15.107:0/599472994 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1728005aa0 con 0x7f17340aed50 2024-08-17T02:24:43.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.059+0000 7f1730c00640 1 -- 172.21.15.107:0/599472994 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1728005c20 con 0x7f17340aed50 2024-08-17T02:24:43.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.059+0000 7f1730c00640 1 -- 172.21.15.107:0/599472994 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1728007320 con 0x7f17340aed50 2024-08-17T02:24:43.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.059+0000 7f173aa00640 1 -- 172.21.15.107:0/599472994 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17340b2a10 con 0x7f17340aed50 2024-08-17T02:24:43.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.059+0000 7f173aa00640 1 -- 172.21.15.107:0/599472994 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f173414db30 con 0x7f17340aed50 2024-08-17T02:24:43.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.061+0000 7f173aa00640 1 -- 172.21.15.107:0/599472994 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1734071050 con 0x7f17340aed50 2024-08-17T02:24:43.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.061+0000 7f1730c00640 1 -- 172.21.15.107:0/599472994 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1728012400 con 0x7f17340aed50 2024-08-17T02:24:43.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.062+0000 7f1730c00640 1 --2- 172.21.15.107:0/599472994 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f1714065150 0x7f1714067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:43.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.062+0000 7f1730c00640 1 -- 172.21.15.107:0/599472994 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f17280817a0 con 0x7f17340aed50 2024-08-17T02:24:43.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.062+0000 7f1738c00640 1 --2- 172.21.15.107:0/599472994 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f1714065150 0x7f1714067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:43.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.063+0000 7f1738c00640 1 --2- 172.21.15.107:0/599472994 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f1714065150 0x7f1714067600 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1720034000 tx=0x7f1720032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:43.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.066+0000 7f1730c00640 1 -- 172.21.15.107:0/599472994 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f172804be40 con 0x7f17340aed50 2024-08-17T02:24:43.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.239+0000 7f173aa00640 1 -- 172.21.15.107:0/599472994 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17340ce2a0 con 0x7f17340aed50 2024-08-17T02:24:43.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.240+0000 7f1730c00640 1 -- 172.21.15.107:0/599472994 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f172804f910 con 0x7f17340aed50 2024-08-17T02:24:43.241 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:24:43.241 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":21,"fsid":"f207b4c0-329d-46b8-b83f-aaf30bdb6ce3","created":"2024-08-17T02:24:11.038049+0000","modified":"2024-08-17T02:24:30.420018+0000","last_up_change":"2024-08-17T02:24:22.047790+0000","last_in_change":"2024-08-17T02:24:13.892720+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:23.456166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:27.078670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:27.804418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"376363f3-b8bf-4f1e-b691-51cdd39171ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37302},{"type":"v1","addr":"172.21.15.107:6801","nonce":37302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37302},{"type":"v1","addr":"172.21.15.107:6803","nonce":37302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37302},{"type":"v1","addr":"172.21.15.107:6807","nonce":37302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37302},{"type":"v1","addr":"172.21.15.107:6805","nonce":37302}]},"public_addr":"172.21.15.107:6801/37302","cluster_addr":"172.21.15.107:6803/37302","heartbeat_back_addr":"172.21.15.107:6807/37302","heartbeat_front_addr":"172.21.15.107:6805/37302","state":["exists","up"]},{"osd":1,"uuid":"cc6624e3-2ad4-4db4-b377-05dfe57424e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37305},{"type":"v1","addr":"172.21.15.107:6824","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37305},{"type":"v1","addr":"172.21.15.107:6827","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37305},{"type":"v1","addr":"172.21.15.107:6831","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37305},{"type":"v1","addr":"172.21.15.107:6829","nonce":37305}]},"public_addr":"172.21.15.107:6824/37305","cluster_addr":"172.21.15.107:6827/37305","heartbeat_back_addr":"172.21.15.107:6831/37305","heartbeat_front_addr":"172.21.15.107:6829/37305","state":["exists","up"]},{"osd":2,"uuid":"25229542-29b5-4281-bcb0-798ae0930aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37307},{"type":"v1","addr":"172.21.15.107:6817","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37307},{"type":"v1","addr":"172.21.15.107:6819","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6823","nonce":37307},{"type":"v1","addr":"172.21.15.107:6825","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37307},{"type":"v1","addr":"172.21.15.107:6821","nonce":37307}]},"public_addr":"172.21.15.107:6817/37307","cluster_addr":"172.21.15.107:6819/37307","heartbeat_back_addr":"172.21.15.107:6825/37307","heartbeat_front_addr":"172.21.15.107:6821/37307","state":["exists","up"]},{"osd":3,"uuid":"5f16aee8-8950-4268-a61a-5cf6ebd670e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37306},{"type":"v1","addr":"172.21.15.107:6809","nonce":37306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37306},{"type":"v1","addr":"172.21.15.107:6811","nonce":37306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37306},{"type":"v1","addr":"172.21.15.107:6815","nonce":37306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37306},{"type":"v1","addr":"172.21.15.107:6813","nonce":37306}]},"public_addr":"172.21.15.107:6809/37306","cluster_addr":"172.21.15.107:6811/37306","heartbeat_back_addr":"172.21.15.107:6815/37306","heartbeat_front_addr":"172.21.15.107:6813/37306","state":["exists","up"]},{"osd":4,"uuid":"23232e28-e23b-4b4e-a531-4939246dbbde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":37329},{"type":"v1","addr":"172.21.15.157:6817","nonce":37329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":37329},{"type":"v1","addr":"172.21.15.157:6819","nonce":37329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":37329},{"type":"v1","addr":"172.21.15.157:6823","nonce":37329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":37329},{"type":"v1","addr":"172.21.15.157:6821","nonce":37329}]},"public_addr":"172.21.15.157:6817/37329","cluster_addr":"172.21.15.157:6819/37329","heartbeat_back_addr":"172.21.15.157:6823/37329","heartbeat_front_addr":"172.21.15.157:6821/37329","state":["exists","up"]},{"osd":5,"uuid":"f87ec331-3e59-4886-a317-6f7e26ec8e21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":37328},{"type":"v1","addr":"172.21.15.157:6804","nonce":37328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":37328},{"type":"v1","addr":"172.21.15.157:6808","nonce":37328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":37328},{"type":"v1","addr":"172.21.15.157:6815","nonce":37328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":37328},{"type":"v1","addr":"172.21.15.157:6812","nonce":37328}]},"public_addr":"172.21.15.157:6804/37328","cluster_addr":"172.21.15.157:6808/37328","heartbeat_back_addr":"172.21.15.157:6815/37328","heartbeat_front_addr":"172.21.15.157:6812/37328","state":["exists","up"]},{"osd":6,"uuid":"92852235-ce49-4d96-a940-6f18d97b13ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":37330},{"type":"v1","addr":"172.21.15.157:6801","nonce":37330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6803","nonce":37330},{"type":"v1","addr":"172.21.15.157:6805","nonce":37330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":37330},{"type":"v1","addr":"172.21.15.157:6813","nonce":37330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":37330},{"type":"v1","addr":"172.21.15.157:6809","nonce":37330}]},"public_addr":"172.21.15.157:6801/37330","cluster_addr":"172.21.15.157:6805/37330","heartbeat_back_addr":"172.21.15.157:6813/37330","heartbeat_front_addr":"172.21.15.157:6809/37330","state":["exists","up"]},{"osd":7,"uuid":"7484a061-723d-4663-b28f-b01766d62f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":37373},{"type":"v1","addr":"172.21.15.157:6825","nonce":37373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":37373},{"type":"v1","addr":"172.21.15.157:6827","nonce":37373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":37373},{"type":"v1","addr":"172.21.15.157:6831","nonce":37373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":37373},{"type":"v1","addr":"172.21.15.157:6829","nonce":37373}]},"public_addr":"172.21.15.157:6825/37373","cluster_addr":"172.21.15.157:6827/37373","heartbeat_back_addr":"172.21.15.157:6831/37373","heartbeat_front_addr":"172.21.15.157:6829/37373","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.110188+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.280265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.252119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.267996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.284582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.144420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.174764+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.308002+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:43.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.242+0000 7f173aa00640 1 -- 172.21.15.107:0/599472994 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f1714065150 msgr2=0x7f1714067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:43.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.242+0000 7f173aa00640 1 --2- 172.21.15.107:0/599472994 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f1714065150 0x7f1714067600 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1720034000 tx=0x7f1720032000 comp rx=0 tx=0).stop 2024-08-17T02:24:43.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.242+0000 7f173aa00640 1 -- 172.21.15.107:0/599472994 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17340aed50 msgr2=0x7f173414d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:43.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.242+0000 7f173aa00640 1 --2- 172.21.15.107:0/599472994 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17340aed50 0x7f173414d5f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f172800c560 tx=0x7f1728007f40 comp rx=0 tx=0).stop 2024-08-17T02:24:43.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.242+0000 7f173aa00640 1 -- 172.21.15.107:0/599472994 shutdown_connections 2024-08-17T02:24:43.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.242+0000 7f173aa00640 1 --2- 172.21.15.107:0/599472994 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f1714065150 0x7f1714067600 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:43.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.242+0000 7f173aa00640 1 --2- 172.21.15.107:0/599472994 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17340ce8a0 0x7f17340b0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:43.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.242+0000 7f173aa00640 1 --2- 172.21.15.107:0/599472994 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17340c5c40 0x7f17340b4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:43.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.242+0000 7f173aa00640 1 --2- 172.21.15.107:0/599472994 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17340aed50 0x7f173414d5f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:43.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.242+0000 7f173aa00640 1 -- 172.21.15.107:0/599472994 >> 172.21.15.107:0/599472994 conn(0x7f1734098e30 msgr2=0x7f17340689b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:43.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.242+0000 7f173aa00640 1 -- 172.21.15.107:0/599472994 shutdown_connections 2024-08-17T02:24:43.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.242+0000 7f173aa00640 1 -- 172.21.15.107:0/599472994 wait complete. 2024-08-17T02:24:43.259 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:24:43.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.405+0000 7fd899c00640 1 Processor -- start 2024-08-17T02:24:43.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.405+0000 7fd899c00640 1 -- start start 2024-08-17T02:24:43.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.407+0000 7fd899c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd894155180 0x7fd8940aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:43.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.407+0000 7fd899c00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd89406e080 0x7fd89406e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:43.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.407+0000 7fd899c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8940afc10 con 0x7fd894155550 2024-08-17T02:24:43.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.407+0000 7fd899c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd89406ea00 con 0x7fd894155180 2024-08-17T02:24:43.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.407+0000 7fd899c00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8940af000 con 0x7fd89406e080 2024-08-17T02:24:43.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.407+0000 7fd892a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd894155180 0x7fd8940aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:43.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.407+0000 7fd892a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd894155180 0x7fd8940aea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:32858/0 (socket says 172.21.15.107:32858) 2024-08-17T02:24:43.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.407+0000 7fd892a00640 1 -- 172.21.15.107:0/1101478682 learned_addr learned my addr 172.21.15.107:0/1101478682 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:43.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.407+0000 7fd893400640 1 --2- 172.21.15.107:0/1101478682 >> v2:172.21.15.157:3300/0 conn(0x7fd89406e080 0x7fd89406e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:43.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.407+0000 7fd892a00640 1 -- 172.21.15.107:0/1101478682 >> v2:172.21.15.157:3300/0 conn(0x7fd89406e080 msgr2=0x7fd89406e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:43.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.407+0000 7fd892a00640 1 --2- 172.21.15.107:0/1101478682 >> v2:172.21.15.157:3300/0 conn(0x7fd89406e080 0x7fd89406e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:43.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.407+0000 7fd892a00640 1 -- 172.21.15.107:0/1101478682 >> v1:172.21.15.107:6789/0 conn(0x7fd894155550 legacy=0x7fd8940ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:43.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.407+0000 7fd892a00640 1 -- 172.21.15.107:0/1101478682 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8940af2e0 con 0x7fd894155180 2024-08-17T02:24:43.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.408+0000 7fd892a00640 1 --2- 172.21.15.107:0/1101478682 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd894155180 0x7fd8940aea20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd8940642c0 tx=0x7fd8840091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c55b7004d6c409ba server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:43.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.409+0000 7fd892000640 1 -- 172.21.15.107:0/1101478682 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88402ae80 con 0x7fd894155180 2024-08-17T02:24:43.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.409+0000 7fd892000640 1 -- 172.21.15.107:0/1101478682 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd884032440 con 0x7fd894155180 2024-08-17T02:24:43.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.409+0000 7fd892000640 1 -- 172.21.15.107:0/1101478682 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd884032800 con 0x7fd894155180 2024-08-17T02:24:43.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.409+0000 7fd899c00640 1 -- 172.21.15.107:0/1101478682 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd894155180 msgr2=0x7fd8940aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:43.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.409+0000 7fd899c00640 1 --2- 172.21.15.107:0/1101478682 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd894155180 0x7fd8940aea20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd8940642c0 tx=0x7fd8840091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:43.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.409+0000 7fd899c00640 1 -- 172.21.15.107:0/1101478682 shutdown_connections 2024-08-17T02:24:43.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.409+0000 7fd899c00640 1 --2- 172.21.15.107:0/1101478682 >> v2:172.21.15.157:3300/0 conn(0x7fd89406e080 0x7fd89406e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:43.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.409+0000 7fd899c00640 1 --2- 172.21.15.107:0/1101478682 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd894155180 0x7fd8940aea20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:43.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.409+0000 7fd899c00640 1 -- 172.21.15.107:0/1101478682 >> 172.21.15.107:0/1101478682 conn(0x7fd8940cb9b0 msgr2=0x7fd8940cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:43.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.409+0000 7fd899c00640 1 -- 172.21.15.107:0/1101478682 shutdown_connections 2024-08-17T02:24:43.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.409+0000 7fd899c00640 1 -- 172.21.15.107:0/1101478682 wait complete. 2024-08-17T02:24:43.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.411+0000 7fd899c00640 1 Processor -- start 2024-08-17T02:24:43.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.411+0000 7fd899c00640 1 -- start start 2024-08-17T02:24:43.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.412+0000 7fd899c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd89406e080 0x7fd8941580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:43.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.412+0000 7fd899c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd894155180 0x7fd894140da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:43.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.412+0000 7fd899c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd894155550 0x7fd894153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:43.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.412+0000 7fd899c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd894142930 con 0x7fd89406e080 2024-08-17T02:24:43.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.412+0000 7fd899c00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd894155cc0 con 0x7fd894155180 2024-08-17T02:24:43.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.412+0000 7fd899c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd894141890 con 0x7fd894155550 2024-08-17T02:24:43.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.412+0000 7fd892a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd89406e080 0x7fd8941580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:43.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.412+0000 7fd892a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd89406e080 0x7fd8941580d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:32868/0 (socket says 172.21.15.107:32868) 2024-08-17T02:24:43.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.412+0000 7fd892a00640 1 -- 172.21.15.107:0/1295196034 learned_addr learned my addr 172.21.15.107:0/1295196034 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:43.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.412+0000 7fd88a000640 1 --2- 172.21.15.107:0/1295196034 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd894155180 0x7fd894140da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:43.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.412+0000 7fd893400640 1 --2- 172.21.15.107:0/1295196034 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd894155550 0x7fd894153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:43.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.412+0000 7fd892a00640 1 -- 172.21.15.107:0/1295196034 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd894155550 msgr2=0x7fd894153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:43.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.412+0000 7fd892a00640 1 --2- 172.21.15.107:0/1295196034 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd894155550 0x7fd894153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:43.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.412+0000 7fd892a00640 1 -- 172.21.15.107:0/1295196034 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd894155180 msgr2=0x7fd894140da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:43.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.412+0000 7fd892a00640 1 --2- 172.21.15.107:0/1295196034 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd894155180 0x7fd894140da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:43.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.412+0000 7fd892a00640 1 -- 172.21.15.107:0/1295196034 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd884009450 con 0x7fd89406e080 2024-08-17T02:24:43.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.413+0000 7fd892a00640 1 --2- 172.21.15.107:0/1295196034 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd89406e080 0x7fd8941580d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd884009210 tx=0x7fd884032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:43.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.413+0000 7fd88aa00640 1 -- 172.21.15.107:0/1295196034 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd884000d10 con 0x7fd89406e080 2024-08-17T02:24:43.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.413+0000 7fd88aa00640 1 -- 172.21.15.107:0/1295196034 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd884031de0 con 0x7fd89406e080 2024-08-17T02:24:43.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.413+0000 7fd88aa00640 1 -- 172.21.15.107:0/1295196034 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88403d690 con 0x7fd89406e080 2024-08-17T02:24:43.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.413+0000 7fd899c00640 1 -- 172.21.15.107:0/1295196034 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd894141b70 con 0x7fd89406e080 2024-08-17T02:24:43.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.413+0000 7fd899c00640 1 -- 172.21.15.107:0/1295196034 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd894142130 con 0x7fd89406e080 2024-08-17T02:24:43.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.414+0000 7fd899c00640 1 -- 172.21.15.107:0/1295196034 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd894064db0 con 0x7fd89406e080 2024-08-17T02:24:43.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.415+0000 7fd88aa00640 1 -- 172.21.15.107:0/1295196034 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd884039040 con 0x7fd89406e080 2024-08-17T02:24:43.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.415+0000 7fd88aa00640 1 --2- 172.21.15.107:0/1295196034 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd870065150 0x7fd870067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:43.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.416+0000 7fd88aa00640 1 -- 172.21.15.107:0/1295196034 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd8840a2750 con 0x7fd89406e080 2024-08-17T02:24:43.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.416+0000 7fd88a000640 1 --2- 172.21.15.107:0/1295196034 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd870065150 0x7fd870067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:43.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.416+0000 7fd88a000640 1 --2- 172.21.15.107:0/1295196034 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd870065150 0x7fd870067600 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd8940cb130 tx=0x7fd87c007e30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:43.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.419+0000 7fd88aa00640 1 -- 172.21.15.107:0/1295196034 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd8840708e0 con 0x7fd89406e080 2024-08-17T02:24:43.629 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.628+0000 7fd899c00640 1 -- 172.21.15.107:0/1295196034 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8940aea20 con 0x7fd89406e080 2024-08-17T02:24:43.630 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.628+0000 7fd88aa00640 1 -- 172.21.15.107:0/1295196034 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4600 (secure 0 0 0) 0x7fd884037090 con 0x7fd89406e080 2024-08-17T02:24:43.630 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:24:43.630 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1386798018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1386798018},{"type":"v1","addr":"172.21.15.107:6835","nonce":1386798018}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6834/287524804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":287524804},{"type":"v1","addr":"172.21.15.157:6834","nonce":287524804}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1183198496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1183198496},{"type":"v1","addr":"172.21.15.107:6837","nonce":1183198496}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:28.816556+0000","modified":"2024-08-17T02:24:32.431137+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6835/1985555291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6833","nonce":1985555291},{"type":"v1","addr":"172.21.15.157:6835","nonce":1985555291}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:24:43.630 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 8 2024-08-17T02:24:43.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.630+0000 7fd899c00640 1 -- 172.21.15.107:0/1295196034 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd870065150 msgr2=0x7fd870067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:43.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.630+0000 7fd899c00640 1 --2- 172.21.15.107:0/1295196034 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd870065150 0x7fd870067600 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd8940cb130 tx=0x7fd87c007e30 comp rx=0 tx=0).stop 2024-08-17T02:24:43.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.630+0000 7fd899c00640 1 -- 172.21.15.107:0/1295196034 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd89406e080 msgr2=0x7fd8941580d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:43.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.630+0000 7fd899c00640 1 --2- 172.21.15.107:0/1295196034 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd89406e080 0x7fd8941580d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd884009210 tx=0x7fd884032000 comp rx=0 tx=0).stop 2024-08-17T02:24:43.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.630+0000 7fd899c00640 1 -- 172.21.15.107:0/1295196034 shutdown_connections 2024-08-17T02:24:43.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.630+0000 7fd899c00640 1 --2- 172.21.15.107:0/1295196034 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd870065150 0x7fd870067600 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:43.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.630+0000 7fd899c00640 1 --2- 172.21.15.107:0/1295196034 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd894155550 0x7fd894153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:43.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.630+0000 7fd899c00640 1 --2- 172.21.15.107:0/1295196034 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd894155180 0x7fd894140da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:43.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.630+0000 7fd899c00640 1 --2- 172.21.15.107:0/1295196034 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd89406e080 0x7fd8941580d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:43.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.630+0000 7fd899c00640 1 -- 172.21.15.107:0/1295196034 >> 172.21.15.107:0/1295196034 conn(0x7fd8940cb9b0 msgr2=0x7fd894152610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:43.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.631+0000 7fd899c00640 1 -- 172.21.15.107:0/1295196034 shutdown_connections 2024-08-17T02:24:43.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:43.631+0000 7fd899c00640 1 -- 172.21.15.107:0/1295196034 wait complete. 2024-08-17T02:24:44.049 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-17T02:24:28.816556+0000', 'modified': '2024-08-17T02:24:32.431137+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4276}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4276': {'gid': 4276, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.157:6835/1985555291', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6833', 'nonce': 1985555291}, {'type': 'v1', 'addr': '172.21.15.157:6835', 'nonce': 1985555291}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-08-17T02:24:44.049 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-17T02:24:44.049 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-08-17T02:24:44.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.196+0000 7fd076800640 1 Processor -- start 2024-08-17T02:24:44.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.196+0000 7fd076800640 1 -- start start 2024-08-17T02:24:44.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.197+0000 7fd076800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd070158ce0 0x7fd0700c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:44.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.197+0000 7fd076800640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd0700d08d0 0x7fd0701590b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:44.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.197+0000 7fd076800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd0700cac30 0x7fd0700cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:44.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.197+0000 7fd076800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0700cf0c0 con 0x7fd070158ce0 2024-08-17T02:24:44.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.197+0000 7fd076800640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd070089000 con 0x7fd0700d08d0 2024-08-17T02:24:44.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.197+0000 7fd076800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0700ceb20 con 0x7fd0700cac30 2024-08-17T02:24:44.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.197+0000 7fd06f400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd070158ce0 0x7fd0700c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:44.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.197+0000 7fd06f400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd070158ce0 0x7fd0700c68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:32876/0 (socket says 172.21.15.107:32876) 2024-08-17T02:24:44.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.197+0000 7fd06f400640 1 -- 172.21.15.107:0/2052802137 learned_addr learned my addr 172.21.15.107:0/2052802137 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:44.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.198+0000 7fd06fe00640 1 --2- 172.21.15.107:0/2052802137 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd0700cac30 0x7fd0700cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:44.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.198+0000 7fd06ea00640 1 --2- 172.21.15.107:0/2052802137 >> v2:172.21.15.157:3300/0 conn(0x7fd0700d08d0 0x7fd0701590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:44.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.198+0000 7fd06f400640 1 -- 172.21.15.107:0/2052802137 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd0700cac30 msgr2=0x7fd0700cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:44.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.198+0000 7fd06f400640 1 --2- 172.21.15.107:0/2052802137 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd0700cac30 0x7fd0700cb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.198+0000 7fd06f400640 1 -- 172.21.15.107:0/2052802137 >> v2:172.21.15.157:3300/0 conn(0x7fd0700d08d0 msgr2=0x7fd0701590b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:44.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.198+0000 7fd06f400640 1 --2- 172.21.15.107:0/2052802137 >> v2:172.21.15.157:3300/0 conn(0x7fd0700d08d0 0x7fd0701590b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.198+0000 7fd06f400640 1 -- 172.21.15.107:0/2052802137 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0700cede0 con 0x7fd070158ce0 2024-08-17T02:24:44.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.199+0000 7fd06f400640 1 --2- 172.21.15.107:0/2052802137 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd070158ce0 0x7fd0700c68c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd0700ca0a0 tx=0x7fd0600091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a04bfbecb7e3897a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:44.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.199+0000 7fd06e000640 1 -- 172.21.15.107:0/2052802137 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06002adb0 con 0x7fd070158ce0 2024-08-17T02:24:44.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.199+0000 7fd06e000640 1 -- 172.21.15.107:0/2052802137 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd060032440 con 0x7fd070158ce0 2024-08-17T02:24:44.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.199+0000 7fd06e000640 1 -- 172.21.15.107:0/2052802137 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd060032820 con 0x7fd070158ce0 2024-08-17T02:24:44.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.199+0000 7fd076800640 1 -- 172.21.15.107:0/2052802137 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd070158ce0 msgr2=0x7fd0700c68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:44.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.199+0000 7fd076800640 1 --2- 172.21.15.107:0/2052802137 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd070158ce0 0x7fd0700c68c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd0700ca0a0 tx=0x7fd0600091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.200+0000 7fd076800640 1 -- 172.21.15.107:0/2052802137 shutdown_connections 2024-08-17T02:24:44.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.200+0000 7fd076800640 1 --2- 172.21.15.107:0/2052802137 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd0700cac30 0x7fd0700cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.200+0000 7fd076800640 1 --2- 172.21.15.107:0/2052802137 >> v2:172.21.15.157:3300/0 conn(0x7fd0700d08d0 0x7fd0701590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.200+0000 7fd076800640 1 --2- 172.21.15.107:0/2052802137 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd070158ce0 0x7fd0700c68c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.200+0000 7fd076800640 1 -- 172.21.15.107:0/2052802137 >> 172.21.15.107:0/2052802137 conn(0x7fd0700cfdc0 msgr2=0x7fd0700d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:44.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.200+0000 7fd076800640 1 -- 172.21.15.107:0/2052802137 shutdown_connections 2024-08-17T02:24:44.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.200+0000 7fd076800640 1 -- 172.21.15.107:0/2052802137 wait complete. 2024-08-17T02:24:44.204 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.201+0000 7fd076800640 1 Processor -- start 2024-08-17T02:24:44.204 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.201+0000 7fd076800640 1 -- start start 2024-08-17T02:24:44.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.202+0000 7fd076800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd0700cac30 0x7fd07014afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:44.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.202+0000 7fd076800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0700d08d0 0x7fd07015a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:44.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.202+0000 7fd076800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd070158ce0 0x7fd0700b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:44.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.202+0000 7fd076800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0700b47e0 con 0x7fd0700d08d0 2024-08-17T02:24:44.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.202+0000 7fd076800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0700b3bd0 con 0x7fd070158ce0 2024-08-17T02:24:44.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.202+0000 7fd076800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0700b3eb0 con 0x7fd0700cac30 2024-08-17T02:24:44.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.202+0000 7fd06ea00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0700d08d0 0x7fd07015a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:44.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.202+0000 7fd06ea00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0700d08d0 0x7fd07015a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:32882/0 (socket says 172.21.15.107:32882) 2024-08-17T02:24:44.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.202+0000 7fd06f400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd0700cac30 0x7fd07014afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:44.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.202+0000 7fd06ea00640 1 -- 172.21.15.107:0/1329994819 learned_addr learned my addr 172.21.15.107:0/1329994819 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:44.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.202+0000 7fd06fe00640 1 --2- 172.21.15.107:0/1329994819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd070158ce0 0x7fd0700b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:44.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.203+0000 7fd06ea00640 1 -- 172.21.15.107:0/1329994819 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd0700cac30 msgr2=0x7fd07014afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:44.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.203+0000 7fd06ea00640 1 --2- 172.21.15.107:0/1329994819 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd0700cac30 0x7fd07014afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.203+0000 7fd06ea00640 1 -- 172.21.15.107:0/1329994819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd070158ce0 msgr2=0x7fd0700b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:44.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.203+0000 7fd06ea00640 1 --2- 172.21.15.107:0/1329994819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd070158ce0 0x7fd0700b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.203+0000 7fd06ea00640 1 -- 172.21.15.107:0/1329994819 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd060009450 con 0x7fd0700d08d0 2024-08-17T02:24:44.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.203+0000 7fd06ea00640 1 --2- 172.21.15.107:0/1329994819 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0700d08d0 0x7fd07015a0d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd05c00d890 tx=0x7fd05c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:44.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.203+0000 7fd066a00640 1 -- 172.21.15.107:0/1329994819 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c00de20 con 0x7fd0700d08d0 2024-08-17T02:24:44.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.203+0000 7fd066a00640 1 -- 172.21.15.107:0/1329994819 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05c00b8d0 con 0x7fd0700d08d0 2024-08-17T02:24:44.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.203+0000 7fd076800640 1 -- 172.21.15.107:0/1329994819 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0700b4190 con 0x7fd0700d08d0 2024-08-17T02:24:44.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.203+0000 7fd066a00640 1 -- 172.21.15.107:0/1329994819 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c00bc70 con 0x7fd0700d08d0 2024-08-17T02:24:44.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.203+0000 7fd076800640 1 -- 172.21.15.107:0/1329994819 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0700b4520 con 0x7fd0700d08d0 2024-08-17T02:24:44.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.206+0000 7fd066a00640 1 -- 172.21.15.107:0/1329994819 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd05c014640 con 0x7fd0700d08d0 2024-08-17T02:24:44.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.206+0000 7fd066a00640 1 --2- 172.21.15.107:0/1329994819 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd050065150 0x7fd050067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:44.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.207+0000 7fd066a00640 1 -- 172.21.15.107:0/1329994819 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd05c082980 con 0x7fd0700d08d0 2024-08-17T02:24:44.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.207+0000 7fd06f400640 1 --2- 172.21.15.107:0/1329994819 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd050065150 0x7fd050067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:44.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.207+0000 7fd078d65740 1 Processor -- start 2024-08-17T02:24:44.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.207+0000 7fd078d65740 1 -- start start 2024-08-17T02:24:44.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.207+0000 7fd06f400640 1 --2- 172.21.15.107:0/1329994819 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd050065150 0x7fd050067600 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd060034000 tx=0x7fd060032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:44.210 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.208+0000 7fd078d65740 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55c7fe4b5a30 0x55c7fe4b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:44.210 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.208+0000 7fd078d65740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c7fe4910a0 0x55c7fe4d35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:44.210 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.208+0000 7fd078d65740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c7fe4d3b10 0x55c7fe48a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:44.210 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.208+0000 7fd078d65740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7fe44b380 con 0x55c7fe4910a0 2024-08-17T02:24:44.210 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.208+0000 7fd078d65740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7fe3f49e0 con 0x55c7fe4d3b10 2024-08-17T02:24:44.210 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.208+0000 7fd078d65740 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c7fe3f2170 con 0x55c7fe4b5a30 2024-08-17T02:24:44.210 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.208+0000 7fd06ea00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c7fe4910a0 0x55c7fe4d35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:44.211 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.208+0000 7fd06ea00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c7fe4910a0 0x55c7fe4d35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:32886/0 (socket says 172.21.15.107:32886) 2024-08-17T02:24:44.211 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.208+0000 7fd06ea00640 1 -- 172.21.15.107:0/1313607913 learned_addr learned my addr 172.21.15.107:0/1313607913 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:44.211 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.208+0000 7fd06fe00640 1 --2- 172.21.15.107:0/1313607913 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c7fe4d3b10 0x55c7fe48a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:44.211 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.208+0000 7fd06f400640 1 --2- 172.21.15.107:0/1313607913 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55c7fe4b5a30 0x55c7fe4b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:44.211 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.209+0000 7fd06ea00640 1 -- 172.21.15.107:0/1313607913 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55c7fe4b5a30 msgr2=0x55c7fe4b5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:44.211 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.209+0000 7fd06ea00640 1 --2- 172.21.15.107:0/1313607913 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55c7fe4b5a30 0x55c7fe4b5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.211 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.209+0000 7fd06ea00640 1 -- 172.21.15.107:0/1313607913 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c7fe4d3b10 msgr2=0x55c7fe48a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:44.211 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.209+0000 7fd06ea00640 1 --2- 172.21.15.107:0/1313607913 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c7fe4d3b10 0x55c7fe48a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.211 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.209+0000 7fd06ea00640 1 -- 172.21.15.107:0/1313607913 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7fe3a1820 con 0x55c7fe4910a0 2024-08-17T02:24:44.211 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.209+0000 7fd06ea00640 1 --2- 172.21.15.107:0/1313607913 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c7fe4910a0 0x55c7fe4d35d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd05c080e80 tx=0x7fd05c080de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=144bf5cb3cbc85cc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:44.211 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.209+0000 7fd05b400640 1 -- 172.21.15.107:0/1313607913 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c05b740 con 0x55c7fe4910a0 2024-08-17T02:24:44.211 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.209+0000 7fd05b400640 1 -- 172.21.15.107:0/1313607913 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05c00bdd0 con 0x55c7fe4910a0 2024-08-17T02:24:44.211 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.209+0000 7fd05b400640 1 -- 172.21.15.107:0/1313607913 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c052bf0 con 0x55c7fe4910a0 2024-08-17T02:24:44.214 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.210+0000 7fd078d65740 1 -- 172.21.15.107:0/1313607913 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c7fe4910a0 msgr2=0x55c7fe4d35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:44.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.210+0000 7fd078d65740 1 --2- 172.21.15.107:0/1313607913 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c7fe4910a0 0x55c7fe4d35d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd05c080e80 tx=0x7fd05c080de0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.210+0000 7fd078d65740 1 -- 172.21.15.107:0/1313607913 shutdown_connections 2024-08-17T02:24:44.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.210+0000 7fd078d65740 1 --2- 172.21.15.107:0/1313607913 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c7fe4d3b10 0x55c7fe48a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.210+0000 7fd078d65740 1 --2- 172.21.15.107:0/1313607913 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c7fe4910a0 0x55c7fe4d35d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.210+0000 7fd078d65740 1 --2- 172.21.15.107:0/1313607913 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55c7fe4b5a30 0x55c7fe4b5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.210+0000 7fd078d65740 1 -- 172.21.15.107:0/1313607913 >> 172.21.15.107:0/1313607913 conn(0x55c7fe429030 msgr2=0x55c7fe4d7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:44.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.210+0000 7fd078d65740 1 -- 172.21.15.107:0/1313607913 shutdown_connections 2024-08-17T02:24:44.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.210+0000 7fd078d65740 1 -- 172.21.15.107:0/1313607913 wait complete. 2024-08-17T02:24:44.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.210+0000 7fd078d65740 1 -- start start 2024-08-17T02:24:44.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.211+0000 7fd078d65740 1 Processor -- start 2024-08-17T02:24:44.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.211+0000 7fd078d65740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c7fe4910a0 0x55c7fe4e6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:44.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.211+0000 7fd078d65740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c7fe4b5a30 0x55c7fe4b89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:44.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.211+0000 7fd078d65740 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55c7fe4d3b10 0x55c7fe4b8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:44.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.212+0000 7fd078d65740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7fe3edf60 con 0x55c7fe4b5a30 2024-08-17T02:24:44.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.212+0000 7fd078d65740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7fe396690 con 0x55c7fe4910a0 2024-08-17T02:24:44.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.212+0000 7fd078d65740 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c7fe396330 con 0x55c7fe4d3b10 2024-08-17T02:24:44.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.212+0000 7fd078d65740 10 client.0 _ll_register_callbacks cb 0x55c7fe3902b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:24:44.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.212+0000 7fd06ea00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c7fe4b5a30 0x55c7fe4b89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:44.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.212+0000 7fd06ea00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c7fe4b5a30 0x55c7fe4b89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:32888/0 (socket says 172.21.15.107:32888) 2024-08-17T02:24:44.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.212+0000 7fd06f400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c7fe4910a0 0x55c7fe4e6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:44.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.212+0000 7fd06fe00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55c7fe4d3b10 0x55c7fe4b8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:44.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.212+0000 7fd06ea00640 1 -- 172.21.15.107:0/3927961345 learned_addr learned my addr 172.21.15.107:0/3927961345 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:44.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.212+0000 7fd06ea00640 1 -- 172.21.15.107:0/3927961345 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55c7fe4d3b10 msgr2=0x55c7fe4b8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:44.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.212+0000 7fd06ea00640 1 --2- 172.21.15.107:0/3927961345 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55c7fe4d3b10 0x55c7fe4b8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.212+0000 7fd06ea00640 1 -- 172.21.15.107:0/3927961345 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c7fe4910a0 msgr2=0x55c7fe4e6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:44.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.212+0000 7fd06ea00640 1 --2- 172.21.15.107:0/3927961345 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c7fe4910a0 0x55c7fe4e6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.212+0000 7fd06ea00640 1 -- 172.21.15.107:0/3927961345 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0700b4520 con 0x55c7fe4b5a30 2024-08-17T02:24:44.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.212+0000 7fd06ea00640 1 --2- 172.21.15.107:0/3927961345 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c7fe4b5a30 0x55c7fe4b89f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd05c080e80 tx=0x7fd05c06f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1e1736029382cfd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:44.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.212+0000 7fd04fe00640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-08-17T02:24:44.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.213+0000 7fd04fe00640 1 -- 172.21.15.107:0/3927961345 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c06f2c0 con 0x55c7fe4b5a30 2024-08-17T02:24:44.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.213+0000 7fd04fe00640 1 -- 172.21.15.107:0/3927961345 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd05c06f420 con 0x55c7fe4b5a30 2024-08-17T02:24:44.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.213+0000 7fd078d65740 1 -- 172.21.15.107:0/3927961345 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c7fe421d20 con 0x55c7fe4b5a30 2024-08-17T02:24:44.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.213+0000 7fd04fe00640 1 -- 172.21.15.107:0/3927961345 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd05c05b2b0 con 0x55c7fe4b5a30 2024-08-17T02:24:44.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.213+0000 7fd078d65740 10 client.4632 fetch_fsmap learned FSMap version 8 2024-08-17T02:24:44.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.213+0000 7fd078d65740 1 -- 172.21.15.107:0/3927961345 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55c7fe3b7ab0 con 0x55c7fe4b5a30 2024-08-17T02:24:44.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.213+0000 7fd04fe00640 1 -- 172.21.15.107:0/3927961345 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c7fe421d20 con 0x55c7fe4b5a30 2024-08-17T02:24:44.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.213+0000 7fd04fe00640 1 -- 172.21.15.107:0/3927961345 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd05c076020 con 0x55c7fe4b5a30 2024-08-17T02:24:44.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.213+0000 7fd078d65740 10 client.4632 fetch_fsmap finished waiting for FSMap version 8 2024-08-17T02:24:44.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.213+0000 7fd078d65740 10 client.4632 resolve_mds: resolved name 'd' to daemon mds.d 2024-08-17T02:24:44.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.213+0000 7fd078d65740 20 client.4632 populate_metadata read hostname 'smithi107' 2024-08-17T02:24:44.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.213+0000 7fd078d65740 1 --2- 172.21.15.107:0/3927961345 >> [v2:172.21.15.157:6833/1985555291,v1:172.21.15.157:6835/1985555291] conn(0x55c7fe4bb740 0x55c7fe4bbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:44.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.213+0000 7fd078d65740 4 client.4632 mds_command: new command op to 4276 tid=0[{"prefix": "get_command_descriptions"}] 2024-08-17T02:24:44.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.213+0000 7fd078d65740 1 -- 172.21.15.107:0/3927961345 --> [v2:172.21.15.157:6833/1985555291,v1:172.21.15.157:6835/1985555291] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c7fe0f53c0 con 0x55c7fe4bb740 2024-08-17T02:24:44.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.213+0000 7fd06f400640 1 --2- 172.21.15.107:0/3927961345 >> [v2:172.21.15.157:6833/1985555291,v1:172.21.15.157:6835/1985555291] conn(0x55c7fe4bb740 0x55c7fe4bbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:44.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.214+0000 7fd06f400640 1 --2- 172.21.15.107:0/3927961345 >> [v2:172.21.15.157:6833/1985555291,v1:172.21.15.157:6835/1985555291] conn(0x55c7fe4bb740 0x55c7fe4bbb10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44513025cb1c6803 server_cookie=1726b2677e7ae1d1 in_seq=0 out_seq=0 2024-08-17T02:24:44.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.214+0000 7fd04fe00640 10 client.4632 ms_handle_connect on v2:172.21.15.157:6833/1985555291 2024-08-17T02:24:44.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.215+0000 7fd04fe00640 1 -- 172.21.15.107:0/3927961345 <== mds.0 v2:172.21.15.157:6833/1985555291 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (crc 0 0 0) 0x55c7fe0f53c0 con 0x55c7fe4bb740 2024-08-17T02:24:44.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.215+0000 7fd04fe00640 10 client.4632 handle_command_reply: tid=0 2024-08-17T02:24:44.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.215+0000 7fd078d65740 1 client.4632 shutdown 2024-08-17T02:24:44.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.215+0000 7fd078d65740 1 -- 172.21.15.107:0/3927961345 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c7fe4b5a30 msgr2=0x55c7fe4b89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:44.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.215+0000 7fd078d65740 1 --2- 172.21.15.107:0/3927961345 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c7fe4b5a30 0x55c7fe4b89f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd05c080e80 tx=0x7fd05c06f000 comp rx=0 tx=0).stop 2024-08-17T02:24:44.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.215+0000 7fd078d65740 1 -- 172.21.15.107:0/3927961345 shutdown_connections 2024-08-17T02:24:44.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.215+0000 7fd078d65740 1 --2- 172.21.15.107:0/3927961345 >> [v2:172.21.15.157:6833/1985555291,v1:172.21.15.157:6835/1985555291] conn(0x55c7fe4bb740 0x55c7fe4bbb10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.215+0000 7fd078d65740 1 --2- 172.21.15.107:0/3927961345 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55c7fe4d3b10 0x55c7fe4b8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.215+0000 7fd078d65740 1 --2- 172.21.15.107:0/3927961345 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c7fe4b5a30 0x55c7fe4b89f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.215+0000 7fd078d65740 1 --2- 172.21.15.107:0/3927961345 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c7fe4910a0 0x55c7fe4e6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.215+0000 7fd078d65740 1 -- 172.21.15.107:0/3927961345 >> 172.21.15.107:0/3927961345 conn(0x55c7fe429030 msgr2=0x55c7fe4d7750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:44.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.215+0000 7fd04fe00640 0 client.4632 ms_handle_reset on v2:172.21.15.157:6833/1985555291 2024-08-17T02:24:44.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.215+0000 7fd078d65740 1 -- 172.21.15.107:0/3927961345 shutdown_connections 2024-08-17T02:24:44.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.215+0000 7fd078d65740 1 -- 172.21.15.107:0/3927961345 wait complete. 2024-08-17T02:24:44.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.216+0000 7fd078d65740 20 client.4632 trim_cache size 0 max 16384 2024-08-17T02:24:44.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.231+0000 7fd078d65740 1 Processor -- start 2024-08-17T02:24:44.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.231+0000 7fd078d65740 1 -- start start 2024-08-17T02:24:44.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.232+0000 7fd078d65740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c7fe4910a0 0x55c7fe4e4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:44.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.232+0000 7fd078d65740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c7fe4b5a30 0x55c7fe4b1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:44.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.232+0000 7fd078d65740 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55c7fe4d3b10 0x55c7fe4b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:44.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.232+0000 7fd078d65740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7fe168f20 con 0x55c7fe4b5a30 2024-08-17T02:24:44.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.232+0000 7fd078d65740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7fe4b1ff0 con 0x55c7fe4910a0 2024-08-17T02:24:44.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.232+0000 7fd078d65740 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c7fe4f7980 con 0x55c7fe4d3b10 2024-08-17T02:24:44.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.232+0000 7fd06ea00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c7fe4b5a30 0x55c7fe4b1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:44.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.232+0000 7fd06ea00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c7fe4b5a30 0x55c7fe4b1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:32902/0 (socket says 172.21.15.107:32902) 2024-08-17T02:24:44.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.232+0000 7fd06ea00640 1 -- 172.21.15.107:0/744538012 learned_addr learned my addr 172.21.15.107:0/744538012 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:44.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.232+0000 7fd06f400640 1 --2- 172.21.15.107:0/744538012 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c7fe4910a0 0x55c7fe4e4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:44.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.232+0000 7fd06fe00640 1 --2- 172.21.15.107:0/744538012 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55c7fe4d3b10 0x55c7fe4b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:44.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.232+0000 7fd06ea00640 1 -- 172.21.15.107:0/744538012 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55c7fe4d3b10 msgr2=0x55c7fe4b1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:44.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.232+0000 7fd06ea00640 1 --2- 172.21.15.107:0/744538012 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55c7fe4d3b10 0x55c7fe4b1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.232+0000 7fd06ea00640 1 -- 172.21.15.107:0/744538012 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c7fe4910a0 msgr2=0x55c7fe4e4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:44.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.232+0000 7fd06ea00640 1 --2- 172.21.15.107:0/744538012 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c7fe4910a0 0x55c7fe4e4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.232+0000 7fd06ea00640 1 -- 172.21.15.107:0/744538012 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7fe3bb490 con 0x55c7fe4b5a30 2024-08-17T02:24:44.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.233+0000 7fd06ea00640 1 --2- 172.21.15.107:0/744538012 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c7fe4b5a30 0x55c7fe4b1570 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd05c007400 tx=0x7fd05c07d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc2f4a9a98dbb007 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:44.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.233+0000 7fd05be00640 1 -- 172.21.15.107:0/744538012 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c05b530 con 0x55c7fe4b5a30 2024-08-17T02:24:44.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.233+0000 7fd05be00640 1 -- 172.21.15.107:0/744538012 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05c05b2b0 con 0x55c7fe4b5a30 2024-08-17T02:24:44.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.233+0000 7fd05be00640 1 -- 172.21.15.107:0/744538012 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c05b740 con 0x55c7fe4b5a30 2024-08-17T02:24:44.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.233+0000 7fd078d65740 1 -- 172.21.15.107:0/744538012 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c7fe4b5a30 msgr2=0x55c7fe4b1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:44.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.233+0000 7fd078d65740 1 --2- 172.21.15.107:0/744538012 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c7fe4b5a30 0x55c7fe4b1570 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd05c007400 tx=0x7fd05c07d070 comp rx=0 tx=0).stop 2024-08-17T02:24:44.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.233+0000 7fd078d65740 1 -- 172.21.15.107:0/744538012 shutdown_connections 2024-08-17T02:24:44.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.233+0000 7fd078d65740 1 --2- 172.21.15.107:0/744538012 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55c7fe4d3b10 0x55c7fe4b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.233+0000 7fd078d65740 1 --2- 172.21.15.107:0/744538012 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c7fe4b5a30 0x55c7fe4b1570 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.233+0000 7fd078d65740 1 --2- 172.21.15.107:0/744538012 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c7fe4910a0 0x55c7fe4e4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.233+0000 7fd078d65740 1 -- 172.21.15.107:0/744538012 >> 172.21.15.107:0/744538012 conn(0x55c7fe429030 msgr2=0x55c7fe48f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:44.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.233+0000 7fd078d65740 1 -- 172.21.15.107:0/744538012 shutdown_connections 2024-08-17T02:24:44.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.233+0000 7fd078d65740 1 -- 172.21.15.107:0/744538012 wait complete. 2024-08-17T02:24:44.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.234+0000 7fd078d65740 1 -- start start 2024-08-17T02:24:44.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.234+0000 7fd078d65740 1 Processor -- start 2024-08-17T02:24:44.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.235+0000 7fd078d65740 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55c7fe4910a0 0x55c7fe523d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:44.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.235+0000 7fd078d65740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c7fe4b5a30 0x55c7fe4d7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:44.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.235+0000 7fd078d65740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c7fe4d3b10 0x55c7fe4d7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:44.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.235+0000 7fd078d65740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7fe53bc70 con 0x55c7fe4d3b10 2024-08-17T02:24:44.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.235+0000 7fd078d65740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7fe4bb5e0 con 0x55c7fe4b5a30 2024-08-17T02:24:44.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.235+0000 7fd078d65740 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c7fe4d50c0 con 0x55c7fe4910a0 2024-08-17T02:24:44.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.235+0000 7fd078d65740 10 client.0 _ll_register_callbacks cb 0x7fd05c050bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:24:44.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.235+0000 7fd06fe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c7fe4d3b10 0x55c7fe4d7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:44.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.235+0000 7fd06fe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c7fe4d3b10 0x55c7fe4d7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:32906/0 (socket says 172.21.15.107:32906) 2024-08-17T02:24:44.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.235+0000 7fd06fe00640 1 -- 172.21.15.107:0/3480728107 learned_addr learned my addr 172.21.15.107:0/3480728107 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:44.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.236+0000 7fd06fe00640 1 -- 172.21.15.107:0/3480728107 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55c7fe4910a0 msgr2=0x55c7fe523d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:44.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.236+0000 7fd06fe00640 1 --2- 172.21.15.107:0/3480728107 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55c7fe4910a0 0x55c7fe523d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.236+0000 7fd06fe00640 1 -- 172.21.15.107:0/3480728107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c7fe4b5a30 msgr2=0x55c7fe4d7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:44.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.236+0000 7fd06ea00640 1 --2- 172.21.15.107:0/3480728107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c7fe4b5a30 0x55c7fe4d7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:44.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.236+0000 7fd06fe00640 1 --2- 172.21.15.107:0/3480728107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c7fe4b5a30 0x55c7fe4d7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.236+0000 7fd06fe00640 1 -- 172.21.15.107:0/3480728107 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c7fe3b7ab0 con 0x55c7fe4d3b10 2024-08-17T02:24:44.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.236+0000 7fd06ea00640 1 --2- 172.21.15.107:0/3480728107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c7fe4b5a30 0x55c7fe4d7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:44.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.236+0000 7fd06fe00640 1 --2- 172.21.15.107:0/3480728107 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c7fe4d3b10 0x55c7fe4d7c90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd068015f10 tx=0x7fd068009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d0751fd8314c7fb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:44.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.236+0000 7fd04fe00640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-08-17T02:24:44.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.236+0000 7fd04fe00640 1 -- 172.21.15.107:0/3480728107 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0680154c0 con 0x55c7fe4d3b10 2024-08-17T02:24:44.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.236+0000 7fd04fe00640 1 -- 172.21.15.107:0/3480728107 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd068023af0 con 0x55c7fe4d3b10 2024-08-17T02:24:44.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.236+0000 7fd078d65740 1 -- 172.21.15.107:0/3480728107 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd05c00bdd0 con 0x55c7fe4d3b10 2024-08-17T02:24:44.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.236+0000 7fd04fe00640 1 -- 172.21.15.107:0/3480728107 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd068019430 con 0x55c7fe4d3b10 2024-08-17T02:24:44.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.237+0000 7fd078d65740 10 client.4638 fetch_fsmap learned FSMap version 8 2024-08-17T02:24:44.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.237+0000 7fd078d65740 1 -- 172.21.15.107:0/3480728107 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55c7fe3bb1e0 con 0x55c7fe4d3b10 2024-08-17T02:24:44.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.237+0000 7fd04fe00640 1 -- 172.21.15.107:0/3480728107 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05c00bdd0 con 0x55c7fe4d3b10 2024-08-17T02:24:44.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.237+0000 7fd04fe00640 1 -- 172.21.15.107:0/3480728107 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd068019590 con 0x55c7fe4d3b10 2024-08-17T02:24:44.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.237+0000 7fd078d65740 10 client.4638 fetch_fsmap finished waiting for FSMap version 8 2024-08-17T02:24:44.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.237+0000 7fd078d65740 10 client.4638 resolve_mds: resolved name 'd' to daemon mds.d 2024-08-17T02:24:44.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.237+0000 7fd078d65740 20 client.4638 populate_metadata read hostname 'smithi107' 2024-08-17T02:24:44.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.237+0000 7fd078d65740 1 --2- 172.21.15.107:0/3480728107 >> [v2:172.21.15.157:6833/1985555291,v1:172.21.15.157:6835/1985555291] conn(0x55c7fe4dd710 0x55c7fe488e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:44.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.237+0000 7fd078d65740 4 client.4638 mds_command: new command op to 4276 tid=0[{"prefix": "status"}] 2024-08-17T02:24:44.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.237+0000 7fd078d65740 1 -- 172.21.15.107:0/3480728107 --> [v2:172.21.15.157:6833/1985555291,v1:172.21.15.157:6835/1985555291] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c7fe1066c0 con 0x55c7fe4dd710 2024-08-17T02:24:44.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.237+0000 7fd06f400640 1 --2- 172.21.15.107:0/3480728107 >> [v2:172.21.15.157:6833/1985555291,v1:172.21.15.157:6835/1985555291] conn(0x55c7fe4dd710 0x55c7fe488e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:44.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.238+0000 7fd06f400640 1 --2- 172.21.15.107:0/3480728107 >> [v2:172.21.15.157:6833/1985555291,v1:172.21.15.157:6835/1985555291] conn(0x55c7fe4dd710 0x55c7fe488e20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69f5759e3c258e9a server_cookie=bd6c7d92c5a154fc in_seq=0 out_seq=0 2024-08-17T02:24:44.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.238+0000 7fd04fe00640 10 client.4638 ms_handle_connect on v2:172.21.15.157:6833/1985555291 2024-08-17T02:24:44.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.238+0000 7fd04fe00640 1 -- 172.21.15.107:0/3480728107 <== mds.0 v2:172.21.15.157:6833/1985555291 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55c7fe1066c0 con 0x55c7fe4dd710 2024-08-17T02:24:44.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.238+0000 7fd04fe00640 10 client.4638 handle_command_reply: tid=0 2024-08-17T02:24:44.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.238+0000 7fd078d65740 1 client.4638 shutdown 2024-08-17T02:24:44.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.238+0000 7fd078d65740 1 -- 172.21.15.107:0/3480728107 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c7fe4d3b10 msgr2=0x55c7fe4d7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:44.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.238+0000 7fd078d65740 1 --2- 172.21.15.107:0/3480728107 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c7fe4d3b10 0x55c7fe4d7c90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd068015f10 tx=0x7fd068009850 comp rx=0 tx=0).stop 2024-08-17T02:24:44.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.238+0000 7fd078d65740 1 -- 172.21.15.107:0/3480728107 shutdown_connections 2024-08-17T02:24:44.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.238+0000 7fd078d65740 1 --2- 172.21.15.107:0/3480728107 >> [v2:172.21.15.157:6833/1985555291,v1:172.21.15.157:6835/1985555291] conn(0x55c7fe4dd710 0x55c7fe488e20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.238+0000 7fd078d65740 1 --2- 172.21.15.107:0/3480728107 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c7fe4d3b10 0x55c7fe4d7c90 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.238+0000 7fd078d65740 1 --2- 172.21.15.107:0/3480728107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c7fe4b5a30 0x55c7fe4d7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.238+0000 7fd078d65740 1 --2- 172.21.15.107:0/3480728107 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55c7fe4910a0 0x55c7fe523d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.238+0000 7fd04fe00640 0 client.4638 ms_handle_reset on v2:172.21.15.157:6833/1985555291 2024-08-17T02:24:44.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.238+0000 7fd078d65740 1 -- 172.21.15.107:0/3480728107 >> 172.21.15.107:0/3480728107 conn(0x55c7fe429030 msgr2=0x55c7fe4b1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:44.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.238+0000 7fd078d65740 1 -- 172.21.15.107:0/3480728107 shutdown_connections 2024-08-17T02:24:44.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.238+0000 7fd078d65740 1 -- 172.21.15.107:0/3480728107 wait complete. 2024-08-17T02:24:44.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.239+0000 7fd078d65740 20 client.4638 trim_cache size 0 max 16384 2024-08-17T02:24:44.247 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-08-17T02:24:44.247 INFO:teuthology.orchestra.run.smithi107.stdout: "cluster_fsid": "f207b4c0-329d-46b8-b83f-aaf30bdb6ce3", 2024-08-17T02:24:44.247 INFO:teuthology.orchestra.run.smithi107.stdout: "whoami": 0, 2024-08-17T02:24:44.247 INFO:teuthology.orchestra.run.smithi107.stdout: "id": 4276, 2024-08-17T02:24:44.247 INFO:teuthology.orchestra.run.smithi107.stdout: "want_state": "up:active", 2024-08-17T02:24:44.247 INFO:teuthology.orchestra.run.smithi107.stdout: "state": "up:active", 2024-08-17T02:24:44.247 INFO:teuthology.orchestra.run.smithi107.stdout: "fs_name": "cephfs", 2024-08-17T02:24:44.248 INFO:teuthology.orchestra.run.smithi107.stdout: "rank_uptime": 14.811555668, 2024-08-17T02:24:44.248 INFO:teuthology.orchestra.run.smithi107.stdout: "mdsmap_epoch": 8, 2024-08-17T02:24:44.248 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch": 21, 2024-08-17T02:24:44.248 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch_barrier": 21, 2024-08-17T02:24:44.248 INFO:teuthology.orchestra.run.smithi107.stdout: "uptime": 21.684052684000001 2024-08-17T02:24:44.248 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-08-17T02:24:44.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.239+0000 7fd076800640 1 -- 172.21.15.107:0/1329994819 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd050065150 msgr2=0x7fd050067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:44.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.239+0000 7fd076800640 1 --2- 172.21.15.107:0/1329994819 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd050065150 0x7fd050067600 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd060034000 tx=0x7fd060032000 comp rx=0 tx=0).stop 2024-08-17T02:24:44.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.239+0000 7fd076800640 1 -- 172.21.15.107:0/1329994819 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0700d08d0 msgr2=0x7fd07015a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:44.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.239+0000 7fd076800640 1 --2- 172.21.15.107:0/1329994819 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0700d08d0 0x7fd07015a0d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd05c00d890 tx=0x7fd05c008040 comp rx=0 tx=0).stop 2024-08-17T02:24:44.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.239+0000 7fd076800640 1 -- 172.21.15.107:0/1329994819 shutdown_connections 2024-08-17T02:24:44.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.239+0000 7fd076800640 1 --2- 172.21.15.107:0/1329994819 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd050065150 0x7fd050067600 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.239+0000 7fd076800640 1 --2- 172.21.15.107:0/1329994819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd070158ce0 0x7fd0700b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.239+0000 7fd076800640 1 --2- 172.21.15.107:0/1329994819 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0700d08d0 0x7fd07015a0d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.239+0000 7fd076800640 1 --2- 172.21.15.107:0/1329994819 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd0700cac30 0x7fd07014afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.239+0000 7fd076800640 1 -- 172.21.15.107:0/1329994819 >> 172.21.15.107:0/1329994819 conn(0x7fd0700cfdc0 msgr2=0x7fd0700675f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:44.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.239+0000 7fd076800640 1 -- 172.21.15.107:0/1329994819 shutdown_connections 2024-08-17T02:24:44.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.239+0000 7fd076800640 1 -- 172.21.15.107:0/1329994819 wait complete. 2024-08-17T02:24:44.254 INFO:teuthology.run_tasks:Running task kclient... 2024-08-17T02:24:44.284 INFO:tasks.kclient:Mounting kernel clients... 2024-08-17T02:24:44.285 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-08-17T02:24:44.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:44.285 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-08-17T02:24:44.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:44.321 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link delete ceph-brx 2024-08-17T02:24:44.419 INFO:teuthology.orchestra.run.smithi107.stderr:Cannot find device "ceph-brx" 2024-08-17T02:24:44.422 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:24:44.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:44.423 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-08-17T02:24:44.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:44.459 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link delete ceph-brx 2024-08-17T02:24:44.557 INFO:teuthology.orchestra.run.smithi107.stderr:Cannot find device "ceph-brx" 2024-08-17T02:24:44.559 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:24:44.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:44.560 DEBUG:teuthology.orchestra.run.smithi157:> ip netns list 2024-08-17T02:24:44.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:44.600 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link delete ceph-brx 2024-08-17T02:24:44.705 INFO:teuthology.orchestra.run.smithi157.stderr:Cannot find device "ceph-brx" 2024-08-17T02:24:44.708 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:24:44.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:44.709 DEBUG:teuthology.orchestra.run.smithi157:> ip netns list 2024-08-17T02:24:44.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:44.746 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link delete ceph-brx 2024-08-17T02:24:44.844 INFO:teuthology.orchestra.run.smithi157.stderr:Cannot find device "ceph-brx" 2024-08-17T02:24:44.847 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:24:44.847 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-08-17T02:24:44.848 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:24:44.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.993+0000 7f367f400640 1 Processor -- start 2024-08-17T02:24:44.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.993+0000 7f367f400640 1 -- start start 2024-08-17T02:24:44.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.994+0000 7f367f400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f36780aa7d0 0x7f367806ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:44.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.995+0000 7f367f400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3678158fa0 0x7f36780ab6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:44.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.995+0000 7f367f400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36780a9a10 con 0x7f367806da20 2024-08-17T02:24:44.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.995+0000 7f367f400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36780ac400 con 0x7f3678158fa0 2024-08-17T02:24:44.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.995+0000 7f367f400640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36780a9cf0 con 0x7f36780aa7d0 2024-08-17T02:24:44.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.995+0000 7f367d400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3678158fa0 0x7f36780ab6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:44.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.995+0000 7f367d400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3678158fa0 0x7f36780ab6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:32912/0 (socket says 172.21.15.107:32912) 2024-08-17T02:24:44.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.995+0000 7f367d400640 1 -- 172.21.15.107:0/1398112865 learned_addr learned my addr 172.21.15.107:0/1398112865 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:44.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.995+0000 7f3677e00640 1 --2- 172.21.15.107:0/1398112865 >> v2:172.21.15.157:3300/0 conn(0x7f36780aa7d0 0x7f367806ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:44.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.995+0000 7f367d400640 1 -- 172.21.15.107:0/1398112865 >> v2:172.21.15.157:3300/0 conn(0x7f36780aa7d0 msgr2=0x7f367806ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:44.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.995+0000 7f367d400640 1 --2- 172.21.15.107:0/1398112865 >> v2:172.21.15.157:3300/0 conn(0x7f36780aa7d0 0x7f367806ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.995+0000 7f367d400640 1 -- 172.21.15.107:0/1398112865 >> v1:172.21.15.107:6789/0 conn(0x7f367806da20 legacy=0x7f3678158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:44.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.995+0000 7f3677400640 1 -- 172.21.15.107:0/1398112865 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 194396600 0 0) 0x7f36780a9a10 con 0x7f367806da20 2024-08-17T02:24:44.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.995+0000 7f367d400640 1 -- 172.21.15.107:0/1398112865 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36780a9fd0 con 0x7f3678158fa0 2024-08-17T02:24:44.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.996+0000 7f367d400640 1 --2- 172.21.15.107:0/1398112865 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3678158fa0 0x7f36780ab6d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f36780ccaa0 tx=0x7f3670009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ed5df285b05a315 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:44.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.996+0000 7f3677400640 1 -- 172.21.15.107:0/1398112865 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3670031400 con 0x7f3678158fa0 2024-08-17T02:24:44.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.997+0000 7f3677400640 1 -- 172.21.15.107:0/1398112865 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367002d050 con 0x7f3678158fa0 2024-08-17T02:24:44.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.997+0000 7f3677400640 1 -- 172.21.15.107:0/1398112865 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3670031790 con 0x7f3678158fa0 2024-08-17T02:24:44.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.997+0000 7f367f400640 1 -- 172.21.15.107:0/1398112865 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3678158fa0 msgr2=0x7f36780ab6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:44.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.997+0000 7f367f400640 1 --2- 172.21.15.107:0/1398112865 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3678158fa0 0x7f36780ab6d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f36780ccaa0 tx=0x7f3670009840 comp rx=0 tx=0).stop 2024-08-17T02:24:44.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.997+0000 7f367f400640 1 -- 172.21.15.107:0/1398112865 shutdown_connections 2024-08-17T02:24:44.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.997+0000 7f367f400640 1 --2- 172.21.15.107:0/1398112865 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3678158fa0 0x7f36780ab6d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.997+0000 7f367f400640 1 --2- 172.21.15.107:0/1398112865 >> v2:172.21.15.157:3300/0 conn(0x7f36780aa7d0 0x7f367806ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.997+0000 7f367f400640 1 -- 172.21.15.107:0/1398112865 >> 172.21.15.107:0/1398112865 conn(0x7f36780cb9b0 msgr2=0x7f36780cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:44.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.997+0000 7f367f400640 1 -- 172.21.15.107:0/1398112865 shutdown_connections 2024-08-17T02:24:45.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.997+0000 7f367f400640 1 -- 172.21.15.107:0/1398112865 wait complete. 2024-08-17T02:24:45.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.999+0000 7f367f400640 1 Processor -- start 2024-08-17T02:24:45.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.999+0000 7f367f400640 1 -- start start 2024-08-17T02:24:45.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.999+0000 7f367f400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f367806da20 0x7f367814d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:45.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.999+0000 7f367f400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36780aa7d0 0x7f3678151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:45.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:44.999+0000 7f367f400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3678158fa0 0x7f3678069770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:45.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:45.000+0000 7f367f400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36780c8de0 con 0x7f367806da20 2024-08-17T02:24:45.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:45.000+0000 7f367f400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3678151b70 con 0x7f36780aa7d0 2024-08-17T02:24:45.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:45.000+0000 7f367f400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3678151e50 con 0x7f3678158fa0 2024-08-17T02:24:45.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:45.000+0000 7f367ca00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f367806da20 0x7f367814d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:45.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:45.000+0000 7f367ca00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f367806da20 0x7f367814d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:32924/0 (socket says 172.21.15.107:32924) 2024-08-17T02:24:45.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:45.000+0000 7f367ca00640 1 -- 172.21.15.107:0/237381454 learned_addr learned my addr 172.21.15.107:0/237381454 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:45.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:45.000+0000 7f3677e00640 1 --2- 172.21.15.107:0/237381454 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36780aa7d0 0x7f3678151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:45.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:45.000+0000 7f367d400640 1 --2- 172.21.15.107:0/237381454 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3678158fa0 0x7f3678069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:45.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:45.000+0000 7f367ca00640 1 -- 172.21.15.107:0/237381454 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3678158fa0 msgr2=0x7f3678069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:45.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:45.000+0000 7f367ca00640 1 --2- 172.21.15.107:0/237381454 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3678158fa0 0x7f3678069770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:45.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:45.000+0000 7f367ca00640 1 -- 172.21.15.107:0/237381454 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36780aa7d0 msgr2=0x7f3678151290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:45.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:45.000+0000 7f367ca00640 1 --2- 172.21.15.107:0/237381454 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36780aa7d0 0x7f3678151290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:45.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:45.000+0000 7f367ca00640 1 -- 172.21.15.107:0/237381454 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3670009ae0 con 0x7f367806da20 2024-08-17T02:24:45.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:45.000+0000 7f367ca00640 1 --2- 172.21.15.107:0/237381454 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f367806da20 0x7f367814d4b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f366800c5b0 tx=0x7f3668007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:45.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:45.001+0000 7f366fe00640 1 -- 172.21.15.107:0/237381454 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3668012630 con 0x7f367806da20 2024-08-17T02:24:45.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:45.001+0000 7f366fe00640 1 -- 172.21.15.107:0/237381454 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36680127d0 con 0x7f367806da20 2024-08-17T02:24:45.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:45.001+0000 7f366fe00640 1 -- 172.21.15.107:0/237381454 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3668012b90 con 0x7f367806da20 2024-08-17T02:24:45.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:45.001+0000 7f367f400640 1 -- 172.21.15.107:0/237381454 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3678152130 con 0x7f367806da20 2024-08-17T02:24:45.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:45.001+0000 7f367f400640 1 -- 172.21.15.107:0/237381454 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f367814d9f0 con 0x7f367806da20 2024-08-17T02:24:45.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:45.002+0000 7f367f400640 1 -- 172.21.15.107:0/237381454 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36780c8f50 con 0x7f367806da20 2024-08-17T02:24:45.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:45.002+0000 7f366fe00640 1 -- 172.21.15.107:0/237381454 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f366801b400 con 0x7f367806da20 2024-08-17T02:24:45.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:45.003+0000 7f366fe00640 1 --2- 172.21.15.107:0/237381454 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3658065180 0x7f3658067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:45.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:45.003+0000 7f366fe00640 1 -- 172.21.15.107:0/237381454 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3668081f90 con 0x7f367806da20 2024-08-17T02:24:45.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:45.003+0000 7f3677e00640 1 --2- 172.21.15.107:0/237381454 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3658065180 0x7f3658067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:45.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:45.004+0000 7f3677e00640 1 --2- 172.21.15.107:0/237381454 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3658065180 0x7f3658067630 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f36780c8250 tx=0x7f36640090f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:45.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:45.007+0000 7f366fe00640 1 -- 172.21.15.107:0/237381454 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f36780c8f50 con 0x7f367806da20 2024-08-17T02:24:45.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:45.215+0000 7f367f400640 1 -- 172.21.15.107:0/237381454 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f36780c8f20 con 0x7f367806da20 2024-08-17T02:24:45.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:45.215+0000 7f366fe00640 1 -- 172.21.15.107:0/237381454 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3668053af0 con 0x7f367806da20 2024-08-17T02:24:45.216 INFO:teuthology.orchestra.run.smithi107.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:24:45.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:45.217+0000 7f367f400640 1 -- 172.21.15.107:0/237381454 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3658065180 msgr2=0x7f3658067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:45.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:45.217+0000 7f367f400640 1 --2- 172.21.15.107:0/237381454 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3658065180 0x7f3658067630 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f36780c8250 tx=0x7f36640090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:45.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:45.217+0000 7f367f400640 1 -- 172.21.15.107:0/237381454 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f367806da20 msgr2=0x7f367814d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:45.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:45.217+0000 7f367f400640 1 --2- 172.21.15.107:0/237381454 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f367806da20 0x7f367814d4b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f366800c5b0 tx=0x7f3668007d60 comp rx=0 tx=0).stop 2024-08-17T02:24:45.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:45.217+0000 7f367f400640 1 -- 172.21.15.107:0/237381454 shutdown_connections 2024-08-17T02:24:45.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:45.217+0000 7f367f400640 1 --2- 172.21.15.107:0/237381454 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3658065180 0x7f3658067630 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:45.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:45.217+0000 7f367f400640 1 --2- 172.21.15.107:0/237381454 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3678158fa0 0x7f3678069770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:45.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:45.217+0000 7f367f400640 1 --2- 172.21.15.107:0/237381454 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36780aa7d0 0x7f3678151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:45.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:45.217+0000 7f367f400640 1 --2- 172.21.15.107:0/237381454 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f367806da20 0x7f367814d4b0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:45.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:45.217+0000 7f367f400640 1 -- 172.21.15.107:0/237381454 >> 172.21.15.107:0/237381454 conn(0x7f36780cb9b0 msgr2=0x7f367806ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:45.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:45.217+0000 7f367f400640 1 -- 172.21.15.107:0/237381454 shutdown_connections 2024-08-17T02:24:45.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:45.217+0000 7f367f400640 1 -- 172.21.15.107:0/237381454 wait complete. 2024-08-17T02:24:45.234 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:24:45.234 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:24:45.234 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi107.front.sepia.ceph.com 2024-08-17T02:24:45.234 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-17T02:24:45.234 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-17T02:24:45.234 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:24:45.235 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:24:45.235 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:24:45.235 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:24:45.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:45.235 DEBUG:teuthology.orchestra.run.smithi107:> ip addr 2024-08-17T02:24:45.271 INFO:teuthology.orchestra.run.smithi107.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:24:45.271 INFO:teuthology.orchestra.run.smithi107.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:24:45.272 INFO:teuthology.orchestra.run.smithi107.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:24:45.272 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:45.272 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 ::1/128 scope host 2024-08-17T02:24:45.272 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:45.272 INFO:teuthology.orchestra.run.smithi107.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:24:45.272 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0a brd ff:ff:ff:ff:ff:ff 2024-08-17T02:24:45.272 INFO:teuthology.orchestra.run.smithi107.stdout: altname enp7s0f0 2024-08-17T02:24:45.272 INFO:teuthology.orchestra.run.smithi107.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:24:45.272 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0b brd ff:ff:ff:ff:ff:ff 2024-08-17T02:24:45.272 INFO:teuthology.orchestra.run.smithi107.stdout: altname enp7s0f1 2024-08-17T02:24:45.272 INFO:teuthology.orchestra.run.smithi107.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:24:45.272 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:ea brd ff:ff:ff:ff:ff:ff 2024-08-17T02:24:45.272 INFO:teuthology.orchestra.run.smithi107.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:24:45.272 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:eb brd ff:ff:ff:ff:ff:ff 2024-08-17T02:24:45.273 INFO:teuthology.orchestra.run.smithi107.stdout: inet 172.21.15.107/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:24:45.273 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft 42671sec preferred_lft 42671sec 2024-08-17T02:24:45.273 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::ec4:7aff:fe8f:47eb/64 scope link 2024-08-17T02:24:45.273 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:45.273 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-17T02:24:45.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:45.273 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2024-08-17T02:24:45.273 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-08-17T02:24:45.274 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link add name ceph-brx type bridge 2024-08-17T02:24:45.274 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip addr flush dev ceph-brx 2024-08-17T02:24:45.274 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set ceph-brx up 2024-08-17T02:24:45.274 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-17T02:24:45.274 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-08-17T02:24:45.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:45.647 DEBUG:teuthology.orchestra.run.smithi107:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:24:45.704 INFO:teuthology.orchestra.run.smithi107.stdout:1 2024-08-17T02:24:45.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:45.707 DEBUG:teuthology.orchestra.run.smithi107:> route 2024-08-17T02:24:45.758 INFO:teuthology.orchestra.run.smithi107.stdout:Kernel IP routing table 2024-08-17T02:24:45.758 INFO:teuthology.orchestra.run.smithi107.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:24:45.758 INFO:teuthology.orchestra.run.smithi107.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:24:45.758 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:24:45.758 INFO:teuthology.orchestra.run.smithi107.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:24:45.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:45.759 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2024-08-17T02:24:45.759 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-08-17T02:24:45.759 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:24:45.759 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:24:45.759 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:24:45.759 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-08-17T02:24:46.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:46.299 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-08-17T02:24:46.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:46.335 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list-id 2024-08-17T02:24:46.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:46.410 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2024-08-17T02:24:46.410 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-08-17T02:24:46.410 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:24:46.410 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-08-17T02:24:46.411 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-08-17T02:24:46.537 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-08-17T02:24:46.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:46.538 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2024-08-17T02:24:46.538 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-08-17T02:24:46.538 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-08-17T02:24:46.538 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-17T02:24:46.538 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-08-17T02:24:46.538 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-08-17T02:24:46.538 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-08-17T02:24:46.538 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-08-17T02:24:46.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:46.722 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2024-08-17T02:24:46.722 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-08-17T02:24:46.723 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set brx.0 up 2024-08-17T02:24:46.723 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set dev brx.0 master ceph-brx 2024-08-17T02:24:46.723 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-08-17T02:24:46.838 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:24:46.838 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-17T02:24:46.873 INFO:teuthology.orchestra.run.smithi107.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:24:46.873 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:24:46.874 DEBUG:teuthology.orchestra.run.smithi107:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:24:46.948 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-08-17T02:24:46.949 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:24:46.949 DEBUG:teuthology.orchestra.run.smithi107:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:24:47.081 INFO:teuthology.orchestra.run.smithi107.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:24:47.082 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:24:47.694 INFO:teuthology.orchestra.run.smithi107.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:24:47.694 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:24:47.694 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: resolved to: "172.21.15.107:3300,172.21.15.157:3300,172.21.15.157:3301" 2024-08-17T02:24:47.694 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: trying mount with new device syntax: 0@f207b4c0-329d-46b8-b83f-aaf30bdb6ce3.cephfs=/ 2024-08-17T02:24:47.694 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.107:3300/172.21.15.157:3300/172.21.15.157:3301" will pass to kernel 2024-08-17T02:24:47.695 INFO:teuthology.orchestra.run.smithi107.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-17T02:24:47.695 INFO:teuthology.orchestra.run.smithi107.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:24:47.696 INFO:teuthology.orchestra.run.smithi107.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:24:47.696 INFO:teuthology.orchestra.run.smithi107.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:24:47.696 INFO:teuthology.orchestra.run.smithi107.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:24:47.699 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:24:47.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:47.699 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:24:47.756 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-08-17T02:24:47.756 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:24:47.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.903+0000 7f737f600640 1 Processor -- start 2024-08-17T02:24:47.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.903+0000 7f737f600640 1 -- start start 2024-08-17T02:24:47.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.905+0000 7f737f600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7378155180 0x7f73780aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:47.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.905+0000 7f737f600640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7378155550 0x7f73780ae070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:47.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.905+0000 7f737f600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73780afc10 con 0x7f737806e080 2024-08-17T02:24:47.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.905+0000 7f737f600640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73780ae5b0 con 0x7f7378155550 2024-08-17T02:24:47.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.905+0000 7f737f600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73780af000 con 0x7f7378155180 2024-08-17T02:24:47.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.905+0000 7f737d600640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f737806e080 0x7f737806e490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:55634/0 (socket says 172.21.15.107:55634) 2024-08-17T02:24:47.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.905+0000 7f737d600640 1 -- 172.21.15.107:0/2727068595 learned_addr learned my addr 172.21.15.107:0/2727068595 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:47.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.905+0000 7f737cc00640 1 --2- 172.21.15.107:0/2727068595 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7378155180 0x7f73780aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:47.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.905+0000 7f736fe00640 1 --2- 172.21.15.107:0/2727068595 >> v2:172.21.15.157:3300/0 conn(0x7f7378155550 0x7f73780ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:47.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.905+0000 7f7377e00640 1 -- 172.21.15.107:0/2727068595 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 694412608 0 0) 0x7f73780afc10 con 0x7f737806e080 2024-08-17T02:24:47.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.905+0000 7f7377e00640 1 -- 172.21.15.107:0/2727068595 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f735c0034e0 con 0x7f737806e080 2024-08-17T02:24:47.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.906+0000 7f736fe00640 1 -- 172.21.15.107:0/2727068595 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7378155180 msgr2=0x7f73780aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:47.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.906+0000 7f7377e00640 1 -- 172.21.15.107:0/2727068595 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3164382008 0 0) 0x7f735c0034e0 con 0x7f737806e080 2024-08-17T02:24:47.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.906+0000 7f736fe00640 1 --2- 172.21.15.107:0/2727068595 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7378155180 0x7f73780aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:47.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.906+0000 7f736fe00640 1 -- 172.21.15.107:0/2727068595 >> v1:172.21.15.107:6789/0 conn(0x7f737806e080 legacy=0x7f737806e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:47.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.906+0000 7f736fe00640 1 -- 172.21.15.107:0/2727068595 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73780af2e0 con 0x7f7378155550 2024-08-17T02:24:47.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.906+0000 7f737cc00640 1 --2- 172.21.15.107:0/2727068595 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7378155180 0x7f73780aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:47.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.907+0000 7f736fe00640 1 --2- 172.21.15.107:0/2727068595 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7378155550 0x7f73780ae070 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7360009880 tx=0x7f73600090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a5559fb29b8c666 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:47.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.907+0000 7f7377e00640 1 -- 172.21.15.107:0/2727068595 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7370001810 con 0x7f7378155550 2024-08-17T02:24:47.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.907+0000 7f7377e00640 1 -- 172.21.15.107:0/2727068595 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f736002aa70 con 0x7f7378155550 2024-08-17T02:24:47.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.907+0000 7f7377e00640 1 -- 172.21.15.107:0/2727068595 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736002ae10 con 0x7f7378155550 2024-08-17T02:24:47.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.908+0000 7f737f600640 1 -- 172.21.15.107:0/2727068595 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7378155550 msgr2=0x7f73780ae070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:47.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.908+0000 7f737f600640 1 --2- 172.21.15.107:0/2727068595 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7378155550 0x7f73780ae070 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7360009880 tx=0x7f73600090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:47.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.908+0000 7f737f600640 1 -- 172.21.15.107:0/2727068595 shutdown_connections 2024-08-17T02:24:47.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.908+0000 7f737f600640 1 --2- 172.21.15.107:0/2727068595 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7378155550 0x7f73780ae070 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:47.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.908+0000 7f737f600640 1 --2- 172.21.15.107:0/2727068595 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7378155180 0x7f73780aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:47.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.908+0000 7f737f600640 1 -- 172.21.15.107:0/2727068595 >> 172.21.15.107:0/2727068595 conn(0x7f73780cb9b0 msgr2=0x7f73780cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:47.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.908+0000 7f737f600640 1 -- 172.21.15.107:0/2727068595 shutdown_connections 2024-08-17T02:24:47.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.908+0000 7f737f600640 1 -- 172.21.15.107:0/2727068595 wait complete. 2024-08-17T02:24:47.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.909+0000 7f737f600640 1 Processor -- start 2024-08-17T02:24:47.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.909+0000 7f737f600640 1 -- start start 2024-08-17T02:24:47.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.910+0000 7f737f600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f737806e080 0x7f7378157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:47.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.910+0000 7f737f600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7378155180 0x7f73780c1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:47.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.910+0000 7f737f600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7378155550 0x7f7378168710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:47.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.910+0000 7f737f600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7378151e70 con 0x7f737806e080 2024-08-17T02:24:47.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.910+0000 7f737f600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7378157a60 con 0x7f7378155550 2024-08-17T02:24:47.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.910+0000 7f737f600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73780c2150 con 0x7f7378155180 2024-08-17T02:24:47.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.910+0000 7f737cc00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f737806e080 0x7f7378157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:47.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.910+0000 7f737cc00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f737806e080 0x7f7378157520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41906/0 (socket says 172.21.15.107:41906) 2024-08-17T02:24:47.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.910+0000 7f737cc00640 1 -- 172.21.15.107:0/3853567220 learned_addr learned my addr 172.21.15.107:0/3853567220 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:47.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.911+0000 7f736fe00640 1 --2- 172.21.15.107:0/3853567220 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7378155180 0x7f73780c1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:47.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.911+0000 7f737d600640 1 --2- 172.21.15.107:0/3853567220 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7378155550 0x7f7378168710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:47.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.911+0000 7f737cc00640 1 -- 172.21.15.107:0/3853567220 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7378155180 msgr2=0x7f73780c1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:47.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.911+0000 7f737cc00640 1 --2- 172.21.15.107:0/3853567220 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7378155180 0x7f73780c1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:47.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.911+0000 7f737cc00640 1 -- 172.21.15.107:0/3853567220 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7378155550 msgr2=0x7f7378168710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:47.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.911+0000 7f737cc00640 1 --2- 172.21.15.107:0/3853567220 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7378155550 0x7f7378168710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:47.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.911+0000 7f737cc00640 1 -- 172.21.15.107:0/3853567220 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7368009390 con 0x7f737806e080 2024-08-17T02:24:47.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.911+0000 7f737cc00640 1 --2- 172.21.15.107:0/3853567220 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f737806e080 0x7f7378157520 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f736800ec80 tx=0x7f73680090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:47.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.911+0000 7f7374c00640 1 -- 172.21.15.107:0/3853567220 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736800eec0 con 0x7f737806e080 2024-08-17T02:24:47.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.911+0000 7f7374c00640 1 -- 172.21.15.107:0/3853567220 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f736800cbc0 con 0x7f737806e080 2024-08-17T02:24:47.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.911+0000 7f7374c00640 1 -- 172.21.15.107:0/3853567220 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7368013470 con 0x7f737806e080 2024-08-17T02:24:47.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.911+0000 7f737f600640 1 -- 172.21.15.107:0/3853567220 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7360009390 con 0x7f737806e080 2024-08-17T02:24:47.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.912+0000 7f737f600640 1 -- 172.21.15.107:0/3853567220 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7378158230 con 0x7f737806e080 2024-08-17T02:24:47.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.913+0000 7f737f600640 1 -- 172.21.15.107:0/3853567220 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7378064db0 con 0x7f737806e080 2024-08-17T02:24:47.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.913+0000 7f7374c00640 1 -- 172.21.15.107:0/3853567220 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f73680137e0 con 0x7f737806e080 2024-08-17T02:24:47.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.915+0000 7f7374c00640 1 --2- 172.21.15.107:0/3853567220 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7354065150 0x7f7354067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:47.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.915+0000 7f7374c00640 1 -- 172.21.15.107:0/3853567220 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f73680827a0 con 0x7f737806e080 2024-08-17T02:24:47.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.915+0000 7f736fe00640 1 --2- 172.21.15.107:0/3853567220 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7354065150 0x7f7354067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:47.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.915+0000 7f736fe00640 1 --2- 172.21.15.107:0/3853567220 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7354065150 0x7f7354067600 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7360034000 tx=0x7f7360032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:47.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:47.919+0000 7f7374c00640 1 -- 172.21.15.107:0/3853567220 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7368050910 con 0x7f737806e080 2024-08-17T02:24:48.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:48.128+0000 7f737f600640 1 -- 172.21.15.107:0/3853567220 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f73780cc500 con 0x7f737806e080 2024-08-17T02:24:48.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:48.128+0000 7f7374c00640 1 -- 172.21.15.107:0/3853567220 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7368053f30 con 0x7f737806e080 2024-08-17T02:24:48.130 INFO:teuthology.orchestra.run.smithi107.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:24:48.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:48.130+0000 7f737f600640 1 -- 172.21.15.107:0/3853567220 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7354065150 msgr2=0x7f7354067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:48.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:48.130+0000 7f737f600640 1 --2- 172.21.15.107:0/3853567220 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7354065150 0x7f7354067600 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7360034000 tx=0x7f7360032000 comp rx=0 tx=0).stop 2024-08-17T02:24:48.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:48.130+0000 7f737f600640 1 -- 172.21.15.107:0/3853567220 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f737806e080 msgr2=0x7f7378157520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:48.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:48.130+0000 7f737f600640 1 --2- 172.21.15.107:0/3853567220 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f737806e080 0x7f7378157520 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f736800ec80 tx=0x7f73680090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:48.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:48.130+0000 7f737f600640 1 -- 172.21.15.107:0/3853567220 shutdown_connections 2024-08-17T02:24:48.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:48.130+0000 7f737f600640 1 --2- 172.21.15.107:0/3853567220 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7354065150 0x7f7354067600 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:48.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:48.130+0000 7f737f600640 1 --2- 172.21.15.107:0/3853567220 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7378155550 0x7f7378168710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:48.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:48.130+0000 7f737f600640 1 --2- 172.21.15.107:0/3853567220 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7378155180 0x7f73780c1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:48.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:48.130+0000 7f737f600640 1 --2- 172.21.15.107:0/3853567220 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f737806e080 0x7f7378157520 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:48.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:48.130+0000 7f737f600640 1 -- 172.21.15.107:0/3853567220 >> 172.21.15.107:0/3853567220 conn(0x7f73780cb9b0 msgr2=0x7f73780c8740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:48.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:48.131+0000 7f737f600640 1 -- 172.21.15.107:0/3853567220 shutdown_connections 2024-08-17T02:24:48.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:48.131+0000 7f737f600640 1 -- 172.21.15.107:0/3853567220 wait complete. 2024-08-17T02:24:48.146 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:24:48.146 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:24:48.146 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi107.front.sepia.ceph.com 2024-08-17T02:24:48.146 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-08-17T02:24:48.146 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-08-17T02:24:48.146 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:24:48.146 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:24:48.146 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:24:48.146 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-08-17T02:24:48.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:48.147 DEBUG:teuthology.orchestra.run.smithi107:> ip addr 2024-08-17T02:24:48.181 INFO:teuthology.orchestra.run.smithi107.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:24:48.182 INFO:teuthology.orchestra.run.smithi107.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:24:48.182 INFO:teuthology.orchestra.run.smithi107.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:24:48.182 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:48.182 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 ::1/128 scope host 2024-08-17T02:24:48.182 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:48.182 INFO:teuthology.orchestra.run.smithi107.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:24:48.182 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0a brd ff:ff:ff:ff:ff:ff 2024-08-17T02:24:48.182 INFO:teuthology.orchestra.run.smithi107.stdout: altname enp7s0f0 2024-08-17T02:24:48.183 INFO:teuthology.orchestra.run.smithi107.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:24:48.183 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0b brd ff:ff:ff:ff:ff:ff 2024-08-17T02:24:48.183 INFO:teuthology.orchestra.run.smithi107.stdout: altname enp7s0f1 2024-08-17T02:24:48.183 INFO:teuthology.orchestra.run.smithi107.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:24:48.183 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:ea brd ff:ff:ff:ff:ff:ff 2024-08-17T02:24:48.183 INFO:teuthology.orchestra.run.smithi107.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:24:48.183 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:eb brd ff:ff:ff:ff:ff:ff 2024-08-17T02:24:48.183 INFO:teuthology.orchestra.run.smithi107.stdout: inet 172.21.15.107/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:24:48.184 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft 42668sec preferred_lft 42668sec 2024-08-17T02:24:48.184 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::ec4:7aff:fe8f:47eb/64 scope link 2024-08-17T02:24:48.184 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:48.184 INFO:teuthology.orchestra.run.smithi107.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:24:48.184 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 1e:af:4e:90:fd:87 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:24:48.184 INFO:teuthology.orchestra.run.smithi107.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:24:48.184 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:48.184 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::60a7:3dff:feb5:107b/64 scope link 2024-08-17T02:24:48.184 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:48.184 INFO:teuthology.orchestra.run.smithi107.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:24:48.184 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 1e:af:4e:90:fd:87 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:24:48.184 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::1caf:4eff:fe90:fd87/64 scope link tentative 2024-08-17T02:24:48.184 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:48.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:48.185 DEBUG:teuthology.orchestra.run.smithi107:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:24:48.279 INFO:teuthology.orchestra.run.smithi107.stdout:1 2024-08-17T02:24:48.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:48.282 DEBUG:teuthology.orchestra.run.smithi107:> route 2024-08-17T02:24:48.319 INFO:teuthology.orchestra.run.smithi107.stdout:Kernel IP routing table 2024-08-17T02:24:48.319 INFO:teuthology.orchestra.run.smithi107.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:24:48.319 INFO:teuthology.orchestra.run.smithi107.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:24:48.319 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:24:48.319 INFO:teuthology.orchestra.run.smithi107.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:24:48.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:48.320 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2024-08-17T02:24:48.320 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-08-17T02:24:48.320 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:24:48.320 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:24:48.320 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:24:48.320 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-08-17T02:24:48.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:48.464 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-08-17T02:24:48.500 INFO:teuthology.orchestra.run.smithi107.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:24:48.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:48.500 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list-id 2024-08-17T02:24:48.575 INFO:teuthology.orchestra.run.smithi107.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-08-17T02:24:48.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:48.576 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2024-08-17T02:24:48.576 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-08-17T02:24:48.576 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:24:48.576 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-08-17T02:24:48.576 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-08-17T02:24:48.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:48.700 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-17T02:24:48.755 INFO:teuthology.orchestra.run.smithi107.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:24:48.755 INFO:teuthology.orchestra.run.smithi107.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:24:48.755 INFO:teuthology.orchestra.run.smithi107.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:24:48.755 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:48.756 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 ::1/128 scope host 2024-08-17T02:24:48.756 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:48.756 INFO:teuthology.orchestra.run.smithi107.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:24:48.756 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 52:52:d0:69:c3:98 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:24:48.756 INFO:teuthology.orchestra.run.smithi107.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:24:48.756 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:48.756 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::5052:d0ff:fe69:c398/64 scope link 2024-08-17T02:24:48.756 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:48.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:48.758 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-17T02:24:48.813 INFO:teuthology.orchestra.run.smithi107.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:24:48.813 INFO:teuthology.orchestra.run.smithi107.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:24:48.813 INFO:teuthology.orchestra.run.smithi107.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:24:48.814 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:48.814 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 ::1/128 scope host 2024-08-17T02:24:48.814 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:48.814 INFO:teuthology.orchestra.run.smithi107.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:24:48.814 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 52:52:d0:69:c3:98 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:24:48.814 INFO:teuthology.orchestra.run.smithi107.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:24:48.814 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:48.814 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::5052:d0ff:fe69:c398/64 scope link 2024-08-17T02:24:48.814 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:48.816 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-08-17T02:24:48.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:48.816 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2024-08-17T02:24:48.817 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-08-17T02:24:48.817 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-08-17T02:24:48.817 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-17T02:24:48.817 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-08-17T02:24:48.817 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-08-17T02:24:48.817 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-08-17T02:24:48.817 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-08-17T02:24:48.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:48.980 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2024-08-17T02:24:48.980 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-08-17T02:24:48.980 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set brx.1 up 2024-08-17T02:24:48.980 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set dev brx.1 master ceph-brx 2024-08-17T02:24:48.980 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-08-17T02:24:49.095 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:24:49.095 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-08-17T02:24:49.130 INFO:teuthology.orchestra.run.smithi107.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-08-17T02:24:49.131 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:24:49.131 DEBUG:teuthology.orchestra.run.smithi107:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-08-17T02:24:49.206 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-08-17T02:24:49.206 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:24:49.206 DEBUG:teuthology.orchestra.run.smithi107:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:24:49.327 INFO:teuthology.orchestra.run.smithi107.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:24:49.327 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:24:49.354 INFO:teuthology.orchestra.run.smithi107.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:24:49.354 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:24:49.354 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: resolved to: "172.21.15.107:3300,172.21.15.157:3300,172.21.15.157:3301" 2024-08-17T02:24:49.354 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: trying mount with new device syntax: 2@f207b4c0-329d-46b8-b83f-aaf30bdb6ce3.cephfs=/ 2024-08-17T02:24:49.354 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.107:3300/172.21.15.157:3300/172.21.15.157:3301" will pass to kernel 2024-08-17T02:24:49.355 INFO:teuthology.orchestra.run.smithi107.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-08-17T02:24:49.355 INFO:teuthology.orchestra.run.smithi107.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:24:49.355 INFO:teuthology.orchestra.run.smithi107.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:24:49.355 INFO:teuthology.orchestra.run.smithi107.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:24:49.355 INFO:teuthology.orchestra.run.smithi107.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:24:49.358 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:24:49.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:49.358 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-08-17T02:24:49.414 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-08-17T02:24:49.414 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:24:49.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.562+0000 7f7a4ee00640 1 Processor -- start 2024-08-17T02:24:49.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.562+0000 7f7a4ee00640 1 -- start start 2024-08-17T02:24:49.565 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.563+0000 7f7a4ee00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7a48159ca0 0x7f7a480ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:49.565 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.563+0000 7f7a4ee00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7a480ca8a0 0x7f7a480cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:49.565 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.563+0000 7f7a4ee00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a480ccad0 0x7f7a480cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:49.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.563+0000 7f7a4ee00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a480cd6e0 con 0x7f7a480ca8a0 2024-08-17T02:24:49.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.563+0000 7f7a4ee00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a480ccf70 con 0x7f7a48159ca0 2024-08-17T02:24:49.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.563+0000 7f7a4ee00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a480cadc0 con 0x7f7a480ccad0 2024-08-17T02:24:49.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.563+0000 7f7a4d000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7a480ca8a0 0x7f7a480cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:49.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.563+0000 7f7a4d000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7a480ca8a0 0x7f7a480cc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41910/0 (socket says 172.21.15.107:41910) 2024-08-17T02:24:49.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.563+0000 7f7a4d000640 1 -- 172.21.15.107:0/1241529459 learned_addr learned my addr 172.21.15.107:0/1241529459 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:49.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.563+0000 7f7a4da00640 1 --2- 172.21.15.107:0/1241529459 >> v2:172.21.15.157:3300/0 conn(0x7f7a48159ca0 0x7f7a480ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:49.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.563+0000 7f7a4e400640 1 --2- 172.21.15.107:0/1241529459 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a480ccad0 0x7f7a480cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:49.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.564+0000 7f7a4d000640 1 -- 172.21.15.107:0/1241529459 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a480ccad0 msgr2=0x7f7a480cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:49.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.564+0000 7f7a4d000640 1 --2- 172.21.15.107:0/1241529459 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a480ccad0 0x7f7a480cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:49.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.564+0000 7f7a4d000640 1 -- 172.21.15.107:0/1241529459 >> v2:172.21.15.157:3300/0 conn(0x7f7a48159ca0 msgr2=0x7f7a480ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:49.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.564+0000 7f7a4d000640 1 --2- 172.21.15.107:0/1241529459 >> v2:172.21.15.157:3300/0 conn(0x7f7a48159ca0 0x7f7a480ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:49.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.564+0000 7f7a4d000640 1 -- 172.21.15.107:0/1241529459 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a480cb060 con 0x7f7a480ca8a0 2024-08-17T02:24:49.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.564+0000 7f7a4da00640 1 --2- 172.21.15.107:0/1241529459 >> v2:172.21.15.157:3300/0 conn(0x7f7a48159ca0 0x7f7a480ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:49.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.564+0000 7f7a4e400640 1 --2- 172.21.15.107:0/1241529459 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a480ccad0 0x7f7a480cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:49.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.565+0000 7f7a4d000640 1 --2- 172.21.15.107:0/1241529459 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a480ca8a0 0x7f7a480cc590 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7a4808a320 tx=0x7f7a340091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb6f3eda9b56105a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:49.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.565+0000 7f7a47e00640 1 -- 172.21.15.107:0/1241529459 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3402add0 con 0x7f7a480ca8a0 2024-08-17T02:24:49.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.565+0000 7f7a47e00640 1 -- 172.21.15.107:0/1241529459 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a34032440 con 0x7f7a480ca8a0 2024-08-17T02:24:49.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.565+0000 7f7a47e00640 1 -- 172.21.15.107:0/1241529459 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a34032820 con 0x7f7a480ca8a0 2024-08-17T02:24:49.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.565+0000 7f7a4ee00640 1 -- 172.21.15.107:0/1241529459 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a480ca8a0 msgr2=0x7f7a480cc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:49.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.565+0000 7f7a4ee00640 1 --2- 172.21.15.107:0/1241529459 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a480ca8a0 0x7f7a480cc590 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7a4808a320 tx=0x7f7a340091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:49.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.566+0000 7f7a4ee00640 1 -- 172.21.15.107:0/1241529459 shutdown_connections 2024-08-17T02:24:49.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.566+0000 7f7a4ee00640 1 --2- 172.21.15.107:0/1241529459 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a480ca8a0 0x7f7a480cc590 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:49.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.566+0000 7f7a4ee00640 1 --2- 172.21.15.107:0/1241529459 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a480ccad0 0x7f7a480cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:49.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.566+0000 7f7a4ee00640 1 --2- 172.21.15.107:0/1241529459 >> v2:172.21.15.157:3300/0 conn(0x7f7a48159ca0 0x7f7a480ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:49.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.566+0000 7f7a4ee00640 1 -- 172.21.15.107:0/1241529459 >> 172.21.15.107:0/1241529459 conn(0x7f7a48098e00 msgr2=0x7f7a4806eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:49.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.566+0000 7f7a4ee00640 1 -- 172.21.15.107:0/1241529459 shutdown_connections 2024-08-17T02:24:49.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.566+0000 7f7a4ee00640 1 -- 172.21.15.107:0/1241529459 wait complete. 2024-08-17T02:24:49.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.567+0000 7f7a4ee00640 1 Processor -- start 2024-08-17T02:24:49.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.567+0000 7f7a4ee00640 1 -- start start 2024-08-17T02:24:49.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.568+0000 7f7a4ee00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a480ca8a0 0x7f7a48168290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:49.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.568+0000 7f7a4ee00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a480ccad0 0x7f7a4815cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:49.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.568+0000 7f7a4ee00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a48159ca0 0x7f7a4815d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:49.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.568+0000 7f7a4ee00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a480b4aa0 con 0x7f7a480ccad0 2024-08-17T02:24:49.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.568+0000 7f7a4ee00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a480b4d80 con 0x7f7a480ca8a0 2024-08-17T02:24:49.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.568+0000 7f7a4ee00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a480b5060 con 0x7f7a48159ca0 2024-08-17T02:24:49.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.568+0000 7f7a4d000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a480ccad0 0x7f7a4815cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:49.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.568+0000 7f7a4d000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a480ccad0 0x7f7a4815cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41924/0 (socket says 172.21.15.107:41924) 2024-08-17T02:24:49.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.568+0000 7f7a4d000640 1 -- 172.21.15.107:0/700653209 learned_addr learned my addr 172.21.15.107:0/700653209 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:49.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.568+0000 7f7a4da00640 1 --2- 172.21.15.107:0/700653209 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a480ca8a0 0x7f7a48168290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:49.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.568+0000 7f7a4e400640 1 --2- 172.21.15.107:0/700653209 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a48159ca0 0x7f7a4815d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:49.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.569+0000 7f7a4d000640 1 -- 172.21.15.107:0/700653209 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a48159ca0 msgr2=0x7f7a4815d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:49.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.569+0000 7f7a4d000640 1 --2- 172.21.15.107:0/700653209 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a48159ca0 0x7f7a4815d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:49.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.569+0000 7f7a4d000640 1 -- 172.21.15.107:0/700653209 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a480ca8a0 msgr2=0x7f7a48168290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:49.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.569+0000 7f7a4d000640 1 --2- 172.21.15.107:0/700653209 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a480ca8a0 0x7f7a48168290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:49.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.569+0000 7f7a4d000640 1 -- 172.21.15.107:0/700653209 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a34009450 con 0x7f7a480ccad0 2024-08-17T02:24:49.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.569+0000 7f7a4e400640 1 --2- 172.21.15.107:0/700653209 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a48159ca0 0x7f7a4815d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:49.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.569+0000 7f7a4d000640 1 --2- 172.21.15.107:0/700653209 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a480ccad0 0x7f7a4815cb80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7a34009210 tx=0x7f7a34032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:49.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.569+0000 7f7a44c00640 1 -- 172.21.15.107:0/700653209 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a34006b30 con 0x7f7a480ccad0 2024-08-17T02:24:49.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.569+0000 7f7a44c00640 1 -- 172.21.15.107:0/700653209 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a34031a40 con 0x7f7a480ccad0 2024-08-17T02:24:49.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.569+0000 7f7a44c00640 1 -- 172.21.15.107:0/700653209 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a34031e00 con 0x7f7a480ccad0 2024-08-17T02:24:49.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.569+0000 7f7a4ee00640 1 -- 172.21.15.107:0/700653209 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a480b5340 con 0x7f7a480ccad0 2024-08-17T02:24:49.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.569+0000 7f7a4ee00640 1 -- 172.21.15.107:0/700653209 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a481687d0 con 0x7f7a480ccad0 2024-08-17T02:24:49.574 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.570+0000 7f7a4ee00640 1 -- 172.21.15.107:0/700653209 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a48071050 con 0x7f7a480ccad0 2024-08-17T02:24:49.574 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.571+0000 7f7a44c00640 1 -- 172.21.15.107:0/700653209 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7a34039040 con 0x7f7a480ccad0 2024-08-17T02:24:49.574 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.572+0000 7f7a44c00640 1 --2- 172.21.15.107:0/700653209 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7a28065150 0x7f7a28067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:49.574 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.572+0000 7f7a44c00640 1 -- 172.21.15.107:0/700653209 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7a340a1ff0 con 0x7f7a480ccad0 2024-08-17T02:24:49.574 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.572+0000 7f7a4da00640 1 --2- 172.21.15.107:0/700653209 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7a28065150 0x7f7a28067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:49.574 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.573+0000 7f7a4da00640 1 --2- 172.21.15.107:0/700653209 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7a28065150 0x7f7a28067600 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c00bd40 tx=0x7f7a3c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:49.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.576+0000 7f7a44c00640 1 -- 172.21.15.107:0/700653209 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7a340700c0 con 0x7f7a480ccad0 2024-08-17T02:24:49.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.785+0000 7f7a4ee00640 1 -- 172.21.15.107:0/700653209 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7a48158d90 con 0x7f7a480ccad0 2024-08-17T02:24:49.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.785+0000 7f7a44c00640 1 -- 172.21.15.107:0/700653209 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7a34042060 con 0x7f7a480ccad0 2024-08-17T02:24:49.787 INFO:teuthology.orchestra.run.smithi107.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:24:49.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.787+0000 7f7a4ee00640 1 -- 172.21.15.107:0/700653209 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7a28065150 msgr2=0x7f7a28067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:49.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.787+0000 7f7a4ee00640 1 --2- 172.21.15.107:0/700653209 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7a28065150 0x7f7a28067600 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c00bd40 tx=0x7f7a3c008040 comp rx=0 tx=0).stop 2024-08-17T02:24:49.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.787+0000 7f7a4ee00640 1 -- 172.21.15.107:0/700653209 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a480ccad0 msgr2=0x7f7a4815cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:49.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.787+0000 7f7a4ee00640 1 --2- 172.21.15.107:0/700653209 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a480ccad0 0x7f7a4815cb80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7a34009210 tx=0x7f7a34032000 comp rx=0 tx=0).stop 2024-08-17T02:24:49.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.787+0000 7f7a4ee00640 1 -- 172.21.15.107:0/700653209 shutdown_connections 2024-08-17T02:24:49.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.787+0000 7f7a4ee00640 1 --2- 172.21.15.107:0/700653209 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7a28065150 0x7f7a28067600 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:49.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.787+0000 7f7a4ee00640 1 --2- 172.21.15.107:0/700653209 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a48159ca0 0x7f7a4815d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:49.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.787+0000 7f7a4ee00640 1 --2- 172.21.15.107:0/700653209 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a480ccad0 0x7f7a4815cb80 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:49.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.787+0000 7f7a4ee00640 1 --2- 172.21.15.107:0/700653209 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a480ca8a0 0x7f7a48168290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:49.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.787+0000 7f7a4ee00640 1 -- 172.21.15.107:0/700653209 >> 172.21.15.107:0/700653209 conn(0x7f7a48098e00 msgr2=0x7f7a48156f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:49.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.787+0000 7f7a4ee00640 1 -- 172.21.15.107:0/700653209 shutdown_connections 2024-08-17T02:24:49.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:49.787+0000 7f7a4ee00640 1 -- 172.21.15.107:0/700653209 wait complete. 2024-08-17T02:24:49.804 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:24:49.804 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:24:49.804 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi157.front.sepia.ceph.com 2024-08-17T02:24:49.804 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-17T02:24:49.804 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-17T02:24:49.804 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:24:49.804 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:24:49.805 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:24:49.805 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:24:49.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:49.805 DEBUG:teuthology.orchestra.run.smithi157:> ip addr 2024-08-17T02:24:49.846 INFO:teuthology.orchestra.run.smithi157.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:24:49.846 INFO:teuthology.orchestra.run.smithi157.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:24:49.846 INFO:teuthology.orchestra.run.smithi157.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:24:49.846 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:49.846 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 ::1/128 scope host 2024-08-17T02:24:49.846 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:49.846 INFO:teuthology.orchestra.run.smithi157.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:24:49.847 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:d9:37:98 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:24:49.847 INFO:teuthology.orchestra.run.smithi157.stdout: altname enp7s0f0 2024-08-17T02:24:49.847 INFO:teuthology.orchestra.run.smithi157.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:24:49.847 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:d9:37:99 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:24:49.847 INFO:teuthology.orchestra.run.smithi157.stdout: altname enp7s0f1 2024-08-17T02:24:49.847 INFO:teuthology.orchestra.run.smithi157.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:24:49.847 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:88:7e:a0 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:24:49.847 INFO:teuthology.orchestra.run.smithi157.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:24:49.847 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:88:7e:a1 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:24:49.847 INFO:teuthology.orchestra.run.smithi157.stdout: inet 172.21.15.157/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:24:49.847 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft 42673sec preferred_lft 42673sec 2024-08-17T02:24:49.847 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 fe80::ec4:7aff:fe88:7ea1/64 scope link 2024-08-17T02:24:49.847 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:49.848 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-17T02:24:49.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:49.848 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2024-08-17T02:24:49.848 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2024-08-17T02:24:49.848 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link add name ceph-brx type bridge 2024-08-17T02:24:49.848 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip addr flush dev ceph-brx 2024-08-17T02:24:49.848 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link set ceph-brx up 2024-08-17T02:24:49.848 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-17T02:24:49.848 DEBUG:teuthology.orchestra.run.smithi157:> ') 2024-08-17T02:24:50.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:50.272 DEBUG:teuthology.orchestra.run.smithi157:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:24:50.328 INFO:teuthology.orchestra.run.smithi157.stdout:1 2024-08-17T02:24:50.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:50.331 DEBUG:teuthology.orchestra.run.smithi157:> route 2024-08-17T02:24:50.385 INFO:teuthology.orchestra.run.smithi157.stdout:Kernel IP routing table 2024-08-17T02:24:50.385 INFO:teuthology.orchestra.run.smithi157.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:24:50.385 INFO:teuthology.orchestra.run.smithi157.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:24:50.385 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:24:50.385 INFO:teuthology.orchestra.run.smithi157.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:24:50.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:50.386 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2024-08-17T02:24:50.386 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2024-08-17T02:24:50.386 DEBUG:teuthology.orchestra.run.smithi157:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:24:50.386 DEBUG:teuthology.orchestra.run.smithi157:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:24:50.386 DEBUG:teuthology.orchestra.run.smithi157:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:24:50.386 DEBUG:teuthology.orchestra.run.smithi157:> ') 2024-08-17T02:24:50.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:50.919 DEBUG:teuthology.orchestra.run.smithi157:> ip netns list 2024-08-17T02:24:50.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:50.955 DEBUG:teuthology.orchestra.run.smithi157:> ip netns list-id 2024-08-17T02:24:51.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:51.031 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2024-08-17T02:24:51.031 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2024-08-17T02:24:51.031 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:24:51.031 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-08-17T02:24:51.031 DEBUG:teuthology.orchestra.run.smithi157:> ') 2024-08-17T02:24:51.156 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-08-17T02:24:51.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:51.156 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2024-08-17T02:24:51.157 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2024-08-17T02:24:51.157 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-08-17T02:24:51.157 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-17T02:24:51.157 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-08-17T02:24:51.157 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-08-17T02:24:51.157 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-08-17T02:24:51.157 DEBUG:teuthology.orchestra.run.smithi157:> ') 2024-08-17T02:24:51.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:51.341 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2024-08-17T02:24:51.341 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2024-08-17T02:24:51.341 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link set brx.0 up 2024-08-17T02:24:51.341 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link set dev brx.0 master ceph-brx 2024-08-17T02:24:51.341 DEBUG:teuthology.orchestra.run.smithi157:> ') 2024-08-17T02:24:51.456 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:24:51.456 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-17T02:24:51.492 INFO:teuthology.orchestra.run.smithi157.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:24:51.492 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:24:51.492 DEBUG:teuthology.orchestra.run.smithi157:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:24:51.567 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-08-17T02:24:51.567 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:24:51.567 DEBUG:teuthology.orchestra.run.smithi157:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:24:51.693 INFO:teuthology.orchestra.run.smithi157.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:24:51.694 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:24:52.356 INFO:teuthology.orchestra.run.smithi157.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:24:52.356 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:24:52.356 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: resolved to: "172.21.15.107:3300,172.21.15.157:3300,172.21.15.157:3301" 2024-08-17T02:24:52.356 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: trying mount with new device syntax: 1@f207b4c0-329d-46b8-b83f-aaf30bdb6ce3.cephfs=/ 2024-08-17T02:24:52.356 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.107:3300/172.21.15.157:3300/172.21.15.157:3301" will pass to kernel 2024-08-17T02:24:52.358 INFO:teuthology.orchestra.run.smithi157.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-08-17T02:24:52.358 INFO:teuthology.orchestra.run.smithi157.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:24:52.358 INFO:teuthology.orchestra.run.smithi157.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:24:52.358 INFO:teuthology.orchestra.run.smithi157.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:24:52.359 INFO:teuthology.orchestra.run.smithi157.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:24:52.361 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:24:52.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:52.361 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:24:52.417 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-08-17T02:24:52.418 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:24:52.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.575+0000 7fdbdb000640 1 Processor -- start 2024-08-17T02:24:52.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.576+0000 7fdbdb000640 1 -- start start 2024-08-17T02:24:52.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.577+0000 7fdbdb000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdbd4154760 0x7fdbd40ae570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:52.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.577+0000 7fdbdb000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fdbd40abfe0 0x7fdbd40ad720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:52.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.577+0000 7fdbdb000640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbd40aab40 con 0x7fdbd40aeab0 2024-08-17T02:24:52.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.577+0000 7fdbdb000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbd4154b30 con 0x7fdbd40abfe0 2024-08-17T02:24:52.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.577+0000 7fdbdb000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd40b08a0 con 0x7fdbd4154760 2024-08-17T02:24:52.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.577+0000 7fdbda600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fdbd40abfe0 0x7fdbd40ad720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:52.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.577+0000 7fdbda600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fdbd40abfe0 0x7fdbd40ad720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41938/0 (socket says 172.21.15.107:41938) 2024-08-17T02:24:52.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.577+0000 7fdbda600640 1 -- 172.21.15.107:0/4017241396 learned_addr learned my addr 172.21.15.107:0/4017241396 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:52.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.577+0000 7fdbd9c00640 1 --2- 172.21.15.107:0/4017241396 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdbd4154760 0x7fdbd40ae570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:52.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.577+0000 7fdbda600640 1 -- 172.21.15.107:0/4017241396 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdbd4154760 msgr2=0x7fdbd40ae570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:52.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.577+0000 7fdbda600640 1 --2- 172.21.15.107:0/4017241396 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdbd4154760 0x7fdbd40ae570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:52.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.577+0000 7fdbda600640 1 -- 172.21.15.107:0/4017241396 >> v1:172.21.15.157:6789/0 conn(0x7fdbd40aeab0 legacy=0x7fdbd40ad010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:52.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.577+0000 7fdbda600640 1 -- 172.21.15.107:0/4017241396 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd40aef00 con 0x7fdbd40abfe0 2024-08-17T02:24:52.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.577+0000 7fdbd9c00640 1 --2- 172.21.15.107:0/4017241396 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdbd4154760 0x7fdbd40ae570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:52.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.578+0000 7fdbda600640 1 --2- 172.21.15.107:0/4017241396 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdbd40abfe0 0x7fdbd40ad720 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc009f20 tx=0x7fdbcc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1628b8d5be5b483e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:52.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.579+0000 7fdbd3e00640 1 -- 172.21.15.107:0/4017241396 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc031400 con 0x7fdbd40abfe0 2024-08-17T02:24:52.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.579+0000 7fdbd3e00640 1 -- 172.21.15.107:0/4017241396 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbcc02d050 con 0x7fdbd40abfe0 2024-08-17T02:24:52.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.579+0000 7fdbd3e00640 1 -- 172.21.15.107:0/4017241396 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc0317d0 con 0x7fdbd40abfe0 2024-08-17T02:24:52.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.579+0000 7fdbdb000640 1 -- 172.21.15.107:0/4017241396 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdbd40abfe0 msgr2=0x7fdbd40ad720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:52.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.579+0000 7fdbdb000640 1 --2- 172.21.15.107:0/4017241396 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdbd40abfe0 0x7fdbd40ad720 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc009f20 tx=0x7fdbcc009840 comp rx=0 tx=0).stop 2024-08-17T02:24:52.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.579+0000 7fdbdb000640 1 -- 172.21.15.107:0/4017241396 shutdown_connections 2024-08-17T02:24:52.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.579+0000 7fdbdb000640 1 --2- 172.21.15.107:0/4017241396 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdbd40abfe0 0x7fdbd40ad720 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:52.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.579+0000 7fdbdb000640 1 --2- 172.21.15.107:0/4017241396 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdbd4154760 0x7fdbd40ae570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:52.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.579+0000 7fdbdb000640 1 -- 172.21.15.107:0/4017241396 >> 172.21.15.107:0/4017241396 conn(0x7fdbd4096a70 msgr2=0x7fdbd4096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:52.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.579+0000 7fdbdb000640 1 -- 172.21.15.107:0/4017241396 shutdown_connections 2024-08-17T02:24:52.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.579+0000 7fdbdb000640 1 -- 172.21.15.107:0/4017241396 wait complete. 2024-08-17T02:24:52.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.581+0000 7fdbdb000640 1 Processor -- start 2024-08-17T02:24:52.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.581+0000 7fdbdb000640 1 -- start start 2024-08-17T02:24:52.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.582+0000 7fdbdb000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdbd40abfe0 0x7fdbd40c9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:52.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.582+0000 7fdbdb000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbd40aeab0 0x7fdbd4067de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:52.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.582+0000 7fdbdb000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdbd4154760 0x7fdbd40c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:52.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.582+0000 7fdbdb000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd40c7ed0 con 0x7fdbd40abfe0 2024-08-17T02:24:52.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.582+0000 7fdbdb000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd4069490 con 0x7fdbd40aeab0 2024-08-17T02:24:52.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.582+0000 7fdbdb000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd40691b0 con 0x7fdbd4154760 2024-08-17T02:24:52.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.582+0000 7fdbd9c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdbd40abfe0 0x7fdbd40c9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:52.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.582+0000 7fdbd9c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdbd40abfe0 0x7fdbd40c9980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41954/0 (socket says 172.21.15.107:41954) 2024-08-17T02:24:52.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.582+0000 7fdbd9c00640 1 -- 172.21.15.107:0/2250877522 learned_addr learned my addr 172.21.15.107:0/2250877522 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:52.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.582+0000 7fdbda600640 1 --2- 172.21.15.107:0/2250877522 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdbd4154760 0x7fdbd40c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:52.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.582+0000 7fdbd9200640 1 --2- 172.21.15.107:0/2250877522 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbd40aeab0 0x7fdbd4067de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:52.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.582+0000 7fdbd9c00640 1 -- 172.21.15.107:0/2250877522 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdbd4154760 msgr2=0x7fdbd40c6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:52.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.582+0000 7fdbd9c00640 1 --2- 172.21.15.107:0/2250877522 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdbd4154760 0x7fdbd40c6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:52.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.583+0000 7fdbd9c00640 1 -- 172.21.15.107:0/2250877522 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbd40aeab0 msgr2=0x7fdbd4067de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:52.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.583+0000 7fdbd9c00640 1 --2- 172.21.15.107:0/2250877522 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbd40aeab0 0x7fdbd4067de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:52.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.583+0000 7fdbd9c00640 1 -- 172.21.15.107:0/2250877522 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbcc009ae0 con 0x7fdbd40abfe0 2024-08-17T02:24:52.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.583+0000 7fdbd9c00640 1 --2- 172.21.15.107:0/2250877522 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdbd40abfe0 0x7fdbd40c9980 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdbc800c8b0 tx=0x7fdbc8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:52.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.583+0000 7fdbd0c00640 1 -- 172.21.15.107:0/2250877522 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc800ce40 con 0x7fdbd40abfe0 2024-08-17T02:24:52.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.583+0000 7fdbd0c00640 1 -- 172.21.15.107:0/2250877522 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc8007830 con 0x7fdbd40abfe0 2024-08-17T02:24:52.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.583+0000 7fdbd0c00640 1 -- 172.21.15.107:0/2250877522 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc8007bd0 con 0x7fdbd40abfe0 2024-08-17T02:24:52.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.583+0000 7fdbdb000640 1 -- 172.21.15.107:0/2250877522 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbd40c9030 con 0x7fdbd40abfe0 2024-08-17T02:24:52.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.583+0000 7fdbdb000640 1 -- 172.21.15.107:0/2250877522 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbd4068b60 con 0x7fdbd40abfe0 2024-08-17T02:24:52.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.584+0000 7fdbdb000640 1 -- 172.21.15.107:0/2250877522 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbd4071050 con 0x7fdbd40abfe0 2024-08-17T02:24:52.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.585+0000 7fdbd0c00640 1 -- 172.21.15.107:0/2250877522 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fdbc80113f0 con 0x7fdbd40abfe0 2024-08-17T02:24:52.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.586+0000 7fdbd0c00640 1 --2- 172.21.15.107:0/2250877522 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fdbb4065150 0x7fdbb4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:52.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.586+0000 7fdbd0c00640 1 -- 172.21.15.107:0/2250877522 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdbc8082780 con 0x7fdbd40abfe0 2024-08-17T02:24:52.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.586+0000 7fdbd9200640 1 --2- 172.21.15.107:0/2250877522 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fdbb4065150 0x7fdbb4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:52.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.587+0000 7fdbd9200640 1 --2- 172.21.15.107:0/2250877522 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fdbb4065150 0x7fdbb4067600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdbd40b0de0 tx=0x7fdbc0007e10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:52.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.590+0000 7fdbd0c00640 1 -- 172.21.15.107:0/2250877522 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fdbc8050850 con 0x7fdbd40abfe0 2024-08-17T02:24:52.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.802+0000 7fdbdb000640 1 -- 172.21.15.107:0/2250877522 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdbd4151b60 con 0x7fdbd40abfe0 2024-08-17T02:24:52.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.802+0000 7fdbd0c00640 1 -- 172.21.15.107:0/2250877522 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fdbc8015060 con 0x7fdbd40abfe0 2024-08-17T02:24:52.804 INFO:teuthology.orchestra.run.smithi107.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:24:52.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.804+0000 7fdbdb000640 1 -- 172.21.15.107:0/2250877522 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fdbb4065150 msgr2=0x7fdbb4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:52.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.804+0000 7fdbdb000640 1 --2- 172.21.15.107:0/2250877522 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fdbb4065150 0x7fdbb4067600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdbd40b0de0 tx=0x7fdbc0007e10 comp rx=0 tx=0).stop 2024-08-17T02:24:52.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.804+0000 7fdbdb000640 1 -- 172.21.15.107:0/2250877522 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdbd40abfe0 msgr2=0x7fdbd40c9980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:52.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.804+0000 7fdbdb000640 1 --2- 172.21.15.107:0/2250877522 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdbd40abfe0 0x7fdbd40c9980 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdbc800c8b0 tx=0x7fdbc8008040 comp rx=0 tx=0).stop 2024-08-17T02:24:52.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.804+0000 7fdbdb000640 1 -- 172.21.15.107:0/2250877522 shutdown_connections 2024-08-17T02:24:52.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.804+0000 7fdbdb000640 1 --2- 172.21.15.107:0/2250877522 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fdbb4065150 0x7fdbb4067600 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:52.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.804+0000 7fdbdb000640 1 --2- 172.21.15.107:0/2250877522 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdbd4154760 0x7fdbd40c6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:52.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.804+0000 7fdbdb000640 1 --2- 172.21.15.107:0/2250877522 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdbd40aeab0 0x7fdbd4067de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:52.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.804+0000 7fdbdb000640 1 --2- 172.21.15.107:0/2250877522 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdbd40abfe0 0x7fdbd40c9980 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:52.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.804+0000 7fdbdb000640 1 -- 172.21.15.107:0/2250877522 >> 172.21.15.107:0/2250877522 conn(0x7fdbd4096a70 msgr2=0x7fdbd41520b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:52.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.804+0000 7fdbdb000640 1 -- 172.21.15.107:0/2250877522 shutdown_connections 2024-08-17T02:24:52.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:52.805+0000 7fdbdb000640 1 -- 172.21.15.107:0/2250877522 wait complete. 2024-08-17T02:24:52.821 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:24:52.821 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:24:52.821 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi157.front.sepia.ceph.com 2024-08-17T02:24:52.821 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-08-17T02:24:52.821 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-08-17T02:24:52.821 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:24:52.821 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:24:52.821 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:24:52.821 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-08-17T02:24:52.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:52.822 DEBUG:teuthology.orchestra.run.smithi157:> ip addr 2024-08-17T02:24:52.857 INFO:teuthology.orchestra.run.smithi157.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:24:52.857 INFO:teuthology.orchestra.run.smithi157.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:24:52.858 INFO:teuthology.orchestra.run.smithi157.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:24:52.858 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:52.858 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 ::1/128 scope host 2024-08-17T02:24:52.858 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:52.858 INFO:teuthology.orchestra.run.smithi157.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:24:52.858 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:d9:37:98 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:24:52.858 INFO:teuthology.orchestra.run.smithi157.stdout: altname enp7s0f0 2024-08-17T02:24:52.858 INFO:teuthology.orchestra.run.smithi157.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:24:52.858 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:d9:37:99 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:24:52.858 INFO:teuthology.orchestra.run.smithi157.stdout: altname enp7s0f1 2024-08-17T02:24:52.858 INFO:teuthology.orchestra.run.smithi157.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:24:52.858 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:88:7e:a0 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:24:52.859 INFO:teuthology.orchestra.run.smithi157.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:24:52.859 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:88:7e:a1 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:24:52.859 INFO:teuthology.orchestra.run.smithi157.stdout: inet 172.21.15.157/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:24:52.859 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft 42670sec preferred_lft 42670sec 2024-08-17T02:24:52.859 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 fe80::ec4:7aff:fe88:7ea1/64 scope link 2024-08-17T02:24:52.859 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:52.859 INFO:teuthology.orchestra.run.smithi157.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:24:52.859 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether c2:4d:d6:49:c7:b7 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:24:52.859 INFO:teuthology.orchestra.run.smithi157.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:24:52.859 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:52.859 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 fe80::98f3:a8ff:feda:eb81/64 scope link 2024-08-17T02:24:52.859 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:52.860 INFO:teuthology.orchestra.run.smithi157.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:24:52.860 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether c2:4d:d6:49:c7:b7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:24:52.860 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 fe80::c04d:d6ff:fe49:c7b7/64 scope link tentative 2024-08-17T02:24:52.860 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:52.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:52.861 DEBUG:teuthology.orchestra.run.smithi157:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:24:52.954 INFO:teuthology.orchestra.run.smithi157.stdout:1 2024-08-17T02:24:52.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:52.957 DEBUG:teuthology.orchestra.run.smithi157:> route 2024-08-17T02:24:52.993 INFO:teuthology.orchestra.run.smithi157.stdout:Kernel IP routing table 2024-08-17T02:24:52.993 INFO:teuthology.orchestra.run.smithi157.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:24:52.993 INFO:teuthology.orchestra.run.smithi157.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:24:52.993 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:24:52.993 INFO:teuthology.orchestra.run.smithi157.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:24:52.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:52.994 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2024-08-17T02:24:52.994 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2024-08-17T02:24:52.994 DEBUG:teuthology.orchestra.run.smithi157:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:24:52.994 DEBUG:teuthology.orchestra.run.smithi157:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:24:52.994 DEBUG:teuthology.orchestra.run.smithi157:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:24:52.994 DEBUG:teuthology.orchestra.run.smithi157:> ') 2024-08-17T02:24:53.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:53.140 DEBUG:teuthology.orchestra.run.smithi157:> ip netns list 2024-08-17T02:24:53.175 INFO:teuthology.orchestra.run.smithi157.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:24:53.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:53.175 DEBUG:teuthology.orchestra.run.smithi157:> ip netns list-id 2024-08-17T02:24:53.250 INFO:teuthology.orchestra.run.smithi157.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-08-17T02:24:53.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:53.251 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2024-08-17T02:24:53.251 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2024-08-17T02:24:53.251 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:24:53.251 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-08-17T02:24:53.251 DEBUG:teuthology.orchestra.run.smithi157:> ') 2024-08-17T02:24:53.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:53.377 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-17T02:24:53.433 INFO:teuthology.orchestra.run.smithi157.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:24:53.433 INFO:teuthology.orchestra.run.smithi157.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:24:53.433 INFO:teuthology.orchestra.run.smithi157.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:24:53.433 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:53.433 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 ::1/128 scope host 2024-08-17T02:24:53.433 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:53.434 INFO:teuthology.orchestra.run.smithi157.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:24:53.434 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether be:f7:34:29:f8:2d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:24:53.434 INFO:teuthology.orchestra.run.smithi157.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:24:53.434 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:53.434 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 fe80::bcf7:34ff:fe29:f82d/64 scope link 2024-08-17T02:24:53.434 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:53.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:53.436 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-17T02:24:53.494 INFO:teuthology.orchestra.run.smithi157.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:24:53.494 INFO:teuthology.orchestra.run.smithi157.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:24:53.494 INFO:teuthology.orchestra.run.smithi157.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:24:53.494 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:53.494 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 ::1/128 scope host 2024-08-17T02:24:53.494 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:53.495 INFO:teuthology.orchestra.run.smithi157.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:24:53.495 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether be:f7:34:29:f8:2d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:24:53.495 INFO:teuthology.orchestra.run.smithi157.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:24:53.495 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:53.495 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 fe80::bcf7:34ff:fe29:f82d/64 scope link 2024-08-17T02:24:53.495 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:24:53.497 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-08-17T02:24:53.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:53.497 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2024-08-17T02:24:53.498 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2024-08-17T02:24:53.498 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-08-17T02:24:53.498 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-17T02:24:53.498 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-08-17T02:24:53.498 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-08-17T02:24:53.498 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-08-17T02:24:53.498 DEBUG:teuthology.orchestra.run.smithi157:> ') 2024-08-17T02:24:53.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:53.668 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2024-08-17T02:24:53.668 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2024-08-17T02:24:53.668 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link set brx.1 up 2024-08-17T02:24:53.668 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link set dev brx.1 master ceph-brx 2024-08-17T02:24:53.668 DEBUG:teuthology.orchestra.run.smithi157:> ') 2024-08-17T02:24:53.783 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:24:53.783 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-08-17T02:24:53.818 INFO:teuthology.orchestra.run.smithi157.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-08-17T02:24:53.819 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:24:53.819 DEBUG:teuthology.orchestra.run.smithi157:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-08-17T02:24:53.894 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-08-17T02:24:53.894 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:24:53.894 DEBUG:teuthology.orchestra.run.smithi157:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:24:54.015 INFO:teuthology.orchestra.run.smithi157.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:24:54.016 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:24:54.041 INFO:teuthology.orchestra.run.smithi157.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:24:54.042 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:24:54.042 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: resolved to: "172.21.15.107:3300,172.21.15.157:3300,172.21.15.157:3301" 2024-08-17T02:24:54.042 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: trying mount with new device syntax: 3@f207b4c0-329d-46b8-b83f-aaf30bdb6ce3.cephfs=/ 2024-08-17T02:24:54.042 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.107:3300/172.21.15.157:3300/172.21.15.157:3301" will pass to kernel 2024-08-17T02:24:54.042 INFO:teuthology.orchestra.run.smithi157.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-08-17T02:24:54.043 INFO:teuthology.orchestra.run.smithi157.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:24:54.043 INFO:teuthology.orchestra.run.smithi157.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:24:54.043 INFO:teuthology.orchestra.run.smithi157.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:24:54.043 INFO:teuthology.orchestra.run.smithi157.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:24:54.046 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:24:54.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:24:54.046 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-08-17T02:24:54.102 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-08-17T02:24:54.119 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:54.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.275+0000 7f75c2000640 1 Processor -- start 2024-08-17T02:24:54.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.275+0000 7f75c2000640 1 -- start start 2024-08-17T02:24:54.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.276+0000 7f75c2000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f75bc1401b0 0x7f75bc0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.276+0000 7f75c2000640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f75bc0b1440 0x7f75bc0c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.276+0000 7f75c2000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75bc0caa80 con 0x7f75bc140580 2024-08-17T02:24:54.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.276+0000 7f75c2000640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75bc0cb450 con 0x7f75bc0b1440 2024-08-17T02:24:54.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.276+0000 7f75c2000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc0c9e70 con 0x7f75bc1401b0 2024-08-17T02:24:54.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.276+0000 7f75b2a00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f75bc140580 0x7f75bc0b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:55646/0 (socket says 172.21.15.107:55646) 2024-08-17T02:24:54.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.276+0000 7f75b2a00640 1 -- 172.21.15.107:0/2412519343 learned_addr learned my addr 172.21.15.107:0/2412519343 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:54.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.277+0000 7f75bb400640 1 --2- 172.21.15.107:0/2412519343 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f75bc1401b0 0x7f75bc0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.277+0000 7f75bbe00640 1 --2- 172.21.15.107:0/2412519343 >> v2:172.21.15.157:3300/0 conn(0x7f75bc0b1440 0x7f75bc0c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.277+0000 7f75baa00640 1 -- 172.21.15.107:0/2412519343 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 145438112 0 0) 0x7f75bc0caa80 con 0x7f75bc140580 2024-08-17T02:24:54.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.277+0000 7f75baa00640 1 -- 172.21.15.107:0/2412519343 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75a00034e0 con 0x7f75bc140580 2024-08-17T02:24:54.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.277+0000 7f75bb400640 1 -- 172.21.15.107:0/2412519343 >> v2:172.21.15.157:3300/0 conn(0x7f75bc0b1440 msgr2=0x7f75bc0c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:54.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.277+0000 7f75bb400640 1 --2- 172.21.15.107:0/2412519343 >> v2:172.21.15.157:3300/0 conn(0x7f75bc0b1440 0x7f75bc0c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.277+0000 7f75bb400640 1 -- 172.21.15.107:0/2412519343 >> v1:172.21.15.107:6789/0 conn(0x7f75bc140580 legacy=0x7f75bc0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:54.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.277+0000 7f75bb400640 1 -- 172.21.15.107:0/2412519343 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75bc0ca150 con 0x7f75bc1401b0 2024-08-17T02:24:54.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.278+0000 7f75bb400640 1 --2- 172.21.15.107:0/2412519343 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f75bc1401b0 0x7f75bc0caf10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f75ac009850 tx=0x7f75ac0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b56c3a19d306e0cd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:54.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.278+0000 7f75baa00640 1 -- 172.21.15.107:0/2412519343 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ac02ad00 con 0x7f75bc1401b0 2024-08-17T02:24:54.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.278+0000 7f75baa00640 1 -- 172.21.15.107:0/2412519343 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ac02ae60 con 0x7f75bc1401b0 2024-08-17T02:24:54.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.278+0000 7f75baa00640 1 -- 172.21.15.107:0/2412519343 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ac032670 con 0x7f75bc1401b0 2024-08-17T02:24:54.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.279+0000 7f75c2000640 1 -- 172.21.15.107:0/2412519343 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f75bc1401b0 msgr2=0x7f75bc0caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:54.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.279+0000 7f75c2000640 1 --2- 172.21.15.107:0/2412519343 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f75bc1401b0 0x7f75bc0caf10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f75ac009850 tx=0x7f75ac0090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.279+0000 7f75c2000640 1 -- 172.21.15.107:0/2412519343 shutdown_connections 2024-08-17T02:24:54.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.279+0000 7f75c2000640 1 --2- 172.21.15.107:0/2412519343 >> v2:172.21.15.157:3300/0 conn(0x7f75bc0b1440 0x7f75bc0c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.279+0000 7f75c2000640 1 --2- 172.21.15.107:0/2412519343 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f75bc1401b0 0x7f75bc0caf10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.279+0000 7f75c2000640 1 -- 172.21.15.107:0/2412519343 >> 172.21.15.107:0/2412519343 conn(0x7f75bc0cb9b0 msgr2=0x7f75bc0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:54.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.279+0000 7f75c2000640 1 -- 172.21.15.107:0/2412519343 shutdown_connections 2024-08-17T02:24:54.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.279+0000 7f75c2000640 1 -- 172.21.15.107:0/2412519343 wait complete. 2024-08-17T02:24:54.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.280+0000 7f75c2000640 1 Processor -- start 2024-08-17T02:24:54.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.280+0000 7f75c2000640 1 -- start start 2024-08-17T02:24:54.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.281+0000 7f75c2000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75bc0b1440 0x7f75bc15a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.281+0000 7f75c2000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f75bc1401b0 0x7f75bc15ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.281+0000 7f75c2000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f75bc140580 0x7f75bc13b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.281+0000 7f75c2000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc15dbe0 con 0x7f75bc0b1440 2024-08-17T02:24:54.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.281+0000 7f75c2000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc15e9d0 con 0x7f75bc140580 2024-08-17T02:24:54.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.281+0000 7f75c2000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc15ddc0 con 0x7f75bc1401b0 2024-08-17T02:24:54.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.281+0000 7f75bb400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75bc0b1440 0x7f75bc15a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.281+0000 7f75bb400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75bc0b1440 0x7f75bc15a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41964/0 (socket says 172.21.15.107:41964) 2024-08-17T02:24:54.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.281+0000 7f75bb400640 1 -- 172.21.15.107:0/2534090032 learned_addr learned my addr 172.21.15.107:0/2534090032 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:54.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.282+0000 7f75bbe00640 1 --2- 172.21.15.107:0/2534090032 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f75bc140580 0x7f75bc13b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.282+0000 7f75b2a00640 1 --2- 172.21.15.107:0/2534090032 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f75bc1401b0 0x7f75bc15ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.282+0000 7f75bb400640 1 -- 172.21.15.107:0/2534090032 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f75bc1401b0 msgr2=0x7f75bc15ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:54.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.282+0000 7f75bb400640 1 --2- 172.21.15.107:0/2534090032 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f75bc1401b0 0x7f75bc15ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.282+0000 7f75bb400640 1 -- 172.21.15.107:0/2534090032 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f75bc140580 msgr2=0x7f75bc13b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:54.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.282+0000 7f75bb400640 1 --2- 172.21.15.107:0/2534090032 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f75bc140580 0x7f75bc13b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.282+0000 7f75bb400640 1 -- 172.21.15.107:0/2534090032 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ac009390 con 0x7f75bc0b1440 2024-08-17T02:24:54.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.282+0000 7f75b2a00640 1 --2- 172.21.15.107:0/2534090032 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f75bc1401b0 0x7f75bc15ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:54.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.282+0000 7f75bb400640 1 --2- 172.21.15.107:0/2534090032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75bc0b1440 0x7f75bc15a640 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f75ac009360 tx=0x7f75ac032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:54.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.282+0000 7f75b3400640 1 -- 172.21.15.107:0/2534090032 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ac03b6e0 con 0x7f75bc0b1440 2024-08-17T02:24:54.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.282+0000 7f75b3400640 1 -- 172.21.15.107:0/2534090032 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ac03b840 con 0x7f75bc0b1440 2024-08-17T02:24:54.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.282+0000 7f75b3400640 1 -- 172.21.15.107:0/2534090032 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ac03bbe0 con 0x7f75bc0b1440 2024-08-17T02:24:54.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.282+0000 7f75c2000640 1 -- 172.21.15.107:0/2534090032 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75bc15e0a0 con 0x7f75bc0b1440 2024-08-17T02:24:54.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.283+0000 7f75c2000640 1 -- 172.21.15.107:0/2534090032 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75bc15e660 con 0x7f75bc0b1440 2024-08-17T02:24:54.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.283+0000 7f75c2000640 1 -- 172.21.15.107:0/2534090032 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75bc064db0 con 0x7f75bc0b1440 2024-08-17T02:24:54.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.284+0000 7f75b3400640 1 -- 172.21.15.107:0/2534090032 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f75ac043030 con 0x7f75bc0b1440 2024-08-17T02:24:54.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.285+0000 7f75b3400640 1 --2- 172.21.15.107:0/2534090032 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7598065180 0x7f7598067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.286+0000 7f75b3400640 1 -- 172.21.15.107:0/2534090032 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f75ac041070 con 0x7f75bc0b1440 2024-08-17T02:24:54.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.286+0000 7f75b2a00640 1 --2- 172.21.15.107:0/2534090032 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7598065180 0x7f7598067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.286+0000 7f75b2a00640 1 --2- 172.21.15.107:0/2534090032 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7598065180 0x7f7598067630 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f75bc0c8410 tx=0x7f75a4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:54.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.291+0000 7f75b3400640 1 -- 172.21.15.107:0/2534090032 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f75ac070a20 con 0x7f75bc0b1440 2024-08-17T02:24:54.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.463+0000 7f75c2000640 1 -- 172.21.15.107:0/2534090032 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75bc15bfe0 con 0x7f75bc0b1440 2024-08-17T02:24:54.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.464+0000 7f75b3400640 1 -- 172.21.15.107:0/2534090032 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f75ac037090 con 0x7f75bc0b1440 2024-08-17T02:24:54.465 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:24:54.465 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":21,"fsid":"f207b4c0-329d-46b8-b83f-aaf30bdb6ce3","created":"2024-08-17T02:24:11.038049+0000","modified":"2024-08-17T02:24:30.420018+0000","last_up_change":"2024-08-17T02:24:22.047790+0000","last_in_change":"2024-08-17T02:24:13.892720+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:23.456166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:27.078670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:27.804418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"376363f3-b8bf-4f1e-b691-51cdd39171ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37302},{"type":"v1","addr":"172.21.15.107:6801","nonce":37302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37302},{"type":"v1","addr":"172.21.15.107:6803","nonce":37302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37302},{"type":"v1","addr":"172.21.15.107:6807","nonce":37302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37302},{"type":"v1","addr":"172.21.15.107:6805","nonce":37302}]},"public_addr":"172.21.15.107:6801/37302","cluster_addr":"172.21.15.107:6803/37302","heartbeat_back_addr":"172.21.15.107:6807/37302","heartbeat_front_addr":"172.21.15.107:6805/37302","state":["exists","up"]},{"osd":1,"uuid":"cc6624e3-2ad4-4db4-b377-05dfe57424e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37305},{"type":"v1","addr":"172.21.15.107:6824","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37305},{"type":"v1","addr":"172.21.15.107:6827","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37305},{"type":"v1","addr":"172.21.15.107:6831","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37305},{"type":"v1","addr":"172.21.15.107:6829","nonce":37305}]},"public_addr":"172.21.15.107:6824/37305","cluster_addr":"172.21.15.107:6827/37305","heartbeat_back_addr":"172.21.15.107:6831/37305","heartbeat_front_addr":"172.21.15.107:6829/37305","state":["exists","up"]},{"osd":2,"uuid":"25229542-29b5-4281-bcb0-798ae0930aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37307},{"type":"v1","addr":"172.21.15.107:6817","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37307},{"type":"v1","addr":"172.21.15.107:6819","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6823","nonce":37307},{"type":"v1","addr":"172.21.15.107:6825","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37307},{"type":"v1","addr":"172.21.15.107:6821","nonce":37307}]},"public_addr":"172.21.15.107:6817/37307","cluster_addr":"172.21.15.107:6819/37307","heartbeat_back_addr":"172.21.15.107:6825/37307","heartbeat_front_addr":"172.21.15.107:6821/37307","state":["exists","up"]},{"osd":3,"uuid":"5f16aee8-8950-4268-a61a-5cf6ebd670e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37306},{"type":"v1","addr":"172.21.15.107:6809","nonce":37306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37306},{"type":"v1","addr":"172.21.15.107:6811","nonce":37306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37306},{"type":"v1","addr":"172.21.15.107:6815","nonce":37306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37306},{"type":"v1","addr":"172.21.15.107:6813","nonce":37306}]},"public_addr":"172.21.15.107:6809/37306","cluster_addr":"172.21.15.107:6811/37306","heartbeat_back_addr":"172.21.15.107:6815/37306","heartbeat_front_addr":"172.21.15.107:6813/37306","state":["exists","up"]},{"osd":4,"uuid":"23232e28-e23b-4b4e-a531-4939246dbbde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":37329},{"type":"v1","addr":"172.21.15.157:6817","nonce":37329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":37329},{"type":"v1","addr":"172.21.15.157:6819","nonce":37329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":37329},{"type":"v1","addr":"172.21.15.157:6823","nonce":37329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":37329},{"type":"v1","addr":"172.21.15.157:6821","nonce":37329}]},"public_addr":"172.21.15.157:6817/37329","cluster_addr":"172.21.15.157:6819/37329","heartbeat_back_addr":"172.21.15.157:6823/37329","heartbeat_front_addr":"172.21.15.157:6821/37329","state":["exists","up"]},{"osd":5,"uuid":"f87ec331-3e59-4886-a317-6f7e26ec8e21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":37328},{"type":"v1","addr":"172.21.15.157:6804","nonce":37328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":37328},{"type":"v1","addr":"172.21.15.157:6808","nonce":37328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":37328},{"type":"v1","addr":"172.21.15.157:6815","nonce":37328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":37328},{"type":"v1","addr":"172.21.15.157:6812","nonce":37328}]},"public_addr":"172.21.15.157:6804/37328","cluster_addr":"172.21.15.157:6808/37328","heartbeat_back_addr":"172.21.15.157:6815/37328","heartbeat_front_addr":"172.21.15.157:6812/37328","state":["exists","up"]},{"osd":6,"uuid":"92852235-ce49-4d96-a940-6f18d97b13ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":37330},{"type":"v1","addr":"172.21.15.157:6801","nonce":37330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6803","nonce":37330},{"type":"v1","addr":"172.21.15.157:6805","nonce":37330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":37330},{"type":"v1","addr":"172.21.15.157:6813","nonce":37330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":37330},{"type":"v1","addr":"172.21.15.157:6809","nonce":37330}]},"public_addr":"172.21.15.157:6801/37330","cluster_addr":"172.21.15.157:6805/37330","heartbeat_back_addr":"172.21.15.157:6813/37330","heartbeat_front_addr":"172.21.15.157:6809/37330","state":["exists","up"]},{"osd":7,"uuid":"7484a061-723d-4663-b28f-b01766d62f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":37373},{"type":"v1","addr":"172.21.15.157:6825","nonce":37373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":37373},{"type":"v1","addr":"172.21.15.157:6827","nonce":37373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":37373},{"type":"v1","addr":"172.21.15.157:6831","nonce":37373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":37373},{"type":"v1","addr":"172.21.15.157:6829","nonce":37373}]},"public_addr":"172.21.15.157:6825/37373","cluster_addr":"172.21.15.157:6827/37373","heartbeat_back_addr":"172.21.15.157:6831/37373","heartbeat_front_addr":"172.21.15.157:6829/37373","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.110188+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.280265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.252119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.267996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.284582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.144420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.174764+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.308002+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:54.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.466+0000 7f75c2000640 1 -- 172.21.15.107:0/2534090032 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7598065180 msgr2=0x7f7598067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:54.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.466+0000 7f75c2000640 1 --2- 172.21.15.107:0/2534090032 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7598065180 0x7f7598067630 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f75bc0c8410 tx=0x7f75a4009040 comp rx=0 tx=0).stop 2024-08-17T02:24:54.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.466+0000 7f75c2000640 1 -- 172.21.15.107:0/2534090032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75bc0b1440 msgr2=0x7f75bc15a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:54.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.466+0000 7f75c2000640 1 --2- 172.21.15.107:0/2534090032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75bc0b1440 0x7f75bc15a640 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f75ac009360 tx=0x7f75ac032000 comp rx=0 tx=0).stop 2024-08-17T02:24:54.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.466+0000 7f75c2000640 1 -- 172.21.15.107:0/2534090032 shutdown_connections 2024-08-17T02:24:54.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.466+0000 7f75c2000640 1 --2- 172.21.15.107:0/2534090032 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7598065180 0x7f7598067630 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.466+0000 7f75c2000640 1 --2- 172.21.15.107:0/2534090032 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f75bc140580 0x7f75bc13b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.466+0000 7f75c2000640 1 --2- 172.21.15.107:0/2534090032 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f75bc1401b0 0x7f75bc15ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.466+0000 7f75c2000640 1 --2- 172.21.15.107:0/2534090032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75bc0b1440 0x7f75bc15a640 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.466+0000 7f75c2000640 1 -- 172.21.15.107:0/2534090032 >> 172.21.15.107:0/2534090032 conn(0x7f75bc0cb9b0 msgr2=0x7f75bc0b09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:54.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.466+0000 7f75c2000640 1 -- 172.21.15.107:0/2534090032 shutdown_connections 2024-08-17T02:24:54.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.466+0000 7f75c2000640 1 -- 172.21.15.107:0/2534090032 wait complete. 2024-08-17T02:24:54.483 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:24:23.456166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:24:27.078670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:24:27.804418+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:24:54.484 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:24:54.634 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.634+0000 7fe691000640 1 Processor -- start 2024-08-17T02:24:54.634 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.634+0000 7fe691000640 1 -- start start 2024-08-17T02:24:54.636 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.635+0000 7fe691000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe68c153320 0x7fe68c0aacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.636 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.635+0000 7fe691000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe68c159340 0x7fe68c066cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.636 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.635+0000 7fe691000640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe68c067210 0x7fe68c0addd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.636 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.635+0000 7fe691000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe68c06e700 con 0x7fe68c153320 2024-08-17T02:24:54.636 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.635+0000 7fe691000640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe68c0ad940 con 0x7fe68c067210 2024-08-17T02:24:54.636 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.635+0000 7fe691000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe68c067650 con 0x7fe68c159340 2024-08-17T02:24:54.636 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.635+0000 7fe689e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe68c153320 0x7fe68c0aacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.636 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.635+0000 7fe689e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe68c153320 0x7fe68c0aacb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41968/0 (socket says 172.21.15.107:41968) 2024-08-17T02:24:54.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.635+0000 7fe689e00640 1 -- 172.21.15.107:0/2630073697 learned_addr learned my addr 172.21.15.107:0/2630073697 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:54.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.636+0000 7fe68a800640 1 --2- 172.21.15.107:0/2630073697 >> v2:172.21.15.157:3300/0 conn(0x7fe68c067210 0x7fe68c0addd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.636+0000 7fe689400640 1 --2- 172.21.15.107:0/2630073697 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe68c159340 0x7fe68c066cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.636+0000 7fe689e00640 1 -- 172.21.15.107:0/2630073697 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe68c159340 msgr2=0x7fe68c066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:54.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.636+0000 7fe689e00640 1 --2- 172.21.15.107:0/2630073697 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe68c159340 0x7fe68c066cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.636+0000 7fe689e00640 1 -- 172.21.15.107:0/2630073697 >> v2:172.21.15.157:3300/0 conn(0x7fe68c067210 msgr2=0x7fe68c0addd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:54.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.636+0000 7fe689e00640 1 --2- 172.21.15.107:0/2630073697 >> v2:172.21.15.157:3300/0 conn(0x7fe68c067210 0x7fe68c0addd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.636+0000 7fe689e00640 1 -- 172.21.15.107:0/2630073697 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe68c159b20 con 0x7fe68c153320 2024-08-17T02:24:54.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.637+0000 7fe689e00640 1 --2- 172.21.15.107:0/2630073697 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe68c153320 0x7fe68c0aacb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe68c156f10 tx=0x7fe67c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef4c48b43544e7a0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:54.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.637+0000 7fe688a00640 1 -- 172.21.15.107:0/2630073697 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67c02ad40 con 0x7fe68c153320 2024-08-17T02:24:54.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.637+0000 7fe688a00640 1 -- 172.21.15.107:0/2630073697 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe67c032440 con 0x7fe68c153320 2024-08-17T02:24:54.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.637+0000 7fe688a00640 1 -- 172.21.15.107:0/2630073697 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67c02aea0 con 0x7fe68c153320 2024-08-17T02:24:54.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.637+0000 7fe691000640 1 -- 172.21.15.107:0/2630073697 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe68c153320 msgr2=0x7fe68c0aacb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:54.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.637+0000 7fe691000640 1 --2- 172.21.15.107:0/2630073697 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe68c153320 0x7fe68c0aacb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe68c156f10 tx=0x7fe67c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.638+0000 7fe691000640 1 -- 172.21.15.107:0/2630073697 shutdown_connections 2024-08-17T02:24:54.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.638+0000 7fe691000640 1 --2- 172.21.15.107:0/2630073697 >> v2:172.21.15.157:3300/0 conn(0x7fe68c067210 0x7fe68c0addd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.638+0000 7fe691000640 1 --2- 172.21.15.107:0/2630073697 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe68c159340 0x7fe68c066cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.638+0000 7fe691000640 1 --2- 172.21.15.107:0/2630073697 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe68c153320 0x7fe68c0aacb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.638+0000 7fe691000640 1 -- 172.21.15.107:0/2630073697 >> 172.21.15.107:0/2630073697 conn(0x7fe68c06d8b0 msgr2=0x7fe68c06dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:54.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.638+0000 7fe691000640 1 -- 172.21.15.107:0/2630073697 shutdown_connections 2024-08-17T02:24:54.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.638+0000 7fe691000640 1 -- 172.21.15.107:0/2630073697 wait complete. 2024-08-17T02:24:54.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.639+0000 7fe691000640 1 Processor -- start 2024-08-17T02:24:54.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.639+0000 7fe691000640 1 -- start start 2024-08-17T02:24:54.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.640+0000 7fe691000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe68c067210 0x7fe68c169af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.640+0000 7fe691000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe68c153320 0x7fe68c13ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.640+0000 7fe691000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe68c159340 0x7fe68c0b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.640+0000 7fe691000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68c150cc0 con 0x7fe68c067210 2024-08-17T02:24:54.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.640+0000 7fe691000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68c16a030 con 0x7fe68c153320 2024-08-17T02:24:54.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.640+0000 7fe691000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe68c0b0110 con 0x7fe68c159340 2024-08-17T02:24:54.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.640+0000 7fe689e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe68c067210 0x7fe68c169af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.640+0000 7fe689e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe68c067210 0x7fe68c169af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41974/0 (socket says 172.21.15.107:41974) 2024-08-17T02:24:54.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.640+0000 7fe689e00640 1 -- 172.21.15.107:0/2753845610 learned_addr learned my addr 172.21.15.107:0/2753845610 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:54.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.640+0000 7fe689400640 1 --2- 172.21.15.107:0/2753845610 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe68c153320 0x7fe68c13ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.640+0000 7fe68a800640 1 --2- 172.21.15.107:0/2753845610 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe68c159340 0x7fe68c0b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.641+0000 7fe689e00640 1 -- 172.21.15.107:0/2753845610 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe68c159340 msgr2=0x7fe68c0b11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:54.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.641+0000 7fe689e00640 1 --2- 172.21.15.107:0/2753845610 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe68c159340 0x7fe68c0b11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.641+0000 7fe689e00640 1 -- 172.21.15.107:0/2753845610 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe68c153320 msgr2=0x7fe68c13ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:54.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.641+0000 7fe689e00640 1 --2- 172.21.15.107:0/2753845610 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe68c153320 0x7fe68c13ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.641+0000 7fe689e00640 1 -- 172.21.15.107:0/2753845610 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe67c009450 con 0x7fe68c067210 2024-08-17T02:24:54.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.641+0000 7fe689e00640 1 --2- 172.21.15.107:0/2753845610 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe68c067210 0x7fe68c169af0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe67c009210 tx=0x7fe67c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:54.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.641+0000 7fe681600640 1 -- 172.21.15.107:0/2753845610 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67c031a60 con 0x7fe68c067210 2024-08-17T02:24:54.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.641+0000 7fe681600640 1 -- 172.21.15.107:0/2753845610 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe67c031be0 con 0x7fe68c067210 2024-08-17T02:24:54.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.641+0000 7fe681600640 1 -- 172.21.15.107:0/2753845610 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67c03d420 con 0x7fe68c067210 2024-08-17T02:24:54.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.641+0000 7fe691000640 1 -- 172.21.15.107:0/2753845610 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe68c0b03f0 con 0x7fe68c067210 2024-08-17T02:24:54.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.641+0000 7fe691000640 1 -- 172.21.15.107:0/2753845610 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe68c0b09b0 con 0x7fe68c067210 2024-08-17T02:24:54.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.642+0000 7fe691000640 1 -- 172.21.15.107:0/2753845610 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe68c064570 con 0x7fe68c067210 2024-08-17T02:24:54.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.643+0000 7fe681600640 1 -- 172.21.15.107:0/2753845610 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe67c039040 con 0x7fe68c067210 2024-08-17T02:24:54.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.644+0000 7fe681600640 1 --2- 172.21.15.107:0/2753845610 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe66c065150 0x7fe66c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.644+0000 7fe681600640 1 -- 172.21.15.107:0/2753845610 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe67c0a1fd0 con 0x7fe68c067210 2024-08-17T02:24:54.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.645+0000 7fe689400640 1 --2- 172.21.15.107:0/2753845610 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe66c065150 0x7fe66c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.645+0000 7fe689400640 1 --2- 172.21.15.107:0/2753845610 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe66c065150 0x7fe66c067600 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe68c06a900 tx=0x7fe678008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:54.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.648+0000 7fe681600640 1 -- 172.21.15.107:0/2753845610 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe68c064570 con 0x7fe68c067210 2024-08-17T02:24:54.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.819+0000 7fe691000640 1 -- 172.21.15.107:0/2753845610 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe68c064570 con 0x7fe68c067210 2024-08-17T02:24:54.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.820+0000 7fe681600640 1 -- 172.21.15.107:0/2753845610 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe67c042020 con 0x7fe68c067210 2024-08-17T02:24:54.820 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2024-08-17T02:24:54.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.822+0000 7fe691000640 1 -- 172.21.15.107:0/2753845610 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe66c065150 msgr2=0x7fe66c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:54.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.822+0000 7fe691000640 1 --2- 172.21.15.107:0/2753845610 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe66c065150 0x7fe66c067600 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe68c06a900 tx=0x7fe678008040 comp rx=0 tx=0).stop 2024-08-17T02:24:54.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.822+0000 7fe691000640 1 -- 172.21.15.107:0/2753845610 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe68c067210 msgr2=0x7fe68c169af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:54.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.822+0000 7fe691000640 1 --2- 172.21.15.107:0/2753845610 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe68c067210 0x7fe68c169af0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe67c009210 tx=0x7fe67c032000 comp rx=0 tx=0).stop 2024-08-17T02:24:54.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.822+0000 7fe691000640 1 -- 172.21.15.107:0/2753845610 shutdown_connections 2024-08-17T02:24:54.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.822+0000 7fe691000640 1 --2- 172.21.15.107:0/2753845610 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe66c065150 0x7fe66c067600 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.822+0000 7fe691000640 1 --2- 172.21.15.107:0/2753845610 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe68c159340 0x7fe68c0b11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.822+0000 7fe691000640 1 --2- 172.21.15.107:0/2753845610 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe68c153320 0x7fe68c13ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.822+0000 7fe691000640 1 --2- 172.21.15.107:0/2753845610 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe68c067210 0x7fe68c169af0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.822+0000 7fe691000640 1 -- 172.21.15.107:0/2753845610 >> 172.21.15.107:0/2753845610 conn(0x7fe68c06d8b0 msgr2=0x7fe68c0addd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:54.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.822+0000 7fe691000640 1 -- 172.21.15.107:0/2753845610 shutdown_connections 2024-08-17T02:24:54.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.822+0000 7fe691000640 1 -- 172.21.15.107:0/2753845610 wait complete. 2024-08-17T02:24:54.838 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:24:54.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.988+0000 7f51a3a00640 1 Processor -- start 2024-08-17T02:24:54.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.988+0000 7f51a3a00640 1 -- start start 2024-08-17T02:24:54.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.989+0000 7f51a3a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f519c155a80 0x7f519c06dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.990 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.989+0000 7f51a3a00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f519c0c7db0 0x7f519c0c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.990 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.989+0000 7f51a3a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f519c155e50 0x7f519c0c9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.990 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.989+0000 7f51a3a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f519c1598f0 con 0x7f519c155e50 2024-08-17T02:24:54.990 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.989+0000 7f51a3a00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f519c159bd0 con 0x7f519c0c7db0 2024-08-17T02:24:54.990 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.989+0000 7f51a3a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f519c159eb0 con 0x7f519c155a80 2024-08-17T02:24:54.990 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.989+0000 7f51a1a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f519c155e50 0x7f519c0c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.990 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.989+0000 7f51a1a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f519c155e50 0x7f519c0c9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41990/0 (socket says 172.21.15.107:41990) 2024-08-17T02:24:54.990 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.989+0000 7f51a1a00640 1 -- 172.21.15.107:0/1814938862 learned_addr learned my addr 172.21.15.107:0/1814938862 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:54.990 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.989+0000 7f5193e00640 1 --2- 172.21.15.107:0/1814938862 >> v2:172.21.15.157:3300/0 conn(0x7f519c0c7db0 0x7f519c0c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.990 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.989+0000 7f51a1000640 1 --2- 172.21.15.107:0/1814938862 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f519c155a80 0x7f519c06dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.990 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.990+0000 7f51a1a00640 1 -- 172.21.15.107:0/1814938862 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f519c155a80 msgr2=0x7f519c06dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:54.990 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.990+0000 7f51a1a00640 1 --2- 172.21.15.107:0/1814938862 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f519c155a80 0x7f519c06dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.990+0000 7f51a1a00640 1 -- 172.21.15.107:0/1814938862 >> v2:172.21.15.157:3300/0 conn(0x7f519c0c7db0 msgr2=0x7f519c0c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:54.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.990+0000 7f51a1a00640 1 --2- 172.21.15.107:0/1814938862 >> v2:172.21.15.157:3300/0 conn(0x7f519c0c7db0 0x7f519c0c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.990+0000 7f51a1a00640 1 -- 172.21.15.107:0/1814938862 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519c15a190 con 0x7f519c155e50 2024-08-17T02:24:54.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.991+0000 7f51a1a00640 1 --2- 172.21.15.107:0/1814938862 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f519c155e50 0x7f519c0c9110 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f519c068570 tx=0x7f5194009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59b533e0a7ee84a8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:54.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.991+0000 7f519be00640 1 -- 172.21.15.107:0/1814938862 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5194031400 con 0x7f519c155e50 2024-08-17T02:24:54.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.991+0000 7f519be00640 1 -- 172.21.15.107:0/1814938862 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519402d050 con 0x7f519c155e50 2024-08-17T02:24:54.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.991+0000 7f519be00640 1 -- 172.21.15.107:0/1814938862 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51940317d0 con 0x7f519c155e50 2024-08-17T02:24:54.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.991+0000 7f51a3a00640 1 -- 172.21.15.107:0/1814938862 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f519c155e50 msgr2=0x7f519c0c9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:54.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.991+0000 7f51a3a00640 1 --2- 172.21.15.107:0/1814938862 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f519c155e50 0x7f519c0c9110 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f519c068570 tx=0x7f5194009840 comp rx=0 tx=0).stop 2024-08-17T02:24:54.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.991+0000 7f51a3a00640 1 -- 172.21.15.107:0/1814938862 shutdown_connections 2024-08-17T02:24:54.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.992+0000 7f51a3a00640 1 --2- 172.21.15.107:0/1814938862 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f519c155e50 0x7f519c0c9110 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.992+0000 7f51a3a00640 1 --2- 172.21.15.107:0/1814938862 >> v2:172.21.15.157:3300/0 conn(0x7f519c0c7db0 0x7f519c0c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.992+0000 7f51a3a00640 1 --2- 172.21.15.107:0/1814938862 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f519c155a80 0x7f519c06dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.992+0000 7f51a3a00640 1 -- 172.21.15.107:0/1814938862 >> 172.21.15.107:0/1814938862 conn(0x7f519c067750 msgr2=0x7f519c0c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:54.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.992+0000 7f51a3a00640 1 -- 172.21.15.107:0/1814938862 shutdown_connections 2024-08-17T02:24:54.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.992+0000 7f51a3a00640 1 -- 172.21.15.107:0/1814938862 wait complete. 2024-08-17T02:24:54.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.993+0000 7f51a3a00640 1 Processor -- start 2024-08-17T02:24:54.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.993+0000 7f51a3a00640 1 -- start start 2024-08-17T02:24:54.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.994+0000 7f51a3a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f519c0c7db0 0x7f519c14df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.994+0000 7f51a3a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f519c155a80 0x7f519c14fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.994+0000 7f51a3a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f519c155e50 0x7f519c158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.994+0000 7f51a3a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519c156340 con 0x7f519c0c7db0 2024-08-17T02:24:54.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.994+0000 7f51a3a00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519c1538c0 con 0x7f519c155e50 2024-08-17T02:24:54.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.994+0000 7f51a3a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f519c1568c0 con 0x7f519c155a80 2024-08-17T02:24:54.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.994+0000 7f51a1000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f519c0c7db0 0x7f519c14df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.994+0000 7f51a1000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f519c0c7db0 0x7f519c14df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41992/0 (socket says 172.21.15.107:41992) 2024-08-17T02:24:54.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.994+0000 7f51a1000640 1 -- 172.21.15.107:0/304334471 learned_addr learned my addr 172.21.15.107:0/304334471 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:54.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.995+0000 7f51a1000640 1 -- 172.21.15.107:0/304334471 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f519c155a80 msgr2=0x7f519c14fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:54.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.995+0000 7f51a1000640 1 --2- 172.21.15.107:0/304334471 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f519c155a80 0x7f519c14fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.995+0000 7f51a1000640 1 -- 172.21.15.107:0/304334471 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f519c155e50 msgr2=0x7f519c158100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:54.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.995+0000 7f51a1000640 1 --2- 172.21.15.107:0/304334471 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f519c155e50 0x7f519c158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.995+0000 7f51a1000640 1 -- 172.21.15.107:0/304334471 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5194009ae0 con 0x7f519c0c7db0 2024-08-17T02:24:54.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.995+0000 7f51a1000640 1 --2- 172.21.15.107:0/304334471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f519c0c7db0 0x7f519c14df80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f518c00d890 tx=0x7f518c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:54.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.995+0000 7f5198c00640 1 -- 172.21.15.107:0/304334471 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518c00de20 con 0x7f519c0c7db0 2024-08-17T02:24:54.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.995+0000 7f5198c00640 1 -- 172.21.15.107:0/304334471 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f518c00b8d0 con 0x7f519c0c7db0 2024-08-17T02:24:54.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.995+0000 7f5198c00640 1 -- 172.21.15.107:0/304334471 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518c00bc90 con 0x7f519c0c7db0 2024-08-17T02:24:54.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.995+0000 7f51a3a00640 1 -- 172.21.15.107:0/304334471 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f519c158ce0 con 0x7f519c0c7db0 2024-08-17T02:24:54.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.995+0000 7f51a3a00640 1 -- 172.21.15.107:0/304334471 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f519c1565d0 con 0x7f519c0c7db0 2024-08-17T02:24:54.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.996+0000 7f51a3a00640 1 -- 172.21.15.107:0/304334471 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f519c1591c0 con 0x7f519c0c7db0 2024-08-17T02:24:54.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.997+0000 7f5198c00640 1 -- 172.21.15.107:0/304334471 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f518c014640 con 0x7f519c0c7db0 2024-08-17T02:24:54.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.998+0000 7f5198c00640 1 --2- 172.21.15.107:0/304334471 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f5178065150 0x7f5178067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.998+0000 7f5198c00640 1 -- 172.21.15.107:0/304334471 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f518c082b80 con 0x7f519c0c7db0 2024-08-17T02:24:54.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.999+0000 7f5193e00640 1 --2- 172.21.15.107:0/304334471 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f5178065150 0x7f5178067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:54.999+0000 7f5193e00640 1 --2- 172.21.15.107:0/304334471 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f5178065150 0x7f5178067600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f519c151c40 tx=0x7f518400b3b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.002+0000 7f5198c00640 1 -- 172.21.15.107:0/304334471 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f518c050ba0 con 0x7f519c0c7db0 2024-08-17T02:24:55.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.174+0000 7f51a3a00640 1 -- 172.21.15.107:0/304334471 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f519c071050 con 0x7f519c0c7db0 2024-08-17T02:24:55.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.174+0000 7f5198c00640 1 -- 172.21.15.107:0/304334471 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f518c082e60 con 0x7f519c0c7db0 2024-08-17T02:24:55.175 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2024-08-17T02:24:55.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.176+0000 7f51a3a00640 1 -- 172.21.15.107:0/304334471 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f5178065150 msgr2=0x7f5178067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.176+0000 7f51a3a00640 1 --2- 172.21.15.107:0/304334471 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f5178065150 0x7f5178067600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f519c151c40 tx=0x7f518400b3b0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.176+0000 7f51a3a00640 1 -- 172.21.15.107:0/304334471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f519c0c7db0 msgr2=0x7f519c14df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.176+0000 7f51a3a00640 1 --2- 172.21.15.107:0/304334471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f519c0c7db0 0x7f519c14df80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f518c00d890 tx=0x7f518c008040 comp rx=0 tx=0).stop 2024-08-17T02:24:55.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.176+0000 7f51a3a00640 1 -- 172.21.15.107:0/304334471 shutdown_connections 2024-08-17T02:24:55.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.176+0000 7f51a3a00640 1 --2- 172.21.15.107:0/304334471 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f5178065150 0x7f5178067600 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.176+0000 7f51a3a00640 1 --2- 172.21.15.107:0/304334471 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f519c155e50 0x7f519c158100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.176+0000 7f51a3a00640 1 --2- 172.21.15.107:0/304334471 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f519c155a80 0x7f519c14fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.176+0000 7f51a3a00640 1 --2- 172.21.15.107:0/304334471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f519c0c7db0 0x7f519c14df80 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.176+0000 7f51a3a00640 1 -- 172.21.15.107:0/304334471 >> 172.21.15.107:0/304334471 conn(0x7f519c067750 msgr2=0x7f519c0c8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:55.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.177+0000 7f51a3a00640 1 -- 172.21.15.107:0/304334471 shutdown_connections 2024-08-17T02:24:55.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.177+0000 7f51a3a00640 1 -- 172.21.15.107:0/304334471 wait complete. 2024-08-17T02:24:55.192 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:24:55.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.342+0000 7fe889600640 1 Processor -- start 2024-08-17T02:24:55.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.342+0000 7fe889600640 1 -- start start 2024-08-17T02:24:55.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.343+0000 7fe889600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe884158940 0x7fe88415d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.343+0000 7fe889600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe8840673e0 0x7fe8840b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.343+0000 7fe889600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe88406e660 con 0x7fe884158d10 2024-08-17T02:24:55.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.343+0000 7fe889600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8840a9b70 con 0x7fe884158940 2024-08-17T02:24:55.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.343+0000 7fe889600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe88406da50 con 0x7fe8840673e0 2024-08-17T02:24:55.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.343+0000 7fe883e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe884158940 0x7fe88415d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.343+0000 7fe883e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe884158940 0x7fe88415d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41998/0 (socket says 172.21.15.107:41998) 2024-08-17T02:24:55.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.343+0000 7fe883e00640 1 -- 172.21.15.107:0/790095081 learned_addr learned my addr 172.21.15.107:0/790095081 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:55.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.343+0000 7fe888c00640 1 --2- 172.21.15.107:0/790095081 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe8840673e0 0x7fe8840b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.344+0000 7fe883e00640 1 -- 172.21.15.107:0/790095081 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe8840673e0 msgr2=0x7fe8840b0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:55.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.344+0000 7fe883e00640 1 --2- 172.21.15.107:0/790095081 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe8840673e0 0x7fe8840b0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.344+0000 7fe883e00640 1 -- 172.21.15.107:0/790095081 >> v1:172.21.15.107:6789/0 conn(0x7fe884158d10 legacy=0x7fe884066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.344+0000 7fe883e00640 1 -- 172.21.15.107:0/790095081 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe88406dd30 con 0x7fe884158940 2024-08-17T02:24:55.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.345+0000 7fe883e00640 1 --2- 172.21.15.107:0/790095081 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe884158940 0x7fe88415d140 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe874009910 tx=0x7fe8740091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caec735f27665719 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.345+0000 7fe883400640 1 -- 172.21.15.107:0/790095081 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87402add0 con 0x7fe884158940 2024-08-17T02:24:55.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.345+0000 7fe883400640 1 -- 172.21.15.107:0/790095081 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe874032440 con 0x7fe884158940 2024-08-17T02:24:55.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.345+0000 7fe883400640 1 -- 172.21.15.107:0/790095081 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe874032820 con 0x7fe884158940 2024-08-17T02:24:55.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.345+0000 7fe889600640 1 -- 172.21.15.107:0/790095081 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe884158940 msgr2=0x7fe88415d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.345+0000 7fe889600640 1 --2- 172.21.15.107:0/790095081 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe884158940 0x7fe88415d140 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe874009910 tx=0x7fe8740091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.346+0000 7fe889600640 1 -- 172.21.15.107:0/790095081 shutdown_connections 2024-08-17T02:24:55.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.346+0000 7fe889600640 1 --2- 172.21.15.107:0/790095081 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe8840673e0 0x7fe8840b0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.346+0000 7fe889600640 1 --2- 172.21.15.107:0/790095081 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe884158940 0x7fe88415d140 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.346+0000 7fe889600640 1 -- 172.21.15.107:0/790095081 >> 172.21.15.107:0/790095081 conn(0x7fe884067de0 msgr2=0x7fe8840681e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:55.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.346+0000 7fe889600640 1 -- 172.21.15.107:0/790095081 shutdown_connections 2024-08-17T02:24:55.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.346+0000 7fe889600640 1 -- 172.21.15.107:0/790095081 wait complete. 2024-08-17T02:24:55.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.347+0000 7fe889600640 1 Processor -- start 2024-08-17T02:24:55.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.347+0000 7fe889600640 1 -- start start 2024-08-17T02:24:55.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.348+0000 7fe889600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe8840673e0 0x7fe884145a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.348+0000 7fe889600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe884158940 0x7fe8840c1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.348+0000 7fe889600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe884158d10 0x7fe8840ad780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.348+0000 7fe889600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8840c3db0 con 0x7fe8840673e0 2024-08-17T02:24:55.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.348+0000 7fe889600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe884145fd0 con 0x7fe884158940 2024-08-17T02:24:55.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.348+0000 7fe889600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8840c22f0 con 0x7fe884158d10 2024-08-17T02:24:55.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.348+0000 7fe883e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe8840673e0 0x7fe884145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.348+0000 7fe883e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe8840673e0 0x7fe884145a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42006/0 (socket says 172.21.15.107:42006) 2024-08-17T02:24:55.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.348+0000 7fe883e00640 1 -- 172.21.15.107:0/3624227953 learned_addr learned my addr 172.21.15.107:0/3624227953 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:55.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.348+0000 7fe87b400640 1 --2- 172.21.15.107:0/3624227953 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe884158940 0x7fe8840c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.349+0000 7fe888c00640 1 --2- 172.21.15.107:0/3624227953 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe884158d10 0x7fe8840ad780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.349+0000 7fe883e00640 1 -- 172.21.15.107:0/3624227953 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe884158d10 msgr2=0x7fe8840ad780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.349+0000 7fe883e00640 1 --2- 172.21.15.107:0/3624227953 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe884158d10 0x7fe8840ad780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.349+0000 7fe883e00640 1 -- 172.21.15.107:0/3624227953 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe884158940 msgr2=0x7fe8840c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.349+0000 7fe883e00640 1 --2- 172.21.15.107:0/3624227953 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe884158940 0x7fe8840c1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.349+0000 7fe883e00640 1 -- 172.21.15.107:0/3624227953 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe874009450 con 0x7fe8840673e0 2024-08-17T02:24:55.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.349+0000 7fe87b400640 1 --2- 172.21.15.107:0/3624227953 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe884158940 0x7fe8840c1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:55.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.349+0000 7fe883e00640 1 --2- 172.21.15.107:0/3624227953 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe8840673e0 0x7fe884145a90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe874035040 tx=0x7fe874032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.349+0000 7fe87be00640 1 -- 172.21.15.107:0/3624227953 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe874031c80 con 0x7fe8840673e0 2024-08-17T02:24:55.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.349+0000 7fe87be00640 1 -- 172.21.15.107:0/3624227953 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe874031e00 con 0x7fe8840673e0 2024-08-17T02:24:55.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.349+0000 7fe87be00640 1 -- 172.21.15.107:0/3624227953 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87403d670 con 0x7fe8840673e0 2024-08-17T02:24:55.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.349+0000 7fe889600640 1 -- 172.21.15.107:0/3624227953 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8840c25d0 con 0x7fe8840673e0 2024-08-17T02:24:55.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.349+0000 7fe889600640 1 -- 172.21.15.107:0/3624227953 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8840c3a40 con 0x7fe8840673e0 2024-08-17T02:24:55.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.350+0000 7fe889600640 1 -- 172.21.15.107:0/3624227953 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8840c3870 con 0x7fe8840673e0 2024-08-17T02:24:55.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.351+0000 7fe87be00640 1 -- 172.21.15.107:0/3624227953 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe874039040 con 0x7fe8840673e0 2024-08-17T02:24:55.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.352+0000 7fe87be00640 1 --2- 172.21.15.107:0/3624227953 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe860065150 0x7fe860067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.352+0000 7fe87be00640 1 -- 172.21.15.107:0/3624227953 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe8740a2420 con 0x7fe8840673e0 2024-08-17T02:24:55.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.352+0000 7fe87b400640 1 --2- 172.21.15.107:0/3624227953 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe860065150 0x7fe860067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.353+0000 7fe87b400640 1 --2- 172.21.15.107:0/3624227953 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe860065150 0x7fe860067600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe8840aac20 tx=0x7fe86c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.356+0000 7fe87be00640 1 -- 172.21.15.107:0/3624227953 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe874070440 con 0x7fe8840673e0 2024-08-17T02:24:55.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.531+0000 7fe889600640 1 -- 172.21.15.107:0/3624227953 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe884071050 con 0x7fe8840673e0 2024-08-17T02:24:55.532 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.532+0000 7fe87be00640 1 -- 172.21.15.107:0/3624227953 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe874037020 con 0x7fe8840673e0 2024-08-17T02:24:55.532 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 64 2024-08-17T02:24:55.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.534+0000 7fe889600640 1 -- 172.21.15.107:0/3624227953 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe860065150 msgr2=0x7fe860067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.534+0000 7fe889600640 1 --2- 172.21.15.107:0/3624227953 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe860065150 0x7fe860067600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe8840aac20 tx=0x7fe86c009040 comp rx=0 tx=0).stop 2024-08-17T02:24:55.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.534+0000 7fe889600640 1 -- 172.21.15.107:0/3624227953 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe8840673e0 msgr2=0x7fe884145a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.534+0000 7fe889600640 1 --2- 172.21.15.107:0/3624227953 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe8840673e0 0x7fe884145a90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe874035040 tx=0x7fe874032000 comp rx=0 tx=0).stop 2024-08-17T02:24:55.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.534+0000 7fe889600640 1 -- 172.21.15.107:0/3624227953 shutdown_connections 2024-08-17T02:24:55.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.534+0000 7fe889600640 1 --2- 172.21.15.107:0/3624227953 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe860065150 0x7fe860067600 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.534+0000 7fe889600640 1 --2- 172.21.15.107:0/3624227953 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe884158d10 0x7fe8840ad780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.534+0000 7fe889600640 1 --2- 172.21.15.107:0/3624227953 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe884158940 0x7fe8840c1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.534+0000 7fe889600640 1 --2- 172.21.15.107:0/3624227953 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe8840673e0 0x7fe884145a90 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.534+0000 7fe889600640 1 -- 172.21.15.107:0/3624227953 >> 172.21.15.107:0/3624227953 conn(0x7fe884067de0 msgr2=0x7fe8841579b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:55.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.534+0000 7fe889600640 1 -- 172.21.15.107:0/3624227953 shutdown_connections 2024-08-17T02:24:55.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.534+0000 7fe889600640 1 -- 172.21.15.107:0/3624227953 wait complete. 2024-08-17T02:24:55.550 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:55.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.698+0000 7f6b67200640 1 Processor -- start 2024-08-17T02:24:55.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.698+0000 7f6b67200640 1 -- start start 2024-08-17T02:24:55.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.699+0000 7f6b67200640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6b68155900 0x7f6b68155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.699+0000 7f6b67200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b680b0270 0x7f6b68156210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.699+0000 7f6b67200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b68157690 con 0x7f6b68157b20 2024-08-17T02:24:55.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.699+0000 7f6b67200640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b68156a80 con 0x7f6b68155900 2024-08-17T02:24:55.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.699+0000 7f6b67200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b68156d60 con 0x7f6b680b0270 2024-08-17T02:24:55.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.699+0000 7f6b66800640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f6b68157b20 0x7f6b68157fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:55658/0 (socket says 172.21.15.107:55658) 2024-08-17T02:24:55.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.699+0000 7f6b66800640 1 -- 172.21.15.107:0/1383267475 learned_addr learned my addr 172.21.15.107:0/1383267475 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:55.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.699+0000 7f6b65e00640 1 --2- 172.21.15.107:0/1383267475 >> v2:172.21.15.157:3300/0 conn(0x7f6b68155900 0x7f6b68155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.700+0000 7f6b5d400640 1 --2- 172.21.15.107:0/1383267475 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b680b0270 0x7f6b68156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.700+0000 7f6b65400640 1 -- 172.21.15.107:0/1383267475 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1391928812 0 0) 0x7f6b68157690 con 0x7f6b68157b20 2024-08-17T02:24:55.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.700+0000 7f6b65400640 1 -- 172.21.15.107:0/1383267475 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b4c0034e0 con 0x7f6b68157b20 2024-08-17T02:24:55.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.700+0000 7f6b65400640 1 -- 172.21.15.107:0/1383267475 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 851431186 0 0) 0x7f6b4c0034e0 con 0x7f6b68157b20 2024-08-17T02:24:55.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.700+0000 7f6b65400640 1 -- 172.21.15.107:0/1383267475 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b680b0270 msgr2=0x7f6b68156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:55.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.700+0000 7f6b65400640 1 --2- 172.21.15.107:0/1383267475 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b680b0270 0x7f6b68156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.700+0000 7f6b65400640 1 -- 172.21.15.107:0/1383267475 >> v2:172.21.15.157:3300/0 conn(0x7f6b68155900 msgr2=0x7f6b68155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:55.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.700+0000 7f6b65400640 1 --2- 172.21.15.107:0/1383267475 >> v2:172.21.15.157:3300/0 conn(0x7f6b68155900 0x7f6b68155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.700+0000 7f6b65400640 1 -- 172.21.15.107:0/1383267475 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b68157040 con 0x7f6b68157b20 2024-08-17T02:24:55.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.700+0000 7f6b65400640 1 -- 172.21.15.107:0/1383267475 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 537989081 0 0) 0x7f6b600017f0 con 0x7f6b68157b20 2024-08-17T02:24:55.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.700+0000 7f6b65400640 1 -- 172.21.15.107:0/1383267475 >> v1:172.21.15.107:6789/0 conn(0x7f6b68157b20 legacy=0x7f6b68157fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.700+0000 7f6b65400640 1 --2- 172.21.15.107:0/1383267475 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b4c0039d0 0x7f6b4c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.700+0000 7f6b65400640 1 --2- 172.21.15.107:0/1383267475 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b4c004780 0x7f6b4c004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.700+0000 7f6b65400640 1 --2- 172.21.15.107:0/1383267475 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b680b0270 0x7f6b4c005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.700+0000 7f6b65400640 1 -- 172.21.15.107:0/1383267475 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b68156a80 con 0x7f6b4c0039d0 2024-08-17T02:24:55.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.700+0000 7f6b65400640 1 -- 172.21.15.107:0/1383267475 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b68156d60 con 0x7f6b4c004780 2024-08-17T02:24:55.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.700+0000 7f6b65400640 1 -- 172.21.15.107:0/1383267475 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c00b9d0 con 0x7f6b680b0270 2024-08-17T02:24:55.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.700+0000 7f6b65e00640 1 --2- 172.21.15.107:0/1383267475 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b4c0039d0 0x7f6b4c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.701+0000 7f6b5d400640 1 --2- 172.21.15.107:0/1383267475 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b4c004780 0x7f6b4c004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.701+0000 7f6b66800640 1 --2- 172.21.15.107:0/1383267475 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b680b0270 0x7f6b4c005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.701+0000 7f6b65e00640 1 -- 172.21.15.107:0/1383267475 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b680b0270 msgr2=0x7f6b4c005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:55.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.701+0000 7f6b65e00640 1 --2- 172.21.15.107:0/1383267475 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b680b0270 0x7f6b4c005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.701+0000 7f6b65e00640 1 -- 172.21.15.107:0/1383267475 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b4c004780 msgr2=0x7f6b4c004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:55.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.701+0000 7f6b65e00640 1 --2- 172.21.15.107:0/1383267475 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b4c004780 0x7f6b4c004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.701+0000 7f6b65e00640 1 -- 172.21.15.107:0/1383267475 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b4c0034e0 con 0x7f6b4c0039d0 2024-08-17T02:24:55.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.701+0000 7f6b66800640 1 --2- 172.21.15.107:0/1383267475 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b680b0270 0x7f6b4c005130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:55.704 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.702+0000 7f6b65e00640 1 --2- 172.21.15.107:0/1383267475 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b4c0039d0 0x7f6b4c003de0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6b58009ba0 tx=0x7f6b580090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=226eacdb9672f091 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.704 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.702+0000 7f6b65400640 1 -- 172.21.15.107:0/1383267475 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b58031400 con 0x7f6b4c0039d0 2024-08-17T02:24:55.705 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.702+0000 7f6b65400640 1 -- 172.21.15.107:0/1383267475 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b5802d050 con 0x7f6b4c0039d0 2024-08-17T02:24:55.705 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.702+0000 7f6b65400640 1 -- 172.21.15.107:0/1383267475 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b58031790 con 0x7f6b4c0039d0 2024-08-17T02:24:55.705 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.703+0000 7f6b67200640 1 -- 172.21.15.107:0/1383267475 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b4c0039d0 msgr2=0x7f6b4c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.705 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.703+0000 7f6b67200640 1 --2- 172.21.15.107:0/1383267475 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b4c0039d0 0x7f6b4c003de0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6b58009ba0 tx=0x7f6b580090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.705 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.703+0000 7f6b66800640 1 -- 172.21.15.107:0/1383267475 reap_dead start 2024-08-17T02:24:55.705 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.703+0000 7f6b67200640 1 -- 172.21.15.107:0/1383267475 shutdown_connections 2024-08-17T02:24:55.705 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.703+0000 7f6b67200640 1 -- 172.21.15.107:0/1383267475 >> 172.21.15.107:0/1383267475 conn(0x7f6b68067750 msgr2=0x7f6b680cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:55.705 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.703+0000 7f6b67200640 1 -- 172.21.15.107:0/1383267475 shutdown_connections 2024-08-17T02:24:55.705 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.703+0000 7f6b67200640 1 -- 172.21.15.107:0/1383267475 wait complete. 2024-08-17T02:24:55.705 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.704+0000 7f6b67200640 1 Processor -- start 2024-08-17T02:24:55.705 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.704+0000 7f6b67200640 1 -- start start 2024-08-17T02:24:55.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.705+0000 7f6b67200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b4c0039d0 0x7f6b6816be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.705+0000 7f6b67200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b680a8dc0 0x7f6b680a9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.705+0000 7f6b67200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b6814b3b0 0x7f6b6814b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.705+0000 7f6b67200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6814bd60 con 0x7f6b6814b3b0 2024-08-17T02:24:55.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.705+0000 7f6b67200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b680ac570 con 0x7f6b4c0039d0 2024-08-17T02:24:55.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.705+0000 7f6b67200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b680ab960 con 0x7f6b680a8dc0 2024-08-17T02:24:55.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.705+0000 7f6b66800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b6814b3b0 0x7f6b6814b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.705+0000 7f6b66800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b6814b3b0 0x7f6b6814b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42018/0 (socket says 172.21.15.107:42018) 2024-08-17T02:24:55.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.705+0000 7f6b66800640 1 -- 172.21.15.107:0/3855173897 learned_addr learned my addr 172.21.15.107:0/3855173897 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:55.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.706+0000 7f6b66800640 1 -- 172.21.15.107:0/3855173897 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b680a8dc0 msgr2=0x7f6b680a9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.706+0000 7f6b66800640 1 --2- 172.21.15.107:0/3855173897 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b680a8dc0 0x7f6b680a9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.706+0000 7f6b66800640 1 -- 172.21.15.107:0/3855173897 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b4c0039d0 msgr2=0x7f6b6816be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.706+0000 7f6b66800640 1 --2- 172.21.15.107:0/3855173897 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b4c0039d0 0x7f6b6816be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.706+0000 7f6b66800640 1 -- 172.21.15.107:0/3855173897 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b680abc40 con 0x7f6b6814b3b0 2024-08-17T02:24:55.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.706+0000 7f6b66800640 1 --2- 172.21.15.107:0/3855173897 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b6814b3b0 0x7f6b6814b820 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6b68157ef0 tx=0x7f6b68157600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.706+0000 7f6b5e000640 1 -- 172.21.15.107:0/3855173897 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b60012590 con 0x7f6b6814b3b0 2024-08-17T02:24:55.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.706+0000 7f6b5e000640 1 -- 172.21.15.107:0/3855173897 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b60012710 con 0x7f6b6814b3b0 2024-08-17T02:24:55.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.706+0000 7f6b5e000640 1 -- 172.21.15.107:0/3855173897 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b60012ad0 con 0x7f6b6814b3b0 2024-08-17T02:24:55.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.706+0000 7f6b67200640 1 -- 172.21.15.107:0/3855173897 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b680abf20 con 0x7f6b6814b3b0 2024-08-17T02:24:55.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.707+0000 7f6b67200640 1 -- 172.21.15.107:0/3855173897 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b680ab630 con 0x7f6b6814b3b0 2024-08-17T02:24:55.709 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.707+0000 7f6b67200640 1 -- 172.21.15.107:0/3855173897 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b680ac3a0 con 0x7f6b6814b3b0 2024-08-17T02:24:55.709 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.708+0000 7f6b5e000640 1 -- 172.21.15.107:0/3855173897 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6b6001d460 con 0x7f6b6814b3b0 2024-08-17T02:24:55.709 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.709+0000 7f6b5e000640 1 --2- 172.21.15.107:0/3855173897 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6b44065180 0x7f6b44067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.709 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.709+0000 7f6b5e000640 1 -- 172.21.15.107:0/3855173897 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6b60082230 con 0x7f6b6814b3b0 2024-08-17T02:24:55.709 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.709+0000 7f6b65e00640 1 --2- 172.21.15.107:0/3855173897 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6b44065180 0x7f6b44067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.710 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.710+0000 7f6b65e00640 1 --2- 172.21.15.107:0/3855173897 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6b44065180 0x7f6b44067630 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6b58034000 tx=0x7f6b58035000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.713+0000 7f6b5e000640 1 -- 172.21.15.107:0/3855173897 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6b60050250 con 0x7f6b6814b3b0 2024-08-17T02:24:55.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.887+0000 7f6b67200640 1 -- 172.21.15.107:0/3855173897 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b68071050 con 0x7f6b6814b3b0 2024-08-17T02:24:55.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.888+0000 7f6b5e000640 1 -- 172.21.15.107:0/3855173897 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f6b60053870 con 0x7f6b6814b3b0 2024-08-17T02:24:55.889 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:24:55.889 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":21,"fsid":"f207b4c0-329d-46b8-b83f-aaf30bdb6ce3","created":"2024-08-17T02:24:11.038049+0000","modified":"2024-08-17T02:24:30.420018+0000","last_up_change":"2024-08-17T02:24:22.047790+0000","last_in_change":"2024-08-17T02:24:13.892720+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:23.456166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:27.078670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:27.804418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"376363f3-b8bf-4f1e-b691-51cdd39171ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37302},{"type":"v1","addr":"172.21.15.107:6801","nonce":37302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37302},{"type":"v1","addr":"172.21.15.107:6803","nonce":37302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37302},{"type":"v1","addr":"172.21.15.107:6807","nonce":37302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37302},{"type":"v1","addr":"172.21.15.107:6805","nonce":37302}]},"public_addr":"172.21.15.107:6801/37302","cluster_addr":"172.21.15.107:6803/37302","heartbeat_back_addr":"172.21.15.107:6807/37302","heartbeat_front_addr":"172.21.15.107:6805/37302","state":["exists","up"]},{"osd":1,"uuid":"cc6624e3-2ad4-4db4-b377-05dfe57424e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37305},{"type":"v1","addr":"172.21.15.107:6824","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37305},{"type":"v1","addr":"172.21.15.107:6827","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37305},{"type":"v1","addr":"172.21.15.107:6831","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37305},{"type":"v1","addr":"172.21.15.107:6829","nonce":37305}]},"public_addr":"172.21.15.107:6824/37305","cluster_addr":"172.21.15.107:6827/37305","heartbeat_back_addr":"172.21.15.107:6831/37305","heartbeat_front_addr":"172.21.15.107:6829/37305","state":["exists","up"]},{"osd":2,"uuid":"25229542-29b5-4281-bcb0-798ae0930aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37307},{"type":"v1","addr":"172.21.15.107:6817","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37307},{"type":"v1","addr":"172.21.15.107:6819","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6823","nonce":37307},{"type":"v1","addr":"172.21.15.107:6825","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37307},{"type":"v1","addr":"172.21.15.107:6821","nonce":37307}]},"public_addr":"172.21.15.107:6817/37307","cluster_addr":"172.21.15.107:6819/37307","heartbeat_back_addr":"172.21.15.107:6825/37307","heartbeat_front_addr":"172.21.15.107:6821/37307","state":["exists","up"]},{"osd":3,"uuid":"5f16aee8-8950-4268-a61a-5cf6ebd670e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37306},{"type":"v1","addr":"172.21.15.107:6809","nonce":37306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37306},{"type":"v1","addr":"172.21.15.107:6811","nonce":37306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37306},{"type":"v1","addr":"172.21.15.107:6815","nonce":37306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37306},{"type":"v1","addr":"172.21.15.107:6813","nonce":37306}]},"public_addr":"172.21.15.107:6809/37306","cluster_addr":"172.21.15.107:6811/37306","heartbeat_back_addr":"172.21.15.107:6815/37306","heartbeat_front_addr":"172.21.15.107:6813/37306","state":["exists","up"]},{"osd":4,"uuid":"23232e28-e23b-4b4e-a531-4939246dbbde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":37329},{"type":"v1","addr":"172.21.15.157:6817","nonce":37329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":37329},{"type":"v1","addr":"172.21.15.157:6819","nonce":37329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":37329},{"type":"v1","addr":"172.21.15.157:6823","nonce":37329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":37329},{"type":"v1","addr":"172.21.15.157:6821","nonce":37329}]},"public_addr":"172.21.15.157:6817/37329","cluster_addr":"172.21.15.157:6819/37329","heartbeat_back_addr":"172.21.15.157:6823/37329","heartbeat_front_addr":"172.21.15.157:6821/37329","state":["exists","up"]},{"osd":5,"uuid":"f87ec331-3e59-4886-a317-6f7e26ec8e21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":37328},{"type":"v1","addr":"172.21.15.157:6804","nonce":37328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":37328},{"type":"v1","addr":"172.21.15.157:6808","nonce":37328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":37328},{"type":"v1","addr":"172.21.15.157:6815","nonce":37328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":37328},{"type":"v1","addr":"172.21.15.157:6812","nonce":37328}]},"public_addr":"172.21.15.157:6804/37328","cluster_addr":"172.21.15.157:6808/37328","heartbeat_back_addr":"172.21.15.157:6815/37328","heartbeat_front_addr":"172.21.15.157:6812/37328","state":["exists","up"]},{"osd":6,"uuid":"92852235-ce49-4d96-a940-6f18d97b13ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":37330},{"type":"v1","addr":"172.21.15.157:6801","nonce":37330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6803","nonce":37330},{"type":"v1","addr":"172.21.15.157:6805","nonce":37330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":37330},{"type":"v1","addr":"172.21.15.157:6813","nonce":37330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":37330},{"type":"v1","addr":"172.21.15.157:6809","nonce":37330}]},"public_addr":"172.21.15.157:6801/37330","cluster_addr":"172.21.15.157:6805/37330","heartbeat_back_addr":"172.21.15.157:6813/37330","heartbeat_front_addr":"172.21.15.157:6809/37330","state":["exists","up"]},{"osd":7,"uuid":"7484a061-723d-4663-b28f-b01766d62f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":37373},{"type":"v1","addr":"172.21.15.157:6825","nonce":37373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":37373},{"type":"v1","addr":"172.21.15.157:6827","nonce":37373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":37373},{"type":"v1","addr":"172.21.15.157:6831","nonce":37373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":37373},{"type":"v1","addr":"172.21.15.157:6829","nonce":37373}]},"public_addr":"172.21.15.157:6825/37373","cluster_addr":"172.21.15.157:6827/37373","heartbeat_back_addr":"172.21.15.157:6831/37373","heartbeat_front_addr":"172.21.15.157:6829/37373","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.110188+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.280265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.252119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.267996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.284582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.144420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.174764+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.308002+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:55.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.890+0000 7f6b67200640 1 -- 172.21.15.107:0/3855173897 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6b44065180 msgr2=0x7f6b44067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.890+0000 7f6b67200640 1 --2- 172.21.15.107:0/3855173897 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6b44065180 0x7f6b44067630 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6b58034000 tx=0x7f6b58035000 comp rx=0 tx=0).stop 2024-08-17T02:24:55.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.890+0000 7f6b67200640 1 -- 172.21.15.107:0/3855173897 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b6814b3b0 msgr2=0x7f6b6814b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.890+0000 7f6b67200640 1 --2- 172.21.15.107:0/3855173897 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b6814b3b0 0x7f6b6814b820 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6b68157ef0 tx=0x7f6b68157600 comp rx=0 tx=0).stop 2024-08-17T02:24:55.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.891+0000 7f6b67200640 1 -- 172.21.15.107:0/3855173897 shutdown_connections 2024-08-17T02:24:55.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.891+0000 7f6b67200640 1 --2- 172.21.15.107:0/3855173897 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6b44065180 0x7f6b44067630 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.891+0000 7f6b67200640 1 --2- 172.21.15.107:0/3855173897 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b6814b3b0 0x7f6b6814b820 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.891+0000 7f6b67200640 1 --2- 172.21.15.107:0/3855173897 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b680a8dc0 0x7f6b680a9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.891+0000 7f6b67200640 1 --2- 172.21.15.107:0/3855173897 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b4c0039d0 0x7f6b6816be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.891+0000 7f6b67200640 1 -- 172.21.15.107:0/3855173897 >> 172.21.15.107:0/3855173897 conn(0x7f6b68067750 msgr2=0x7f6b6806de60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:55.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.891+0000 7f6b67200640 1 -- 172.21.15.107:0/3855173897 shutdown_connections 2024-08-17T02:24:55.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:55.891+0000 7f6b67200640 1 -- 172.21.15.107:0/3855173897 wait complete. 2024-08-17T02:24:55.907 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:24:23.456166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:24:27.078670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:24:27.804418+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:24:55.907 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:24:56.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.058+0000 7fd2f0400640 1 Processor -- start 2024-08-17T02:24:56.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.058+0000 7fd2f0400640 1 -- start start 2024-08-17T02:24:56.059 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.059+0000 7fd2f0400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd2e81592a0 0x7fd2e8069a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:56.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.059+0000 7fd2f0400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e80b10e0 con 0x7fd2e8158ed0 2024-08-17T02:24:56.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.059+0000 7fd2f0400640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e80ac680 con 0x7fd2e8096a70 2024-08-17T02:24:56.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.059+0000 7fd2f0400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e80b0a90 con 0x7fd2e81592a0 2024-08-17T02:24:56.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.059+0000 7fd2eda00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fd2e8158ed0 0x7fd2e80abeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:55666/0 (socket says 172.21.15.107:55666) 2024-08-17T02:24:56.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.059+0000 7fd2eda00640 1 -- 172.21.15.107:0/748739768 learned_addr learned my addr 172.21.15.107:0/748739768 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:56.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.060+0000 7fd2ed000640 1 --2- 172.21.15.107:0/748739768 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd2e81592a0 0x7fd2e8069a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:56.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.060+0000 7fd2e7e00640 1 -- 172.21.15.107:0/748739768 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4144229231 0 0) 0x7fd2e80b10e0 con 0x7fd2e8158ed0 2024-08-17T02:24:56.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.060+0000 7fd2e7e00640 1 -- 172.21.15.107:0/748739768 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2d00034e0 con 0x7fd2e8158ed0 2024-08-17T02:24:56.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.060+0000 7fd2e7e00640 1 -- 172.21.15.107:0/748739768 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2273600576 0 0) 0x7fd2e80ac680 con 0x7fd2e8096a70 2024-08-17T02:24:56.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.060+0000 7fd2e7e00640 1 -- 172.21.15.107:0/748739768 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2e80b10e0 con 0x7fd2e8096a70 2024-08-17T02:24:56.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.060+0000 7fd2ed000640 1 -- 172.21.15.107:0/748739768 >> v1:172.21.15.157:6789/0 conn(0x7fd2e8096a70 legacy=0x7fd2e80b1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:56.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.060+0000 7fd2ed000640 1 -- 172.21.15.107:0/748739768 >> v1:172.21.15.107:6789/0 conn(0x7fd2e8158ed0 legacy=0x7fd2e80abeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:56.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.060+0000 7fd2e7e00640 1 -- 172.21.15.107:0/748739768 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2685596369 0 0) 0x7fd2d00034e0 con 0x7fd2e8158ed0 2024-08-17T02:24:56.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.060+0000 7fd2ed000640 1 -- 172.21.15.107:0/748739768 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e80b0d70 con 0x7fd2e81592a0 2024-08-17T02:24:56.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.061+0000 7fd2ed000640 1 --2- 172.21.15.107:0/748739768 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd2e81592a0 0x7fd2e8069a80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4009880 tx=0x7fd2d40090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab02f6b6f31db281 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:56.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.062+0000 7fd2e7e00640 1 -- 172.21.15.107:0/748739768 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d402ae20 con 0x7fd2e81592a0 2024-08-17T02:24:56.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.062+0000 7fd2e7e00640 1 -- 172.21.15.107:0/748739768 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d4032440 con 0x7fd2e81592a0 2024-08-17T02:24:56.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.062+0000 7fd2e7e00640 1 -- 172.21.15.107:0/748739768 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d40327e0 con 0x7fd2e81592a0 2024-08-17T02:24:56.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.062+0000 7fd2f0400640 1 -- 172.21.15.107:0/748739768 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd2e81592a0 msgr2=0x7fd2e8069a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:56.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.062+0000 7fd2f0400640 1 --2- 172.21.15.107:0/748739768 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd2e81592a0 0x7fd2e8069a80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4009880 tx=0x7fd2d40090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.062+0000 7fd2f0400640 1 -- 172.21.15.107:0/748739768 shutdown_connections 2024-08-17T02:24:56.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.062+0000 7fd2f0400640 1 --2- 172.21.15.107:0/748739768 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd2e81592a0 0x7fd2e8069a80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.062+0000 7fd2f0400640 1 -- 172.21.15.107:0/748739768 >> 172.21.15.107:0/748739768 conn(0x7fd2e80b30b0 msgr2=0x7fd2e80b34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:56.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.062+0000 7fd2f0400640 1 -- 172.21.15.107:0/748739768 shutdown_connections 2024-08-17T02:24:56.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.062+0000 7fd2f0400640 1 -- 172.21.15.107:0/748739768 wait complete. 2024-08-17T02:24:56.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.064+0000 7fd2f0400640 1 Processor -- start 2024-08-17T02:24:56.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.064+0000 7fd2f0400640 1 -- start start 2024-08-17T02:24:56.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.065+0000 7fd2f0400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd2e8096a70 0x7fd2e8153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:56.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.065+0000 7fd2f0400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd2e8158ed0 0x7fd2e815d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:56.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.065+0000 7fd2f0400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2e815da70 0x7fd2e815ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:56.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.065+0000 7fd2f0400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e8159680 con 0x7fd2e815da70 2024-08-17T02:24:56.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.065+0000 7fd2f0400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e8159960 con 0x7fd2e8096a70 2024-08-17T02:24:56.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.065+0000 7fd2f0400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e815e060 con 0x7fd2e8158ed0 2024-08-17T02:24:56.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.065+0000 7fd2ee400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2e815da70 0x7fd2e815ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:56.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.065+0000 7fd2ee400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2e815da70 0x7fd2e815ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42034/0 (socket says 172.21.15.107:42034) 2024-08-17T02:24:56.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.065+0000 7fd2ee400640 1 -- 172.21.15.107:0/180004682 learned_addr learned my addr 172.21.15.107:0/180004682 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:56.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.065+0000 7fd2eda00640 1 --2- 172.21.15.107:0/180004682 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd2e8096a70 0x7fd2e8153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:56.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.065+0000 7fd2ed000640 1 --2- 172.21.15.107:0/180004682 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd2e8158ed0 0x7fd2e815d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:56.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.065+0000 7fd2ee400640 1 -- 172.21.15.107:0/180004682 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd2e8158ed0 msgr2=0x7fd2e815d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:56.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.065+0000 7fd2ee400640 1 --2- 172.21.15.107:0/180004682 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd2e8158ed0 0x7fd2e815d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.065+0000 7fd2ee400640 1 -- 172.21.15.107:0/180004682 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd2e8096a70 msgr2=0x7fd2e8153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:56.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.065+0000 7fd2ee400640 1 --2- 172.21.15.107:0/180004682 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd2e8096a70 0x7fd2e8153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.065+0000 7fd2ee400640 1 -- 172.21.15.107:0/180004682 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d4009390 con 0x7fd2e815da70 2024-08-17T02:24:56.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.066+0000 7fd2ee400640 1 --2- 172.21.15.107:0/180004682 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2e815da70 0x7fd2e815ebb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd2e000c870 tx=0x7fd2e0002650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:56.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.066+0000 7fd2e4c00640 1 -- 172.21.15.107:0/180004682 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e000ce00 con 0x7fd2e815da70 2024-08-17T02:24:56.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.066+0000 7fd2e4c00640 1 -- 172.21.15.107:0/180004682 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e000a850 con 0x7fd2e815da70 2024-08-17T02:24:56.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.066+0000 7fd2f0400640 1 -- 172.21.15.107:0/180004682 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e815e340 con 0x7fd2e815da70 2024-08-17T02:24:56.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.066+0000 7fd2e4c00640 1 -- 172.21.15.107:0/180004682 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e000ac10 con 0x7fd2e815da70 2024-08-17T02:24:56.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.066+0000 7fd2f0400640 1 -- 172.21.15.107:0/180004682 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e8154890 con 0x7fd2e815da70 2024-08-17T02:24:56.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.067+0000 7fd2f0400640 1 -- 172.21.15.107:0/180004682 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2e8064db0 con 0x7fd2e815da70 2024-08-17T02:24:56.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.068+0000 7fd2e4c00640 1 -- 172.21.15.107:0/180004682 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd2e0012630 con 0x7fd2e815da70 2024-08-17T02:24:56.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.069+0000 7fd2e4c00640 1 --2- 172.21.15.107:0/180004682 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd2c8065150 0x7fd2c8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:56.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.069+0000 7fd2e4c00640 1 -- 172.21.15.107:0/180004682 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd2e0082650 con 0x7fd2e815da70 2024-08-17T02:24:56.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.069+0000 7fd2eda00640 1 --2- 172.21.15.107:0/180004682 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd2c8065150 0x7fd2c8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:56.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.070+0000 7fd2eda00640 1 --2- 172.21.15.107:0/180004682 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd2c8065150 0x7fd2c8067600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc0011e0 tx=0x7fd2dc007ca0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:56.073 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.073+0000 7fd2e4c00640 1 -- 172.21.15.107:0/180004682 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd2e00507c0 con 0x7fd2e815da70 2024-08-17T02:24:56.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.243+0000 7fd2f0400640 1 -- 172.21.15.107:0/180004682 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd2e8159aa0 con 0x7fd2e815da70 2024-08-17T02:24:56.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.244+0000 7fd2e4c00640 1 -- 172.21.15.107:0/180004682 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd2e0053de0 con 0x7fd2e815da70 2024-08-17T02:24:56.244 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2024-08-17T02:24:56.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.245+0000 7fd2f0400640 1 -- 172.21.15.107:0/180004682 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd2c8065150 msgr2=0x7fd2c8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:56.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.245+0000 7fd2f0400640 1 --2- 172.21.15.107:0/180004682 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd2c8065150 0x7fd2c8067600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc0011e0 tx=0x7fd2dc007ca0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.245+0000 7fd2f0400640 1 -- 172.21.15.107:0/180004682 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2e815da70 msgr2=0x7fd2e815ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:56.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.245+0000 7fd2f0400640 1 --2- 172.21.15.107:0/180004682 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2e815da70 0x7fd2e815ebb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd2e000c870 tx=0x7fd2e0002650 comp rx=0 tx=0).stop 2024-08-17T02:24:56.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.246+0000 7fd2f0400640 1 -- 172.21.15.107:0/180004682 shutdown_connections 2024-08-17T02:24:56.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.246+0000 7fd2f0400640 1 --2- 172.21.15.107:0/180004682 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd2c8065150 0x7fd2c8067600 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.246+0000 7fd2f0400640 1 --2- 172.21.15.107:0/180004682 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2e815da70 0x7fd2e815ebb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.246+0000 7fd2f0400640 1 --2- 172.21.15.107:0/180004682 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd2e8158ed0 0x7fd2e815d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.246+0000 7fd2f0400640 1 --2- 172.21.15.107:0/180004682 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd2e8096a70 0x7fd2e8153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.246+0000 7fd2f0400640 1 -- 172.21.15.107:0/180004682 >> 172.21.15.107:0/180004682 conn(0x7fd2e80b30b0 msgr2=0x7fd2e8157830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:56.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.246+0000 7fd2f0400640 1 -- 172.21.15.107:0/180004682 shutdown_connections 2024-08-17T02:24:56.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.246+0000 7fd2f0400640 1 -- 172.21.15.107:0/180004682 wait complete. 2024-08-17T02:24:56.261 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:24:56.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.411+0000 7f28c2c00640 1 Processor -- start 2024-08-17T02:24:56.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.411+0000 7f28c2c00640 1 -- start start 2024-08-17T02:24:56.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.412+0000 7f28c2c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f28bc0caa20 0x7f28bc0c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:56.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.412+0000 7f28c2c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f28bc0c3390 0x7f28bc0c7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:56.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.412+0000 7f28c2c00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28bc0cb540 con 0x7f28bc158e20 2024-08-17T02:24:56.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.412+0000 7f28c2c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28bc0cf7f0 con 0x7f28bc0c3390 2024-08-17T02:24:56.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.412+0000 7f28c2c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc0caef0 con 0x7f28bc0caa20 2024-08-17T02:24:56.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.412+0000 7f28c0c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f28bc0c3390 0x7f28bc0c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:56.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.413+0000 7f28c0c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f28bc0c3390 0x7f28bc0c7350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42038/0 (socket says 172.21.15.107:42038) 2024-08-17T02:24:56.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.413+0000 7f28c0c00640 1 -- 172.21.15.107:0/578664757 learned_addr learned my addr 172.21.15.107:0/578664757 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:56.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.413+0000 7f28bb400640 1 --2- 172.21.15.107:0/578664757 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f28bc0caa20 0x7f28bc0c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:56.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.413+0000 7f28c0c00640 1 -- 172.21.15.107:0/578664757 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f28bc0caa20 msgr2=0x7f28bc0c6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:56.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.413+0000 7f28c0c00640 1 --2- 172.21.15.107:0/578664757 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f28bc0caa20 0x7f28bc0c6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.413+0000 7f28c0c00640 1 -- 172.21.15.107:0/578664757 >> v1:172.21.15.157:6789/0 conn(0x7f28bc158e20 legacy=0x7f28bc0ca310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:56.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.413+0000 7f28c0c00640 1 -- 172.21.15.107:0/578664757 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28bc0cb1d0 con 0x7f28bc0c3390 2024-08-17T02:24:56.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.413+0000 7f28bb400640 1 --2- 172.21.15.107:0/578664757 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f28bc0caa20 0x7f28bc0c6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:56.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.414+0000 7f28c0c00640 1 --2- 172.21.15.107:0/578664757 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28bc0c3390 0x7f28bc0c7350 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f28b4009f20 tx=0x7f28b4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da7c979ae99b9468 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:56.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.414+0000 7f28baa00640 1 -- 172.21.15.107:0/578664757 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b4031400 con 0x7f28bc0c3390 2024-08-17T02:24:56.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.414+0000 7f28baa00640 1 -- 172.21.15.107:0/578664757 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b402d050 con 0x7f28bc0c3390 2024-08-17T02:24:56.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.414+0000 7f28baa00640 1 -- 172.21.15.107:0/578664757 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b40317d0 con 0x7f28bc0c3390 2024-08-17T02:24:56.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.415+0000 7f28c2c00640 1 -- 172.21.15.107:0/578664757 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28bc0c3390 msgr2=0x7f28bc0c7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:56.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.415+0000 7f28c2c00640 1 --2- 172.21.15.107:0/578664757 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28bc0c3390 0x7f28bc0c7350 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f28b4009f20 tx=0x7f28b4009840 comp rx=0 tx=0).stop 2024-08-17T02:24:56.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.415+0000 7f28c2c00640 1 -- 172.21.15.107:0/578664757 shutdown_connections 2024-08-17T02:24:56.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.415+0000 7f28c2c00640 1 --2- 172.21.15.107:0/578664757 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28bc0c3390 0x7f28bc0c7350 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.415+0000 7f28c2c00640 1 --2- 172.21.15.107:0/578664757 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f28bc0caa20 0x7f28bc0c6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.415+0000 7f28c2c00640 1 -- 172.21.15.107:0/578664757 >> 172.21.15.107:0/578664757 conn(0x7f28bc0cfd70 msgr2=0x7f28bc0d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:56.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.415+0000 7f28c2c00640 1 -- 172.21.15.107:0/578664757 shutdown_connections 2024-08-17T02:24:56.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.415+0000 7f28c2c00640 1 -- 172.21.15.107:0/578664757 wait complete. 2024-08-17T02:24:56.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.416+0000 7f28c2c00640 1 Processor -- start 2024-08-17T02:24:56.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.416+0000 7f28c2c00640 1 -- start start 2024-08-17T02:24:56.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.417+0000 7f28c2c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28bc0c3390 0x7f28bc0b4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:56.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.417+0000 7f28c2c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f28bc0caa20 0x7f28bc0b5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:56.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.417+0000 7f28c2c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28bc158e20 0x7f28bc0b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:56.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.417+0000 7f28c2c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc0b4180 con 0x7f28bc158e20 2024-08-17T02:24:56.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.417+0000 7f28c2c00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc0b4b50 con 0x7f28bc0c3390 2024-08-17T02:24:56.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.417+0000 7f28c2c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc0b3570 con 0x7f28bc0caa20 2024-08-17T02:24:56.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.417+0000 7f28c0c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28bc158e20 0x7f28bc0b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:56.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.418+0000 7f28c0c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28bc158e20 0x7f28bc0b2b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42042/0 (socket says 172.21.15.107:42042) 2024-08-17T02:24:56.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.418+0000 7f28c0c00640 1 -- 172.21.15.107:0/2392800583 learned_addr learned my addr 172.21.15.107:0/2392800583 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:56.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.418+0000 7f28bb400640 1 --2- 172.21.15.107:0/2392800583 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f28bc0caa20 0x7f28bc0b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:56.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.418+0000 7f28bbe00640 1 --2- 172.21.15.107:0/2392800583 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28bc0c3390 0x7f28bc0b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:56.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.418+0000 7f28c0c00640 1 -- 172.21.15.107:0/2392800583 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f28bc0caa20 msgr2=0x7f28bc0b5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:56.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.418+0000 7f28c0c00640 1 --2- 172.21.15.107:0/2392800583 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f28bc0caa20 0x7f28bc0b5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.418+0000 7f28c0c00640 1 -- 172.21.15.107:0/2392800583 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28bc0c3390 msgr2=0x7f28bc0b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:56.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.418+0000 7f28c0c00640 1 --2- 172.21.15.107:0/2392800583 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28bc0c3390 0x7f28bc0b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.418+0000 7f28c0c00640 1 -- 172.21.15.107:0/2392800583 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b4009ae0 con 0x7f28bc158e20 2024-08-17T02:24:56.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.418+0000 7f28bb400640 1 --2- 172.21.15.107:0/2392800583 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f28bc0caa20 0x7f28bc0b5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:56.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.418+0000 7f28c0c00640 1 --2- 172.21.15.107:0/2392800583 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28bc158e20 0x7f28bc0b2b20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f28b4009f20 tx=0x7f28b4036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:56.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.419+0000 7f28b3400640 1 -- 172.21.15.107:0/2392800583 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b4008e50 con 0x7f28bc158e20 2024-08-17T02:24:56.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.419+0000 7f28b3400640 1 -- 172.21.15.107:0/2392800583 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b403b410 con 0x7f28bc158e20 2024-08-17T02:24:56.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.419+0000 7f28b3400640 1 -- 172.21.15.107:0/2392800583 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b403b7d0 con 0x7f28bc158e20 2024-08-17T02:24:56.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.419+0000 7f28c2c00640 1 -- 172.21.15.107:0/2392800583 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28bc0b3850 con 0x7f28bc158e20 2024-08-17T02:24:56.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.419+0000 7f28c2c00640 1 -- 172.21.15.107:0/2392800583 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28bc0b3e10 con 0x7f28bc158e20 2024-08-17T02:24:56.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.420+0000 7f28c2c00640 1 -- 172.21.15.107:0/2392800583 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28bc071050 con 0x7f28bc158e20 2024-08-17T02:24:56.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.420+0000 7f28b3400640 1 -- 172.21.15.107:0/2392800583 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f28b4038050 con 0x7f28bc158e20 2024-08-17T02:24:56.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.421+0000 7f28b3400640 1 --2- 172.21.15.107:0/2392800583 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f289c065150 0x7f289c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:56.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.421+0000 7f28b3400640 1 -- 172.21.15.107:0/2392800583 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f28b40a3240 con 0x7f28bc158e20 2024-08-17T02:24:56.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.421+0000 7f28bbe00640 1 --2- 172.21.15.107:0/2392800583 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f289c065150 0x7f289c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:56.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.422+0000 7f28bbe00640 1 --2- 172.21.15.107:0/2392800583 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f289c065150 0x7f289c067600 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f28ac003720 tx=0x7f28ac009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:56.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.425+0000 7f28b3400640 1 -- 172.21.15.107:0/2392800583 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f28b4071260 con 0x7f28bc158e20 2024-08-17T02:24:56.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.598+0000 7f28c2c00640 1 -- 172.21.15.107:0/2392800583 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f28bc067260 con 0x7f28bc158e20 2024-08-17T02:24:56.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.598+0000 7f28b3400640 1 -- 172.21.15.107:0/2392800583 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f28b4074880 con 0x7f28bc158e20 2024-08-17T02:24:56.599 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2024-08-17T02:24:56.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.600+0000 7f28c2c00640 1 -- 172.21.15.107:0/2392800583 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f289c065150 msgr2=0x7f289c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:56.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.600+0000 7f28c2c00640 1 --2- 172.21.15.107:0/2392800583 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f289c065150 0x7f289c067600 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f28ac003720 tx=0x7f28ac009040 comp rx=0 tx=0).stop 2024-08-17T02:24:56.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.600+0000 7f28c2c00640 1 -- 172.21.15.107:0/2392800583 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28bc158e20 msgr2=0x7f28bc0b2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:56.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.600+0000 7f28c2c00640 1 --2- 172.21.15.107:0/2392800583 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28bc158e20 0x7f28bc0b2b20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f28b4009f20 tx=0x7f28b4036000 comp rx=0 tx=0).stop 2024-08-17T02:24:56.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.600+0000 7f28c2c00640 1 -- 172.21.15.107:0/2392800583 shutdown_connections 2024-08-17T02:24:56.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.600+0000 7f28c2c00640 1 --2- 172.21.15.107:0/2392800583 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f289c065150 0x7f289c067600 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.600+0000 7f28c2c00640 1 --2- 172.21.15.107:0/2392800583 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28bc158e20 0x7f28bc0b2b20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.600+0000 7f28c2c00640 1 --2- 172.21.15.107:0/2392800583 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f28bc0caa20 0x7f28bc0b5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.600+0000 7f28c2c00640 1 --2- 172.21.15.107:0/2392800583 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28bc0c3390 0x7f28bc0b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.600+0000 7f28c2c00640 1 -- 172.21.15.107:0/2392800583 >> 172.21.15.107:0/2392800583 conn(0x7f28bc0cfd70 msgr2=0x7f28bc0cd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:56.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.601+0000 7f28c2c00640 1 -- 172.21.15.107:0/2392800583 shutdown_connections 2024-08-17T02:24:56.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.601+0000 7f28c2c00640 1 -- 172.21.15.107:0/2392800583 wait complete. 2024-08-17T02:24:56.615 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:24:56.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.766+0000 7ff152c00640 1 Processor -- start 2024-08-17T02:24:56.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.766+0000 7ff152c00640 1 -- start start 2024-08-17T02:24:56.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.767+0000 7ff152c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff14c0cb9f0 0x7ff14c06d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:56.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.767+0000 7ff152c00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff14c15c760 0x7ff14c15cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:56.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.767+0000 7ff152c00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff14c15d0e0 con 0x7ff14c066cd0 2024-08-17T02:24:56.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.767+0000 7ff152c00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff14c1536c0 con 0x7ff14c15c760 2024-08-17T02:24:56.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.767+0000 7ff152c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c06d720 con 0x7ff14c0cb9f0 2024-08-17T02:24:56.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.767+0000 7ff151800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff14c0cb9f0 0x7ff14c06d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:56.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.768+0000 7ff151800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff14c0cb9f0 0x7ff14c06d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:59680/0 (socket says 172.21.15.107:59680) 2024-08-17T02:24:56.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.768+0000 7ff152200640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff14c15c760 0x7ff14c15cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:56.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.768+0000 7ff150e00640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7ff14c066cd0 0x7ff14c0abde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:47134/0 (socket says 172.21.15.107:47134) 2024-08-17T02:24:56.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.768+0000 7ff151800640 1 -- 172.21.15.107:0/3615870309 learned_addr learned my addr 172.21.15.107:0/3615870309 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:56.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.768+0000 7ff151800640 1 -- 172.21.15.107:0/3615870309 >> v2:172.21.15.157:3300/0 conn(0x7ff14c15c760 msgr2=0x7ff14c15cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:56.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.768+0000 7ff151800640 1 --2- 172.21.15.107:0/3615870309 >> v2:172.21.15.157:3300/0 conn(0x7ff14c15c760 0x7ff14c15cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.768+0000 7ff151800640 1 -- 172.21.15.107:0/3615870309 >> v1:172.21.15.157:6789/0 conn(0x7ff14c066cd0 legacy=0x7ff14c0abde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:56.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.768+0000 7ff14be00640 1 -- 172.21.15.107:0/3615870309 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1793657015 0 0) 0x7ff14c15d0e0 con 0x7ff14c066cd0 2024-08-17T02:24:56.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.768+0000 7ff151800640 1 -- 172.21.15.107:0/3615870309 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14c06da00 con 0x7ff14c0cb9f0 2024-08-17T02:24:56.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.769+0000 7ff151800640 1 --2- 172.21.15.107:0/3615870309 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff14c0cb9f0 0x7ff14c06d020 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff140009910 tx=0x7ff1400091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9bb06cae48da9fa server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:56.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.769+0000 7ff14be00640 1 -- 172.21.15.107:0/3615870309 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14002adb0 con 0x7ff14c0cb9f0 2024-08-17T02:24:56.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.769+0000 7ff14be00640 1 -- 172.21.15.107:0/3615870309 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff140032440 con 0x7ff14c0cb9f0 2024-08-17T02:24:56.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.769+0000 7ff14be00640 1 -- 172.21.15.107:0/3615870309 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1400327e0 con 0x7ff14c0cb9f0 2024-08-17T02:24:56.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.770+0000 7ff152c00640 1 -- 172.21.15.107:0/3615870309 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff14c0cb9f0 msgr2=0x7ff14c06d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:56.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.770+0000 7ff152c00640 1 --2- 172.21.15.107:0/3615870309 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff14c0cb9f0 0x7ff14c06d020 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff140009910 tx=0x7ff1400091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.770+0000 7ff152c00640 1 -- 172.21.15.107:0/3615870309 shutdown_connections 2024-08-17T02:24:56.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.770+0000 7ff152c00640 1 --2- 172.21.15.107:0/3615870309 >> v2:172.21.15.157:3300/0 conn(0x7ff14c15c760 0x7ff14c15cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.770+0000 7ff152c00640 1 --2- 172.21.15.107:0/3615870309 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff14c0cb9f0 0x7ff14c06d020 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.770+0000 7ff152c00640 1 -- 172.21.15.107:0/3615870309 >> 172.21.15.107:0/3615870309 conn(0x7ff14c0cca90 msgr2=0x7ff14c0a8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:56.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.770+0000 7ff152c00640 1 -- 172.21.15.107:0/3615870309 shutdown_connections 2024-08-17T02:24:56.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.770+0000 7ff152c00640 1 -- 172.21.15.107:0/3615870309 wait complete. 2024-08-17T02:24:56.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.772+0000 7ff152c00640 1 Processor -- start 2024-08-17T02:24:56.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.772+0000 7ff152c00640 1 -- start start 2024-08-17T02:24:56.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.773+0000 7ff152c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff14c066cd0 0x7ff14c096a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:56.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.773+0000 7ff152c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff14c0cb9f0 0x7ff14c168e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:56.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.773+0000 7ff152c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff14c15c760 0x7ff14c0b07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:56.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.773+0000 7ff152c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c099110 con 0x7ff14c15c760 2024-08-17T02:24:56.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.773+0000 7ff152c00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c0993f0 con 0x7ff14c066cd0 2024-08-17T02:24:56.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.773+0000 7ff152c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c0996d0 con 0x7ff14c0cb9f0 2024-08-17T02:24:56.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.773+0000 7ff151800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff14c066cd0 0x7ff14c096a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:56.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.773+0000 7ff150e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff14c0cb9f0 0x7ff14c168e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:56.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.773+0000 7ff151800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff14c066cd0 0x7ff14c096a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:58194/0 (socket says 172.21.15.107:58194) 2024-08-17T02:24:56.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.773+0000 7ff151800640 1 -- 172.21.15.107:0/3249828937 learned_addr learned my addr 172.21.15.107:0/3249828937 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:56.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.773+0000 7ff152200640 1 --2- 172.21.15.107:0/3249828937 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff14c15c760 0x7ff14c0b07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:56.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.773+0000 7ff152200640 1 -- 172.21.15.107:0/3249828937 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff14c0cb9f0 msgr2=0x7ff14c168e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:56.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.773+0000 7ff152200640 1 --2- 172.21.15.107:0/3249828937 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff14c0cb9f0 0x7ff14c168e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.773+0000 7ff152200640 1 -- 172.21.15.107:0/3249828937 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff14c066cd0 msgr2=0x7ff14c096a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:56.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.773+0000 7ff152200640 1 --2- 172.21.15.107:0/3249828937 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff14c066cd0 0x7ff14c096a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.773+0000 7ff152200640 1 -- 172.21.15.107:0/3249828937 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff140009450 con 0x7ff14c15c760 2024-08-17T02:24:56.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.773+0000 7ff151800640 1 --2- 172.21.15.107:0/3249828937 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff14c066cd0 0x7ff14c096a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:56.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.773+0000 7ff150e00640 1 --2- 172.21.15.107:0/3249828937 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff14c0cb9f0 0x7ff14c168e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:56.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.774+0000 7ff152200640 1 --2- 172.21.15.107:0/3249828937 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff14c15c760 0x7ff14c0b07c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff144009e50 tx=0x7ff14400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:56.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.774+0000 7ff148c00640 1 -- 172.21.15.107:0/3249828937 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14400cd40 con 0x7ff14c15c760 2024-08-17T02:24:56.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.774+0000 7ff148c00640 1 -- 172.21.15.107:0/3249828937 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14400f040 con 0x7ff14c15c760 2024-08-17T02:24:56.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.774+0000 7ff152c00640 1 -- 172.21.15.107:0/3249828937 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff14c0999b0 con 0x7ff14c15c760 2024-08-17T02:24:56.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.774+0000 7ff148c00640 1 -- 172.21.15.107:0/3249828937 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14400cea0 con 0x7ff14c15c760 2024-08-17T02:24:56.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.774+0000 7ff152c00640 1 -- 172.21.15.107:0/3249828937 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff14c097150 con 0x7ff14c15c760 2024-08-17T02:24:56.777 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.775+0000 7ff152c00640 1 -- 172.21.15.107:0/3249828937 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff14c071050 con 0x7ff14c15c760 2024-08-17T02:24:56.777 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.776+0000 7ff148c00640 1 -- 172.21.15.107:0/3249828937 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff1440148e0 con 0x7ff14c15c760 2024-08-17T02:24:56.777 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.777+0000 7ff148c00640 1 --2- 172.21.15.107:0/3249828937 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ff12c065150 0x7ff12c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:56.777 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.777+0000 7ff148c00640 1 -- 172.21.15.107:0/3249828937 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff144083170 con 0x7ff14c15c760 2024-08-17T02:24:56.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.777+0000 7ff151800640 1 --2- 172.21.15.107:0/3249828937 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ff12c065150 0x7ff12c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:56.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.777+0000 7ff151800640 1 --2- 172.21.15.107:0/3249828937 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ff12c065150 0x7ff12c067600 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff140009910 tx=0x7ff140032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:56.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.781+0000 7ff148c00640 1 -- 172.21.15.107:0/3249828937 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff144054cd0 con 0x7ff14c15c760 2024-08-17T02:24:56.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.951+0000 7ff152c00640 1 -- 172.21.15.107:0/3249828937 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff14c062e30 con 0x7ff14c15c760 2024-08-17T02:24:56.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.952+0000 7ff148c00640 1 -- 172.21.15.107:0/3249828937 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff144054860 con 0x7ff14c15c760 2024-08-17T02:24:56.952 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 64 2024-08-17T02:24:56.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.954+0000 7ff152c00640 1 -- 172.21.15.107:0/3249828937 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ff12c065150 msgr2=0x7ff12c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:56.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.954+0000 7ff152c00640 1 --2- 172.21.15.107:0/3249828937 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ff12c065150 0x7ff12c067600 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff140009910 tx=0x7ff140032000 comp rx=0 tx=0).stop 2024-08-17T02:24:56.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.954+0000 7ff152c00640 1 -- 172.21.15.107:0/3249828937 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff14c15c760 msgr2=0x7ff14c0b07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:56.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.954+0000 7ff152c00640 1 --2- 172.21.15.107:0/3249828937 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff14c15c760 0x7ff14c0b07c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff144009e50 tx=0x7ff14400b040 comp rx=0 tx=0).stop 2024-08-17T02:24:56.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.954+0000 7ff152c00640 1 -- 172.21.15.107:0/3249828937 shutdown_connections 2024-08-17T02:24:56.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.954+0000 7ff152c00640 1 --2- 172.21.15.107:0/3249828937 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ff12c065150 0x7ff12c067600 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.954+0000 7ff152c00640 1 --2- 172.21.15.107:0/3249828937 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff14c15c760 0x7ff14c0b07c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.954+0000 7ff152c00640 1 --2- 172.21.15.107:0/3249828937 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff14c0cb9f0 0x7ff14c168e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.954+0000 7ff152c00640 1 --2- 172.21.15.107:0/3249828937 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff14c066cd0 0x7ff14c096a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.954+0000 7ff152c00640 1 -- 172.21.15.107:0/3249828937 >> 172.21.15.107:0/3249828937 conn(0x7ff14c0cca90 msgr2=0x7ff14c15aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:56.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.954+0000 7ff152c00640 1 -- 172.21.15.107:0/3249828937 shutdown_connections 2024-08-17T02:24:56.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:56.954+0000 7ff152c00640 1 -- 172.21.15.107:0/3249828937 wait complete. 2024-08-17T02:24:56.969 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:57.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.117+0000 7f1b58c00640 1 Processor -- start 2024-08-17T02:24:57.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.117+0000 7f1b58c00640 1 -- start start 2024-08-17T02:24:57.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.118+0000 7f1b58c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1b54069710 0x7f1b540ac000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.118+0000 7f1b58c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b540aec20 con 0x7f1b54158bd0 2024-08-17T02:24:57.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.118+0000 7f1b58c00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b540ae330 con 0x7f1b540ac540 2024-08-17T02:24:57.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.118+0000 7f1b58c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b540acd30 con 0x7f1b54069710 2024-08-17T02:24:57.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.118+0000 7f1b53400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f1b54158bd0 0x7f1b54069000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:50422/0 (socket says 172.21.15.107:50422) 2024-08-17T02:24:57.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.118+0000 7f1b53400640 1 -- 172.21.15.107:0/1878064935 learned_addr learned my addr 172.21.15.107:0/1878064935 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:57.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.118+0000 7f1b4be00640 1 --2- 172.21.15.107:0/1878064935 >> v2:172.21.15.107:3300/0 conn(0x7f1b54069710 0x7f1b540ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.119+0000 7f1b4be00640 1 -- 172.21.15.107:0/1878064935 >> v1:172.21.15.157:6789/0 conn(0x7f1b540ac540 legacy=0x7f1b540af0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.119+0000 7f1b4be00640 1 -- 172.21.15.107:0/1878064935 >> v1:172.21.15.107:6789/0 conn(0x7f1b54158bd0 legacy=0x7f1b54069000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.119+0000 7f1b4be00640 1 -- 172.21.15.107:0/1878064935 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b540ae5d0 con 0x7f1b54069710 2024-08-17T02:24:57.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.119+0000 7f1b52a00640 1 -- 172.21.15.107:0/1878064935 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1263126042 0 0) 0x7f1b540aec20 con 0x7f1b54158bd0 2024-08-17T02:24:57.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.120+0000 7f1b4be00640 1 --2- 172.21.15.107:0/1878064935 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b54069710 0x7f1b540ac000 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c009850 tx=0x7f1b3c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c54623976a7fe97d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:57.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.120+0000 7f1b52a00640 1 -- 172.21.15.107:0/1878064935 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c02ad00 con 0x7f1b54069710 2024-08-17T02:24:57.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.120+0000 7f1b52a00640 1 -- 172.21.15.107:0/1878064935 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b3c02ae60 con 0x7f1b54069710 2024-08-17T02:24:57.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.120+0000 7f1b52a00640 1 -- 172.21.15.107:0/1878064935 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c032670 con 0x7f1b54069710 2024-08-17T02:24:57.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.121+0000 7f1b58c00640 1 -- 172.21.15.107:0/1878064935 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b54069710 msgr2=0x7f1b540ac000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.121+0000 7f1b58c00640 1 --2- 172.21.15.107:0/1878064935 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b54069710 0x7f1b540ac000 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c009850 tx=0x7f1b3c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.121+0000 7f1b58c00640 1 -- 172.21.15.107:0/1878064935 shutdown_connections 2024-08-17T02:24:57.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.121+0000 7f1b58c00640 1 --2- 172.21.15.107:0/1878064935 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b54069710 0x7f1b540ac000 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.121+0000 7f1b58c00640 1 -- 172.21.15.107:0/1878064935 >> 172.21.15.107:0/1878064935 conn(0x7f1b54096a70 msgr2=0x7f1b540cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:57.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.121+0000 7f1b58c00640 1 -- 172.21.15.107:0/1878064935 shutdown_connections 2024-08-17T02:24:57.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.121+0000 7f1b58c00640 1 -- 172.21.15.107:0/1878064935 wait complete. 2024-08-17T02:24:57.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.122+0000 7f1b58c00640 1 Processor -- start 2024-08-17T02:24:57.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.122+0000 7f1b58c00640 1 -- start start 2024-08-17T02:24:57.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.123+0000 7f1b58c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b54069710 0x7f1b540b0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.123+0000 7f1b58c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b540ac540 0x7f1b54152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.123+0000 7f1b58c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b54158bd0 0x7f1b54153150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.123+0000 7f1b58c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5415e590 con 0x7f1b540ac540 2024-08-17T02:24:57.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.123+0000 7f1b58c00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5415dc60 con 0x7f1b54158bd0 2024-08-17T02:24:57.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.123+0000 7f1b58c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5415df40 con 0x7f1b54069710 2024-08-17T02:24:57.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.123+0000 7f1b4be00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b540ac540 0x7f1b54152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.123+0000 7f1b4be00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b540ac540 0x7f1b54152c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45678/0 (socket says 172.21.15.107:45678) 2024-08-17T02:24:57.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.123+0000 7f1b4be00640 1 -- 172.21.15.107:0/1627397291 learned_addr learned my addr 172.21.15.107:0/1627397291 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:57.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.124+0000 7f1b53400640 1 --2- 172.21.15.107:0/1627397291 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b54069710 0x7f1b540b0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.124+0000 7f1b53e00640 1 --2- 172.21.15.107:0/1627397291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b54158bd0 0x7f1b54153150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.124+0000 7f1b4be00640 1 -- 172.21.15.107:0/1627397291 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b54069710 msgr2=0x7f1b540b0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.124+0000 7f1b4be00640 1 --2- 172.21.15.107:0/1627397291 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b54069710 0x7f1b540b0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.124+0000 7f1b4be00640 1 -- 172.21.15.107:0/1627397291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b54158bd0 msgr2=0x7f1b54153150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.124+0000 7f1b4be00640 1 --2- 172.21.15.107:0/1627397291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b54158bd0 0x7f1b54153150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.124+0000 7f1b4be00640 1 -- 172.21.15.107:0/1627397291 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b3c009390 con 0x7f1b540ac540 2024-08-17T02:24:57.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.124+0000 7f1b4be00640 1 --2- 172.21.15.107:0/1627397291 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b540ac540 0x7f1b54152c10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c009850 tx=0x7f1b3c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:57.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.124+0000 7f1b4aa00640 1 -- 172.21.15.107:0/1627397291 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c031880 con 0x7f1b540ac540 2024-08-17T02:24:57.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.125+0000 7f1b4aa00640 1 -- 172.21.15.107:0/1627397291 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b3c0319e0 con 0x7f1b540ac540 2024-08-17T02:24:57.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.125+0000 7f1b4aa00640 1 -- 172.21.15.107:0/1627397291 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c031de0 con 0x7f1b540ac540 2024-08-17T02:24:57.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.125+0000 7f1b58c00640 1 -- 172.21.15.107:0/1627397291 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b5415e220 con 0x7f1b540ac540 2024-08-17T02:24:57.127 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.125+0000 7f1b58c00640 1 -- 172.21.15.107:0/1627397291 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b540b0e60 con 0x7f1b540ac540 2024-08-17T02:24:57.127 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.126+0000 7f1b58c00640 1 -- 172.21.15.107:0/1627397291 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b5415e3b0 con 0x7f1b540ac540 2024-08-17T02:24:57.127 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.126+0000 7f1b4aa00640 1 -- 172.21.15.107:0/1627397291 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1b3c039050 con 0x7f1b540ac540 2024-08-17T02:24:57.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.128+0000 7f1b4aa00640 1 --2- 172.21.15.107:0/1627397291 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f1b30065150 0x7f1b30067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.128+0000 7f1b4aa00640 1 -- 172.21.15.107:0/1627397291 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1b3c0a26d0 con 0x7f1b540ac540 2024-08-17T02:24:57.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.128+0000 7f1b53400640 1 --2- 172.21.15.107:0/1627397291 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f1b30065150 0x7f1b30067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.129+0000 7f1b53400640 1 --2- 172.21.15.107:0/1627397291 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f1b30065150 0x7f1b30067600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1b44000c00 tx=0x7f1b44009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:57.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.132+0000 7f1b4aa00640 1 -- 172.21.15.107:0/1627397291 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1b3c0706f0 con 0x7f1b540ac540 2024-08-17T02:24:57.304 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.303+0000 7f1b58c00640 1 -- 172.21.15.107:0/1627397291 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b54071050 con 0x7f1b540ac540 2024-08-17T02:24:57.304 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.304+0000 7f1b4aa00640 1 -- 172.21.15.107:0/1627397291 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f1b3c073d10 con 0x7f1b540ac540 2024-08-17T02:24:57.305 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:24:57.305 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":21,"fsid":"f207b4c0-329d-46b8-b83f-aaf30bdb6ce3","created":"2024-08-17T02:24:11.038049+0000","modified":"2024-08-17T02:24:30.420018+0000","last_up_change":"2024-08-17T02:24:22.047790+0000","last_in_change":"2024-08-17T02:24:13.892720+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:23.456166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:27.078670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:27.804418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"376363f3-b8bf-4f1e-b691-51cdd39171ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37302},{"type":"v1","addr":"172.21.15.107:6801","nonce":37302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37302},{"type":"v1","addr":"172.21.15.107:6803","nonce":37302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37302},{"type":"v1","addr":"172.21.15.107:6807","nonce":37302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37302},{"type":"v1","addr":"172.21.15.107:6805","nonce":37302}]},"public_addr":"172.21.15.107:6801/37302","cluster_addr":"172.21.15.107:6803/37302","heartbeat_back_addr":"172.21.15.107:6807/37302","heartbeat_front_addr":"172.21.15.107:6805/37302","state":["exists","up"]},{"osd":1,"uuid":"cc6624e3-2ad4-4db4-b377-05dfe57424e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37305},{"type":"v1","addr":"172.21.15.107:6824","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37305},{"type":"v1","addr":"172.21.15.107:6827","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37305},{"type":"v1","addr":"172.21.15.107:6831","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37305},{"type":"v1","addr":"172.21.15.107:6829","nonce":37305}]},"public_addr":"172.21.15.107:6824/37305","cluster_addr":"172.21.15.107:6827/37305","heartbeat_back_addr":"172.21.15.107:6831/37305","heartbeat_front_addr":"172.21.15.107:6829/37305","state":["exists","up"]},{"osd":2,"uuid":"25229542-29b5-4281-bcb0-798ae0930aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37307},{"type":"v1","addr":"172.21.15.107:6817","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37307},{"type":"v1","addr":"172.21.15.107:6819","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6823","nonce":37307},{"type":"v1","addr":"172.21.15.107:6825","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37307},{"type":"v1","addr":"172.21.15.107:6821","nonce":37307}]},"public_addr":"172.21.15.107:6817/37307","cluster_addr":"172.21.15.107:6819/37307","heartbeat_back_addr":"172.21.15.107:6825/37307","heartbeat_front_addr":"172.21.15.107:6821/37307","state":["exists","up"]},{"osd":3,"uuid":"5f16aee8-8950-4268-a61a-5cf6ebd670e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37306},{"type":"v1","addr":"172.21.15.107:6809","nonce":37306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37306},{"type":"v1","addr":"172.21.15.107:6811","nonce":37306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37306},{"type":"v1","addr":"172.21.15.107:6815","nonce":37306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37306},{"type":"v1","addr":"172.21.15.107:6813","nonce":37306}]},"public_addr":"172.21.15.107:6809/37306","cluster_addr":"172.21.15.107:6811/37306","heartbeat_back_addr":"172.21.15.107:6815/37306","heartbeat_front_addr":"172.21.15.107:6813/37306","state":["exists","up"]},{"osd":4,"uuid":"23232e28-e23b-4b4e-a531-4939246dbbde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":37329},{"type":"v1","addr":"172.21.15.157:6817","nonce":37329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":37329},{"type":"v1","addr":"172.21.15.157:6819","nonce":37329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":37329},{"type":"v1","addr":"172.21.15.157:6823","nonce":37329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":37329},{"type":"v1","addr":"172.21.15.157:6821","nonce":37329}]},"public_addr":"172.21.15.157:6817/37329","cluster_addr":"172.21.15.157:6819/37329","heartbeat_back_addr":"172.21.15.157:6823/37329","heartbeat_front_addr":"172.21.15.157:6821/37329","state":["exists","up"]},{"osd":5,"uuid":"f87ec331-3e59-4886-a317-6f7e26ec8e21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":37328},{"type":"v1","addr":"172.21.15.157:6804","nonce":37328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":37328},{"type":"v1","addr":"172.21.15.157:6808","nonce":37328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":37328},{"type":"v1","addr":"172.21.15.157:6815","nonce":37328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":37328},{"type":"v1","addr":"172.21.15.157:6812","nonce":37328}]},"public_addr":"172.21.15.157:6804/37328","cluster_addr":"172.21.15.157:6808/37328","heartbeat_back_addr":"172.21.15.157:6815/37328","heartbeat_front_addr":"172.21.15.157:6812/37328","state":["exists","up"]},{"osd":6,"uuid":"92852235-ce49-4d96-a940-6f18d97b13ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":37330},{"type":"v1","addr":"172.21.15.157:6801","nonce":37330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6803","nonce":37330},{"type":"v1","addr":"172.21.15.157:6805","nonce":37330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":37330},{"type":"v1","addr":"172.21.15.157:6813","nonce":37330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":37330},{"type":"v1","addr":"172.21.15.157:6809","nonce":37330}]},"public_addr":"172.21.15.157:6801/37330","cluster_addr":"172.21.15.157:6805/37330","heartbeat_back_addr":"172.21.15.157:6813/37330","heartbeat_front_addr":"172.21.15.157:6809/37330","state":["exists","up"]},{"osd":7,"uuid":"7484a061-723d-4663-b28f-b01766d62f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":37373},{"type":"v1","addr":"172.21.15.157:6825","nonce":37373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":37373},{"type":"v1","addr":"172.21.15.157:6827","nonce":37373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":37373},{"type":"v1","addr":"172.21.15.157:6831","nonce":37373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":37373},{"type":"v1","addr":"172.21.15.157:6829","nonce":37373}]},"public_addr":"172.21.15.157:6825/37373","cluster_addr":"172.21.15.157:6827/37373","heartbeat_back_addr":"172.21.15.157:6831/37373","heartbeat_front_addr":"172.21.15.157:6829/37373","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.110188+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.280265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.252119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.267996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.284582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.144420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.174764+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.308002+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:57.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.307+0000 7f1b58c00640 1 -- 172.21.15.107:0/1627397291 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f1b30065150 msgr2=0x7f1b30067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.307+0000 7f1b58c00640 1 --2- 172.21.15.107:0/1627397291 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f1b30065150 0x7f1b30067600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1b44000c00 tx=0x7f1b44009040 comp rx=0 tx=0).stop 2024-08-17T02:24:57.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.307+0000 7f1b58c00640 1 -- 172.21.15.107:0/1627397291 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b540ac540 msgr2=0x7f1b54152c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.307+0000 7f1b58c00640 1 --2- 172.21.15.107:0/1627397291 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b540ac540 0x7f1b54152c10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c009850 tx=0x7f1b3c032000 comp rx=0 tx=0).stop 2024-08-17T02:24:57.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.307+0000 7f1b58c00640 1 -- 172.21.15.107:0/1627397291 shutdown_connections 2024-08-17T02:24:57.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.307+0000 7f1b58c00640 1 --2- 172.21.15.107:0/1627397291 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f1b30065150 0x7f1b30067600 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.307+0000 7f1b58c00640 1 --2- 172.21.15.107:0/1627397291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b54158bd0 0x7f1b54153150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.307+0000 7f1b58c00640 1 --2- 172.21.15.107:0/1627397291 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b540ac540 0x7f1b54152c10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.307+0000 7f1b58c00640 1 --2- 172.21.15.107:0/1627397291 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b54069710 0x7f1b540b0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.307+0000 7f1b58c00640 1 -- 172.21.15.107:0/1627397291 >> 172.21.15.107:0/1627397291 conn(0x7f1b54096a70 msgr2=0x7f1b54069000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:57.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.307+0000 7f1b58c00640 1 -- 172.21.15.107:0/1627397291 shutdown_connections 2024-08-17T02:24:57.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.307+0000 7f1b58c00640 1 -- 172.21.15.107:0/1627397291 wait complete. 2024-08-17T02:24:57.322 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:24:23.456166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:24:27.078670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:24:27.804418+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:24:57.322 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:24:57.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.473+0000 7f20dfe00640 1 Processor -- start 2024-08-17T02:24:57.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.473+0000 7f20dfe00640 1 -- start start 2024-08-17T02:24:57.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.474+0000 7f20dfe00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20e00cee50 0x7f20e00b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.475+0000 7f20dfe00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f20e00b3080 0x7f20e0099810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.475+0000 7f20dfe00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20e00b2300 con 0x7f20e006ef90 2024-08-17T02:24:57.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.475+0000 7f20dfe00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20e00b1710 con 0x7f20e00b3080 2024-08-17T02:24:57.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.475+0000 7f20dfe00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e00b19d0 con 0x7f20e00cee50 2024-08-17T02:24:57.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.475+0000 7f20dea00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20e00cee50 0x7f20e00b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.475+0000 7f20df400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f20e00b3080 0x7f20e0099810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.475+0000 7f20de000640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f20e006ef90 0x7f20e00b2970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:47146/0 (socket says 172.21.15.107:47146) 2024-08-17T02:24:57.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.475+0000 7f20de000640 1 -- 172.21.15.107:0/2902225549 learned_addr learned my addr 172.21.15.107:0/2902225549 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:57.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.476+0000 7f20dd600640 1 -- 172.21.15.107:0/2902225549 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1896273697 0 0) 0x7f20e00b2300 con 0x7f20e006ef90 2024-08-17T02:24:57.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.476+0000 7f20dea00640 1 -- 172.21.15.107:0/2902225549 >> v2:172.21.15.157:3300/0 conn(0x7f20e00b3080 msgr2=0x7f20e0099810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:57.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.476+0000 7f20dea00640 1 --2- 172.21.15.107:0/2902225549 >> v2:172.21.15.157:3300/0 conn(0x7f20e00b3080 0x7f20e0099810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.476+0000 7f20dea00640 1 -- 172.21.15.107:0/2902225549 >> v1:172.21.15.157:6789/0 conn(0x7f20e006ef90 legacy=0x7f20e00b2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.476+0000 7f20dea00640 1 -- 172.21.15.107:0/2902225549 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e00b1cb0 con 0x7f20e00cee50 2024-08-17T02:24:57.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.477+0000 7f20dea00640 1 --2- 172.21.15.107:0/2902225549 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20e00cee50 0x7f20e00b54e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f20d0009e60 tx=0x7f20d0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18262a3282a2f51 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:57.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.477+0000 7f20dd600640 1 -- 172.21.15.107:0/2902225549 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d0007550 con 0x7f20e00cee50 2024-08-17T02:24:57.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.477+0000 7f20dd600640 1 -- 172.21.15.107:0/2902225549 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d002d050 con 0x7f20e00cee50 2024-08-17T02:24:57.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.477+0000 7f20dd600640 1 -- 172.21.15.107:0/2902225549 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d0007900 con 0x7f20e00cee50 2024-08-17T02:24:57.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.477+0000 7f20dfe00640 1 -- 172.21.15.107:0/2902225549 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20e00cee50 msgr2=0x7f20e00b54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.477+0000 7f20dfe00640 1 --2- 172.21.15.107:0/2902225549 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20e00cee50 0x7f20e00b54e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f20d0009e60 tx=0x7f20d0009780 comp rx=0 tx=0).stop 2024-08-17T02:24:57.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.477+0000 7f20dfe00640 1 -- 172.21.15.107:0/2902225549 shutdown_connections 2024-08-17T02:24:57.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.477+0000 7f20dfe00640 1 --2- 172.21.15.107:0/2902225549 >> v2:172.21.15.157:3300/0 conn(0x7f20e00b3080 0x7f20e0099810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.477+0000 7f20dfe00640 1 --2- 172.21.15.107:0/2902225549 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20e00cee50 0x7f20e00b54e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.477+0000 7f20dfe00640 1 -- 172.21.15.107:0/2902225549 >> 172.21.15.107:0/2902225549 conn(0x7f20e006eb90 msgr2=0x7f20e00cfbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:57.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.477+0000 7f20dfe00640 1 -- 172.21.15.107:0/2902225549 shutdown_connections 2024-08-17T02:24:57.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.477+0000 7f20dfe00640 1 -- 172.21.15.107:0/2902225549 wait complete. 2024-08-17T02:24:57.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.479+0000 7f20dfe00640 1 Processor -- start 2024-08-17T02:24:57.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.479+0000 7f20dfe00640 1 -- start start 2024-08-17T02:24:57.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.480+0000 7f20dfe00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20e006ef90 0x7f20e0155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.480+0000 7f20dfe00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20e00b3080 0x7f20e00ab990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.480+0000 7f20dfe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20e00cee50 0x7f20e00adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.480+0000 7f20dfe00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e00aea50 con 0x7f20e00cee50 2024-08-17T02:24:57.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.480+0000 7f20dfe00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e015e2e0 con 0x7f20e006ef90 2024-08-17T02:24:57.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.480+0000 7f20dfe00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e00ae4f0 con 0x7f20e00b3080 2024-08-17T02:24:57.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.480+0000 7f20df400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20e00cee50 0x7f20e00adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.480+0000 7f20df400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20e00cee50 0x7f20e00adfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45690/0 (socket says 172.21.15.107:45690) 2024-08-17T02:24:57.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.480+0000 7f20df400640 1 -- 172.21.15.107:0/1076254950 learned_addr learned my addr 172.21.15.107:0/1076254950 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:57.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.480+0000 7f20dea00640 1 --2- 172.21.15.107:0/1076254950 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20e006ef90 0x7f20e0155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.480+0000 7f20de000640 1 --2- 172.21.15.107:0/1076254950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20e00b3080 0x7f20e00ab990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.480+0000 7f20df400640 1 -- 172.21.15.107:0/1076254950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20e00b3080 msgr2=0x7f20e00ab990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.480+0000 7f20df400640 1 --2- 172.21.15.107:0/1076254950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20e00b3080 0x7f20e00ab990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.480+0000 7f20df400640 1 -- 172.21.15.107:0/1076254950 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20e006ef90 msgr2=0x7f20e0155cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.481+0000 7f20df400640 1 --2- 172.21.15.107:0/1076254950 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20e006ef90 0x7f20e0155cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.481+0000 7f20df400640 1 -- 172.21.15.107:0/1076254950 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d0009a20 con 0x7f20e00cee50 2024-08-17T02:24:57.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.481+0000 7f20df400640 1 --2- 172.21.15.107:0/1076254950 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20e00cee50 0x7f20e00adfb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f20d800e930 tx=0x7f20d80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:57.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.481+0000 7f20d6000640 1 -- 172.21.15.107:0/1076254950 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d800c940 con 0x7f20e00cee50 2024-08-17T02:24:57.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.481+0000 7f20d6000640 1 -- 172.21.15.107:0/1076254950 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d800caa0 con 0x7f20e00cee50 2024-08-17T02:24:57.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.481+0000 7f20d6000640 1 -- 172.21.15.107:0/1076254950 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d800ce20 con 0x7f20e00cee50 2024-08-17T02:24:57.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.481+0000 7f20dfe00640 1 -- 172.21.15.107:0/1076254950 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20e00ae770 con 0x7f20e00cee50 2024-08-17T02:24:57.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.481+0000 7f20dfe00640 1 -- 172.21.15.107:0/1076254950 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20e015df70 con 0x7f20e00cee50 2024-08-17T02:24:57.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.482+0000 7f20dfe00640 1 -- 172.21.15.107:0/1076254950 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20e015e490 con 0x7f20e00cee50 2024-08-17T02:24:57.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.483+0000 7f20d6000640 1 -- 172.21.15.107:0/1076254950 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f20d8013680 con 0x7f20e00cee50 2024-08-17T02:24:57.484 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.484+0000 7f20d6000640 1 --2- 172.21.15.107:0/1076254950 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f20c0065150 0x7f20c0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.484 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.484+0000 7f20d6000640 1 -- 172.21.15.107:0/1076254950 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f20d8082630 con 0x7f20e00cee50 2024-08-17T02:24:57.484 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.484+0000 7f20dea00640 1 --2- 172.21.15.107:0/1076254950 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f20c0065150 0x7f20c0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.485 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.485+0000 7f20dea00640 1 --2- 172.21.15.107:0/1076254950 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f20c0065150 0x7f20c0067600 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f20d0034000 tx=0x7f20d0037000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:57.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.488+0000 7f20d6000640 1 -- 172.21.15.107:0/1076254950 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f20e015e490 con 0x7f20e00cee50 2024-08-17T02:24:57.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.664+0000 7f20dfe00640 1 -- 172.21.15.107:0/1076254950 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f20e015e490 con 0x7f20e00cee50 2024-08-17T02:24:57.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.664+0000 7f20d6000640 1 -- 172.21.15.107:0/1076254950 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f20e015e490 con 0x7f20e00cee50 2024-08-17T02:24:57.665 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2024-08-17T02:24:57.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.666+0000 7f20dfe00640 1 -- 172.21.15.107:0/1076254950 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f20c0065150 msgr2=0x7f20c0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.666+0000 7f20dfe00640 1 --2- 172.21.15.107:0/1076254950 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f20c0065150 0x7f20c0067600 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f20d0034000 tx=0x7f20d0037000 comp rx=0 tx=0).stop 2024-08-17T02:24:57.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.666+0000 7f20dfe00640 1 -- 172.21.15.107:0/1076254950 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20e00cee50 msgr2=0x7f20e00adfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.666+0000 7f20dfe00640 1 --2- 172.21.15.107:0/1076254950 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20e00cee50 0x7f20e00adfb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f20d800e930 tx=0x7f20d80090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.666+0000 7f20dfe00640 1 -- 172.21.15.107:0/1076254950 shutdown_connections 2024-08-17T02:24:57.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.666+0000 7f20dfe00640 1 --2- 172.21.15.107:0/1076254950 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f20c0065150 0x7f20c0067600 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.666+0000 7f20dfe00640 1 --2- 172.21.15.107:0/1076254950 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20e00cee50 0x7f20e00adfb0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.666+0000 7f20dfe00640 1 --2- 172.21.15.107:0/1076254950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f20e00b3080 0x7f20e00ab990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.666+0000 7f20dfe00640 1 --2- 172.21.15.107:0/1076254950 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20e006ef90 0x7f20e0155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.666+0000 7f20dfe00640 1 -- 172.21.15.107:0/1076254950 >> 172.21.15.107:0/1076254950 conn(0x7f20e006eb90 msgr2=0x7f20e009c130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:57.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.667+0000 7f20dfe00640 1 -- 172.21.15.107:0/1076254950 shutdown_connections 2024-08-17T02:24:57.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.667+0000 7f20dfe00640 1 -- 172.21.15.107:0/1076254950 wait complete. 2024-08-17T02:24:57.682 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:24:57.833 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.833+0000 7f4072200640 1 Processor -- start 2024-08-17T02:24:57.833 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.833+0000 7f4072200640 1 -- start start 2024-08-17T02:24:57.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.834+0000 7f4072200640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f406c158a30 0x7f406c0c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.834+0000 7f4072200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f406c0c4a20 0x7f406c0ce180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.834+0000 7f4072200640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f406c0c61d0 con 0x7f406c158e00 2024-08-17T02:24:57.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.834+0000 7f4072200640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f406c0c64b0 con 0x7f406c158a30 2024-08-17T02:24:57.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.834+0000 7f4072200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f406c0c6790 con 0x7f406c0c4a20 2024-08-17T02:24:57.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.835+0000 7f406be00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f406c0c4a20 0x7f406c0ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.835+0000 7f406be00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f406c0c4a20 0x7f406c0ce180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:59718/0 (socket says 172.21.15.107:59718) 2024-08-17T02:24:57.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.835+0000 7f406be00640 1 -- 172.21.15.107:0/3509961053 learned_addr learned my addr 172.21.15.107:0/3509961053 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:57.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.835+0000 7f4070e00640 1 --2- 172.21.15.107:0/3509961053 >> v2:172.21.15.157:3300/0 conn(0x7f406c158a30 0x7f406c0c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.835+0000 7f406be00640 1 -- 172.21.15.107:0/3509961053 >> v2:172.21.15.157:3300/0 conn(0x7f406c158a30 msgr2=0x7f406c0c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:57.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.835+0000 7f406be00640 1 --2- 172.21.15.107:0/3509961053 >> v2:172.21.15.157:3300/0 conn(0x7f406c158a30 0x7f406c0c58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.835+0000 7f406be00640 1 -- 172.21.15.107:0/3509961053 >> v1:172.21.15.157:6789/0 conn(0x7f406c158e00 legacy=0x7f406c15c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.835+0000 7f406b400640 1 -- 172.21.15.107:0/3509961053 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1355337182 0 0) 0x7f406c0c61d0 con 0x7f406c158e00 2024-08-17T02:24:57.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.835+0000 7f406be00640 1 -- 172.21.15.107:0/3509961053 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f406c0cab70 con 0x7f406c0c4a20 2024-08-17T02:24:57.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.836+0000 7f406be00640 1 --2- 172.21.15.107:0/3509961053 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f406c0c4a20 0x7f406c0ce180 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4058009910 tx=0x7f40580091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7de99506ed042bf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:57.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.837+0000 7f406b400640 1 -- 172.21.15.107:0/3509961053 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405802ae40 con 0x7f406c0c4a20 2024-08-17T02:24:57.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.837+0000 7f406b400640 1 -- 172.21.15.107:0/3509961053 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4058032440 con 0x7f406c0c4a20 2024-08-17T02:24:57.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.837+0000 7f406b400640 1 -- 172.21.15.107:0/3509961053 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40580327e0 con 0x7f406c0c4a20 2024-08-17T02:24:57.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.837+0000 7f4072200640 1 -- 172.21.15.107:0/3509961053 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f406c0c4a20 msgr2=0x7f406c0ce180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.837+0000 7f4072200640 1 --2- 172.21.15.107:0/3509961053 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f406c0c4a20 0x7f406c0ce180 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4058009910 tx=0x7f40580091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.837+0000 7f4072200640 1 -- 172.21.15.107:0/3509961053 shutdown_connections 2024-08-17T02:24:57.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.837+0000 7f4072200640 1 --2- 172.21.15.107:0/3509961053 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f406c0c4a20 0x7f406c0ce180 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.837+0000 7f4072200640 1 --2- 172.21.15.107:0/3509961053 >> v2:172.21.15.157:3300/0 conn(0x7f406c158a30 0x7f406c0c58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.837+0000 7f4072200640 1 -- 172.21.15.107:0/3509961053 >> 172.21.15.107:0/3509961053 conn(0x7f406c098e30 msgr2=0x7f406c06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:57.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.837+0000 7f4072200640 1 -- 172.21.15.107:0/3509961053 shutdown_connections 2024-08-17T02:24:57.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.837+0000 7f4072200640 1 -- 172.21.15.107:0/3509961053 wait complete. 2024-08-17T02:24:57.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.839+0000 7f4072200640 1 Processor -- start 2024-08-17T02:24:57.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.839+0000 7f4072200640 1 -- start start 2024-08-17T02:24:57.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.840+0000 7f4072200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f406c0c4a20 0x7f406c153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.840+0000 7f4072200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f406c158a30 0x7f406c0b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.840+0000 7f4072200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f406c158e00 0x7f406c0b5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.840+0000 7f4072200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406c0c8be0 con 0x7f406c0c4a20 2024-08-17T02:24:57.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.840+0000 7f4072200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406c0c85d0 con 0x7f406c158e00 2024-08-17T02:24:57.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.840+0000 7f4072200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f406c09ad00 con 0x7f406c158a30 2024-08-17T02:24:57.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.840+0000 7f4070e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f406c0c4a20 0x7f406c153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.840+0000 7f4070e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f406c0c4a20 0x7f406c153510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45704/0 (socket says 172.21.15.107:45704) 2024-08-17T02:24:57.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.840+0000 7f4070e00640 1 -- 172.21.15.107:0/370177118 learned_addr learned my addr 172.21.15.107:0/370177118 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:57.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.840+0000 7f406be00640 1 --2- 172.21.15.107:0/370177118 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f406c158a30 0x7f406c0b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.840+0000 7f4071800640 1 --2- 172.21.15.107:0/370177118 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f406c158e00 0x7f406c0b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.841+0000 7f4070e00640 1 -- 172.21.15.107:0/370177118 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f406c158a30 msgr2=0x7f406c0b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.842 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.841+0000 7f4070e00640 1 --2- 172.21.15.107:0/370177118 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f406c158a30 0x7f406c0b4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.842 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.841+0000 7f4070e00640 1 -- 172.21.15.107:0/370177118 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f406c158e00 msgr2=0x7f406c0b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.842 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.841+0000 7f4070e00640 1 --2- 172.21.15.107:0/370177118 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f406c158e00 0x7f406c0b5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.842 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.841+0000 7f4070e00640 1 -- 172.21.15.107:0/370177118 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4058009450 con 0x7f406c0c4a20 2024-08-17T02:24:57.842 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.841+0000 7f4070e00640 1 --2- 172.21.15.107:0/370177118 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f406c0c4a20 0x7f406c153510 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f406000ea20 tx=0x7f40600090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:57.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.841+0000 7f405fe00640 1 -- 172.21.15.107:0/370177118 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406000ca10 con 0x7f406c0c4a20 2024-08-17T02:24:57.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.841+0000 7f405fe00640 1 -- 172.21.15.107:0/370177118 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406000cb70 con 0x7f406c0c4a20 2024-08-17T02:24:57.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.841+0000 7f4072200640 1 -- 172.21.15.107:0/370177118 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f406c0c8870 con 0x7f406c0c4a20 2024-08-17T02:24:57.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.841+0000 7f405fe00640 1 -- 172.21.15.107:0/370177118 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4060013470 con 0x7f406c0c4a20 2024-08-17T02:24:57.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.841+0000 7f4072200640 1 -- 172.21.15.107:0/370177118 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f406c153a50 con 0x7f406c0c4a20 2024-08-17T02:24:57.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.842+0000 7f4072200640 1 -- 172.21.15.107:0/370177118 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f406c071050 con 0x7f406c0c4a20 2024-08-17T02:24:57.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.843+0000 7f405fe00640 1 -- 172.21.15.107:0/370177118 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4060013860 con 0x7f406c0c4a20 2024-08-17T02:24:57.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.844+0000 7f405fe00640 1 --2- 172.21.15.107:0/370177118 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f404c065150 0x7f404c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.844+0000 7f405fe00640 1 -- 172.21.15.107:0/370177118 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4060082730 con 0x7f406c0c4a20 2024-08-17T02:24:57.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.844+0000 7f406be00640 1 --2- 172.21.15.107:0/370177118 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f404c065150 0x7f404c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.845+0000 7f406be00640 1 --2- 172.21.15.107:0/370177118 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f404c065150 0x7f404c067600 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4058034000 tx=0x7f4058032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:57.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:57.848+0000 7f405fe00640 1 -- 172.21.15.107:0/370177118 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4060050800 con 0x7f406c0c4a20 2024-08-17T02:24:58.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.021+0000 7f4072200640 1 -- 172.21.15.107:0/370177118 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f406c062fa0 con 0x7f406c0c4a20 2024-08-17T02:24:58.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.022+0000 7f405fe00640 1 -- 172.21.15.107:0/370177118 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4060053e20 con 0x7f406c0c4a20 2024-08-17T02:24:58.022 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2024-08-17T02:24:58.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.024+0000 7f4072200640 1 -- 172.21.15.107:0/370177118 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f404c065150 msgr2=0x7f404c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:58.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.024+0000 7f4072200640 1 --2- 172.21.15.107:0/370177118 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f404c065150 0x7f404c067600 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4058034000 tx=0x7f4058032000 comp rx=0 tx=0).stop 2024-08-17T02:24:58.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.024+0000 7f4072200640 1 -- 172.21.15.107:0/370177118 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f406c0c4a20 msgr2=0x7f406c153510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:58.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.024+0000 7f4072200640 1 --2- 172.21.15.107:0/370177118 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f406c0c4a20 0x7f406c153510 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f406000ea20 tx=0x7f40600090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.024+0000 7f4072200640 1 -- 172.21.15.107:0/370177118 shutdown_connections 2024-08-17T02:24:58.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.024+0000 7f4072200640 1 --2- 172.21.15.107:0/370177118 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f404c065150 0x7f404c067600 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.024+0000 7f4072200640 1 --2- 172.21.15.107:0/370177118 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f406c158e00 0x7f406c0b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.024+0000 7f4072200640 1 --2- 172.21.15.107:0/370177118 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f406c158a30 0x7f406c0b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.024+0000 7f4072200640 1 --2- 172.21.15.107:0/370177118 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f406c0c4a20 0x7f406c153510 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.024+0000 7f4072200640 1 -- 172.21.15.107:0/370177118 >> 172.21.15.107:0/370177118 conn(0x7f406c098e30 msgr2=0x7f406c068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:58.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.025+0000 7f4072200640 1 -- 172.21.15.107:0/370177118 shutdown_connections 2024-08-17T02:24:58.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.025+0000 7f4072200640 1 -- 172.21.15.107:0/370177118 wait complete. 2024-08-17T02:24:58.040 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:24:58.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.189+0000 7fc6f6800640 1 Processor -- start 2024-08-17T02:24:58.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.189+0000 7fc6f6800640 1 -- start start 2024-08-17T02:24:58.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.190+0000 7fc6f6800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc6f0156c50 0x7fc6f00c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:58.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.190+0000 7fc6f6800640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc6f00adcf0 0x7fc6f00ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:58.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.191+0000 7fc6f6800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6f00ab130 con 0x7fc6f00abb00 2024-08-17T02:24:58.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.191+0000 7fc6f6800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6f00ae5a0 con 0x7fc6f0156c50 2024-08-17T02:24:58.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.191+0000 7fc6f6800640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6f00ae2c0 con 0x7fc6f00adcf0 2024-08-17T02:24:58.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.191+0000 7fc6ef400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc6f0156c50 0x7fc6f00c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:58.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.191+0000 7fc6ef400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc6f0156c50 0x7fc6f00c7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45714/0 (socket says 172.21.15.107:45714) 2024-08-17T02:24:58.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.191+0000 7fc6ef400640 1 -- 172.21.15.107:0/2719019383 learned_addr learned my addr 172.21.15.107:0/2719019383 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:58.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.191+0000 7fc6e6a00640 1 --2- 172.21.15.107:0/2719019383 >> v2:172.21.15.157:3300/0 conn(0x7fc6f00adcf0 0x7fc6f00ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:58.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.191+0000 7fc6ef400640 1 -- 172.21.15.107:0/2719019383 >> v2:172.21.15.157:3300/0 conn(0x7fc6f00adcf0 msgr2=0x7fc6f00ab5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:58.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.191+0000 7fc6ef400640 1 --2- 172.21.15.107:0/2719019383 >> v2:172.21.15.157:3300/0 conn(0x7fc6f00adcf0 0x7fc6f00ab5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.191+0000 7fc6ef400640 1 -- 172.21.15.107:0/2719019383 >> v1:172.21.15.107:6789/0 conn(0x7fc6f00abb00 legacy=0x7fc6f00c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:58.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.191+0000 7fc6ef400640 1 -- 172.21.15.107:0/2719019383 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f00aaae0 con 0x7fc6f0156c50 2024-08-17T02:24:58.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.191+0000 7fc6e6a00640 1 --2- 172.21.15.107:0/2719019383 >> v2:172.21.15.157:3300/0 conn(0x7fc6f00adcf0 0x7fc6f00ab5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:58.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.192+0000 7fc6ef400640 1 --2- 172.21.15.107:0/2719019383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6f0156c50 0x7fc6f00c7cf0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc6f006f0c0 tx=0x7fc6e00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5738255271556169 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:58.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.192+0000 7fc6eea00640 1 -- 172.21.15.107:0/2719019383 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e002ad50 con 0x7fc6f0156c50 2024-08-17T02:24:58.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.193+0000 7fc6eea00640 1 -- 172.21.15.107:0/2719019383 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e0032440 con 0x7fc6f0156c50 2024-08-17T02:24:58.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.193+0000 7fc6eea00640 1 -- 172.21.15.107:0/2719019383 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0032820 con 0x7fc6f0156c50 2024-08-17T02:24:58.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.193+0000 7fc6f6800640 1 -- 172.21.15.107:0/2719019383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6f0156c50 msgr2=0x7fc6f00c7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:58.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.193+0000 7fc6f6800640 1 --2- 172.21.15.107:0/2719019383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6f0156c50 0x7fc6f00c7cf0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc6f006f0c0 tx=0x7fc6e00091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.193+0000 7fc6f6800640 1 -- 172.21.15.107:0/2719019383 shutdown_connections 2024-08-17T02:24:58.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.193+0000 7fc6f6800640 1 --2- 172.21.15.107:0/2719019383 >> v2:172.21.15.157:3300/0 conn(0x7fc6f00adcf0 0x7fc6f00ab5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.193+0000 7fc6f6800640 1 --2- 172.21.15.107:0/2719019383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6f0156c50 0x7fc6f00c7cf0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.193+0000 7fc6f6800640 1 -- 172.21.15.107:0/2719019383 >> 172.21.15.107:0/2719019383 conn(0x7fc6f0067750 msgr2=0x7fc6f00c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:58.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.193+0000 7fc6f6800640 1 -- 172.21.15.107:0/2719019383 shutdown_connections 2024-08-17T02:24:58.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.193+0000 7fc6f6800640 1 -- 172.21.15.107:0/2719019383 wait complete. 2024-08-17T02:24:58.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.195+0000 7fc6f6800640 1 Processor -- start 2024-08-17T02:24:58.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.195+0000 7fc6f6800640 1 -- start start 2024-08-17T02:24:58.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.195+0000 7fc6f6800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6f00abb00 0x7fc6f015b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:58.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.196+0000 7fc6f6800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6f00adcf0 0x7fc6f0155690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:58.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.196+0000 7fc6f6800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6f0156c50 0x7fc6f015c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:58.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.196+0000 7fc6f6800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f015d320 con 0x7fc6f00abb00 2024-08-17T02:24:58.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.196+0000 7fc6f6800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f015cd60 con 0x7fc6f00adcf0 2024-08-17T02:24:58.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.196+0000 7fc6f6800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f015d040 con 0x7fc6f0156c50 2024-08-17T02:24:58.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.196+0000 7fc6ef400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6f00abb00 0x7fc6f015b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:58.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.196+0000 7fc6ef400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6f00abb00 0x7fc6f015b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45726/0 (socket says 172.21.15.107:45726) 2024-08-17T02:24:58.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.196+0000 7fc6ef400640 1 -- 172.21.15.107:0/3634207086 learned_addr learned my addr 172.21.15.107:0/3634207086 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:58.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.196+0000 7fc6e6a00640 1 --2- 172.21.15.107:0/3634207086 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6f00adcf0 0x7fc6f0155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:58.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.196+0000 7fc6efe00640 1 --2- 172.21.15.107:0/3634207086 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6f0156c50 0x7fc6f015c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:58.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.196+0000 7fc6ef400640 1 -- 172.21.15.107:0/3634207086 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6f0156c50 msgr2=0x7fc6f015c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:58.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.196+0000 7fc6ef400640 1 --2- 172.21.15.107:0/3634207086 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6f0156c50 0x7fc6f015c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.196+0000 7fc6ef400640 1 -- 172.21.15.107:0/3634207086 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6f00adcf0 msgr2=0x7fc6f0155690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:58.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.196+0000 7fc6ef400640 1 --2- 172.21.15.107:0/3634207086 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6f00adcf0 0x7fc6f0155690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.196+0000 7fc6ef400640 1 -- 172.21.15.107:0/3634207086 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e0009450 con 0x7fc6f00abb00 2024-08-17T02:24:58.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.196+0000 7fc6efe00640 1 --2- 172.21.15.107:0/3634207086 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6f0156c50 0x7fc6f015c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:58.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.196+0000 7fc6ef400640 1 --2- 172.21.15.107:0/3634207086 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6f00abb00 0x7fc6f015b210 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0009210 tx=0x7fc6e0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:58.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.197+0000 7fc6e7400640 1 -- 172.21.15.107:0/3634207086 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0000d10 con 0x7fc6f00abb00 2024-08-17T02:24:58.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.197+0000 7fc6e7400640 1 -- 172.21.15.107:0/3634207086 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e0031a60 con 0x7fc6f00abb00 2024-08-17T02:24:58.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.197+0000 7fc6e7400640 1 -- 172.21.15.107:0/3634207086 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0031e40 con 0x7fc6f00abb00 2024-08-17T02:24:58.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.197+0000 7fc6f6800640 1 -- 172.21.15.107:0/3634207086 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6f015aa10 con 0x7fc6f00abb00 2024-08-17T02:24:58.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.197+0000 7fc6f6800640 1 -- 172.21.15.107:0/3634207086 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6f015b750 con 0x7fc6f00abb00 2024-08-17T02:24:58.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.198+0000 7fc6f6800640 1 -- 172.21.15.107:0/3634207086 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6f015a870 con 0x7fc6f00abb00 2024-08-17T02:24:58.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.199+0000 7fc6e7400640 1 -- 172.21.15.107:0/3634207086 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc6e0039040 con 0x7fc6f00abb00 2024-08-17T02:24:58.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.199+0000 7fc6e7400640 1 --2- 172.21.15.107:0/3634207086 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fc6cc065150 0x7fc6cc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:58.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.199+0000 7fc6e7400640 1 -- 172.21.15.107:0/3634207086 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc6e00a2070 con 0x7fc6f00abb00 2024-08-17T02:24:58.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.200+0000 7fc6e6a00640 1 --2- 172.21.15.107:0/3634207086 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fc6cc065150 0x7fc6cc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:58.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.200+0000 7fc6e6a00640 1 --2- 172.21.15.107:0/3634207086 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fc6cc065150 0x7fc6cc067600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc6f016a760 tx=0x7fc6d8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:58.204 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.204+0000 7fc6e7400640 1 -- 172.21.15.107:0/3634207086 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc6e00d3e40 con 0x7fc6f00abb00 2024-08-17T02:24:58.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.376+0000 7fc6f6800640 1 -- 172.21.15.107:0/3634207086 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc6f0071050 con 0x7fc6f00abb00 2024-08-17T02:24:58.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.377+0000 7fc6e7400640 1 -- 172.21.15.107:0/3634207086 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc6e0042020 con 0x7fc6f00abb00 2024-08-17T02:24:58.377 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 64 2024-08-17T02:24:58.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.379+0000 7fc6f6800640 1 -- 172.21.15.107:0/3634207086 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fc6cc065150 msgr2=0x7fc6cc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:58.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.379+0000 7fc6f6800640 1 --2- 172.21.15.107:0/3634207086 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fc6cc065150 0x7fc6cc067600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc6f016a760 tx=0x7fc6d8008040 comp rx=0 tx=0).stop 2024-08-17T02:24:58.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.379+0000 7fc6f6800640 1 -- 172.21.15.107:0/3634207086 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6f00abb00 msgr2=0x7fc6f015b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:58.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.379+0000 7fc6f6800640 1 --2- 172.21.15.107:0/3634207086 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6f00abb00 0x7fc6f015b210 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0009210 tx=0x7fc6e0032000 comp rx=0 tx=0).stop 2024-08-17T02:24:58.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.379+0000 7fc6f6800640 1 -- 172.21.15.107:0/3634207086 shutdown_connections 2024-08-17T02:24:58.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.379+0000 7fc6f6800640 1 --2- 172.21.15.107:0/3634207086 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fc6cc065150 0x7fc6cc067600 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.379+0000 7fc6f6800640 1 --2- 172.21.15.107:0/3634207086 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6f0156c50 0x7fc6f015c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.379+0000 7fc6f6800640 1 --2- 172.21.15.107:0/3634207086 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6f00adcf0 0x7fc6f0155690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.379+0000 7fc6f6800640 1 --2- 172.21.15.107:0/3634207086 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6f00abb00 0x7fc6f015b210 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.379+0000 7fc6f6800640 1 -- 172.21.15.107:0/3634207086 >> 172.21.15.107:0/3634207086 conn(0x7fc6f0067750 msgr2=0x7fc6f0152ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:58.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.379+0000 7fc6f6800640 1 -- 172.21.15.107:0/3634207086 shutdown_connections 2024-08-17T02:24:58.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.379+0000 7fc6f6800640 1 -- 172.21.15.107:0/3634207086 wait complete. 2024-08-17T02:24:58.394 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:58.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.541+0000 7fe645400640 1 Processor -- start 2024-08-17T02:24:58.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.542+0000 7fe645400640 1 -- start start 2024-08-17T02:24:58.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.543+0000 7fe645400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe6400ac710 0x7fe640163870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:58.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.543+0000 7fe645400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6400aec20 con 0x7fe640158bd0 2024-08-17T02:24:58.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.543+0000 7fe645400640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6400ae330 con 0x7fe640069710 2024-08-17T02:24:58.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.543+0000 7fe645400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6400acb10 con 0x7fe6400ac710 2024-08-17T02:24:58.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.543+0000 7fe63fe00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fe640158bd0 0x7fe640069000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:50430/0 (socket says 172.21.15.107:50430) 2024-08-17T02:24:58.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.543+0000 7fe63fe00640 1 -- 172.21.15.107:0/1796983713 learned_addr learned my addr 172.21.15.107:0/1796983713 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:58.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.543+0000 7fe644a00640 1 --2- 172.21.15.107:0/1796983713 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe6400ac710 0x7fe640163870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:58.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.544+0000 7fe63ea00640 1 -- 172.21.15.107:0/1796983713 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2636605706 0 0) 0x7fe6400aec20 con 0x7fe640158bd0 2024-08-17T02:24:58.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.544+0000 7fe63ea00640 1 -- 172.21.15.107:0/1796983713 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6240034e0 con 0x7fe640158bd0 2024-08-17T02:24:58.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.544+0000 7fe63ea00640 1 -- 172.21.15.107:0/1796983713 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4287327482 0 0) 0x7fe6400ae330 con 0x7fe640069710 2024-08-17T02:24:58.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.544+0000 7fe63ea00640 1 -- 172.21.15.107:0/1796983713 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6400aec20 con 0x7fe640069710 2024-08-17T02:24:58.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.544+0000 7fe644a00640 1 -- 172.21.15.107:0/1796983713 >> v1:172.21.15.157:6789/0 conn(0x7fe640069710 legacy=0x7fe6400ac000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:58.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.544+0000 7fe644a00640 1 -- 172.21.15.107:0/1796983713 >> v1:172.21.15.107:6789/0 conn(0x7fe640158bd0 legacy=0x7fe640069000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:58.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.544+0000 7fe644a00640 1 -- 172.21.15.107:0/1796983713 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6400acd30 con 0x7fe6400ac710 2024-08-17T02:24:58.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.545+0000 7fe644a00640 1 --2- 172.21.15.107:0/1796983713 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe6400ac710 0x7fe640163870 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe638009e90 tx=0x7fe638009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e938dff6050f6079 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:58.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.545+0000 7fe63ea00640 1 -- 172.21.15.107:0/1796983713 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe638007550 con 0x7fe6400ac710 2024-08-17T02:24:58.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.545+0000 7fe63ea00640 1 -- 172.21.15.107:0/1796983713 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63802d050 con 0x7fe6400ac710 2024-08-17T02:24:58.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.545+0000 7fe63ea00640 1 -- 172.21.15.107:0/1796983713 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6380078e0 con 0x7fe6400ac710 2024-08-17T02:24:58.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.546+0000 7fe645400640 1 -- 172.21.15.107:0/1796983713 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe6400ac710 msgr2=0x7fe640163870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:58.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.546+0000 7fe645400640 1 --2- 172.21.15.107:0/1796983713 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe6400ac710 0x7fe640163870 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe638009e90 tx=0x7fe638009780 comp rx=0 tx=0).stop 2024-08-17T02:24:58.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.546+0000 7fe645400640 1 -- 172.21.15.107:0/1796983713 shutdown_connections 2024-08-17T02:24:58.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.546+0000 7fe645400640 1 --2- 172.21.15.107:0/1796983713 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe6400ac710 0x7fe640163870 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.546+0000 7fe645400640 1 -- 172.21.15.107:0/1796983713 >> 172.21.15.107:0/1796983713 conn(0x7fe640096a70 msgr2=0x7fe6400cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:58.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.546+0000 7fe645400640 1 -- 172.21.15.107:0/1796983713 shutdown_connections 2024-08-17T02:24:58.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.546+0000 7fe645400640 1 -- 172.21.15.107:0/1796983713 wait complete. 2024-08-17T02:24:58.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.547+0000 7fe645400640 1 Processor -- start 2024-08-17T02:24:58.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.547+0000 7fe645400640 1 -- start start 2024-08-17T02:24:58.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.548+0000 7fe645400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe640069710 0x7fe640159980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:58.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.548+0000 7fe645400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6400ac710 0x7fe6400c8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:58.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.548+0000 7fe645400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe640158bd0 0x7fe640148ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:58.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.548+0000 7fe645400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6400b1280 con 0x7fe6400ac710 2024-08-17T02:24:58.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.548+0000 7fe645400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6400b1560 con 0x7fe640069710 2024-08-17T02:24:58.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.548+0000 7fe645400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6400b1840 con 0x7fe640158bd0 2024-08-17T02:24:58.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.548+0000 7fe63f400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6400ac710 0x7fe6400c8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:58.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.549+0000 7fe63f400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6400ac710 0x7fe6400c8e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45728/0 (socket says 172.21.15.107:45728) 2024-08-17T02:24:58.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.549+0000 7fe63f400640 1 -- 172.21.15.107:0/824929830 learned_addr learned my addr 172.21.15.107:0/824929830 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:58.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.549+0000 7fe63fe00640 1 --2- 172.21.15.107:0/824929830 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe640069710 0x7fe640159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:58.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.549+0000 7fe644a00640 1 --2- 172.21.15.107:0/824929830 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe640158bd0 0x7fe640148ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:58.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.549+0000 7fe63f400640 1 -- 172.21.15.107:0/824929830 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe640158bd0 msgr2=0x7fe640148ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:58.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.549+0000 7fe63f400640 1 --2- 172.21.15.107:0/824929830 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe640158bd0 0x7fe640148ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.549+0000 7fe63f400640 1 -- 172.21.15.107:0/824929830 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe640069710 msgr2=0x7fe640159980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:58.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.549+0000 7fe63f400640 1 --2- 172.21.15.107:0/824929830 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe640069710 0x7fe640159980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.549+0000 7fe63f400640 1 -- 172.21.15.107:0/824929830 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe638009a20 con 0x7fe6400ac710 2024-08-17T02:24:58.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.549+0000 7fe63fe00640 1 --2- 172.21.15.107:0/824929830 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe640069710 0x7fe640159980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:58.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.549+0000 7fe63f400640 1 --2- 172.21.15.107:0/824929830 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6400ac710 0x7fe6400c8e60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe62c00c560 tx=0x7fe62c007d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:58.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.549+0000 7fe637400640 1 -- 172.21.15.107:0/824929830 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c011590 con 0x7fe6400ac710 2024-08-17T02:24:58.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.549+0000 7fe637400640 1 -- 172.21.15.107:0/824929830 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe62c0116f0 con 0x7fe6400ac710 2024-08-17T02:24:58.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.549+0000 7fe637400640 1 -- 172.21.15.107:0/824929830 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c011af0 con 0x7fe6400ac710 2024-08-17T02:24:58.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.549+0000 7fe645400640 1 -- 172.21.15.107:0/824929830 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6400b1b20 con 0x7fe6400ac710 2024-08-17T02:24:58.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.550+0000 7fe645400640 1 -- 172.21.15.107:0/824929830 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6400b3770 con 0x7fe6400ac710 2024-08-17T02:24:58.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.551+0000 7fe645400640 1 -- 172.21.15.107:0/824929830 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6400b2020 con 0x7fe6400ac710 2024-08-17T02:24:58.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.551+0000 7fe637400640 1 -- 172.21.15.107:0/824929830 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe62c01c460 con 0x7fe6400ac710 2024-08-17T02:24:58.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.552+0000 7fe637400640 1 --2- 172.21.15.107:0/824929830 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe620065150 0x7fe620067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:58.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.552+0000 7fe637400640 1 -- 172.21.15.107:0/824929830 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe62c082210 con 0x7fe6400ac710 2024-08-17T02:24:58.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.552+0000 7fe63fe00640 1 --2- 172.21.15.107:0/824929830 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe620065150 0x7fe620067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:58.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.553+0000 7fe63fe00640 1 --2- 172.21.15.107:0/824929830 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe620065150 0x7fe620067600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe640068bd0 tx=0x7fe630009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:58.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.556+0000 7fe637400640 1 -- 172.21.15.107:0/824929830 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe62c050230 con 0x7fe6400ac710 2024-08-17T02:24:58.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.729+0000 7fe645400640 1 -- 172.21.15.107:0/824929830 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe640071050 con 0x7fe6400ac710 2024-08-17T02:24:58.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.730+0000 7fe637400640 1 -- 172.21.15.107:0/824929830 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fe62c053850 con 0x7fe6400ac710 2024-08-17T02:24:58.730 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:24:58.731 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":21,"fsid":"f207b4c0-329d-46b8-b83f-aaf30bdb6ce3","created":"2024-08-17T02:24:11.038049+0000","modified":"2024-08-17T02:24:30.420018+0000","last_up_change":"2024-08-17T02:24:22.047790+0000","last_in_change":"2024-08-17T02:24:13.892720+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:23.456166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:27.078670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:27.804418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"376363f3-b8bf-4f1e-b691-51cdd39171ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37302},{"type":"v1","addr":"172.21.15.107:6801","nonce":37302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37302},{"type":"v1","addr":"172.21.15.107:6803","nonce":37302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37302},{"type":"v1","addr":"172.21.15.107:6807","nonce":37302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37302},{"type":"v1","addr":"172.21.15.107:6805","nonce":37302}]},"public_addr":"172.21.15.107:6801/37302","cluster_addr":"172.21.15.107:6803/37302","heartbeat_back_addr":"172.21.15.107:6807/37302","heartbeat_front_addr":"172.21.15.107:6805/37302","state":["exists","up"]},{"osd":1,"uuid":"cc6624e3-2ad4-4db4-b377-05dfe57424e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37305},{"type":"v1","addr":"172.21.15.107:6824","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37305},{"type":"v1","addr":"172.21.15.107:6827","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37305},{"type":"v1","addr":"172.21.15.107:6831","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37305},{"type":"v1","addr":"172.21.15.107:6829","nonce":37305}]},"public_addr":"172.21.15.107:6824/37305","cluster_addr":"172.21.15.107:6827/37305","heartbeat_back_addr":"172.21.15.107:6831/37305","heartbeat_front_addr":"172.21.15.107:6829/37305","state":["exists","up"]},{"osd":2,"uuid":"25229542-29b5-4281-bcb0-798ae0930aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37307},{"type":"v1","addr":"172.21.15.107:6817","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37307},{"type":"v1","addr":"172.21.15.107:6819","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6823","nonce":37307},{"type":"v1","addr":"172.21.15.107:6825","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37307},{"type":"v1","addr":"172.21.15.107:6821","nonce":37307}]},"public_addr":"172.21.15.107:6817/37307","cluster_addr":"172.21.15.107:6819/37307","heartbeat_back_addr":"172.21.15.107:6825/37307","heartbeat_front_addr":"172.21.15.107:6821/37307","state":["exists","up"]},{"osd":3,"uuid":"5f16aee8-8950-4268-a61a-5cf6ebd670e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37306},{"type":"v1","addr":"172.21.15.107:6809","nonce":37306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37306},{"type":"v1","addr":"172.21.15.107:6811","nonce":37306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37306},{"type":"v1","addr":"172.21.15.107:6815","nonce":37306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37306},{"type":"v1","addr":"172.21.15.107:6813","nonce":37306}]},"public_addr":"172.21.15.107:6809/37306","cluster_addr":"172.21.15.107:6811/37306","heartbeat_back_addr":"172.21.15.107:6815/37306","heartbeat_front_addr":"172.21.15.107:6813/37306","state":["exists","up"]},{"osd":4,"uuid":"23232e28-e23b-4b4e-a531-4939246dbbde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":37329},{"type":"v1","addr":"172.21.15.157:6817","nonce":37329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":37329},{"type":"v1","addr":"172.21.15.157:6819","nonce":37329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":37329},{"type":"v1","addr":"172.21.15.157:6823","nonce":37329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":37329},{"type":"v1","addr":"172.21.15.157:6821","nonce":37329}]},"public_addr":"172.21.15.157:6817/37329","cluster_addr":"172.21.15.157:6819/37329","heartbeat_back_addr":"172.21.15.157:6823/37329","heartbeat_front_addr":"172.21.15.157:6821/37329","state":["exists","up"]},{"osd":5,"uuid":"f87ec331-3e59-4886-a317-6f7e26ec8e21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":37328},{"type":"v1","addr":"172.21.15.157:6804","nonce":37328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":37328},{"type":"v1","addr":"172.21.15.157:6808","nonce":37328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":37328},{"type":"v1","addr":"172.21.15.157:6815","nonce":37328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":37328},{"type":"v1","addr":"172.21.15.157:6812","nonce":37328}]},"public_addr":"172.21.15.157:6804/37328","cluster_addr":"172.21.15.157:6808/37328","heartbeat_back_addr":"172.21.15.157:6815/37328","heartbeat_front_addr":"172.21.15.157:6812/37328","state":["exists","up"]},{"osd":6,"uuid":"92852235-ce49-4d96-a940-6f18d97b13ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":37330},{"type":"v1","addr":"172.21.15.157:6801","nonce":37330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6803","nonce":37330},{"type":"v1","addr":"172.21.15.157:6805","nonce":37330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":37330},{"type":"v1","addr":"172.21.15.157:6813","nonce":37330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":37330},{"type":"v1","addr":"172.21.15.157:6809","nonce":37330}]},"public_addr":"172.21.15.157:6801/37330","cluster_addr":"172.21.15.157:6805/37330","heartbeat_back_addr":"172.21.15.157:6813/37330","heartbeat_front_addr":"172.21.15.157:6809/37330","state":["exists","up"]},{"osd":7,"uuid":"7484a061-723d-4663-b28f-b01766d62f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":37373},{"type":"v1","addr":"172.21.15.157:6825","nonce":37373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":37373},{"type":"v1","addr":"172.21.15.157:6827","nonce":37373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":37373},{"type":"v1","addr":"172.21.15.157:6831","nonce":37373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":37373},{"type":"v1","addr":"172.21.15.157:6829","nonce":37373}]},"public_addr":"172.21.15.157:6825/37373","cluster_addr":"172.21.15.157:6827/37373","heartbeat_back_addr":"172.21.15.157:6831/37373","heartbeat_front_addr":"172.21.15.157:6829/37373","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.110188+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.280265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.252119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.267996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.284582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.144420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.174764+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.308002+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:58.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.732+0000 7fe645400640 1 -- 172.21.15.107:0/824929830 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe620065150 msgr2=0x7fe620067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:58.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.732+0000 7fe645400640 1 --2- 172.21.15.107:0/824929830 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe620065150 0x7fe620067600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe640068bd0 tx=0x7fe630009040 comp rx=0 tx=0).stop 2024-08-17T02:24:58.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.732+0000 7fe645400640 1 -- 172.21.15.107:0/824929830 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6400ac710 msgr2=0x7fe6400c8e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:58.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.732+0000 7fe645400640 1 --2- 172.21.15.107:0/824929830 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6400ac710 0x7fe6400c8e60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe62c00c560 tx=0x7fe62c007d50 comp rx=0 tx=0).stop 2024-08-17T02:24:58.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.732+0000 7fe645400640 1 -- 172.21.15.107:0/824929830 shutdown_connections 2024-08-17T02:24:58.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.732+0000 7fe645400640 1 --2- 172.21.15.107:0/824929830 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe620065150 0x7fe620067600 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.732+0000 7fe645400640 1 --2- 172.21.15.107:0/824929830 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe640158bd0 0x7fe640148ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.732+0000 7fe645400640 1 --2- 172.21.15.107:0/824929830 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6400ac710 0x7fe6400c8e60 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.732+0000 7fe645400640 1 --2- 172.21.15.107:0/824929830 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe640069710 0x7fe640159980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.732+0000 7fe645400640 1 -- 172.21.15.107:0/824929830 >> 172.21.15.107:0/824929830 conn(0x7fe640096a70 msgr2=0x7fe640156c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:58.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.732+0000 7fe645400640 1 -- 172.21.15.107:0/824929830 shutdown_connections 2024-08-17T02:24:58.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.732+0000 7fe645400640 1 -- 172.21.15.107:0/824929830 wait complete. 2024-08-17T02:24:58.748 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:24:23.456166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:24:27.078670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:24:27.804418+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:24:58.748 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:24:58.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.898+0000 7fd527e00640 1 Processor -- start 2024-08-17T02:24:58.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.899+0000 7fd527e00640 1 -- start start 2024-08-17T02:24:58.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.900+0000 7fd527e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd52815a0e0 0x7fd52806e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:58.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.900+0000 7fd527e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd5280ab010 0x7fd5280ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:58.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.900+0000 7fd527e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5280af5f0 con 0x7fd52806df00 2024-08-17T02:24:58.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.900+0000 7fd527e00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd528159600 con 0x7fd5280ab010 2024-08-17T02:24:58.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.900+0000 7fd527e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5281598e0 con 0x7fd52815a0e0 2024-08-17T02:24:58.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.900+0000 7fd526a00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fd52806df00 0x7fd5280aa900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:50432/0 (socket says 172.21.15.107:50432) 2024-08-17T02:24:58.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.900+0000 7fd526a00640 1 -- 172.21.15.107:0/545761654 learned_addr learned my addr 172.21.15.107:0/545761654 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:58.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.900+0000 7fd527400640 1 --2- 172.21.15.107:0/545761654 >> v2:172.21.15.157:3300/0 conn(0x7fd5280ab010 0x7fd5280ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:58.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.900+0000 7fd51e000640 1 --2- 172.21.15.107:0/545761654 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd52815a0e0 0x7fd52806e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:58.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.901+0000 7fd526000640 1 -- 172.21.15.107:0/545761654 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1843392620 0 0) 0x7fd5280af5f0 con 0x7fd52806df00 2024-08-17T02:24:58.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.901+0000 7fd526000640 1 -- 172.21.15.107:0/545761654 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd50c0034e0 con 0x7fd52806df00 2024-08-17T02:24:58.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.901+0000 7fd527400640 1 -- 172.21.15.107:0/545761654 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd52815a0e0 msgr2=0x7fd52806e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:58.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.901+0000 7fd527400640 1 --2- 172.21.15.107:0/545761654 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd52815a0e0 0x7fd52806e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.901+0000 7fd527400640 1 -- 172.21.15.107:0/545761654 >> v1:172.21.15.107:6789/0 conn(0x7fd52806df00 legacy=0x7fd5280aa900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:58.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.901+0000 7fd527400640 1 -- 172.21.15.107:0/545761654 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd528159bc0 con 0x7fd5280ab010 2024-08-17T02:24:58.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.902+0000 7fd527400640 1 --2- 172.21.15.107:0/545761654 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5280ab010 0x7fd5280ae8c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd520009e60 tx=0x7fd520009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a59788f868ef6b8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:58.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.902+0000 7fd526000640 1 -- 172.21.15.107:0/545761654 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd520007550 con 0x7fd5280ab010 2024-08-17T02:24:58.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.902+0000 7fd526000640 1 -- 172.21.15.107:0/545761654 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52002d050 con 0x7fd5280ab010 2024-08-17T02:24:58.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.902+0000 7fd526000640 1 -- 172.21.15.107:0/545761654 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd520007900 con 0x7fd5280ab010 2024-08-17T02:24:58.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.903+0000 7fd527e00640 1 -- 172.21.15.107:0/545761654 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5280ab010 msgr2=0x7fd5280ae8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:58.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.903+0000 7fd527e00640 1 --2- 172.21.15.107:0/545761654 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5280ab010 0x7fd5280ae8c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd520009e60 tx=0x7fd520009780 comp rx=0 tx=0).stop 2024-08-17T02:24:58.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.903+0000 7fd527e00640 1 -- 172.21.15.107:0/545761654 shutdown_connections 2024-08-17T02:24:58.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.903+0000 7fd527e00640 1 --2- 172.21.15.107:0/545761654 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5280ab010 0x7fd5280ae8c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.903+0000 7fd527e00640 1 --2- 172.21.15.107:0/545761654 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd52815a0e0 0x7fd52806e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.903+0000 7fd527e00640 1 -- 172.21.15.107:0/545761654 >> 172.21.15.107:0/545761654 conn(0x7fd528067750 msgr2=0x7fd52806c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:58.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.903+0000 7fd527e00640 1 -- 172.21.15.107:0/545761654 shutdown_connections 2024-08-17T02:24:58.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.903+0000 7fd527e00640 1 -- 172.21.15.107:0/545761654 wait complete. 2024-08-17T02:24:58.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.904+0000 7fd527e00640 1 Processor -- start 2024-08-17T02:24:58.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.904+0000 7fd527e00640 1 -- start start 2024-08-17T02:24:58.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.905+0000 7fd527e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd52806df00 0x7fd5280a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:58.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.905+0000 7fd527e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5280ab010 0x7fd5280a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:58.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.905+0000 7fd527e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd52815a0e0 0x7fd528166d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:58.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.905+0000 7fd527e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5280a5a10 con 0x7fd5280ab010 2024-08-17T02:24:58.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.905+0000 7fd527e00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5280c9af0 con 0x7fd52806df00 2024-08-17T02:24:58.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.905+0000 7fd527e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5280c9dd0 con 0x7fd52815a0e0 2024-08-17T02:24:58.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.905+0000 7fd51e000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5280ab010 0x7fd5280a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:58.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.905+0000 7fd51e000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5280ab010 0x7fd5280a98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45734/0 (socket says 172.21.15.107:45734) 2024-08-17T02:24:58.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.905+0000 7fd51e000640 1 -- 172.21.15.107:0/4034546931 learned_addr learned my addr 172.21.15.107:0/4034546931 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:58.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.906+0000 7fd526a00640 1 --2- 172.21.15.107:0/4034546931 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd52806df00 0x7fd5280a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:58.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.906+0000 7fd527400640 1 --2- 172.21.15.107:0/4034546931 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd52815a0e0 0x7fd528166d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:58.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.906+0000 7fd51e000640 1 -- 172.21.15.107:0/4034546931 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd52815a0e0 msgr2=0x7fd528166d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:58.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.906+0000 7fd51e000640 1 --2- 172.21.15.107:0/4034546931 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd52815a0e0 0x7fd528166d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.906+0000 7fd51e000640 1 -- 172.21.15.107:0/4034546931 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd52806df00 msgr2=0x7fd5280a54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:58.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.906+0000 7fd51e000640 1 --2- 172.21.15.107:0/4034546931 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd52806df00 0x7fd5280a54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.906+0000 7fd51e000640 1 -- 172.21.15.107:0/4034546931 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd520009a20 con 0x7fd5280ab010 2024-08-17T02:24:58.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.906+0000 7fd526a00640 1 --2- 172.21.15.107:0/4034546931 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd52806df00 0x7fd5280a54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:58.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.906+0000 7fd527400640 1 --2- 172.21.15.107:0/4034546931 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd52815a0e0 0x7fd528166d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:58.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.906+0000 7fd51e000640 1 --2- 172.21.15.107:0/4034546931 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5280ab010 0x7fd5280a98e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd51000e900 tx=0x7fd5100090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:58.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.906+0000 7fd51ea00640 1 -- 172.21.15.107:0/4034546931 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51000c8e0 con 0x7fd5280ab010 2024-08-17T02:24:58.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.906+0000 7fd51ea00640 1 -- 172.21.15.107:0/4034546931 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51000ca40 con 0x7fd5280ab010 2024-08-17T02:24:58.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.906+0000 7fd51ea00640 1 -- 172.21.15.107:0/4034546931 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51000cde0 con 0x7fd5280ab010 2024-08-17T02:24:58.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.906+0000 7fd527e00640 1 -- 172.21.15.107:0/4034546931 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5280ca0b0 con 0x7fd5280ab010 2024-08-17T02:24:58.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.907+0000 7fd527e00640 1 -- 172.21.15.107:0/4034546931 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5280c97c0 con 0x7fd5280ab010 2024-08-17T02:24:58.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.908+0000 7fd527e00640 1 -- 172.21.15.107:0/4034546931 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd528071050 con 0x7fd5280ab010 2024-08-17T02:24:58.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.908+0000 7fd51ea00640 1 -- 172.21.15.107:0/4034546931 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd510013680 con 0x7fd5280ab010 2024-08-17T02:24:58.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.910+0000 7fd51ea00640 1 --2- 172.21.15.107:0/4034546931 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd504065150 0x7fd504067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:58.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.910+0000 7fd51ea00640 1 -- 172.21.15.107:0/4034546931 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd5100826a0 con 0x7fd5280ab010 2024-08-17T02:24:58.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.910+0000 7fd526a00640 1 --2- 172.21.15.107:0/4034546931 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd504065150 0x7fd504067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:58.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.910+0000 7fd526a00640 1 --2- 172.21.15.107:0/4034546931 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd504065150 0x7fd504067600 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd5280b13b0 tx=0x7fd518009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:58.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:58.914+0000 7fd51ea00640 1 -- 172.21.15.107:0/4034546931 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd510050780 con 0x7fd5280ab010 2024-08-17T02:24:59.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.084+0000 7fd527e00640 1 -- 172.21.15.107:0/4034546931 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd5280ad9a0 con 0x7fd5280ab010 2024-08-17T02:24:59.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.085+0000 7fd51ea00640 1 -- 172.21.15.107:0/4034546931 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd510053da0 con 0x7fd5280ab010 2024-08-17T02:24:59.085 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2024-08-17T02:24:59.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.087+0000 7fd527e00640 1 -- 172.21.15.107:0/4034546931 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd504065150 msgr2=0x7fd504067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:59.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.087+0000 7fd527e00640 1 --2- 172.21.15.107:0/4034546931 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd504065150 0x7fd504067600 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd5280b13b0 tx=0x7fd518009040 comp rx=0 tx=0).stop 2024-08-17T02:24:59.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.087+0000 7fd527e00640 1 -- 172.21.15.107:0/4034546931 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5280ab010 msgr2=0x7fd5280a98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:59.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.087+0000 7fd527e00640 1 --2- 172.21.15.107:0/4034546931 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5280ab010 0x7fd5280a98e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd51000e900 tx=0x7fd5100090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.087+0000 7fd527e00640 1 -- 172.21.15.107:0/4034546931 shutdown_connections 2024-08-17T02:24:59.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.087+0000 7fd527e00640 1 --2- 172.21.15.107:0/4034546931 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd504065150 0x7fd504067600 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.087+0000 7fd527e00640 1 --2- 172.21.15.107:0/4034546931 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd52815a0e0 0x7fd528166d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.087+0000 7fd527e00640 1 --2- 172.21.15.107:0/4034546931 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5280ab010 0x7fd5280a98e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.087+0000 7fd527e00640 1 --2- 172.21.15.107:0/4034546931 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd52806df00 0x7fd5280a54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.087+0000 7fd527e00640 1 -- 172.21.15.107:0/4034546931 >> 172.21.15.107:0/4034546931 conn(0x7fd528067750 msgr2=0x7fd528154600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:59.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.087+0000 7fd527e00640 1 -- 172.21.15.107:0/4034546931 shutdown_connections 2024-08-17T02:24:59.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.087+0000 7fd527e00640 1 -- 172.21.15.107:0/4034546931 wait complete. 2024-08-17T02:24:59.102 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:24:59.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.251+0000 7f4a7e000640 1 Processor -- start 2024-08-17T02:24:59.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.251+0000 7f4a7e000640 1 -- start start 2024-08-17T02:24:59.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.252+0000 7f4a7e000640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4a780ae540 0x7f4a780ae910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:59.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.252+0000 7f4a7e000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a780ab790 con 0x7f4a780af0f0 2024-08-17T02:24:59.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.252+0000 7f4a7e000640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a78068b50 con 0x7f4a780acc30 2024-08-17T02:24:59.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.252+0000 7f4a7e000640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a780aee50 con 0x7f4a780ae540 2024-08-17T02:24:59.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.252+0000 7f4a6fe00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f4a780af0f0 0x7f4a78067d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:50448/0 (socket says 172.21.15.107:50448) 2024-08-17T02:24:59.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.252+0000 7f4a6fe00640 1 -- 172.21.15.107:0/1156919149 learned_addr learned my addr 172.21.15.107:0/1156919149 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:59.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.253+0000 7f4a7cc00640 1 --2- 172.21.15.107:0/1156919149 >> v2:172.21.15.157:3300/0 conn(0x7f4a780ae540 0x7f4a780ae910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:59.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.253+0000 7f4a77e00640 1 -- 172.21.15.107:0/1156919149 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2224286514 0 0) 0x7f4a780ab790 con 0x7f4a780af0f0 2024-08-17T02:24:59.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.253+0000 7f4a77e00640 1 -- 172.21.15.107:0/1156919149 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a5c0034e0 con 0x7f4a780af0f0 2024-08-17T02:24:59.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.253+0000 7f4a77e00640 1 -- 172.21.15.107:0/1156919149 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2524700445 0 0) 0x7f4a78068b50 con 0x7f4a780acc30 2024-08-17T02:24:59.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.253+0000 7f4a77e00640 1 -- 172.21.15.107:0/1156919149 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a780ab790 con 0x7f4a780acc30 2024-08-17T02:24:59.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.253+0000 7f4a7cc00640 1 -- 172.21.15.107:0/1156919149 >> v1:172.21.15.157:6789/0 conn(0x7f4a780acc30 legacy=0x7f4a78068440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:59.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.253+0000 7f4a7cc00640 1 -- 172.21.15.107:0/1156919149 >> v1:172.21.15.107:6789/0 conn(0x7f4a780af0f0 legacy=0x7f4a78067d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:59.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.253+0000 7f4a7cc00640 1 -- 172.21.15.107:0/1156919149 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a780aab80 con 0x7f4a780ae540 2024-08-17T02:24:59.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.254+0000 7f4a7cc00640 1 --2- 172.21.15.107:0/1156919149 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a780ae540 0x7f4a780ae910 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4a68009850 tx=0x7f4a680090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef2256bdb253d2b4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:59.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.254+0000 7f4a77e00640 1 -- 172.21.15.107:0/1156919149 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6802ae20 con 0x7f4a780ae540 2024-08-17T02:24:59.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.255+0000 7f4a77e00640 1 -- 172.21.15.107:0/1156919149 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a68032440 con 0x7f4a780ae540 2024-08-17T02:24:59.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.255+0000 7f4a77e00640 1 -- 172.21.15.107:0/1156919149 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a680327e0 con 0x7f4a780ae540 2024-08-17T02:24:59.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.255+0000 7f4a7e000640 1 -- 172.21.15.107:0/1156919149 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a780ae540 msgr2=0x7f4a780ae910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:59.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.255+0000 7f4a7e000640 1 --2- 172.21.15.107:0/1156919149 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a780ae540 0x7f4a780ae910 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4a68009850 tx=0x7f4a680090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.255+0000 7f4a7e000640 1 -- 172.21.15.107:0/1156919149 shutdown_connections 2024-08-17T02:24:59.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.255+0000 7f4a7e000640 1 --2- 172.21.15.107:0/1156919149 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a780ae540 0x7f4a780ae910 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.255+0000 7f4a7e000640 1 -- 172.21.15.107:0/1156919149 >> 172.21.15.107:0/1156919149 conn(0x7f4a78096a70 msgr2=0x7f4a78096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:59.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.255+0000 7f4a7e000640 1 -- 172.21.15.107:0/1156919149 shutdown_connections 2024-08-17T02:24:59.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.255+0000 7f4a7e000640 1 -- 172.21.15.107:0/1156919149 wait complete. 2024-08-17T02:24:59.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.257+0000 7f4a7e000640 1 Processor -- start 2024-08-17T02:24:59.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.257+0000 7f4a7e000640 1 -- start start 2024-08-17T02:24:59.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.258+0000 7f4a7e000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a780acc30 0x7f4a7809b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:59.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.258+0000 7f4a7e000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a780ae540 0x7f4a7814d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:59.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.258+0000 7f4a7e000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a780af0f0 0x7f4a7816c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:59.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.258+0000 7f4a7e000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a78097b60 con 0x7f4a780af0f0 2024-08-17T02:24:59.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.258+0000 7f4a7e000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7809ac10 con 0x7f4a780ae540 2024-08-17T02:24:59.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.258+0000 7f4a7e000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7809a600 con 0x7f4a780acc30 2024-08-17T02:24:59.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.258+0000 7f4a7d600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a780af0f0 0x7f4a7816c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:59.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.258+0000 7f4a7d600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a780af0f0 0x7f4a7816c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45736/0 (socket says 172.21.15.107:45736) 2024-08-17T02:24:59.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.258+0000 7f4a7d600640 1 -- 172.21.15.107:0/2420348601 learned_addr learned my addr 172.21.15.107:0/2420348601 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:59.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.258+0000 7f4a7cc00640 1 --2- 172.21.15.107:0/2420348601 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a780acc30 0x7f4a7809b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:59.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.259+0000 7f4a6fe00640 1 --2- 172.21.15.107:0/2420348601 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a780ae540 0x7f4a7814d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:59.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.259+0000 7f4a7d600640 1 -- 172.21.15.107:0/2420348601 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a780acc30 msgr2=0x7f4a7809b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:59.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.259+0000 7f4a7d600640 1 --2- 172.21.15.107:0/2420348601 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a780acc30 0x7f4a7809b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.259+0000 7f4a7d600640 1 -- 172.21.15.107:0/2420348601 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a780ae540 msgr2=0x7f4a7814d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:59.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.259+0000 7f4a7d600640 1 --2- 172.21.15.107:0/2420348601 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a780ae540 0x7f4a7814d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.259+0000 7f4a7d600640 1 -- 172.21.15.107:0/2420348601 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a68009390 con 0x7f4a780af0f0 2024-08-17T02:24:59.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.259+0000 7f4a6fe00640 1 --2- 172.21.15.107:0/2420348601 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a780ae540 0x7f4a7814d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:59.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.259+0000 7f4a7d600640 1 --2- 172.21.15.107:0/2420348601 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a780af0f0 0x7f4a7816c6d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4a7000c910 tx=0x7f4a700026f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:59.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.259+0000 7f4a74c00640 1 -- 172.21.15.107:0/2420348601 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7000cea0 con 0x7f4a780af0f0 2024-08-17T02:24:59.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.259+0000 7f4a74c00640 1 -- 172.21.15.107:0/2420348601 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a7000a850 con 0x7f4a780af0f0 2024-08-17T02:24:59.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.259+0000 7f4a7e000640 1 -- 172.21.15.107:0/2420348601 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a7816d2b0 con 0x7f4a780af0f0 2024-08-17T02:24:59.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.259+0000 7f4a74c00640 1 -- 172.21.15.107:0/2420348601 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7000ac30 con 0x7f4a780af0f0 2024-08-17T02:24:59.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.259+0000 7f4a7e000640 1 -- 172.21.15.107:0/2420348601 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a7816d590 con 0x7f4a780af0f0 2024-08-17T02:24:59.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.260+0000 7f4a7e000640 1 -- 172.21.15.107:0/2420348601 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a7809a460 con 0x7f4a780af0f0 2024-08-17T02:24:59.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.261+0000 7f4a74c00640 1 -- 172.21.15.107:0/2420348601 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4a70012630 con 0x7f4a780af0f0 2024-08-17T02:24:59.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.262+0000 7f4a74c00640 1 --2- 172.21.15.107:0/2420348601 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4a54065150 0x7f4a54067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:59.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.262+0000 7f4a74c00640 1 -- 172.21.15.107:0/2420348601 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4a700827c0 con 0x7f4a780af0f0 2024-08-17T02:24:59.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.262+0000 7f4a7cc00640 1 --2- 172.21.15.107:0/2420348601 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4a54065150 0x7f4a54067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:59.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.263+0000 7f4a7cc00640 1 --2- 172.21.15.107:0/2420348601 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4a54065150 0x7f4a54067600 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4a68034000 tx=0x7f4a68032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:59.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.266+0000 7f4a74c00640 1 -- 172.21.15.107:0/2420348601 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4a7809a460 con 0x7f4a780af0f0 2024-08-17T02:24:59.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.438+0000 7f4a7e000640 1 -- 172.21.15.107:0/2420348601 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4a780ad230 con 0x7f4a780af0f0 2024-08-17T02:24:59.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.439+0000 7f4a74c00640 1 -- 172.21.15.107:0/2420348601 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4a780ad230 con 0x7f4a780af0f0 2024-08-17T02:24:59.439 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2024-08-17T02:24:59.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.441+0000 7f4a7e000640 1 -- 172.21.15.107:0/2420348601 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4a54065150 msgr2=0x7f4a54067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:59.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.441+0000 7f4a7e000640 1 --2- 172.21.15.107:0/2420348601 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4a54065150 0x7f4a54067600 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4a68034000 tx=0x7f4a68032000 comp rx=0 tx=0).stop 2024-08-17T02:24:59.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.441+0000 7f4a7e000640 1 -- 172.21.15.107:0/2420348601 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a780af0f0 msgr2=0x7f4a7816c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:59.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.441+0000 7f4a7e000640 1 --2- 172.21.15.107:0/2420348601 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a780af0f0 0x7f4a7816c6d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4a7000c910 tx=0x7f4a700026f0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.441+0000 7f4a7e000640 1 -- 172.21.15.107:0/2420348601 shutdown_connections 2024-08-17T02:24:59.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.441+0000 7f4a7e000640 1 --2- 172.21.15.107:0/2420348601 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4a54065150 0x7f4a54067600 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.441+0000 7f4a7e000640 1 --2- 172.21.15.107:0/2420348601 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a780af0f0 0x7f4a7816c6d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.441+0000 7f4a7e000640 1 --2- 172.21.15.107:0/2420348601 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a780ae540 0x7f4a7814d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.441+0000 7f4a7e000640 1 --2- 172.21.15.107:0/2420348601 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a780acc30 0x7f4a7809b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.441+0000 7f4a7e000640 1 -- 172.21.15.107:0/2420348601 >> 172.21.15.107:0/2420348601 conn(0x7f4a78096a70 msgr2=0x7f4a780af500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:59.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.441+0000 7f4a7e000640 1 -- 172.21.15.107:0/2420348601 shutdown_connections 2024-08-17T02:24:59.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.441+0000 7f4a7e000640 1 -- 172.21.15.107:0/2420348601 wait complete. 2024-08-17T02:24:59.456 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:24:59.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.607+0000 7fb453c00640 1 Processor -- start 2024-08-17T02:24:59.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.607+0000 7fb453c00640 1 -- start start 2024-08-17T02:24:59.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.608+0000 7fb453c00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb44c156be0 0x7fb44c062af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:59.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.608+0000 7fb453c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb44c0ae6a0 con 0x7fb44c06e490 2024-08-17T02:24:59.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.608+0000 7fb453c00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb44c067da0 con 0x7fb44c157fc0 2024-08-17T02:24:59.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.608+0000 7fb453c00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb44c0ada90 con 0x7fb44c156be0 2024-08-17T02:24:59.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.608+0000 7fb44be00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fb44c06e490 0x7fb44c066f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:50462/0 (socket says 172.21.15.107:50462) 2024-08-17T02:24:59.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.608+0000 7fb44be00640 1 -- 172.21.15.107:0/1319130996 learned_addr learned my addr 172.21.15.107:0/1319130996 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:24:59.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.609+0000 7fb44b400640 1 -- 172.21.15.107:0/1319130996 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1080108342 0 0) 0x7fb44c0ae6a0 con 0x7fb44c06e490 2024-08-17T02:24:59.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.609+0000 7fb44b400640 1 -- 172.21.15.107:0/1319130996 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4340034e0 con 0x7fb44c06e490 2024-08-17T02:24:59.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.609+0000 7fb451200640 1 --2- 172.21.15.107:0/1319130996 >> v2:172.21.15.157:3300/0 conn(0x7fb44c156be0 0x7fb44c062af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:59.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.609+0000 7fb44b400640 1 -- 172.21.15.107:0/1319130996 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2061471376 0 0) 0x7fb4340034e0 con 0x7fb44c06e490 2024-08-17T02:24:59.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.609+0000 7fb44b400640 1 -- 172.21.15.107:0/1319130996 >> v2:172.21.15.157:3300/0 conn(0x7fb44c156be0 msgr2=0x7fb44c062af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:59.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.609+0000 7fb44b400640 1 --2- 172.21.15.107:0/1319130996 >> v2:172.21.15.157:3300/0 conn(0x7fb44c156be0 0x7fb44c062af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.609+0000 7fb44b400640 1 -- 172.21.15.107:0/1319130996 >> v1:172.21.15.157:6789/0 conn(0x7fb44c157fc0 legacy=0x7fb44c067690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:59.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.609+0000 7fb44b400640 1 -- 172.21.15.107:0/1319130996 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb44c0add70 con 0x7fb44c06e490 2024-08-17T02:24:59.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.609+0000 7fb44b400640 1 -- 172.21.15.107:0/1319130996 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 537989081 0 0) 0x7fb438001470 con 0x7fb44c06e490 2024-08-17T02:24:59.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.609+0000 7fb44b400640 1 -- 172.21.15.107:0/1319130996 >> v1:172.21.15.107:6789/0 conn(0x7fb44c06e490 legacy=0x7fb44c066f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:59.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.609+0000 7fb44b400640 1 --2- 172.21.15.107:0/1319130996 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb434003a20 0x7fb434003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:59.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.609+0000 7fb44b400640 1 --2- 172.21.15.107:0/1319130996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb434004780 0x7fb434004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:59.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.609+0000 7fb44b400640 1 --2- 172.21.15.107:0/1319130996 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb434005250 0x7fb43400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:59.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.609+0000 7fb44b400640 1 -- 172.21.15.107:0/1319130996 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c0ada90 con 0x7fb434004780 2024-08-17T02:24:59.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.609+0000 7fb44b400640 1 -- 172.21.15.107:0/1319130996 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43400c1d0 con 0x7fb434005250 2024-08-17T02:24:59.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.609+0000 7fb44b400640 1 -- 172.21.15.107:0/1319130996 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb43400c390 con 0x7fb434003a20 2024-08-17T02:24:59.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.609+0000 7fb451200640 1 --2- 172.21.15.107:0/1319130996 >> v2:172.21.15.157:3300/0 conn(0x7fb44c156be0 0x7fb44c062af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:59.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.609+0000 7fb44be00640 1 --2- 172.21.15.107:0/1319130996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb434004780 0x7fb434004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:59.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.610+0000 7fb451c00640 1 --2- 172.21.15.107:0/1319130996 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb434005250 0x7fb43400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:59.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.610+0000 7fb451200640 1 --2- 172.21.15.107:0/1319130996 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb434003a20 0x7fb434003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:59.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.610+0000 7fb44be00640 1 -- 172.21.15.107:0/1319130996 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb434003a20 msgr2=0x7fb434003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:59.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.610+0000 7fb44be00640 1 --2- 172.21.15.107:0/1319130996 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb434003a20 0x7fb434003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.610+0000 7fb44be00640 1 -- 172.21.15.107:0/1319130996 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb434005250 msgr2=0x7fb43400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:59.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.610+0000 7fb44be00640 1 --2- 172.21.15.107:0/1319130996 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb434005250 0x7fb43400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.610+0000 7fb44be00640 1 -- 172.21.15.107:0/1319130996 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4340034e0 con 0x7fb434004780 2024-08-17T02:24:59.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.610+0000 7fb451200640 1 --2- 172.21.15.107:0/1319130996 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb434003a20 0x7fb434003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:59.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.610+0000 7fb451c00640 1 -- 172.21.15.107:0/1319130996 reap_dead start 2024-08-17T02:24:59.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.611+0000 7fb44be00640 1 --2- 172.21.15.107:0/1319130996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb434004780 0x7fb434004bf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb43800c190 tx=0x7fb438001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41e3dea026cb846f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:59.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.611+0000 7fb44b400640 1 -- 172.21.15.107:0/1319130996 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb438005890 con 0x7fb434004780 2024-08-17T02:24:59.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.611+0000 7fb44b400640 1 -- 172.21.15.107:0/1319130996 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43802d070 con 0x7fb434004780 2024-08-17T02:24:59.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.611+0000 7fb44b400640 1 -- 172.21.15.107:0/1319130996 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb438005a50 con 0x7fb434004780 2024-08-17T02:24:59.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.611+0000 7fb453c00640 1 -- 172.21.15.107:0/1319130996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb434004780 msgr2=0x7fb434004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:59.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.611+0000 7fb453c00640 1 --2- 172.21.15.107:0/1319130996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb434004780 0x7fb434004bf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb43800c190 tx=0x7fb438001d80 comp rx=0 tx=0).stop 2024-08-17T02:24:59.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.612+0000 7fb453c00640 1 -- 172.21.15.107:0/1319130996 shutdown_connections 2024-08-17T02:24:59.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.612+0000 7fb453c00640 1 --2- 172.21.15.107:0/1319130996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb434004780 0x7fb434004bf0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.612+0000 7fb453c00640 1 -- 172.21.15.107:0/1319130996 >> 172.21.15.107:0/1319130996 conn(0x7fb44c0b17a0 msgr2=0x7fb44c0b1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:59.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.612+0000 7fb453c00640 1 -- 172.21.15.107:0/1319130996 shutdown_connections 2024-08-17T02:24:59.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.612+0000 7fb453c00640 1 -- 172.21.15.107:0/1319130996 wait complete. 2024-08-17T02:24:59.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.613+0000 7fb453c00640 1 Processor -- start 2024-08-17T02:24:59.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.613+0000 7fb453c00640 1 -- start start 2024-08-17T02:24:59.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.614+0000 7fb453c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb434004780 0x7fb44c0c5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:59.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.614+0000 7fb453c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb44c0aabd0 0x7fb44c1699d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:59.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.614+0000 7fb453c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb44c169f10 0x7fb44c168a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:59.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.614+0000 7fb453c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c0c59b0 con 0x7fb44c169f10 2024-08-17T02:24:59.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.614+0000 7fb453c00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c16a6e0 con 0x7fb44c0aabd0 2024-08-17T02:24:59.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.614+0000 7fb453c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c0abc30 con 0x7fb434004780 2024-08-17T02:24:59.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.614+0000 7fb451c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb44c169f10 0x7fb44c168a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:59.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.614+0000 7fb451c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb44c169f10 0x7fb44c168a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45746/0 (socket says 172.21.15.107:45746) 2024-08-17T02:24:59.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.614+0000 7fb451c00640 1 -- 172.21.15.107:0/1442165369 learned_addr learned my addr 172.21.15.107:0/1442165369 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:24:59.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.615+0000 7fb451200640 1 --2- 172.21.15.107:0/1442165369 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb434004780 0x7fb44c0c5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:59.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.615+0000 7fb44be00640 1 --2- 172.21.15.107:0/1442165369 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb44c0aabd0 0x7fb44c1699d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:59.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.615+0000 7fb451c00640 1 -- 172.21.15.107:0/1442165369 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb434004780 msgr2=0x7fb44c0c5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:59.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.615+0000 7fb451c00640 1 --2- 172.21.15.107:0/1442165369 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb434004780 0x7fb44c0c5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.615+0000 7fb451c00640 1 -- 172.21.15.107:0/1442165369 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb44c0aabd0 msgr2=0x7fb44c1699d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:59.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.615+0000 7fb451c00640 1 --2- 172.21.15.107:0/1442165369 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb44c0aabd0 0x7fb44c1699d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.615+0000 7fb451c00640 1 -- 172.21.15.107:0/1442165369 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb44c0ab0b0 con 0x7fb44c169f10 2024-08-17T02:24:59.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.615+0000 7fb451c00640 1 --2- 172.21.15.107:0/1442165369 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb44c169f10 0x7fb44c168a60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0af190 tx=0x7fb444009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:59.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.615+0000 7fb43fe00640 1 -- 172.21.15.107:0/1442165369 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb444006d20 con 0x7fb44c169f10 2024-08-17T02:24:59.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.615+0000 7fb43fe00640 1 -- 172.21.15.107:0/1442165369 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb444003030 con 0x7fb44c169f10 2024-08-17T02:24:59.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.615+0000 7fb43fe00640 1 -- 172.21.15.107:0/1442165369 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb444006ea0 con 0x7fb44c169f10 2024-08-17T02:24:59.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.615+0000 7fb453c00640 1 -- 172.21.15.107:0/1442165369 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb44c0ab390 con 0x7fb44c169f10 2024-08-17T02:24:59.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.615+0000 7fb453c00640 1 -- 172.21.15.107:0/1442165369 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb44c0ab950 con 0x7fb44c169f10 2024-08-17T02:24:59.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.616+0000 7fb453c00640 1 -- 172.21.15.107:0/1442165369 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb44c071050 con 0x7fb44c169f10 2024-08-17T02:24:59.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.617+0000 7fb43fe00640 1 -- 172.21.15.107:0/1442165369 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb44400eb70 con 0x7fb44c169f10 2024-08-17T02:24:59.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.618+0000 7fb43fe00640 1 --2- 172.21.15.107:0/1442165369 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fb42c065150 0x7fb42c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:59.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.619+0000 7fb43fe00640 1 -- 172.21.15.107:0/1442165369 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb444080c90 con 0x7fb44c169f10 2024-08-17T02:24:59.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.619+0000 7fb451200640 1 --2- 172.21.15.107:0/1442165369 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fb42c065150 0x7fb42c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:59.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.619+0000 7fb451200640 1 --2- 172.21.15.107:0/1442165369 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fb42c065150 0x7fb42c067600 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb44c153e60 tx=0x7fb440008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:59.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.622+0000 7fb43fe00640 1 -- 172.21.15.107:0/1442165369 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb444052740 con 0x7fb44c169f10 2024-08-17T02:24:59.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.794+0000 7fb453c00640 1 -- 172.21.15.107:0/1442165369 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb44c15a470 con 0x7fb44c169f10 2024-08-17T02:24:59.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.795+0000 7fb43fe00640 1 -- 172.21.15.107:0/1442165369 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb4440522d0 con 0x7fb44c169f10 2024-08-17T02:24:59.795 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 64 2024-08-17T02:24:59.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.797+0000 7fb453c00640 1 -- 172.21.15.107:0/1442165369 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fb42c065150 msgr2=0x7fb42c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:59.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.797+0000 7fb453c00640 1 --2- 172.21.15.107:0/1442165369 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fb42c065150 0x7fb42c067600 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb44c153e60 tx=0x7fb440008040 comp rx=0 tx=0).stop 2024-08-17T02:24:59.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.797+0000 7fb453c00640 1 -- 172.21.15.107:0/1442165369 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb44c169f10 msgr2=0x7fb44c168a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:59.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.797+0000 7fb453c00640 1 --2- 172.21.15.107:0/1442165369 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb44c169f10 0x7fb44c168a60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0af190 tx=0x7fb444009040 comp rx=0 tx=0).stop 2024-08-17T02:24:59.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.797+0000 7fb453c00640 1 -- 172.21.15.107:0/1442165369 shutdown_connections 2024-08-17T02:24:59.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.797+0000 7fb453c00640 1 --2- 172.21.15.107:0/1442165369 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fb42c065150 0x7fb42c067600 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.797+0000 7fb453c00640 1 --2- 172.21.15.107:0/1442165369 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb44c169f10 0x7fb44c168a60 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.797+0000 7fb453c00640 1 --2- 172.21.15.107:0/1442165369 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb44c0aabd0 0x7fb44c1699d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.797+0000 7fb453c00640 1 --2- 172.21.15.107:0/1442165369 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb434004780 0x7fb44c0c5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.797+0000 7fb453c00640 1 -- 172.21.15.107:0/1442165369 >> 172.21.15.107:0/1442165369 conn(0x7fb44c0b17a0 msgr2=0x7fb44c06fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:59.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.797+0000 7fb453c00640 1 -- 172.21.15.107:0/1442165369 shutdown_connections 2024-08-17T02:24:59.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:24:59.797+0000 7fb453c00640 1 -- 172.21.15.107:0/1442165369 wait complete. 2024-08-17T02:24:59.886 INFO:tasks.cephfs_test_runner:Starting test: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) That the volume can be created and then cleans up 2024-08-17T02:24:59.886 INFO:tasks.cephfs_test_runner:test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:24:59.886 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:00.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.033+0000 7feecb200640 1 Processor -- start 2024-08-17T02:25:00.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.034+0000 7feecb200640 1 -- start start 2024-08-17T02:25:00.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.035+0000 7feecb200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feecc156a10 0x7feecc0ce040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:00.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.035+0000 7feecb200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7feecc0aeb30 0x7feecc160610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:00.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.035+0000 7feecb200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feecc0b38a0 con 0x7feecc096e40 2024-08-17T02:25:00.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.035+0000 7feecb200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feecc0adbb0 con 0x7feecc0aeb30 2024-08-17T02:25:00.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.035+0000 7feecb200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feecc0ab5f0 con 0x7feecc156a10 2024-08-17T02:25:00.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.035+0000 7feeca800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7feecc0aeb30 0x7feecc160610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:00.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.035+0000 7feeca800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7feecc0aeb30 0x7feecc160610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45762/0 (socket says 172.21.15.107:45762) 2024-08-17T02:25:00.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.035+0000 7feeca800640 1 -- 172.21.15.107:0/3599757370 learned_addr learned my addr 172.21.15.107:0/3599757370 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:00.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.035+0000 7feec9e00640 1 --2- 172.21.15.107:0/3599757370 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feecc156a10 0x7feecc0ce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:00.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.036+0000 7feeca800640 1 -- 172.21.15.107:0/3599757370 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feecc156a10 msgr2=0x7feecc0ce040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:00.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.036+0000 7feeca800640 1 --2- 172.21.15.107:0/3599757370 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feecc156a10 0x7feecc0ce040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.036+0000 7feeca800640 1 -- 172.21.15.107:0/3599757370 >> v1:172.21.15.107:6789/0 conn(0x7feecc096e40 legacy=0x7feecc0ae420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:00.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.036+0000 7feeca800640 1 -- 172.21.15.107:0/3599757370 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feecc0ab8d0 con 0x7feecc0aeb30 2024-08-17T02:25:00.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.036+0000 7feec9400640 1 -- 172.21.15.107:0/3599757370 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2998279630 0 0) 0x7feecc0b38a0 con 0x7feecc096e40 2024-08-17T02:25:00.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.036+0000 7feeca800640 1 --2- 172.21.15.107:0/3599757370 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feecc0aeb30 0x7feecc160610 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7feec4009f20 tx=0x7feec4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f04bbe01b823798d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:00.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.037+0000 7feec9400640 1 -- 172.21.15.107:0/3599757370 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec4031400 con 0x7feecc0aeb30 2024-08-17T02:25:00.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.037+0000 7feec9400640 1 -- 172.21.15.107:0/3599757370 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec402d050 con 0x7feecc0aeb30 2024-08-17T02:25:00.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.037+0000 7feec9400640 1 -- 172.21.15.107:0/3599757370 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec4031790 con 0x7feecc0aeb30 2024-08-17T02:25:00.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.037+0000 7feecb200640 1 -- 172.21.15.107:0/3599757370 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feecc0aeb30 msgr2=0x7feecc160610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:00.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.037+0000 7feecb200640 1 --2- 172.21.15.107:0/3599757370 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feecc0aeb30 0x7feecc160610 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7feec4009f20 tx=0x7feec4009840 comp rx=0 tx=0).stop 2024-08-17T02:25:00.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.037+0000 7feecb200640 1 -- 172.21.15.107:0/3599757370 shutdown_connections 2024-08-17T02:25:00.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.037+0000 7feecb200640 1 --2- 172.21.15.107:0/3599757370 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feecc0aeb30 0x7feecc160610 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.037+0000 7feecb200640 1 --2- 172.21.15.107:0/3599757370 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feecc156a10 0x7feecc0ce040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.037+0000 7feecb200640 1 -- 172.21.15.107:0/3599757370 >> 172.21.15.107:0/3599757370 conn(0x7feecc096a70 msgr2=0x7feecc0cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:00.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.037+0000 7feecb200640 1 -- 172.21.15.107:0/3599757370 shutdown_connections 2024-08-17T02:25:00.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.037+0000 7feecb200640 1 -- 172.21.15.107:0/3599757370 wait complete. 2024-08-17T02:25:00.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.039+0000 7feecb200640 1 Processor -- start 2024-08-17T02:25:00.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.039+0000 7feecb200640 1 -- start start 2024-08-17T02:25:00.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.040+0000 7feecb200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feecc096e40 0x7feecc09b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:00.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.040+0000 7feecb200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feecc0aeb30 0x7feecc099b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:00.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.040+0000 7feecb200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feecc156a10 0x7feecc169310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:00.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.040+0000 7feecb200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feecc169850 con 0x7feecc096e40 2024-08-17T02:25:00.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.040+0000 7feecb200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feecc09a1f0 con 0x7feecc156a10 2024-08-17T02:25:00.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.040+0000 7feecb200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feecc09a4d0 con 0x7feecc0aeb30 2024-08-17T02:25:00.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.040+0000 7feec9e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feecc096e40 0x7feecc09b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:00.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.040+0000 7feec9e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feecc096e40 0x7feecc09b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45778/0 (socket says 172.21.15.107:45778) 2024-08-17T02:25:00.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.040+0000 7feec9e00640 1 -- 172.21.15.107:0/2396547677 learned_addr learned my addr 172.21.15.107:0/2396547677 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:00.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.040+0000 7feec9e00640 1 -- 172.21.15.107:0/2396547677 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feecc0aeb30 msgr2=0x7feecc099b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:00.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.040+0000 7feec9e00640 1 --2- 172.21.15.107:0/2396547677 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feecc0aeb30 0x7feecc099b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.040+0000 7feec9e00640 1 -- 172.21.15.107:0/2396547677 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feecc156a10 msgr2=0x7feecc169310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:00.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.040+0000 7feec9e00640 1 --2- 172.21.15.107:0/2396547677 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feecc156a10 0x7feecc169310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.040+0000 7feec9e00640 1 -- 172.21.15.107:0/2396547677 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec4009ae0 con 0x7feecc096e40 2024-08-17T02:25:00.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.041+0000 7feec9e00640 1 --2- 172.21.15.107:0/2396547677 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feecc096e40 0x7feecc09b290 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7feebc00d890 tx=0x7feebc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:00.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.041+0000 7feec2000640 1 -- 172.21.15.107:0/2396547677 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feebc00de20 con 0x7feecc096e40 2024-08-17T02:25:00.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.041+0000 7feec2000640 1 -- 172.21.15.107:0/2396547677 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feebc00b8d0 con 0x7feecc096e40 2024-08-17T02:25:00.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.041+0000 7feecb200640 1 -- 172.21.15.107:0/2396547677 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feecc09a7b0 con 0x7feecc096e40 2024-08-17T02:25:00.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.041+0000 7feec2000640 1 -- 172.21.15.107:0/2396547677 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feebc00bc70 con 0x7feecc096e40 2024-08-17T02:25:00.044 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.041+0000 7feecb200640 1 -- 172.21.15.107:0/2396547677 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feecc09ad70 con 0x7feecc096e40 2024-08-17T02:25:00.044 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.042+0000 7feecb200640 1 -- 172.21.15.107:0/2396547677 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feecc071050 con 0x7feecc096e40 2024-08-17T02:25:00.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.043+0000 7feec2000640 1 -- 172.21.15.107:0/2396547677 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7feebc014640 con 0x7feecc096e40 2024-08-17T02:25:00.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.044+0000 7feec2000640 1 --2- 172.21.15.107:0/2396547677 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7feea8065150 0x7feea8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:00.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.044+0000 7feec2000640 1 -- 172.21.15.107:0/2396547677 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feebc082b60 con 0x7feecc096e40 2024-08-17T02:25:00.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.044+0000 7feec1400640 1 --2- 172.21.15.107:0/2396547677 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7feea8065150 0x7feea8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:00.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.045+0000 7feec1400640 1 --2- 172.21.15.107:0/2396547677 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7feea8065150 0x7feea8067600 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7feecc16bdf0 tx=0x7feeb4007ab0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:00.048 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.048+0000 7feec2000640 1 -- 172.21.15.107:0/2396547677 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7feebc050c40 con 0x7feecc096e40 2024-08-17T02:25:00.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.220+0000 7feecb200640 1 -- 172.21.15.107:0/2396547677 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feecc0b3680 con 0x7feecc096e40 2024-08-17T02:25:00.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.221+0000 7feec2000640 1 -- 172.21.15.107:0/2396547677 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7feebc054260 con 0x7feecc096e40 2024-08-17T02:25:00.221 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:25:00.221 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":21,"fsid":"f207b4c0-329d-46b8-b83f-aaf30bdb6ce3","created":"2024-08-17T02:24:11.038049+0000","modified":"2024-08-17T02:24:30.420018+0000","last_up_change":"2024-08-17T02:24:22.047790+0000","last_in_change":"2024-08-17T02:24:13.892720+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:23.456166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:27.078670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:27.804418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"376363f3-b8bf-4f1e-b691-51cdd39171ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37302},{"type":"v1","addr":"172.21.15.107:6801","nonce":37302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37302},{"type":"v1","addr":"172.21.15.107:6803","nonce":37302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37302},{"type":"v1","addr":"172.21.15.107:6807","nonce":37302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37302},{"type":"v1","addr":"172.21.15.107:6805","nonce":37302}]},"public_addr":"172.21.15.107:6801/37302","cluster_addr":"172.21.15.107:6803/37302","heartbeat_back_addr":"172.21.15.107:6807/37302","heartbeat_front_addr":"172.21.15.107:6805/37302","state":["exists","up"]},{"osd":1,"uuid":"cc6624e3-2ad4-4db4-b377-05dfe57424e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37305},{"type":"v1","addr":"172.21.15.107:6824","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37305},{"type":"v1","addr":"172.21.15.107:6827","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37305},{"type":"v1","addr":"172.21.15.107:6831","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37305},{"type":"v1","addr":"172.21.15.107:6829","nonce":37305}]},"public_addr":"172.21.15.107:6824/37305","cluster_addr":"172.21.15.107:6827/37305","heartbeat_back_addr":"172.21.15.107:6831/37305","heartbeat_front_addr":"172.21.15.107:6829/37305","state":["exists","up"]},{"osd":2,"uuid":"25229542-29b5-4281-bcb0-798ae0930aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37307},{"type":"v1","addr":"172.21.15.107:6817","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37307},{"type":"v1","addr":"172.21.15.107:6819","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6823","nonce":37307},{"type":"v1","addr":"172.21.15.107:6825","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37307},{"type":"v1","addr":"172.21.15.107:6821","nonce":37307}]},"public_addr":"172.21.15.107:6817/37307","cluster_addr":"172.21.15.107:6819/37307","heartbeat_back_addr":"172.21.15.107:6825/37307","heartbeat_front_addr":"172.21.15.107:6821/37307","state":["exists","up"]},{"osd":3,"uuid":"5f16aee8-8950-4268-a61a-5cf6ebd670e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37306},{"type":"v1","addr":"172.21.15.107:6809","nonce":37306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37306},{"type":"v1","addr":"172.21.15.107:6811","nonce":37306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37306},{"type":"v1","addr":"172.21.15.107:6815","nonce":37306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37306},{"type":"v1","addr":"172.21.15.107:6813","nonce":37306}]},"public_addr":"172.21.15.107:6809/37306","cluster_addr":"172.21.15.107:6811/37306","heartbeat_back_addr":"172.21.15.107:6815/37306","heartbeat_front_addr":"172.21.15.107:6813/37306","state":["exists","up"]},{"osd":4,"uuid":"23232e28-e23b-4b4e-a531-4939246dbbde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":37329},{"type":"v1","addr":"172.21.15.157:6817","nonce":37329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":37329},{"type":"v1","addr":"172.21.15.157:6819","nonce":37329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":37329},{"type":"v1","addr":"172.21.15.157:6823","nonce":37329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":37329},{"type":"v1","addr":"172.21.15.157:6821","nonce":37329}]},"public_addr":"172.21.15.157:6817/37329","cluster_addr":"172.21.15.157:6819/37329","heartbeat_back_addr":"172.21.15.157:6823/37329","heartbeat_front_addr":"172.21.15.157:6821/37329","state":["exists","up"]},{"osd":5,"uuid":"f87ec331-3e59-4886-a317-6f7e26ec8e21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":37328},{"type":"v1","addr":"172.21.15.157:6804","nonce":37328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":37328},{"type":"v1","addr":"172.21.15.157:6808","nonce":37328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":37328},{"type":"v1","addr":"172.21.15.157:6815","nonce":37328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":37328},{"type":"v1","addr":"172.21.15.157:6812","nonce":37328}]},"public_addr":"172.21.15.157:6804/37328","cluster_addr":"172.21.15.157:6808/37328","heartbeat_back_addr":"172.21.15.157:6815/37328","heartbeat_front_addr":"172.21.15.157:6812/37328","state":["exists","up"]},{"osd":6,"uuid":"92852235-ce49-4d96-a940-6f18d97b13ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":37330},{"type":"v1","addr":"172.21.15.157:6801","nonce":37330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6803","nonce":37330},{"type":"v1","addr":"172.21.15.157:6805","nonce":37330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":37330},{"type":"v1","addr":"172.21.15.157:6813","nonce":37330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":37330},{"type":"v1","addr":"172.21.15.157:6809","nonce":37330}]},"public_addr":"172.21.15.157:6801/37330","cluster_addr":"172.21.15.157:6805/37330","heartbeat_back_addr":"172.21.15.157:6813/37330","heartbeat_front_addr":"172.21.15.157:6809/37330","state":["exists","up"]},{"osd":7,"uuid":"7484a061-723d-4663-b28f-b01766d62f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":37373},{"type":"v1","addr":"172.21.15.157:6825","nonce":37373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":37373},{"type":"v1","addr":"172.21.15.157:6827","nonce":37373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":37373},{"type":"v1","addr":"172.21.15.157:6831","nonce":37373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":37373},{"type":"v1","addr":"172.21.15.157:6829","nonce":37373}]},"public_addr":"172.21.15.157:6825/37373","cluster_addr":"172.21.15.157:6827/37373","heartbeat_back_addr":"172.21.15.157:6831/37373","heartbeat_front_addr":"172.21.15.157:6829/37373","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.110188+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.280265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.252119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.267996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.284582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.144420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.174764+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.308002+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:00.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.223+0000 7feecb200640 1 -- 172.21.15.107:0/2396547677 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7feea8065150 msgr2=0x7feea8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:00.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.223+0000 7feecb200640 1 --2- 172.21.15.107:0/2396547677 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7feea8065150 0x7feea8067600 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7feecc16bdf0 tx=0x7feeb4007ab0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.223+0000 7feecb200640 1 -- 172.21.15.107:0/2396547677 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feecc096e40 msgr2=0x7feecc09b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:00.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.223+0000 7feecb200640 1 --2- 172.21.15.107:0/2396547677 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feecc096e40 0x7feecc09b290 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7feebc00d890 tx=0x7feebc008040 comp rx=0 tx=0).stop 2024-08-17T02:25:00.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.223+0000 7feecb200640 1 -- 172.21.15.107:0/2396547677 shutdown_connections 2024-08-17T02:25:00.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.223+0000 7feecb200640 1 --2- 172.21.15.107:0/2396547677 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7feea8065150 0x7feea8067600 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.223+0000 7feecb200640 1 --2- 172.21.15.107:0/2396547677 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feecc156a10 0x7feecc169310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.223+0000 7feecb200640 1 --2- 172.21.15.107:0/2396547677 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feecc0aeb30 0x7feecc099b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.223+0000 7feecb200640 1 --2- 172.21.15.107:0/2396547677 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feecc096e40 0x7feecc09b290 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.223+0000 7feecb200640 1 -- 172.21.15.107:0/2396547677 >> 172.21.15.107:0/2396547677 conn(0x7feecc096a70 msgr2=0x7feecc0ac5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:00.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.223+0000 7feecb200640 1 -- 172.21.15.107:0/2396547677 shutdown_connections 2024-08-17T02:25:00.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.223+0000 7feecb200640 1 -- 172.21.15.107:0/2396547677 wait complete. 2024-08-17T02:25:00.239 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:24:23.456166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:24:27.078670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:24:27.804418+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:25:00.239 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:25:00.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.389+0000 7fea6b600640 1 Processor -- start 2024-08-17T02:25:00.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.389+0000 7fea6b600640 1 -- start start 2024-08-17T02:25:00.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.390+0000 7fea6b600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fea64158ed0 0x7fea64069a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:00.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.390+0000 7fea6b600640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fea641592a0 0x7fea640abeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:00.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.390+0000 7fea6b600640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea640b10e0 con 0x7fea64096a70 2024-08-17T02:25:00.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.390+0000 7fea6b600640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea640ac3f0 con 0x7fea641592a0 2024-08-17T02:25:00.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.390+0000 7fea6b600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea640ac680 con 0x7fea64158ed0 2024-08-17T02:25:00.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.391+0000 7fea68c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fea64158ed0 0x7fea64069a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:00.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.391+0000 7fea68c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fea64158ed0 0x7fea64069a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:59842/0 (socket says 172.21.15.107:59842) 2024-08-17T02:25:00.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.391+0000 7fea63e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fea641592a0 0x7fea640abeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:00.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.391+0000 7fea68c00640 1 -- 172.21.15.107:0/910208304 learned_addr learned my addr 172.21.15.107:0/910208304 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:00.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.391+0000 7fea69600640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fea64096a70 0x7fea64067d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:47184/0 (socket says 172.21.15.107:47184) 2024-08-17T02:25:00.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.391+0000 7fea68c00640 1 -- 172.21.15.107:0/910208304 >> v2:172.21.15.157:3300/0 conn(0x7fea641592a0 msgr2=0x7fea640abeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:00.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.391+0000 7fea68c00640 1 --2- 172.21.15.107:0/910208304 >> v2:172.21.15.157:3300/0 conn(0x7fea641592a0 0x7fea640abeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.391+0000 7fea68c00640 1 -- 172.21.15.107:0/910208304 >> v1:172.21.15.157:6789/0 conn(0x7fea64096a70 legacy=0x7fea64067d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:00.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.391+0000 7fea68c00640 1 -- 172.21.15.107:0/910208304 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea640b0a90 con 0x7fea64158ed0 2024-08-17T02:25:00.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.391+0000 7fea63e00640 1 --2- 172.21.15.107:0/910208304 >> v2:172.21.15.157:3300/0 conn(0x7fea641592a0 0x7fea640abeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:00.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.392+0000 7fea68c00640 1 --2- 172.21.15.107:0/910208304 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fea64158ed0 0x7fea64069a80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fea58009910 tx=0x7fea580091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=408d199bdce54242 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:00.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.393+0000 7fea63400640 1 -- 172.21.15.107:0/910208304 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5802ae40 con 0x7fea64158ed0 2024-08-17T02:25:00.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.393+0000 7fea63400640 1 -- 172.21.15.107:0/910208304 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea58032440 con 0x7fea64158ed0 2024-08-17T02:25:00.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.393+0000 7fea63400640 1 -- 172.21.15.107:0/910208304 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea58032820 con 0x7fea64158ed0 2024-08-17T02:25:00.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.393+0000 7fea6b600640 1 -- 172.21.15.107:0/910208304 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fea64158ed0 msgr2=0x7fea64069a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:00.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.393+0000 7fea6b600640 1 --2- 172.21.15.107:0/910208304 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fea64158ed0 0x7fea64069a80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fea58009910 tx=0x7fea580091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.393+0000 7fea6b600640 1 -- 172.21.15.107:0/910208304 shutdown_connections 2024-08-17T02:25:00.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.393+0000 7fea6b600640 1 --2- 172.21.15.107:0/910208304 >> v2:172.21.15.157:3300/0 conn(0x7fea641592a0 0x7fea640abeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.393+0000 7fea6b600640 1 --2- 172.21.15.107:0/910208304 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fea64158ed0 0x7fea64069a80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.393+0000 7fea6b600640 1 -- 172.21.15.107:0/910208304 >> 172.21.15.107:0/910208304 conn(0x7fea640b30b0 msgr2=0x7fea640b34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:00.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.393+0000 7fea6b600640 1 -- 172.21.15.107:0/910208304 shutdown_connections 2024-08-17T02:25:00.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.393+0000 7fea6b600640 1 -- 172.21.15.107:0/910208304 wait complete. 2024-08-17T02:25:00.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.395+0000 7fea6b600640 1 Processor -- start 2024-08-17T02:25:00.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.395+0000 7fea6b600640 1 -- start start 2024-08-17T02:25:00.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.396+0000 7fea6b600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea64096a70 0x7fea640ad630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:00.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.396+0000 7fea6b600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea64158ed0 0x7fea6406be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:00.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.396+0000 7fea6b600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fea6406c340 0x7fea640cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:00.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.396+0000 7fea6b600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6415e290 con 0x7fea64158ed0 2024-08-17T02:25:00.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.396+0000 7fea6b600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6415e570 con 0x7fea64096a70 2024-08-17T02:25:00.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.396+0000 7fea6b600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea640adb70 con 0x7fea6406c340 2024-08-17T02:25:00.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.396+0000 7fea63e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea64158ed0 0x7fea6406be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:00.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.396+0000 7fea68c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea64096a70 0x7fea640ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:00.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.396+0000 7fea63e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea64158ed0 0x7fea6406be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45794/0 (socket says 172.21.15.107:45794) 2024-08-17T02:25:00.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.396+0000 7fea63e00640 1 -- 172.21.15.107:0/566986200 learned_addr learned my addr 172.21.15.107:0/566986200 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:00.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.396+0000 7fea69600640 1 --2- 172.21.15.107:0/566986200 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fea6406c340 0x7fea640cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:00.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.396+0000 7fea63e00640 1 -- 172.21.15.107:0/566986200 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fea6406c340 msgr2=0x7fea640cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:00.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.396+0000 7fea63e00640 1 --2- 172.21.15.107:0/566986200 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fea6406c340 0x7fea640cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.397+0000 7fea63e00640 1 -- 172.21.15.107:0/566986200 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea64096a70 msgr2=0x7fea640ad630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:00.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.397+0000 7fea63e00640 1 --2- 172.21.15.107:0/566986200 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea64096a70 0x7fea640ad630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.397+0000 7fea63e00640 1 -- 172.21.15.107:0/566986200 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea50009390 con 0x7fea64158ed0 2024-08-17T02:25:00.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.397+0000 7fea63e00640 1 --2- 172.21.15.107:0/566986200 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea64158ed0 0x7fea6406be00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fea5000ecb0 tx=0x7fea500090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:00.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.397+0000 7fea57e00640 1 -- 172.21.15.107:0/566986200 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5000cbc0 con 0x7fea64158ed0 2024-08-17T02:25:00.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.397+0000 7fea57e00640 1 -- 172.21.15.107:0/566986200 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5000cd20 con 0x7fea64158ed0 2024-08-17T02:25:00.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.397+0000 7fea57e00640 1 -- 172.21.15.107:0/566986200 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea50013680 con 0x7fea64158ed0 2024-08-17T02:25:00.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.397+0000 7fea6b600640 1 -- 172.21.15.107:0/566986200 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea58009450 con 0x7fea64158ed0 2024-08-17T02:25:00.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.397+0000 7fea6b600640 1 -- 172.21.15.107:0/566986200 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea640ae0f0 con 0x7fea64158ed0 2024-08-17T02:25:00.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.398+0000 7fea6b600640 1 -- 172.21.15.107:0/566986200 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea6415e700 con 0x7fea64158ed0 2024-08-17T02:25:00.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.399+0000 7fea57e00640 1 -- 172.21.15.107:0/566986200 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fea500139f0 con 0x7fea64158ed0 2024-08-17T02:25:00.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.400+0000 7fea57e00640 1 --2- 172.21.15.107:0/566986200 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fea44065180 0x7fea44067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:00.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.400+0000 7fea57e00640 1 -- 172.21.15.107:0/566986200 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fea50082b50 con 0x7fea64158ed0 2024-08-17T02:25:00.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.400+0000 7fea68c00640 1 --2- 172.21.15.107:0/566986200 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fea44065180 0x7fea44067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:00.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.401+0000 7fea68c00640 1 --2- 172.21.15.107:0/566986200 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fea44065180 0x7fea44067630 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fea58034000 tx=0x7fea58032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:00.404 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.404+0000 7fea57e00640 1 -- 172.21.15.107:0/566986200 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fea50050c20 con 0x7fea64158ed0 2024-08-17T02:25:00.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.578+0000 7fea6b600640 1 -- 172.21.15.107:0/566986200 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fea64064db0 con 0x7fea64158ed0 2024-08-17T02:25:00.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.579+0000 7fea57e00640 1 -- 172.21.15.107:0/566986200 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fea500170a0 con 0x7fea64158ed0 2024-08-17T02:25:00.579 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2024-08-17T02:25:00.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.581+0000 7fea6b600640 1 -- 172.21.15.107:0/566986200 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fea44065180 msgr2=0x7fea44067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:00.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.581+0000 7fea6b600640 1 --2- 172.21.15.107:0/566986200 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fea44065180 0x7fea44067630 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fea58034000 tx=0x7fea58032000 comp rx=0 tx=0).stop 2024-08-17T02:25:00.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.581+0000 7fea6b600640 1 -- 172.21.15.107:0/566986200 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea64158ed0 msgr2=0x7fea6406be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:00.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.581+0000 7fea6b600640 1 --2- 172.21.15.107:0/566986200 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea64158ed0 0x7fea6406be00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fea5000ecb0 tx=0x7fea500090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.581+0000 7fea6b600640 1 -- 172.21.15.107:0/566986200 shutdown_connections 2024-08-17T02:25:00.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.581+0000 7fea6b600640 1 --2- 172.21.15.107:0/566986200 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fea44065180 0x7fea44067630 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.581+0000 7fea6b600640 1 --2- 172.21.15.107:0/566986200 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fea6406c340 0x7fea640cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.581+0000 7fea6b600640 1 --2- 172.21.15.107:0/566986200 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea64158ed0 0x7fea6406be00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.581+0000 7fea6b600640 1 --2- 172.21.15.107:0/566986200 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea64096a70 0x7fea640ad630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.581+0000 7fea6b600640 1 -- 172.21.15.107:0/566986200 >> 172.21.15.107:0/566986200 conn(0x7fea640b30b0 msgr2=0x7fea64156eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:00.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.581+0000 7fea6b600640 1 -- 172.21.15.107:0/566986200 shutdown_connections 2024-08-17T02:25:00.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.581+0000 7fea6b600640 1 -- 172.21.15.107:0/566986200 wait complete. 2024-08-17T02:25:00.597 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:25:00.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.746+0000 7f7ede200640 1 Processor -- start 2024-08-17T02:25:00.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.746+0000 7f7ede200640 1 -- start start 2024-08-17T02:25:00.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.747+0000 7f7ede200640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7ed8155a80 0x7f7ed806dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:00.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.747+0000 7f7ede200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ed80c7db0 0x7f7ed80c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:00.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.747+0000 7f7ede200640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ed81598f0 con 0x7f7ed8155e50 2024-08-17T02:25:00.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.747+0000 7f7ede200640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ed8159bd0 con 0x7f7ed8155a80 2024-08-17T02:25:00.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.747+0000 7f7ede200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed8159eb0 con 0x7f7ed80c7db0 2024-08-17T02:25:00.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.748+0000 7f7ed6a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ed80c7db0 0x7f7ed80c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:00.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.748+0000 7f7ed7400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7ed8155a80 0x7f7ed806dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:00.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.748+0000 7f7ed7e00640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f7ed8155e50 0x7f7ed806c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:47190/0 (socket says 172.21.15.107:47190) 2024-08-17T02:25:00.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.748+0000 7f7ed7e00640 1 -- 172.21.15.107:0/401083535 learned_addr learned my addr 172.21.15.107:0/401083535 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:25:00.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.748+0000 7f7ed7400640 1 -- 172.21.15.107:0/401083535 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ed80c7db0 msgr2=0x7f7ed80c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:00.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.748+0000 7f7ed7400640 1 --2- 172.21.15.107:0/401083535 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ed80c7db0 0x7f7ed80c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.748+0000 7f7ed7400640 1 -- 172.21.15.107:0/401083535 >> v1:172.21.15.157:6789/0 conn(0x7f7ed8155e50 legacy=0x7f7ed806c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:00.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.748+0000 7f7ed7400640 1 -- 172.21.15.107:0/401083535 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed815a190 con 0x7f7ed8155a80 2024-08-17T02:25:00.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.748+0000 7f7ed6a00640 1 --2- 172.21.15.107:0/401083535 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ed80c7db0 0x7f7ed80c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:00.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.748+0000 7f7ed6000640 1 -- 172.21.15.107:0/401083535 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3156625985 0 0) 0x7f7ed81598f0 con 0x7f7ed8155e50 2024-08-17T02:25:00.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.749+0000 7f7ed7400640 1 --2- 172.21.15.107:0/401083535 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ed8155a80 0x7f7ed806dc00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8009850 tx=0x7f7ec80090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61458e22b5d8697e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:00.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.750+0000 7f7ed6000640 1 -- 172.21.15.107:0/401083535 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec802ad90 con 0x7f7ed8155a80 2024-08-17T02:25:00.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.750+0000 7f7ed6000640 1 -- 172.21.15.107:0/401083535 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec8032440 con 0x7f7ed8155a80 2024-08-17T02:25:00.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.750+0000 7f7ed6000640 1 -- 172.21.15.107:0/401083535 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec80327e0 con 0x7f7ed8155a80 2024-08-17T02:25:00.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.750+0000 7f7ede200640 1 -- 172.21.15.107:0/401083535 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ed8155a80 msgr2=0x7f7ed806dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:00.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.750+0000 7f7ede200640 1 --2- 172.21.15.107:0/401083535 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ed8155a80 0x7f7ed806dc00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8009850 tx=0x7f7ec80090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.750+0000 7f7ede200640 1 -- 172.21.15.107:0/401083535 shutdown_connections 2024-08-17T02:25:00.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.750+0000 7f7ede200640 1 --2- 172.21.15.107:0/401083535 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ed80c7db0 0x7f7ed80c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.750+0000 7f7ede200640 1 --2- 172.21.15.107:0/401083535 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ed8155a80 0x7f7ed806dc00 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.750+0000 7f7ede200640 1 -- 172.21.15.107:0/401083535 >> 172.21.15.107:0/401083535 conn(0x7f7ed8067750 msgr2=0x7f7ed80c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:00.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.750+0000 7f7ede200640 1 -- 172.21.15.107:0/401083535 shutdown_connections 2024-08-17T02:25:00.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.750+0000 7f7ede200640 1 -- 172.21.15.107:0/401083535 wait complete. 2024-08-17T02:25:00.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.751+0000 7f7ede200640 1 Processor -- start 2024-08-17T02:25:00.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.752+0000 7f7ede200640 1 -- start start 2024-08-17T02:25:00.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.752+0000 7f7ede200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ed80c7db0 0x7f7ed8157310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:00.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.752+0000 7f7ede200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ed8155a80 0x7f7ed8147340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:00.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.752+0000 7f7ede200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ed8155e50 0x7f7ed8154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:00.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.752+0000 7f7ede200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed816a070 con 0x7f7ed80c7db0 2024-08-17T02:25:00.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.752+0000 7f7ede200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed8158f00 con 0x7f7ed8155e50 2024-08-17T02:25:00.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.752+0000 7f7ede200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed81691b0 con 0x7f7ed8155a80 2024-08-17T02:25:00.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.753+0000 7f7ed7400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ed80c7db0 0x7f7ed8157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:00.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.753+0000 7f7ed7400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ed80c7db0 0x7f7ed8157310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45802/0 (socket says 172.21.15.107:45802) 2024-08-17T02:25:00.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.753+0000 7f7ed7400640 1 -- 172.21.15.107:0/385660675 learned_addr learned my addr 172.21.15.107:0/385660675 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:00.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.753+0000 7f7ed7e00640 1 --2- 172.21.15.107:0/385660675 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ed8155e50 0x7f7ed8154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:00.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.753+0000 7f7ed6a00640 1 --2- 172.21.15.107:0/385660675 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ed8155a80 0x7f7ed8147340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:00.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.753+0000 7f7ed7400640 1 -- 172.21.15.107:0/385660675 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ed8155a80 msgr2=0x7f7ed8147340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:00.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.753+0000 7f7ed7400640 1 --2- 172.21.15.107:0/385660675 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ed8155a80 0x7f7ed8147340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.753+0000 7f7ed7400640 1 -- 172.21.15.107:0/385660675 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ed8155e50 msgr2=0x7f7ed8154ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:00.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.753+0000 7f7ed7400640 1 --2- 172.21.15.107:0/385660675 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ed8155e50 0x7f7ed8154ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.753+0000 7f7ed7400640 1 -- 172.21.15.107:0/385660675 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec4009390 con 0x7f7ed80c7db0 2024-08-17T02:25:00.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.753+0000 7f7ed7400640 1 --2- 172.21.15.107:0/385660675 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ed80c7db0 0x7f7ed8157310 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8009360 tx=0x7f7ec8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:00.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.754+0000 7f7ecea00640 1 -- 172.21.15.107:0/385660675 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec8000d10 con 0x7f7ed80c7db0 2024-08-17T02:25:00.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.754+0000 7f7ecea00640 1 -- 172.21.15.107:0/385660675 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec8031e00 con 0x7f7ed80c7db0 2024-08-17T02:25:00.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.754+0000 7f7ecea00640 1 -- 172.21.15.107:0/385660675 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec803d670 con 0x7f7ed80c7db0 2024-08-17T02:25:00.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.754+0000 7f7ede200640 1 -- 172.21.15.107:0/385660675 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ec8009390 con 0x7f7ed80c7db0 2024-08-17T02:25:00.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.754+0000 7f7ede200640 1 -- 172.21.15.107:0/385660675 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ed8169740 con 0x7f7ed80c7db0 2024-08-17T02:25:00.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.755+0000 7f7ede200640 1 -- 172.21.15.107:0/385660675 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ed8071050 con 0x7f7ed80c7db0 2024-08-17T02:25:00.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.756+0000 7f7ecea00640 1 -- 172.21.15.107:0/385660675 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7ec8039040 con 0x7f7ed80c7db0 2024-08-17T02:25:00.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.756+0000 7f7ecea00640 1 --2- 172.21.15.107:0/385660675 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7eb8065150 0x7f7eb8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:00.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.756+0000 7f7ecea00640 1 -- 172.21.15.107:0/385660675 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7ec80a2430 con 0x7f7ed80c7db0 2024-08-17T02:25:00.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.757+0000 7f7ed6a00640 1 --2- 172.21.15.107:0/385660675 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7eb8065150 0x7f7eb8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:00.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.757+0000 7f7ed6a00640 1 --2- 172.21.15.107:0/385660675 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7eb8065150 0x7f7eb8067600 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8154990 tx=0x7f7ec40090f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:00.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.761+0000 7f7ecea00640 1 -- 172.21.15.107:0/385660675 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7ec8070500 con 0x7f7ed80c7db0 2024-08-17T02:25:00.932 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.932+0000 7f7ede200640 1 -- 172.21.15.107:0/385660675 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7ed80ca0f0 con 0x7f7ed80c7db0 2024-08-17T02:25:00.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.932+0000 7f7ecea00640 1 -- 172.21.15.107:0/385660675 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7ec8073b20 con 0x7f7ed80c7db0 2024-08-17T02:25:00.933 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2024-08-17T02:25:00.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.934+0000 7f7ede200640 1 -- 172.21.15.107:0/385660675 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7eb8065150 msgr2=0x7f7eb8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:00.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.934+0000 7f7ede200640 1 --2- 172.21.15.107:0/385660675 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7eb8065150 0x7f7eb8067600 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8154990 tx=0x7f7ec40090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.934+0000 7f7ede200640 1 -- 172.21.15.107:0/385660675 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ed80c7db0 msgr2=0x7f7ed8157310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:00.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.934+0000 7f7ede200640 1 --2- 172.21.15.107:0/385660675 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ed80c7db0 0x7f7ed8157310 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8009360 tx=0x7f7ec8032000 comp rx=0 tx=0).stop 2024-08-17T02:25:00.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.934+0000 7f7ede200640 1 -- 172.21.15.107:0/385660675 shutdown_connections 2024-08-17T02:25:00.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.935+0000 7f7ede200640 1 --2- 172.21.15.107:0/385660675 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7eb8065150 0x7f7eb8067600 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.935+0000 7f7ede200640 1 --2- 172.21.15.107:0/385660675 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ed8155e50 0x7f7ed8154ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.935+0000 7f7ede200640 1 --2- 172.21.15.107:0/385660675 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ed8155a80 0x7f7ed8147340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.935+0000 7f7ede200640 1 --2- 172.21.15.107:0/385660675 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ed80c7db0 0x7f7ed8157310 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.935+0000 7f7ede200640 1 -- 172.21.15.107:0/385660675 >> 172.21.15.107:0/385660675 conn(0x7f7ed8067750 msgr2=0x7f7ed80cb080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:00.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.935+0000 7f7ede200640 1 -- 172.21.15.107:0/385660675 shutdown_connections 2024-08-17T02:25:00.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:00.935+0000 7f7ede200640 1 -- 172.21.15.107:0/385660675 wait complete. 2024-08-17T02:25:00.950 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:25:01.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.100+0000 7f1134000640 1 Processor -- start 2024-08-17T02:25:01.101 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.100+0000 7f1134000640 1 -- start start 2024-08-17T02:25:01.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.101+0000 7f1134000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f112c158da0 0x7f112c0ac3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:01.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.101+0000 7f1134000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f112c159170 0x7f112c0aa810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:01.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.102+0000 7f1134000640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f112c0681f0 con 0x7f112c0aad50 2024-08-17T02:25:01.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.102+0000 7f1134000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f112c0ab1d0 con 0x7f112c159170 2024-08-17T02:25:01.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.102+0000 7f1134000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f112c0b08c0 con 0x7f112c158da0 2024-08-17T02:25:01.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.102+0000 7f1130c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f112c159170 0x7f112c0aa810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:01.103 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.102+0000 7f1130c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f112c159170 0x7f112c0aa810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45806/0 (socket says 172.21.15.107:45806) 2024-08-17T02:25:01.103 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.102+0000 7f1130c00640 1 -- 172.21.15.107:0/582666840 learned_addr learned my addr 172.21.15.107:0/582666840 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:01.103 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.102+0000 7f1131600640 1 --2- 172.21.15.107:0/582666840 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f112c158da0 0x7f112c0ac3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:01.103 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.102+0000 7f112be00640 1 -- 172.21.15.107:0/582666840 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3737070344 0 0) 0x7f112c0681f0 con 0x7f112c0aad50 2024-08-17T02:25:01.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.102+0000 7f1130c00640 1 -- 172.21.15.107:0/582666840 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f112c158da0 msgr2=0x7f112c0ac3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:01.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.102+0000 7f1130c00640 1 --2- 172.21.15.107:0/582666840 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f112c158da0 0x7f112c0ac3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.102+0000 7f1130c00640 1 -- 172.21.15.107:0/582666840 >> v1:172.21.15.157:6789/0 conn(0x7f112c0aad50 legacy=0x7f112c068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:01.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.102+0000 7f1130c00640 1 -- 172.21.15.107:0/582666840 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f112c0aca00 con 0x7f112c159170 2024-08-17T02:25:01.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.103+0000 7f1130c00640 1 --2- 172.21.15.107:0/582666840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f112c159170 0x7f112c0aa810 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1118009910 tx=0x7f11180091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5518f1e6dd007fa9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:01.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.104+0000 7f112be00640 1 -- 172.21.15.107:0/582666840 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111802adb0 con 0x7f112c159170 2024-08-17T02:25:01.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.104+0000 7f112be00640 1 -- 172.21.15.107:0/582666840 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1118032440 con 0x7f112c159170 2024-08-17T02:25:01.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.104+0000 7f112be00640 1 -- 172.21.15.107:0/582666840 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11180327e0 con 0x7f112c159170 2024-08-17T02:25:01.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.104+0000 7f1134000640 1 -- 172.21.15.107:0/582666840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f112c159170 msgr2=0x7f112c0aa810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:01.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.104+0000 7f1134000640 1 --2- 172.21.15.107:0/582666840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f112c159170 0x7f112c0aa810 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1118009910 tx=0x7f11180091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.104+0000 7f1134000640 1 -- 172.21.15.107:0/582666840 shutdown_connections 2024-08-17T02:25:01.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.104+0000 7f1134000640 1 --2- 172.21.15.107:0/582666840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f112c159170 0x7f112c0aa810 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.104+0000 7f1134000640 1 --2- 172.21.15.107:0/582666840 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f112c158da0 0x7f112c0ac3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.104+0000 7f1134000640 1 -- 172.21.15.107:0/582666840 >> 172.21.15.107:0/582666840 conn(0x7f112c096a70 msgr2=0x7f112c096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:01.106 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.104+0000 7f1134000640 1 -- 172.21.15.107:0/582666840 shutdown_connections 2024-08-17T02:25:01.106 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.104+0000 7f1134000640 1 -- 172.21.15.107:0/582666840 wait complete. 2024-08-17T02:25:01.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.106+0000 7f1134000640 1 Processor -- start 2024-08-17T02:25:01.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.106+0000 7f1134000640 1 -- start start 2024-08-17T02:25:01.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.107+0000 7f1134000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f112c0aad50 0x7f112c0b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:01.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.107+0000 7f1134000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f112c158da0 0x7f112c15ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:01.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.107+0000 7f1134000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f112c0b0bc0 0x7f112c15f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:01.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.107+0000 7f1134000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112c15e740 con 0x7f112c0b0bc0 2024-08-17T02:25:01.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.107+0000 7f1134000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112c0b2370 con 0x7f112c0aad50 2024-08-17T02:25:01.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.107+0000 7f1134000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f112c15de10 con 0x7f112c158da0 2024-08-17T02:25:01.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.107+0000 7f1132000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f112c0b0bc0 0x7f112c15f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:01.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.107+0000 7f1132000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f112c0b0bc0 0x7f112c15f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45816/0 (socket says 172.21.15.107:45816) 2024-08-17T02:25:01.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.107+0000 7f1132000640 1 -- 172.21.15.107:0/1700994670 learned_addr learned my addr 172.21.15.107:0/1700994670 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:01.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.107+0000 7f1131600640 1 --2- 172.21.15.107:0/1700994670 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f112c0aad50 0x7f112c0b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:01.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.107+0000 7f1130c00640 1 --2- 172.21.15.107:0/1700994670 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f112c158da0 0x7f112c15ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:01.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.107+0000 7f1132000640 1 -- 172.21.15.107:0/1700994670 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f112c158da0 msgr2=0x7f112c15ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:01.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.107+0000 7f1132000640 1 --2- 172.21.15.107:0/1700994670 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f112c158da0 0x7f112c15ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.107+0000 7f1132000640 1 -- 172.21.15.107:0/1700994670 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f112c0aad50 msgr2=0x7f112c0b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:01.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.107+0000 7f1132000640 1 --2- 172.21.15.107:0/1700994670 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f112c0aad50 0x7f112c0b1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.107+0000 7f1132000640 1 -- 172.21.15.107:0/1700994670 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1118009450 con 0x7f112c0b0bc0 2024-08-17T02:25:01.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.108+0000 7f1132000640 1 --2- 172.21.15.107:0/1700994670 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f112c0b0bc0 0x7f112c15f110 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f112400c810 tx=0x7f11240015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:01.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.108+0000 7f1128c00640 1 -- 172.21.15.107:0/1700994670 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112400ce00 con 0x7f112c0b0bc0 2024-08-17T02:25:01.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.108+0000 7f1128c00640 1 -- 172.21.15.107:0/1700994670 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f112400a850 con 0x7f112c0b0bc0 2024-08-17T02:25:01.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.108+0000 7f1134000640 1 -- 172.21.15.107:0/1700994670 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f112c15e0f0 con 0x7f112c0b0bc0 2024-08-17T02:25:01.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.108+0000 7f1128c00640 1 -- 172.21.15.107:0/1700994670 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112400ac10 con 0x7f112c0b0bc0 2024-08-17T02:25:01.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.108+0000 7f1134000640 1 -- 172.21.15.107:0/1700994670 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f112c159a70 con 0x7f112c0b0bc0 2024-08-17T02:25:01.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.109+0000 7f1134000640 1 -- 172.21.15.107:0/1700994670 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f112c15e8b0 con 0x7f112c0b0bc0 2024-08-17T02:25:01.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.110+0000 7f1128c00640 1 -- 172.21.15.107:0/1700994670 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1124012630 con 0x7f112c0b0bc0 2024-08-17T02:25:01.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.110+0000 7f1128c00640 1 --2- 172.21.15.107:0/1700994670 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f110c065150 0x7f110c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:01.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.111+0000 7f1128c00640 1 -- 172.21.15.107:0/1700994670 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f11240825e0 con 0x7f112c0b0bc0 2024-08-17T02:25:01.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.111+0000 7f1131600640 1 --2- 172.21.15.107:0/1700994670 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f110c065150 0x7f110c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:01.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.111+0000 7f1131600640 1 --2- 172.21.15.107:0/1700994670 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f110c065150 0x7f110c067600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1120009d20 tx=0x7f11200090f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:01.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.115+0000 7f1128c00640 1 -- 172.21.15.107:0/1700994670 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1124054140 con 0x7f112c0b0bc0 2024-08-17T02:25:01.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.285+0000 7f1134000640 1 -- 172.21.15.107:0/1700994670 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f112c071050 con 0x7f112c0b0bc0 2024-08-17T02:25:01.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.285+0000 7f1128c00640 1 -- 172.21.15.107:0/1700994670 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1124053cd0 con 0x7f112c0b0bc0 2024-08-17T02:25:01.286 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 64 2024-08-17T02:25:01.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.287+0000 7f1134000640 1 -- 172.21.15.107:0/1700994670 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f110c065150 msgr2=0x7f110c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:01.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.287+0000 7f1134000640 1 --2- 172.21.15.107:0/1700994670 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f110c065150 0x7f110c067600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1120009d20 tx=0x7f11200090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.287+0000 7f1134000640 1 -- 172.21.15.107:0/1700994670 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f112c0b0bc0 msgr2=0x7f112c15f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:01.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.287+0000 7f1134000640 1 --2- 172.21.15.107:0/1700994670 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f112c0b0bc0 0x7f112c15f110 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f112400c810 tx=0x7f11240015f0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.288+0000 7f1134000640 1 -- 172.21.15.107:0/1700994670 shutdown_connections 2024-08-17T02:25:01.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.288+0000 7f1134000640 1 --2- 172.21.15.107:0/1700994670 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f110c065150 0x7f110c067600 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.288+0000 7f1134000640 1 --2- 172.21.15.107:0/1700994670 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f112c0b0bc0 0x7f112c15f110 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.288+0000 7f1134000640 1 --2- 172.21.15.107:0/1700994670 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f112c158da0 0x7f112c15ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.288+0000 7f1134000640 1 --2- 172.21.15.107:0/1700994670 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f112c0aad50 0x7f112c0b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.288+0000 7f1134000640 1 -- 172.21.15.107:0/1700994670 >> 172.21.15.107:0/1700994670 conn(0x7f112c096a70 msgr2=0x7f112c0ab310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:01.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.288+0000 7f1134000640 1 -- 172.21.15.107:0/1700994670 shutdown_connections 2024-08-17T02:25:01.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.288+0000 7f1134000640 1 -- 172.21.15.107:0/1700994670 wait complete. 2024-08-17T02:25:01.302 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-08-17T02:25:01.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.454+0000 7f97cf200640 1 Processor -- start 2024-08-17T02:25:01.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.454+0000 7f97cf200640 1 -- start start 2024-08-17T02:25:01.456 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.455+0000 7f97cf200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97c806df00 0x7f97c80adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:01.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.455+0000 7f97cf200640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f97c8155df0 0x7f97c80ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:01.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.455+0000 7f97cf200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97c8156670 con 0x7f97c8155a20 2024-08-17T02:25:01.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.456+0000 7f97cf200640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97c80b0350 con 0x7f97c8155df0 2024-08-17T02:25:01.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.456+0000 7f97cf200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c806e5e0 con 0x7f97c806df00 2024-08-17T02:25:01.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.456+0000 7f97c7e00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f97c8155a20 0x7f97c806d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:50470/0 (socket says 172.21.15.107:50470) 2024-08-17T02:25:01.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.456+0000 7f97c7e00640 1 -- 172.21.15.107:0/656284612 learned_addr learned my addr 172.21.15.107:0/656284612 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:25:01.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.456+0000 7f97c7400640 1 --2- 172.21.15.107:0/656284612 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97c806df00 0x7f97c80adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:01.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.456+0000 7f97cd200640 1 --2- 172.21.15.107:0/656284612 >> v2:172.21.15.157:3300/0 conn(0x7f97c8155df0 0x7f97c80ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:01.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.456+0000 7f97c6a00640 1 -- 172.21.15.107:0/656284612 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4166374715 0 0) 0x7f97c8156670 con 0x7f97c8155a20 2024-08-17T02:25:01.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.456+0000 7f97c6a00640 1 -- 172.21.15.107:0/656284612 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97ac0034e0 con 0x7f97c8155a20 2024-08-17T02:25:01.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.456+0000 7f97c7400640 1 -- 172.21.15.107:0/656284612 >> v2:172.21.15.157:3300/0 conn(0x7f97c8155df0 msgr2=0x7f97c80ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:01.458 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.456+0000 7f97c7400640 1 --2- 172.21.15.107:0/656284612 >> v2:172.21.15.157:3300/0 conn(0x7f97c8155df0 0x7f97c80ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.458 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.456+0000 7f97c7400640 1 -- 172.21.15.107:0/656284612 >> v1:172.21.15.107:6789/0 conn(0x7f97c8155a20 legacy=0x7f97c806d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:01.458 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.456+0000 7f97c7400640 1 -- 172.21.15.107:0/656284612 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c806e8c0 con 0x7f97c806df00 2024-08-17T02:25:01.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.457+0000 7f97c7400640 1 --2- 172.21.15.107:0/656284612 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97c806df00 0x7f97c80adf10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f97b4009850 tx=0x7f97b40090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a46b7d7588481a4f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:01.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.458+0000 7f97c6a00640 1 -- 172.21.15.107:0/656284612 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b402ad90 con 0x7f97c806df00 2024-08-17T02:25:01.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.458+0000 7f97c6a00640 1 -- 172.21.15.107:0/656284612 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b4032440 con 0x7f97c806df00 2024-08-17T02:25:01.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.458+0000 7f97c6a00640 1 -- 172.21.15.107:0/656284612 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b4032820 con 0x7f97c806df00 2024-08-17T02:25:01.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.458+0000 7f97cf200640 1 -- 172.21.15.107:0/656284612 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97c806df00 msgr2=0x7f97c80adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:01.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.458+0000 7f97cf200640 1 --2- 172.21.15.107:0/656284612 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97c806df00 0x7f97c80adf10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f97b4009850 tx=0x7f97b40090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.458+0000 7f97cf200640 1 -- 172.21.15.107:0/656284612 shutdown_connections 2024-08-17T02:25:01.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.458+0000 7f97cf200640 1 --2- 172.21.15.107:0/656284612 >> v2:172.21.15.157:3300/0 conn(0x7f97c8155df0 0x7f97c80ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.458+0000 7f97cf200640 1 --2- 172.21.15.107:0/656284612 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97c806df00 0x7f97c80adf10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.458+0000 7f97cf200640 1 -- 172.21.15.107:0/656284612 >> 172.21.15.107:0/656284612 conn(0x7f97c80cb9b0 msgr2=0x7f97c80cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:01.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.459+0000 7f97cf200640 1 -- 172.21.15.107:0/656284612 shutdown_connections 2024-08-17T02:25:01.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.459+0000 7f97cf200640 1 -- 172.21.15.107:0/656284612 wait complete. 2024-08-17T02:25:01.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.460+0000 7f97cf200640 1 Processor -- start 2024-08-17T02:25:01.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.460+0000 7f97cf200640 1 -- start start 2024-08-17T02:25:01.463 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.461+0000 7f97cf200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97c806df00 0x7f97c8158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:01.463 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.461+0000 7f97cf200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97c8155a20 0x7f97c816c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:01.463 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.461+0000 7f97cf200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97c8155df0 0x7f97c816cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:01.463 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.461+0000 7f97cf200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c814f7b0 con 0x7f97c8155df0 2024-08-17T02:25:01.463 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.461+0000 7f97cf200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c816d600 con 0x7f97c806df00 2024-08-17T02:25:01.463 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.461+0000 7f97cf200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c816d320 con 0x7f97c8155a20 2024-08-17T02:25:01.463 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.461+0000 7f97cd200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97c8155df0 0x7f97c816cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:01.463 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.461+0000 7f97cd200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97c8155df0 0x7f97c816cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45824/0 (socket says 172.21.15.107:45824) 2024-08-17T02:25:01.463 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.461+0000 7f97cd200640 1 -- 172.21.15.107:0/2937376540 learned_addr learned my addr 172.21.15.107:0/2937376540 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:01.463 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.461+0000 7f97c7400640 1 --2- 172.21.15.107:0/2937376540 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97c8155a20 0x7f97c816c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:01.463 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.461+0000 7f97c7e00640 1 --2- 172.21.15.107:0/2937376540 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97c806df00 0x7f97c8158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:01.463 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.462+0000 7f97cd200640 1 -- 172.21.15.107:0/2937376540 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97c8155a20 msgr2=0x7f97c816c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:01.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.462+0000 7f97cd200640 1 --2- 172.21.15.107:0/2937376540 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97c8155a20 0x7f97c816c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.462+0000 7f97cd200640 1 -- 172.21.15.107:0/2937376540 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97c806df00 msgr2=0x7f97c8158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:01.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.462+0000 7f97cd200640 1 --2- 172.21.15.107:0/2937376540 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97c806df00 0x7f97c8158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.462+0000 7f97cd200640 1 -- 172.21.15.107:0/2937376540 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b4009390 con 0x7f97c8155df0 2024-08-17T02:25:01.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.462+0000 7f97c7400640 1 --2- 172.21.15.107:0/2937376540 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97c8155a20 0x7f97c816c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:01.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.462+0000 7f97cd200640 1 --2- 172.21.15.107:0/2937376540 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97c8155df0 0x7f97c816cc30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f97c0009d70 tx=0x7f97c000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:01.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.462+0000 7f97bf400640 1 -- 172.21.15.107:0/2937376540 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c000cd40 con 0x7f97c8155df0 2024-08-17T02:25:01.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.462+0000 7f97bf400640 1 -- 172.21.15.107:0/2937376540 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c000f040 con 0x7f97c8155df0 2024-08-17T02:25:01.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.462+0000 7f97bf400640 1 -- 172.21.15.107:0/2937376540 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c000cea0 con 0x7f97c8155df0 2024-08-17T02:25:01.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.462+0000 7f97cf200640 1 -- 172.21.15.107:0/2937376540 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97c814a2f0 con 0x7f97c8155df0 2024-08-17T02:25:01.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.462+0000 7f97cf200640 1 -- 172.21.15.107:0/2937376540 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97c814a8b0 con 0x7f97c8155df0 2024-08-17T02:25:01.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.463+0000 7f97cf200640 1 -- 172.21.15.107:0/2937376540 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97c8064db0 con 0x7f97c8155df0 2024-08-17T02:25:01.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.464+0000 7f97bf400640 1 -- 172.21.15.107:0/2937376540 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f97c00148e0 con 0x7f97c8155df0 2024-08-17T02:25:01.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.465+0000 7f97bf400640 1 --2- 172.21.15.107:0/2937376540 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f97a8065150 0x7f97a8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:01.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.465+0000 7f97bf400640 1 -- 172.21.15.107:0/2937376540 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f97c00830e0 con 0x7f97c8155df0 2024-08-17T02:25:01.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.465+0000 7f97c7e00640 1 --2- 172.21.15.107:0/2937376540 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f97a8065150 0x7f97a8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:01.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.466+0000 7f97c7e00640 1 --2- 172.21.15.107:0/2937376540 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f97a8065150 0x7f97a8067600 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f97b8005840 tx=0x7f97b8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:01.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.469+0000 7f97bf400640 1 -- 172.21.15.107:0/2937376540 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f97c00511b0 con 0x7f97c8155df0 2024-08-17T02:25:01.705 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:01.705+0000 7f97cf200640 1 -- 172.21.15.107:0/2937376540 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7f97c80ae1a0 con 0x7f97c8155df0 2024-08-17T02:25:02.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.542+0000 7f97bf400640 1 -- 172.21.15.107:0/2937376540 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v48) v1 ==== 138+0+0 (secure 0 0 0) 0x7f97c00547d0 con 0x7f97c8155df0 2024-08-17T02:25:02.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.545+0000 7f97cf200640 1 -- 172.21.15.107:0/2937376540 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f97a8065150 msgr2=0x7f97a8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:02.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.545+0000 7f97cf200640 1 --2- 172.21.15.107:0/2937376540 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f97a8065150 0x7f97a8067600 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f97b8005840 tx=0x7f97b8009040 comp rx=0 tx=0).stop 2024-08-17T02:25:02.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.545+0000 7f97cf200640 1 -- 172.21.15.107:0/2937376540 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97c8155df0 msgr2=0x7f97c816cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:02.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.545+0000 7f97cf200640 1 --2- 172.21.15.107:0/2937376540 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97c8155df0 0x7f97c816cc30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f97c0009d70 tx=0x7f97c000b040 comp rx=0 tx=0).stop 2024-08-17T02:25:02.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.545+0000 7f97cf200640 1 -- 172.21.15.107:0/2937376540 shutdown_connections 2024-08-17T02:25:02.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.545+0000 7f97cf200640 1 --2- 172.21.15.107:0/2937376540 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f97a8065150 0x7f97a8067600 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.545+0000 7f97cf200640 1 --2- 172.21.15.107:0/2937376540 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97c8155df0 0x7f97c816cc30 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.545+0000 7f97cf200640 1 --2- 172.21.15.107:0/2937376540 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97c8155a20 0x7f97c816c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.545+0000 7f97cf200640 1 --2- 172.21.15.107:0/2937376540 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97c806df00 0x7f97c8158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.545+0000 7f97cf200640 1 -- 172.21.15.107:0/2937376540 >> 172.21.15.107:0/2937376540 conn(0x7f97c80cb9b0 msgr2=0x7f97c8150230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:02.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.545+0000 7f97cf200640 1 -- 172.21.15.107:0/2937376540 shutdown_connections 2024-08-17T02:25:02.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.545+0000 7f97cf200640 1 -- 172.21.15.107:0/2937376540 wait complete. 2024-08-17T02:25:02.563 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-17T02:25:02.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.718+0000 7f708dc00640 1 Processor -- start 2024-08-17T02:25:02.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.718+0000 7f708dc00640 1 -- start start 2024-08-17T02:25:02.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.719+0000 7f708dc00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f708815c2f0 0x7f70880cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:02.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.719+0000 7f708dc00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f70880d09a0 0x7f70880cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:02.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.719+0000 7f708dc00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70880cf300 con 0x7f70880ce360 2024-08-17T02:25:02.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.719+0000 7f708dc00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70880cf550 con 0x7f70880d09a0 2024-08-17T02:25:02.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.719+0000 7f708dc00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70880cf830 con 0x7f708815c2f0 2024-08-17T02:25:02.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.719+0000 7f708d200640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f70880ce360 0x7f70880ca350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:50472/0 (socket says 172.21.15.107:50472) 2024-08-17T02:25:02.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.719+0000 7f708d200640 1 -- 172.21.15.107:0/1061714843 learned_addr learned my addr 172.21.15.107:0/1061714843 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:25:02.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.719+0000 7f7087e00640 1 --2- 172.21.15.107:0/1061714843 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f708815c2f0 0x7f70880cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:02.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.719+0000 7f707f400640 1 --2- 172.21.15.107:0/1061714843 >> v2:172.21.15.157:3300/0 conn(0x7f70880d09a0 0x7f70880cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:02.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.720+0000 7f7087400640 1 -- 172.21.15.107:0/1061714843 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1985801330 0 0) 0x7f70880cf300 con 0x7f70880ce360 2024-08-17T02:25:02.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.720+0000 7f7087e00640 1 -- 172.21.15.107:0/1061714843 >> v2:172.21.15.157:3300/0 conn(0x7f70880d09a0 msgr2=0x7f70880cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:02.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.720+0000 7f7087e00640 1 --2- 172.21.15.107:0/1061714843 >> v2:172.21.15.157:3300/0 conn(0x7f70880d09a0 0x7f70880cde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.720+0000 7f7087e00640 1 -- 172.21.15.107:0/1061714843 >> v1:172.21.15.107:6789/0 conn(0x7f70880ce360 legacy=0x7f70880ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:02.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.720+0000 7f7087e00640 1 -- 172.21.15.107:0/1061714843 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70880aceb0 con 0x7f708815c2f0 2024-08-17T02:25:02.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.721+0000 7f7087e00640 1 --2- 172.21.15.107:0/1061714843 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f708815c2f0 0x7f70880cd8e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7078009850 tx=0x7f70780090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b26b4e4b7c180887 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:02.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.721+0000 7f7087400640 1 -- 172.21.15.107:0/1061714843 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707802ad00 con 0x7f708815c2f0 2024-08-17T02:25:02.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.721+0000 7f7087400640 1 -- 172.21.15.107:0/1061714843 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f707802ae60 con 0x7f708815c2f0 2024-08-17T02:25:02.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.721+0000 7f7087400640 1 -- 172.21.15.107:0/1061714843 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7078032670 con 0x7f708815c2f0 2024-08-17T02:25:02.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.722+0000 7f708dc00640 1 -- 172.21.15.107:0/1061714843 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f708815c2f0 msgr2=0x7f70880cd8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:02.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.722+0000 7f708dc00640 1 --2- 172.21.15.107:0/1061714843 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f708815c2f0 0x7f70880cd8e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7078009850 tx=0x7f70780090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.722+0000 7f708dc00640 1 -- 172.21.15.107:0/1061714843 shutdown_connections 2024-08-17T02:25:02.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.722+0000 7f708dc00640 1 --2- 172.21.15.107:0/1061714843 >> v2:172.21.15.157:3300/0 conn(0x7f70880d09a0 0x7f70880cde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.722+0000 7f708dc00640 1 --2- 172.21.15.107:0/1061714843 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f708815c2f0 0x7f70880cd8e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.722+0000 7f708dc00640 1 -- 172.21.15.107:0/1061714843 >> 172.21.15.107:0/1061714843 conn(0x7f70880cfdb0 msgr2=0x7f70880d01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:02.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.722+0000 7f708dc00640 1 -- 172.21.15.107:0/1061714843 shutdown_connections 2024-08-17T02:25:02.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.722+0000 7f708dc00640 1 -- 172.21.15.107:0/1061714843 wait complete. 2024-08-17T02:25:02.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.723+0000 7f708dc00640 1 Processor -- start 2024-08-17T02:25:02.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.723+0000 7f708dc00640 1 -- start start 2024-08-17T02:25:02.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.724+0000 7f708dc00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f70880ce360 0x7f70880c7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:02.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.724+0000 7f708dc00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70880d09a0 0x7f70880c9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:02.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.724+0000 7f708dc00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f708815c2f0 0x7f70880b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:02.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.724+0000 7f708dc00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70880c9db0 con 0x7f70880d09a0 2024-08-17T02:25:02.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.724+0000 7f708dc00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708814f4d0 con 0x7f70880ce360 2024-08-17T02:25:02.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.724+0000 7f708dc00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70880c7e40 con 0x7f708815c2f0 2024-08-17T02:25:02.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.725+0000 7f707f400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70880d09a0 0x7f70880c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:02.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.725+0000 7f707f400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70880d09a0 0x7f70880c9870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45840/0 (socket says 172.21.15.107:45840) 2024-08-17T02:25:02.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.725+0000 7f707f400640 1 -- 172.21.15.107:0/3677792471 learned_addr learned my addr 172.21.15.107:0/3677792471 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:02.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.725+0000 7f708d200640 1 --2- 172.21.15.107:0/3677792471 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f708815c2f0 0x7f70880b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:02.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.725+0000 7f7087e00640 1 --2- 172.21.15.107:0/3677792471 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f70880ce360 0x7f70880c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:02.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.725+0000 7f707f400640 1 -- 172.21.15.107:0/3677792471 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f708815c2f0 msgr2=0x7f70880b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:02.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.725+0000 7f707f400640 1 --2- 172.21.15.107:0/3677792471 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f708815c2f0 0x7f70880b4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.725+0000 7f707f400640 1 -- 172.21.15.107:0/3677792471 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f70880ce360 msgr2=0x7f70880c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:02.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.725+0000 7f707f400640 1 --2- 172.21.15.107:0/3677792471 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f70880ce360 0x7f70880c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.725+0000 7f707f400640 1 -- 172.21.15.107:0/3677792471 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7078009390 con 0x7f70880d09a0 2024-08-17T02:25:02.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.725+0000 7f707f400640 1 --2- 172.21.15.107:0/3677792471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70880d09a0 0x7f70880c9870 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7070009fd0 tx=0x7f70700090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:02.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.725+0000 7f707fe00640 1 -- 172.21.15.107:0/3677792471 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707000c940 con 0x7f70880d09a0 2024-08-17T02:25:02.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.726+0000 7f707fe00640 1 -- 172.21.15.107:0/3677792471 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f707000caa0 con 0x7f70880d09a0 2024-08-17T02:25:02.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.726+0000 7f707fe00640 1 -- 172.21.15.107:0/3677792471 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707000ce40 con 0x7f70880d09a0 2024-08-17T02:25:02.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.726+0000 7f708dc00640 1 -- 172.21.15.107:0/3677792471 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f708814ee80 con 0x7f70880d09a0 2024-08-17T02:25:02.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.726+0000 7f708dc00640 1 -- 172.21.15.107:0/3677792471 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70880c8120 con 0x7f70880d09a0 2024-08-17T02:25:02.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.727+0000 7f708dc00640 1 -- 172.21.15.107:0/3677792471 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7088071050 con 0x7f70880d09a0 2024-08-17T02:25:02.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.727+0000 7f707fe00640 1 -- 172.21.15.107:0/3677792471 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7070013680 con 0x7f70880d09a0 2024-08-17T02:25:02.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.728+0000 7f707fe00640 1 --2- 172.21.15.107:0/3677792471 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7064065150 0x7f7064067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:02.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.728+0000 7f707fe00640 1 -- 172.21.15.107:0/3677792471 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7070082740 con 0x7f70880d09a0 2024-08-17T02:25:02.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.729+0000 7f7087e00640 1 --2- 172.21.15.107:0/3677792471 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7064065150 0x7f7064067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:02.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.729+0000 7f7087e00640 1 --2- 172.21.15.107:0/3677792471 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7064065150 0x7f7064067600 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7078034000 tx=0x7f7078032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:02.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.732+0000 7f707fe00640 1 -- 172.21.15.107:0/3677792471 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f70700508d0 con 0x7f70880d09a0 2024-08-17T02:25:02.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.903+0000 7f708dc00640 1 -- 172.21.15.107:0/3677792471 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f708814f610 con 0x7f70880d09a0 2024-08-17T02:25:02.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.907+0000 7f707fe00640 1 -- 172.21.15.107:0/3677792471 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7070053ef0 con 0x7f70880d09a0 2024-08-17T02:25:02.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.909+0000 7f708dc00640 1 -- 172.21.15.107:0/3677792471 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7064065150 msgr2=0x7f7064067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:02.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.909+0000 7f708dc00640 1 --2- 172.21.15.107:0/3677792471 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7064065150 0x7f7064067600 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7078034000 tx=0x7f7078032000 comp rx=0 tx=0).stop 2024-08-17T02:25:02.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.909+0000 7f708dc00640 1 -- 172.21.15.107:0/3677792471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70880d09a0 msgr2=0x7f70880c9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:02.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.909+0000 7f708dc00640 1 --2- 172.21.15.107:0/3677792471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70880d09a0 0x7f70880c9870 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7070009fd0 tx=0x7f70700090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.909+0000 7f708dc00640 1 -- 172.21.15.107:0/3677792471 shutdown_connections 2024-08-17T02:25:02.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.909+0000 7f708dc00640 1 --2- 172.21.15.107:0/3677792471 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7064065150 0x7f7064067600 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.909+0000 7f708dc00640 1 --2- 172.21.15.107:0/3677792471 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f708815c2f0 0x7f70880b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.909+0000 7f708dc00640 1 --2- 172.21.15.107:0/3677792471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70880d09a0 0x7f70880c9870 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.909+0000 7f708dc00640 1 --2- 172.21.15.107:0/3677792471 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f70880ce360 0x7f70880c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.909+0000 7f708dc00640 1 -- 172.21.15.107:0/3677792471 >> 172.21.15.107:0/3677792471 conn(0x7f70880cfdb0 msgr2=0x7f708815b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:02.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.909+0000 7f708dc00640 1 -- 172.21.15.107:0/3677792471 shutdown_connections 2024-08-17T02:25:02.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:02.909+0000 7f708dc00640 1 -- 172.21.15.107:0/3677792471 wait complete. 2024-08-17T02:25:02.925 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-17T02:25:02.925 DEBUG:teuthology.orchestra.run.smithi107:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:25:03.017 DEBUG:teuthology.orchestra.run.smithi157:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:25:03.117 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-17T02:25:03.117 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-17T02:25:03.117 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:03.118 DEBUG:teuthology.orchestra.run.smithi107:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-08-17T02:25:03.178 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi107.front.sepia.ceph.com 2024-08-17T02:25:03.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:03.178 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-17T02:25:03.228 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-08-17T02:25:03.228 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:03.228 DEBUG:teuthology.orchestra.run.smithi157:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-08-17T02:25:03.293 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi157.front.sepia.ceph.com 2024-08-17T02:25:03.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:03.293 DEBUG:teuthology.orchestra.run.smithi157:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-17T02:25:03.338 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-08-17T02:25:03.338 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:03.338 DEBUG:teuthology.orchestra.run.smithi107:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-08-17T02:25:03.398 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi107.front.sepia.ceph.com 2024-08-17T02:25:03.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:03.398 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-08-17T02:25:03.434 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-08-17T02:25:03.434 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:03.434 DEBUG:teuthology.orchestra.run.smithi157:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-08-17T02:25:03.495 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi157.front.sepia.ceph.com 2024-08-17T02:25:03.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:03.495 DEBUG:teuthology.orchestra.run.smithi157:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-08-17T02:25:03.531 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-08-17T02:25:03.531 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:25:03.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.679+0000 7fbf5f800640 1 Processor -- start 2024-08-17T02:25:03.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.679+0000 7fbf5f800640 1 -- start start 2024-08-17T02:25:03.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.680+0000 7fbf5f800640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fbf58140580 0x7fbf580c9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:03.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.680+0000 7fbf5f800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf580caa80 con 0x7fbf580b1440 2024-08-17T02:25:03.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.680+0000 7fbf5f800640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf580c9e70 con 0x7fbf581401b0 2024-08-17T02:25:03.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.680+0000 7fbf5f800640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf580c9c90 con 0x7fbf58140580 2024-08-17T02:25:03.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.680+0000 7fbf57e00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fbf580b1440 0x7fbf580c9040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:50484/0 (socket says 172.21.15.107:50484) 2024-08-17T02:25:03.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.680+0000 7fbf57e00640 1 -- 172.21.15.107:0/2654442443 learned_addr learned my addr 172.21.15.107:0/2654442443 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:25:03.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.680+0000 7fbf5d800640 1 --2- 172.21.15.107:0/2654442443 >> v2:172.21.15.157:3300/0 conn(0x7fbf58140580 0x7fbf580c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:03.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.681+0000 7fbf57400640 1 -- 172.21.15.107:0/2654442443 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2637405778 0 0) 0x7fbf580caa80 con 0x7fbf580b1440 2024-08-17T02:25:03.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.681+0000 7fbf57400640 1 -- 172.21.15.107:0/2654442443 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf400034e0 con 0x7fbf580b1440 2024-08-17T02:25:03.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.681+0000 7fbf57400640 1 -- 172.21.15.107:0/2654442443 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 874416992 0 0) 0x7fbf580c9e70 con 0x7fbf581401b0 2024-08-17T02:25:03.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.681+0000 7fbf57400640 1 -- 172.21.15.107:0/2654442443 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf580caa80 con 0x7fbf581401b0 2024-08-17T02:25:03.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.681+0000 7fbf5d800640 1 -- 172.21.15.107:0/2654442443 >> v1:172.21.15.157:6789/0 conn(0x7fbf581401b0 legacy=0x7fbf580b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:03.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.681+0000 7fbf5d800640 1 -- 172.21.15.107:0/2654442443 >> v1:172.21.15.107:6789/0 conn(0x7fbf580b1440 legacy=0x7fbf580c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:03.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.681+0000 7fbf5d800640 1 -- 172.21.15.107:0/2654442443 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf580ca150 con 0x7fbf58140580 2024-08-17T02:25:03.683 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.682+0000 7fbf5d800640 1 --2- 172.21.15.107:0/2654442443 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf58140580 0x7fbf580c9750 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbf50009e60 tx=0x7fbf50009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4cd003a0a627500 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:03.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.682+0000 7fbf57400640 1 -- 172.21.15.107:0/2654442443 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf50007550 con 0x7fbf58140580 2024-08-17T02:25:03.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.682+0000 7fbf57400640 1 -- 172.21.15.107:0/2654442443 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5002d050 con 0x7fbf58140580 2024-08-17T02:25:03.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.682+0000 7fbf57400640 1 -- 172.21.15.107:0/2654442443 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf50007900 con 0x7fbf58140580 2024-08-17T02:25:03.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.683+0000 7fbf5f800640 1 -- 172.21.15.107:0/2654442443 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf58140580 msgr2=0x7fbf580c9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:03.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.683+0000 7fbf5f800640 1 --2- 172.21.15.107:0/2654442443 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf58140580 0x7fbf580c9750 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbf50009e60 tx=0x7fbf50009780 comp rx=0 tx=0).stop 2024-08-17T02:25:03.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.683+0000 7fbf5f800640 1 -- 172.21.15.107:0/2654442443 shutdown_connections 2024-08-17T02:25:03.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.683+0000 7fbf5f800640 1 --2- 172.21.15.107:0/2654442443 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf58140580 0x7fbf580c9750 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.683+0000 7fbf5f800640 1 -- 172.21.15.107:0/2654442443 >> 172.21.15.107:0/2654442443 conn(0x7fbf580cb9b0 msgr2=0x7fbf580cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:03.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.683+0000 7fbf5f800640 1 -- 172.21.15.107:0/2654442443 shutdown_connections 2024-08-17T02:25:03.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.683+0000 7fbf5f800640 1 -- 172.21.15.107:0/2654442443 wait complete. 2024-08-17T02:25:03.685 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.684+0000 7fbf5f800640 1 Processor -- start 2024-08-17T02:25:03.685 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.684+0000 7fbf5f800640 1 -- start start 2024-08-17T02:25:03.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.685+0000 7fbf5f800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf580b1440 0x7fbf58156650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:03.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.685+0000 7fbf5f800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf581401b0 0x7fbf580c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:03.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.685+0000 7fbf5f800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbf58140580 0x7fbf580c46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:03.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.685+0000 7fbf5f800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5813e5f0 con 0x7fbf581401b0 2024-08-17T02:25:03.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.685+0000 7fbf5f800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf58156b90 con 0x7fbf580b1440 2024-08-17T02:25:03.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.685+0000 7fbf5f800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf580c8110 con 0x7fbf58140580 2024-08-17T02:25:03.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.685+0000 7fbf57e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf581401b0 0x7fbf580c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:03.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.686+0000 7fbf57e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf581401b0 0x7fbf580c7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45846/0 (socket says 172.21.15.107:45846) 2024-08-17T02:25:03.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.686+0000 7fbf57e00640 1 -- 172.21.15.107:0/2414566525 learned_addr learned my addr 172.21.15.107:0/2414566525 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:03.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.686+0000 7fbf5ce00640 1 --2- 172.21.15.107:0/2414566525 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf580b1440 0x7fbf58156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:03.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.686+0000 7fbf5d800640 1 --2- 172.21.15.107:0/2414566525 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbf58140580 0x7fbf580c46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:03.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.686+0000 7fbf57e00640 1 -- 172.21.15.107:0/2414566525 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbf58140580 msgr2=0x7fbf580c46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:03.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.686+0000 7fbf57e00640 1 --2- 172.21.15.107:0/2414566525 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbf58140580 0x7fbf580c46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.686+0000 7fbf57e00640 1 -- 172.21.15.107:0/2414566525 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf580b1440 msgr2=0x7fbf58156650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:03.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.686+0000 7fbf57e00640 1 --2- 172.21.15.107:0/2414566525 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf580b1440 0x7fbf58156650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.686+0000 7fbf57e00640 1 -- 172.21.15.107:0/2414566525 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf50009a20 con 0x7fbf581401b0 2024-08-17T02:25:03.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.686+0000 7fbf5ce00640 1 --2- 172.21.15.107:0/2414566525 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf580b1440 0x7fbf58156650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:03.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.686+0000 7fbf57e00640 1 --2- 172.21.15.107:0/2414566525 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf581401b0 0x7fbf580c7bd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbf44005840 tx=0x7fbf44007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:03.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.686+0000 7fbf4be00640 1 -- 172.21.15.107:0/2414566525 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf44005aa0 con 0x7fbf581401b0 2024-08-17T02:25:03.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.686+0000 7fbf4be00640 1 -- 172.21.15.107:0/2414566525 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf44005c00 con 0x7fbf581401b0 2024-08-17T02:25:03.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.686+0000 7fbf4be00640 1 -- 172.21.15.107:0/2414566525 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf440070f0 con 0x7fbf581401b0 2024-08-17T02:25:03.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.686+0000 7fbf5f800640 1 -- 172.21.15.107:0/2414566525 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf580c7740 con 0x7fbf581401b0 2024-08-17T02:25:03.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.687+0000 7fbf5f800640 1 -- 172.21.15.107:0/2414566525 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf580c70f0 con 0x7fbf581401b0 2024-08-17T02:25:03.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.688+0000 7fbf5f800640 1 -- 172.21.15.107:0/2414566525 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf580683c0 con 0x7fbf581401b0 2024-08-17T02:25:03.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.688+0000 7fbf4be00640 1 -- 172.21.15.107:0/2414566525 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbf44007520 con 0x7fbf581401b0 2024-08-17T02:25:03.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.690+0000 7fbf4be00640 1 --2- 172.21.15.107:0/2414566525 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbf38065150 0x7fbf38067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:03.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.690+0000 7fbf4be00640 1 -- 172.21.15.107:0/2414566525 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbf44081ef0 con 0x7fbf581401b0 2024-08-17T02:25:03.691 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.690+0000 7fbf5ce00640 1 --2- 172.21.15.107:0/2414566525 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbf38065150 0x7fbf38067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:03.691 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.690+0000 7fbf5ce00640 1 --2- 172.21.15.107:0/2414566525 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbf38065150 0x7fbf38067600 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c003900 tx=0x7fbf4c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:03.694 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.694+0000 7fbf4be00640 1 -- 172.21.15.107:0/2414566525 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbf580683c0 con 0x7fbf581401b0 2024-08-17T02:25:03.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.899+0000 7fbf5f800640 1 -- 172.21.15.107:0/2414566525 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf580683c0 con 0x7fbf581401b0 2024-08-17T02:25:03.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.899+0000 7fbf4be00640 1 -- 172.21.15.107:0/2414566525 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4600 (secure 0 0 0) 0x7fbf580683c0 con 0x7fbf581401b0 2024-08-17T02:25:03.900 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:25:03.900 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1386798018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1386798018},{"type":"v1","addr":"172.21.15.107:6835","nonce":1386798018}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6834/287524804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":287524804},{"type":"v1","addr":"172.21.15.157:6834","nonce":287524804}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1183198496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1183198496},{"type":"v1","addr":"172.21.15.107:6837","nonce":1183198496}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:28.816556+0000","modified":"2024-08-17T02:24:32.431137+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6835/1985555291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6833","nonce":1985555291},{"type":"v1","addr":"172.21.15.157:6835","nonce":1985555291}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:25:03.900 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 8 2024-08-17T02:25:03.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.901+0000 7fbf5f800640 1 -- 172.21.15.107:0/2414566525 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbf38065150 msgr2=0x7fbf38067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:03.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.901+0000 7fbf5f800640 1 --2- 172.21.15.107:0/2414566525 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbf38065150 0x7fbf38067600 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c003900 tx=0x7fbf4c009040 comp rx=0 tx=0).stop 2024-08-17T02:25:03.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.901+0000 7fbf5f800640 1 -- 172.21.15.107:0/2414566525 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf581401b0 msgr2=0x7fbf580c7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:03.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.901+0000 7fbf5f800640 1 --2- 172.21.15.107:0/2414566525 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf581401b0 0x7fbf580c7bd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbf44005840 tx=0x7fbf44007e10 comp rx=0 tx=0).stop 2024-08-17T02:25:03.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.901+0000 7fbf5f800640 1 -- 172.21.15.107:0/2414566525 shutdown_connections 2024-08-17T02:25:03.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.901+0000 7fbf5f800640 1 --2- 172.21.15.107:0/2414566525 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbf38065150 0x7fbf38067600 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.901+0000 7fbf5f800640 1 --2- 172.21.15.107:0/2414566525 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbf58140580 0x7fbf580c46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.901+0000 7fbf5f800640 1 --2- 172.21.15.107:0/2414566525 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf581401b0 0x7fbf580c7bd0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.901+0000 7fbf5f800640 1 --2- 172.21.15.107:0/2414566525 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf580b1440 0x7fbf58156650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.901+0000 7fbf5f800640 1 -- 172.21.15.107:0/2414566525 >> 172.21.15.107:0/2414566525 conn(0x7fbf580cb9b0 msgr2=0x7fbf5806dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:03.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.902+0000 7fbf5f800640 1 -- 172.21.15.107:0/2414566525 shutdown_connections 2024-08-17T02:25:03.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:03.902+0000 7fbf5f800640 1 -- 172.21.15.107:0/2414566525 wait complete. 2024-08-17T02:25:03.918 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:04.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.065+0000 7f0c56e00640 1 Processor -- start 2024-08-17T02:25:04.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.065+0000 7f0c56e00640 1 -- start start 2024-08-17T02:25:04.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.066+0000 7f0c56e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0c500c68c0 0x7f0c500cb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:04.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.066+0000 7f0c56e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c500ceb20 con 0x7f0c50158ce0 2024-08-17T02:25:04.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.066+0000 7f0c56e00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c500cede0 con 0x7f0c500d08d0 2024-08-17T02:25:04.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.066+0000 7f0c56e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c500cf0c0 con 0x7f0c500c68c0 2024-08-17T02:25:04.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.066+0000 7f0c4fe00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f0c50158ce0 0x7f0c500cac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:50488/0 (socket says 172.21.15.107:50488) 2024-08-17T02:25:04.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.066+0000 7f0c4fe00640 1 -- 172.21.15.107:0/2124295039 learned_addr learned my addr 172.21.15.107:0/2124295039 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:25:04.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.066+0000 7f0c54e00640 1 --2- 172.21.15.107:0/2124295039 >> v2:172.21.15.107:3300/0 conn(0x7f0c500c68c0 0x7f0c500cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:04.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.067+0000 7f0c4ea00640 1 -- 172.21.15.107:0/2124295039 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1628857534 0 0) 0x7f0c500ceb20 con 0x7f0c50158ce0 2024-08-17T02:25:04.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.067+0000 7f0c54e00640 1 -- 172.21.15.107:0/2124295039 >> v1:172.21.15.157:6789/0 conn(0x7f0c500d08d0 legacy=0x7f0c500c5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:04.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.067+0000 7f0c54e00640 1 -- 172.21.15.107:0/2124295039 >> v1:172.21.15.107:6789/0 conn(0x7f0c50158ce0 legacy=0x7f0c500cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:04.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.067+0000 7f0c54e00640 1 -- 172.21.15.107:0/2124295039 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c500cba10 con 0x7f0c500c68c0 2024-08-17T02:25:04.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.068+0000 7f0c54e00640 1 --2- 172.21.15.107:0/2124295039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c500c68c0 0x7f0c500cb340 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0c48009de0 tx=0x7f0c48009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b25d29213b2f52 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:04.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.068+0000 7f0c4ea00640 1 -- 172.21.15.107:0/2124295039 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c48007550 con 0x7f0c500c68c0 2024-08-17T02:25:04.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.068+0000 7f0c4ea00640 1 -- 172.21.15.107:0/2124295039 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4802d050 con 0x7f0c500c68c0 2024-08-17T02:25:04.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.068+0000 7f0c4ea00640 1 -- 172.21.15.107:0/2124295039 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c480078e0 con 0x7f0c500c68c0 2024-08-17T02:25:04.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.069+0000 7f0c56e00640 1 -- 172.21.15.107:0/2124295039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c500c68c0 msgr2=0x7f0c500cb340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:04.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.069+0000 7f0c56e00640 1 --2- 172.21.15.107:0/2124295039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c500c68c0 0x7f0c500cb340 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0c48009de0 tx=0x7f0c48009780 comp rx=0 tx=0).stop 2024-08-17T02:25:04.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.069+0000 7f0c56e00640 1 -- 172.21.15.107:0/2124295039 shutdown_connections 2024-08-17T02:25:04.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.069+0000 7f0c56e00640 1 --2- 172.21.15.107:0/2124295039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c500c68c0 0x7f0c500cb340 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:04.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.069+0000 7f0c56e00640 1 -- 172.21.15.107:0/2124295039 >> 172.21.15.107:0/2124295039 conn(0x7f0c500cfdc0 msgr2=0x7f0c500d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:04.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.069+0000 7f0c56e00640 1 -- 172.21.15.107:0/2124295039 shutdown_connections 2024-08-17T02:25:04.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.069+0000 7f0c56e00640 1 -- 172.21.15.107:0/2124295039 wait complete. 2024-08-17T02:25:04.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.070+0000 7f0c56e00640 1 Processor -- start 2024-08-17T02:25:04.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.070+0000 7f0c56e00640 1 -- start start 2024-08-17T02:25:04.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.071+0000 7f0c56e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0c500c68c0 0x7f0c500c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:04.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.071+0000 7f0c56e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c500d08d0 0x7f0c5009c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:04.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.071+0000 7f0c56e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c50158ce0 0x7f0c5009c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:04.072 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.071+0000 7f0c56e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c500c98d0 con 0x7f0c50158ce0 2024-08-17T02:25:04.072 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.071+0000 7f0c56e00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c500c8cc0 con 0x7f0c500d08d0 2024-08-17T02:25:04.072 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.071+0000 7f0c56e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c500c8fa0 con 0x7f0c500c68c0 2024-08-17T02:25:04.072 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.071+0000 7f0c54e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c50158ce0 0x7f0c5009c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:04.072 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.071+0000 7f0c54e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c50158ce0 0x7f0c5009c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45864/0 (socket says 172.21.15.107:45864) 2024-08-17T02:25:04.072 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.071+0000 7f0c54e00640 1 -- 172.21.15.107:0/386123692 learned_addr learned my addr 172.21.15.107:0/386123692 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:04.073 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.072+0000 7f0c4f400640 1 --2- 172.21.15.107:0/386123692 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c500d08d0 0x7f0c5009c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:04.073 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.072+0000 7f0c4fe00640 1 --2- 172.21.15.107:0/386123692 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0c500c68c0 0x7f0c500c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:04.073 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.072+0000 7f0c54e00640 1 -- 172.21.15.107:0/386123692 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0c500c68c0 msgr2=0x7f0c500c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:04.073 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.072+0000 7f0c54e00640 1 --2- 172.21.15.107:0/386123692 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0c500c68c0 0x7f0c500c83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:04.073 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.072+0000 7f0c54e00640 1 -- 172.21.15.107:0/386123692 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c500d08d0 msgr2=0x7f0c5009c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:04.073 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.072+0000 7f0c54e00640 1 --2- 172.21.15.107:0/386123692 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c500d08d0 0x7f0c5009c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:04.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.072+0000 7f0c54e00640 1 -- 172.21.15.107:0/386123692 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c48009a20 con 0x7f0c50158ce0 2024-08-17T02:25:04.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.072+0000 7f0c4fe00640 1 --2- 172.21.15.107:0/386123692 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0c500c68c0 0x7f0c500c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:04.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.072+0000 7f0c4f400640 1 --2- 172.21.15.107:0/386123692 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c500d08d0 0x7f0c5009c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:04.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.072+0000 7f0c54e00640 1 --2- 172.21.15.107:0/386123692 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c50158ce0 0x7f0c5009c5e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0c480099f0 tx=0x7f0c48037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:04.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.072+0000 7f0c47400640 1 -- 172.21.15.107:0/386123692 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c48031910 con 0x7f0c50158ce0 2024-08-17T02:25:04.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.072+0000 7f0c47400640 1 -- 172.21.15.107:0/386123692 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c48040070 con 0x7f0c50158ce0 2024-08-17T02:25:04.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.072+0000 7f0c47400640 1 -- 172.21.15.107:0/386123692 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c48031ca0 con 0x7f0c50158ce0 2024-08-17T02:25:04.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.072+0000 7f0c56e00640 1 -- 172.21.15.107:0/386123692 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c500c9280 con 0x7f0c50158ce0 2024-08-17T02:25:04.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.072+0000 7f0c56e00640 1 -- 172.21.15.107:0/386123692 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c500c9d60 con 0x7f0c50158ce0 2024-08-17T02:25:04.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.074+0000 7f0c56e00640 1 -- 172.21.15.107:0/386123692 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c500c9a80 con 0x7f0c50158ce0 2024-08-17T02:25:04.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.074+0000 7f0c47400640 1 -- 172.21.15.107:0/386123692 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0c48042030 con 0x7f0c50158ce0 2024-08-17T02:25:04.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.075+0000 7f0c47400640 1 --2- 172.21.15.107:0/386123692 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f0c30065150 0x7f0c30067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:04.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.076+0000 7f0c47400640 1 -- 172.21.15.107:0/386123692 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0c480a3ed0 con 0x7f0c50158ce0 2024-08-17T02:25:04.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.076+0000 7f0c4fe00640 1 --2- 172.21.15.107:0/386123692 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f0c30065150 0x7f0c30067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:04.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.076+0000 7f0c4fe00640 1 --2- 172.21.15.107:0/386123692 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f0c30065150 0x7f0c30067600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0c50099f80 tx=0x7f0c40009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:04.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.080+0000 7f0c47400640 1 -- 172.21.15.107:0/386123692 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0c48071f90 con 0x7f0c50158ce0 2024-08-17T02:25:04.089 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:25:04.094 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:25:04.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.262+0000 7f0c56e00640 1 -- 172.21.15.107:0/386123692 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c50064db0 con 0x7f0c50158ce0 2024-08-17T02:25:04.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.263+0000 7f0c47400640 1 -- 172.21.15.107:0/386123692 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f0c480755b0 con 0x7f0c50158ce0 2024-08-17T02:25:04.264 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:25:04.264 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":21,"fsid":"f207b4c0-329d-46b8-b83f-aaf30bdb6ce3","created":"2024-08-17T02:24:11.038049+0000","modified":"2024-08-17T02:24:30.420018+0000","last_up_change":"2024-08-17T02:24:22.047790+0000","last_in_change":"2024-08-17T02:24:13.892720+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:23.456166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:27.078670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:27.804418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"376363f3-b8bf-4f1e-b691-51cdd39171ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37302},{"type":"v1","addr":"172.21.15.107:6801","nonce":37302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37302},{"type":"v1","addr":"172.21.15.107:6803","nonce":37302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37302},{"type":"v1","addr":"172.21.15.107:6807","nonce":37302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37302},{"type":"v1","addr":"172.21.15.107:6805","nonce":37302}]},"public_addr":"172.21.15.107:6801/37302","cluster_addr":"172.21.15.107:6803/37302","heartbeat_back_addr":"172.21.15.107:6807/37302","heartbeat_front_addr":"172.21.15.107:6805/37302","state":["exists","up"]},{"osd":1,"uuid":"cc6624e3-2ad4-4db4-b377-05dfe57424e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37305},{"type":"v1","addr":"172.21.15.107:6824","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37305},{"type":"v1","addr":"172.21.15.107:6827","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37305},{"type":"v1","addr":"172.21.15.107:6831","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37305},{"type":"v1","addr":"172.21.15.107:6829","nonce":37305}]},"public_addr":"172.21.15.107:6824/37305","cluster_addr":"172.21.15.107:6827/37305","heartbeat_back_addr":"172.21.15.107:6831/37305","heartbeat_front_addr":"172.21.15.107:6829/37305","state":["exists","up"]},{"osd":2,"uuid":"25229542-29b5-4281-bcb0-798ae0930aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37307},{"type":"v1","addr":"172.21.15.107:6817","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37307},{"type":"v1","addr":"172.21.15.107:6819","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6823","nonce":37307},{"type":"v1","addr":"172.21.15.107:6825","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37307},{"type":"v1","addr":"172.21.15.107:6821","nonce":37307}]},"public_addr":"172.21.15.107:6817/37307","cluster_addr":"172.21.15.107:6819/37307","heartbeat_back_addr":"172.21.15.107:6825/37307","heartbeat_front_addr":"172.21.15.107:6821/37307","state":["exists","up"]},{"osd":3,"uuid":"5f16aee8-8950-4268-a61a-5cf6ebd670e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37306},{"type":"v1","addr":"172.21.15.107:6809","nonce":37306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37306},{"type":"v1","addr":"172.21.15.107:6811","nonce":37306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37306},{"type":"v1","addr":"172.21.15.107:6815","nonce":37306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37306},{"type":"v1","addr":"172.21.15.107:6813","nonce":37306}]},"public_addr":"172.21.15.107:6809/37306","cluster_addr":"172.21.15.107:6811/37306","heartbeat_back_addr":"172.21.15.107:6815/37306","heartbeat_front_addr":"172.21.15.107:6813/37306","state":["exists","up"]},{"osd":4,"uuid":"23232e28-e23b-4b4e-a531-4939246dbbde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":37329},{"type":"v1","addr":"172.21.15.157:6817","nonce":37329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":37329},{"type":"v1","addr":"172.21.15.157:6819","nonce":37329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":37329},{"type":"v1","addr":"172.21.15.157:6823","nonce":37329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":37329},{"type":"v1","addr":"172.21.15.157:6821","nonce":37329}]},"public_addr":"172.21.15.157:6817/37329","cluster_addr":"172.21.15.157:6819/37329","heartbeat_back_addr":"172.21.15.157:6823/37329","heartbeat_front_addr":"172.21.15.157:6821/37329","state":["exists","up"]},{"osd":5,"uuid":"f87ec331-3e59-4886-a317-6f7e26ec8e21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":37328},{"type":"v1","addr":"172.21.15.157:6804","nonce":37328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":37328},{"type":"v1","addr":"172.21.15.157:6808","nonce":37328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":37328},{"type":"v1","addr":"172.21.15.157:6815","nonce":37328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":37328},{"type":"v1","addr":"172.21.15.157:6812","nonce":37328}]},"public_addr":"172.21.15.157:6804/37328","cluster_addr":"172.21.15.157:6808/37328","heartbeat_back_addr":"172.21.15.157:6815/37328","heartbeat_front_addr":"172.21.15.157:6812/37328","state":["exists","up"]},{"osd":6,"uuid":"92852235-ce49-4d96-a940-6f18d97b13ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":37330},{"type":"v1","addr":"172.21.15.157:6801","nonce":37330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6803","nonce":37330},{"type":"v1","addr":"172.21.15.157:6805","nonce":37330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":37330},{"type":"v1","addr":"172.21.15.157:6813","nonce":37330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":37330},{"type":"v1","addr":"172.21.15.157:6809","nonce":37330}]},"public_addr":"172.21.15.157:6801/37330","cluster_addr":"172.21.15.157:6805/37330","heartbeat_back_addr":"172.21.15.157:6813/37330","heartbeat_front_addr":"172.21.15.157:6809/37330","state":["exists","up"]},{"osd":7,"uuid":"7484a061-723d-4663-b28f-b01766d62f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":37373},{"type":"v1","addr":"172.21.15.157:6825","nonce":37373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":37373},{"type":"v1","addr":"172.21.15.157:6827","nonce":37373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":37373},{"type":"v1","addr":"172.21.15.157:6831","nonce":37373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":37373},{"type":"v1","addr":"172.21.15.157:6829","nonce":37373}]},"public_addr":"172.21.15.157:6825/37373","cluster_addr":"172.21.15.157:6827/37373","heartbeat_back_addr":"172.21.15.157:6831/37373","heartbeat_front_addr":"172.21.15.157:6829/37373","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.110188+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.280265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.252119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.267996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.284582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.144420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.174764+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.308002+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:04.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.266+0000 7f0c56e00640 1 -- 172.21.15.107:0/386123692 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f0c30065150 msgr2=0x7f0c30067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:04.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.266+0000 7f0c56e00640 1 --2- 172.21.15.107:0/386123692 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f0c30065150 0x7f0c30067600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0c50099f80 tx=0x7f0c40009040 comp rx=0 tx=0).stop 2024-08-17T02:25:04.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.266+0000 7f0c56e00640 1 -- 172.21.15.107:0/386123692 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c50158ce0 msgr2=0x7f0c5009c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:04.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.266+0000 7f0c56e00640 1 --2- 172.21.15.107:0/386123692 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c50158ce0 0x7f0c5009c5e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0c480099f0 tx=0x7f0c48037000 comp rx=0 tx=0).stop 2024-08-17T02:25:04.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.266+0000 7f0c56e00640 1 -- 172.21.15.107:0/386123692 shutdown_connections 2024-08-17T02:25:04.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.266+0000 7f0c56e00640 1 --2- 172.21.15.107:0/386123692 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f0c30065150 0x7f0c30067600 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:04.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.266+0000 7f0c56e00640 1 --2- 172.21.15.107:0/386123692 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c50158ce0 0x7f0c5009c5e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:04.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.266+0000 7f0c56e00640 1 --2- 172.21.15.107:0/386123692 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c500d08d0 0x7f0c5009c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:04.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.266+0000 7f0c56e00640 1 --2- 172.21.15.107:0/386123692 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0c500c68c0 0x7f0c500c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:04.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.266+0000 7f0c56e00640 1 -- 172.21.15.107:0/386123692 >> 172.21.15.107:0/386123692 conn(0x7f0c500cfdc0 msgr2=0x7f0c50068660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:04.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.266+0000 7f0c56e00640 1 -- 172.21.15.107:0/386123692 shutdown_connections 2024-08-17T02:25:04.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.266+0000 7f0c56e00640 1 -- 172.21.15.107:0/386123692 wait complete. 2024-08-17T02:25:04.281 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:24:23.456166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:24:27.078670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:24:27.804418+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:25:04.281 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:25:04.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.431+0000 7fd9f7000640 1 Processor -- start 2024-08-17T02:25:04.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.431+0000 7fd9f7000640 1 -- start start 2024-08-17T02:25:04.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.432+0000 7fd9f7000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9f00b0a80 0x7fd9f00b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:04.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.432+0000 7fd9f7000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd9f00adec0 0x7fd9f015a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:04.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.432+0000 7fd9f7000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9f0157070 con 0x7fd9f0157e10 2024-08-17T02:25:04.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.432+0000 7fd9f7000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9f00b1390 con 0x7fd9f00adec0 2024-08-17T02:25:04.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.432+0000 7fd9f7000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f015b410 con 0x7fd9f00b0a80 2024-08-17T02:25:04.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.432+0000 7fd9f5000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd9f00adec0 0x7fd9f015a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:04.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.432+0000 7fd9ef400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fd9f0157e10 0x7fd9f00ad7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:50498/0 (socket says 172.21.15.107:50498) 2024-08-17T02:25:04.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.432+0000 7fd9ef400640 1 -- 172.21.15.107:0/93622829 learned_addr learned my addr 172.21.15.107:0/93622829 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:25:04.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.433+0000 7fd9efe00640 1 --2- 172.21.15.107:0/93622829 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9f00b0a80 0x7fd9f00b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:04.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.433+0000 7fd9f5000640 1 -- 172.21.15.107:0/93622829 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9f00b0a80 msgr2=0x7fd9f00b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:04.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.433+0000 7fd9f5000640 1 --2- 172.21.15.107:0/93622829 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9f00b0a80 0x7fd9f00b0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:04.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.433+0000 7fd9f5000640 1 -- 172.21.15.107:0/93622829 >> v1:172.21.15.107:6789/0 conn(0x7fd9f0157e10 legacy=0x7fd9f00ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:04.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.433+0000 7fd9f5000640 1 -- 172.21.15.107:0/93622829 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f0157330 con 0x7fd9f00adec0 2024-08-17T02:25:04.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.433+0000 7fd9efe00640 1 --2- 172.21.15.107:0/93622829 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9f00b0a80 0x7fd9f00b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:04.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.434+0000 7fd9f5000640 1 --2- 172.21.15.107:0/93622829 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9f00adec0 0x7fd9f015a6e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8009e60 tx=0x7fd9e8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d99c209a4bd3ebdd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:04.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.434+0000 7fd9eea00640 1 -- 172.21.15.107:0/93622829 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e8007550 con 0x7fd9f00adec0 2024-08-17T02:25:04.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.434+0000 7fd9eea00640 1 -- 172.21.15.107:0/93622829 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e802d050 con 0x7fd9f00adec0 2024-08-17T02:25:04.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.434+0000 7fd9eea00640 1 -- 172.21.15.107:0/93622829 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e8007920 con 0x7fd9f00adec0 2024-08-17T02:25:04.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.435+0000 7fd9f7000640 1 -- 172.21.15.107:0/93622829 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9f00adec0 msgr2=0x7fd9f015a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:04.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.435+0000 7fd9f7000640 1 --2- 172.21.15.107:0/93622829 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9f00adec0 0x7fd9f015a6e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8009e60 tx=0x7fd9e8009780 comp rx=0 tx=0).stop 2024-08-17T02:25:04.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.435+0000 7fd9f7000640 1 -- 172.21.15.107:0/93622829 shutdown_connections 2024-08-17T02:25:04.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.435+0000 7fd9f7000640 1 --2- 172.21.15.107:0/93622829 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9f00adec0 0x7fd9f015a6e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:04.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.435+0000 7fd9f7000640 1 --2- 172.21.15.107:0/93622829 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9f00b0a80 0x7fd9f00b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:04.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.435+0000 7fd9f7000640 1 -- 172.21.15.107:0/93622829 >> 172.21.15.107:0/93622829 conn(0x7fd9f0067750 msgr2=0x7fd9f00cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:04.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.435+0000 7fd9f7000640 1 -- 172.21.15.107:0/93622829 shutdown_connections 2024-08-17T02:25:04.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.435+0000 7fd9f7000640 1 -- 172.21.15.107:0/93622829 wait complete. 2024-08-17T02:25:04.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.436+0000 7fd9f7000640 1 Processor -- start 2024-08-17T02:25:04.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.436+0000 7fd9f7000640 1 -- start start 2024-08-17T02:25:04.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.437+0000 7fd9f7000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9f00adec0 0x7fd9f0152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:04.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.437+0000 7fd9f7000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9f00b0a80 0x7fd9f014b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:04.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.437+0000 7fd9f7000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9f0157e10 0x7fd9f014c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:04.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.437+0000 7fd9f7000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f01524b0 con 0x7fd9f0157e10 2024-08-17T02:25:04.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.437+0000 7fd9f7000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f0167cc0 con 0x7fd9f00b0a80 2024-08-17T02:25:04.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.437+0000 7fd9f7000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f0151b80 con 0x7fd9f00adec0 2024-08-17T02:25:04.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.437+0000 7fd9f5000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9f0157e10 0x7fd9f014c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:04.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.437+0000 7fd9f5000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9f0157e10 0x7fd9f014c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45876/0 (socket says 172.21.15.107:45876) 2024-08-17T02:25:04.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.437+0000 7fd9f5000640 1 -- 172.21.15.107:0/2251607224 learned_addr learned my addr 172.21.15.107:0/2251607224 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:04.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.438+0000 7fd9efe00640 1 --2- 172.21.15.107:0/2251607224 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9f00adec0 0x7fd9f0152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:04.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.438+0000 7fd9ef400640 1 --2- 172.21.15.107:0/2251607224 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9f00b0a80 0x7fd9f014b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:04.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.438+0000 7fd9f5000640 1 -- 172.21.15.107:0/2251607224 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9f00adec0 msgr2=0x7fd9f0152940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:04.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.438+0000 7fd9f5000640 1 --2- 172.21.15.107:0/2251607224 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9f00adec0 0x7fd9f0152940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:04.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.438+0000 7fd9f5000640 1 -- 172.21.15.107:0/2251607224 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9f00b0a80 msgr2=0x7fd9f014b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:04.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.438+0000 7fd9f5000640 1 --2- 172.21.15.107:0/2251607224 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9f00b0a80 0x7fd9f014b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:04.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.438+0000 7fd9f5000640 1 -- 172.21.15.107:0/2251607224 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e8009a20 con 0x7fd9f0157e10 2024-08-17T02:25:04.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.438+0000 7fd9f5000640 1 --2- 172.21.15.107:0/2251607224 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9f0157e10 0x7fd9f014c4c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8009e60 tx=0x7fd9e8037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:04.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.438+0000 7fd9e7400640 1 -- 172.21.15.107:0/2251607224 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e8031b70 con 0x7fd9f0157e10 2024-08-17T02:25:04.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.438+0000 7fd9e7400640 1 -- 172.21.15.107:0/2251607224 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e8031cd0 con 0x7fd9f0157e10 2024-08-17T02:25:04.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.438+0000 7fd9e7400640 1 -- 172.21.15.107:0/2251607224 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e8045670 con 0x7fd9f0157e10 2024-08-17T02:25:04.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.438+0000 7fd9f7000640 1 -- 172.21.15.107:0/2251607224 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9f0151e60 con 0x7fd9f0157e10 2024-08-17T02:25:04.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.439+0000 7fd9f7000640 1 -- 172.21.15.107:0/2251607224 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9f014ca00 con 0x7fd9f0157e10 2024-08-17T02:25:04.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.440+0000 7fd9f7000640 1 -- 172.21.15.107:0/2251607224 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9f0152660 con 0x7fd9f0157e10 2024-08-17T02:25:04.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.440+0000 7fd9e7400640 1 -- 172.21.15.107:0/2251607224 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd9e803c420 con 0x7fd9f0157e10 2024-08-17T02:25:04.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.441+0000 7fd9e7400640 1 --2- 172.21.15.107:0/2251607224 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd9d0065150 0x7fd9d0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:04.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.441+0000 7fd9e7400640 1 -- 172.21.15.107:0/2251607224 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd9e80a3a70 con 0x7fd9f0157e10 2024-08-17T02:25:04.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.441+0000 7fd9efe00640 1 --2- 172.21.15.107:0/2251607224 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd9d0065150 0x7fd9d0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:04.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.442+0000 7fd9efe00640 1 --2- 172.21.15.107:0/2251607224 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd9d0065150 0x7fd9d0067600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0006e70 tx=0x7fd9e0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:04.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.445+0000 7fd9e7400640 1 -- 172.21.15.107:0/2251607224 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd9f0152660 con 0x7fd9f0157e10 2024-08-17T02:25:04.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.616+0000 7fd9f7000640 1 -- 172.21.15.107:0/2251607224 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd9f0064db0 con 0x7fd9f0157e10 2024-08-17T02:25:04.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.617+0000 7fd9e7400640 1 -- 172.21.15.107:0/2251607224 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd9e8071b30 con 0x7fd9f0157e10 2024-08-17T02:25:04.617 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2024-08-17T02:25:04.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.619+0000 7fd9f7000640 1 -- 172.21.15.107:0/2251607224 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd9d0065150 msgr2=0x7fd9d0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:04.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.619+0000 7fd9f7000640 1 --2- 172.21.15.107:0/2251607224 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd9d0065150 0x7fd9d0067600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0006e70 tx=0x7fd9e0008040 comp rx=0 tx=0).stop 2024-08-17T02:25:04.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.619+0000 7fd9f7000640 1 -- 172.21.15.107:0/2251607224 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9f0157e10 msgr2=0x7fd9f014c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:04.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.619+0000 7fd9f7000640 1 --2- 172.21.15.107:0/2251607224 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9f0157e10 0x7fd9f014c4c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8009e60 tx=0x7fd9e8037000 comp rx=0 tx=0).stop 2024-08-17T02:25:04.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.619+0000 7fd9f7000640 1 -- 172.21.15.107:0/2251607224 shutdown_connections 2024-08-17T02:25:04.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.619+0000 7fd9f7000640 1 --2- 172.21.15.107:0/2251607224 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd9d0065150 0x7fd9d0067600 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:04.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.619+0000 7fd9f7000640 1 --2- 172.21.15.107:0/2251607224 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9f0157e10 0x7fd9f014c4c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:04.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.619+0000 7fd9f7000640 1 --2- 172.21.15.107:0/2251607224 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9f00b0a80 0x7fd9f014b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:04.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.619+0000 7fd9f7000640 1 --2- 172.21.15.107:0/2251607224 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9f00adec0 0x7fd9f0152940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:04.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.619+0000 7fd9f7000640 1 -- 172.21.15.107:0/2251607224 >> 172.21.15.107:0/2251607224 conn(0x7fd9f0067750 msgr2=0x7fd9f00c9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:04.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.619+0000 7fd9f7000640 1 -- 172.21.15.107:0/2251607224 shutdown_connections 2024-08-17T02:25:04.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.619+0000 7fd9f7000640 1 -- 172.21.15.107:0/2251607224 wait complete. 2024-08-17T02:25:04.634 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:25:04.784 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.784+0000 7f4a76e00640 1 Processor -- start 2024-08-17T02:25:04.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.784+0000 7f4a76e00640 1 -- start start 2024-08-17T02:25:04.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.786+0000 7f4a76e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a700adcf0 0x7f4a700ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:04.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.786+0000 7f4a76e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a700ab130 con 0x7f4a70156c50 2024-08-17T02:25:04.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.786+0000 7f4a76e00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a700ae5a0 con 0x7f4a700abb00 2024-08-17T02:25:04.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.786+0000 7f4a76e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a700ae2c0 con 0x7f4a700adcf0 2024-08-17T02:25:04.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.786+0000 7f4a6fe00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f4a70156c50 0x7f4a700c7cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:50514/0 (socket says 172.21.15.107:50514) 2024-08-17T02:25:04.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.786+0000 7f4a6fe00640 1 -- 172.21.15.107:0/1746847577 learned_addr learned my addr 172.21.15.107:0/1746847577 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:25:04.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.786+0000 7f4a6ea00640 1 -- 172.21.15.107:0/1746847577 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1953858252 0 0) 0x7f4a700ab130 con 0x7f4a70156c50 2024-08-17T02:25:04.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.786+0000 7f4a6ea00640 1 -- 172.21.15.107:0/1746847577 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a540034e0 con 0x7f4a70156c50 2024-08-17T02:25:04.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.786+0000 7f4a6f400640 1 --2- 172.21.15.107:0/1746847577 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a700adcf0 0x7f4a700ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:04.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.787+0000 7f4a6ea00640 1 -- 172.21.15.107:0/1746847577 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3180396262 0 0) 0x7f4a540034e0 con 0x7f4a70156c50 2024-08-17T02:25:04.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.787+0000 7f4a6ea00640 1 -- 172.21.15.107:0/1746847577 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a700adcf0 msgr2=0x7f4a700ab5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:04.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.787+0000 7f4a6ea00640 1 --2- 172.21.15.107:0/1746847577 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a700adcf0 0x7f4a700ab5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:04.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.787+0000 7f4a6ea00640 1 -- 172.21.15.107:0/1746847577 >> v1:172.21.15.157:6789/0 conn(0x7f4a700abb00 legacy=0x7f4a700c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:04.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.787+0000 7f4a6ea00640 1 -- 172.21.15.107:0/1746847577 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a700aaae0 con 0x7f4a70156c50 2024-08-17T02:25:04.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.787+0000 7f4a6ea00640 1 -- 172.21.15.107:0/1746847577 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 537989081 0 0) 0x7f4a60001470 con 0x7f4a70156c50 2024-08-17T02:25:04.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.787+0000 7f4a6ea00640 1 -- 172.21.15.107:0/1746847577 >> v1:172.21.15.107:6789/0 conn(0x7f4a70156c50 legacy=0x7f4a700c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:04.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.787+0000 7f4a6ea00640 1 --2- 172.21.15.107:0/1746847577 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a54003a00 0x7f4a54003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:04.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.787+0000 7f4a6ea00640 1 --2- 172.21.15.107:0/1746847577 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a700adcf0 0x7f4a54004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:04.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.787+0000 7f4a6ea00640 1 --2- 172.21.15.107:0/1746847577 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a54004cc0 0x7f4a54005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:04.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.787+0000 7f4a6ea00640 1 -- 172.21.15.107:0/1746847577 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a700ae2c0 con 0x7f4a54004cc0 2024-08-17T02:25:04.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.787+0000 7f4a6ea00640 1 -- 172.21.15.107:0/1746847577 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5400bb60 con 0x7f4a54003a00 2024-08-17T02:25:04.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.787+0000 7f4a6ea00640 1 -- 172.21.15.107:0/1746847577 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5400bcf0 con 0x7f4a700adcf0 2024-08-17T02:25:04.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.787+0000 7f4a6fe00640 1 --2- 172.21.15.107:0/1746847577 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a54003a00 0x7f4a54003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:04.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.787+0000 7f4a6f400640 1 --2- 172.21.15.107:0/1746847577 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a700adcf0 0x7f4a54004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:04.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.787+0000 7f4a74e00640 1 --2- 172.21.15.107:0/1746847577 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a54004cc0 0x7f4a54005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:04.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.787+0000 7f4a74e00640 1 -- 172.21.15.107:0/1746847577 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a700adcf0 msgr2=0x7f4a54004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:04.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.787+0000 7f4a74e00640 1 --2- 172.21.15.107:0/1746847577 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a700adcf0 0x7f4a54004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:04.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.787+0000 7f4a74e00640 1 -- 172.21.15.107:0/1746847577 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a54003a00 msgr2=0x7f4a54003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:04.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.787+0000 7f4a74e00640 1 --2- 172.21.15.107:0/1746847577 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a54003a00 0x7f4a54003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:04.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.788+0000 7f4a74e00640 1 -- 172.21.15.107:0/1746847577 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a540034e0 con 0x7f4a54004cc0 2024-08-17T02:25:04.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.788+0000 7f4a6fe00640 1 --2- 172.21.15.107:0/1746847577 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a54003a00 0x7f4a54003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:04.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.788+0000 7f4a74e00640 1 --2- 172.21.15.107:0/1746847577 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a54004cc0 0x7f4a54005130 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4a68001ef0 tx=0x7f4a68007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c88ff1db22625885 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:04.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.789+0000 7f4a6ea00640 1 -- 172.21.15.107:0/1746847577 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6802ac60 con 0x7f4a54004cc0 2024-08-17T02:25:04.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.789+0000 7f4a6ea00640 1 -- 172.21.15.107:0/1746847577 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6802adc0 con 0x7f4a54004cc0 2024-08-17T02:25:04.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.789+0000 7f4a6ea00640 1 -- 172.21.15.107:0/1746847577 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a68032680 con 0x7f4a54004cc0 2024-08-17T02:25:04.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.789+0000 7f4a76e00640 1 -- 172.21.15.107:0/1746847577 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a54004cc0 msgr2=0x7f4a54005130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:04.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.789+0000 7f4a76e00640 1 --2- 172.21.15.107:0/1746847577 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a54004cc0 0x7f4a54005130 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4a68001ef0 tx=0x7f4a68007f90 comp rx=0 tx=0).stop 2024-08-17T02:25:04.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.789+0000 7f4a74e00640 1 -- 172.21.15.107:0/1746847577 reap_dead start 2024-08-17T02:25:04.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.789+0000 7f4a76e00640 1 -- 172.21.15.107:0/1746847577 shutdown_connections 2024-08-17T02:25:04.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.789+0000 7f4a76e00640 1 -- 172.21.15.107:0/1746847577 >> 172.21.15.107:0/1746847577 conn(0x7f4a70067750 msgr2=0x7f4a700c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:04.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.789+0000 7f4a76e00640 1 -- 172.21.15.107:0/1746847577 shutdown_connections 2024-08-17T02:25:04.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.789+0000 7f4a76e00640 1 -- 172.21.15.107:0/1746847577 wait complete. 2024-08-17T02:25:04.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.791+0000 7f4a76e00640 1 Processor -- start 2024-08-17T02:25:04.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.791+0000 7f4a76e00640 1 -- start start 2024-08-17T02:25:04.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.792+0000 7f4a76e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a54004cc0 0x7f4a701441f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:04.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.792+0000 7f4a76e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a70153d70 0x7f4a7015b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:04.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.792+0000 7f4a76e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a7015bcd0 0x7f4a701542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:04.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.792+0000 7f4a76e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a70156240 con 0x7f4a70153d70 2024-08-17T02:25:04.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.792+0000 7f4a76e00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7015c150 con 0x7f4a54004cc0 2024-08-17T02:25:04.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.792+0000 7f4a76e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a701538e0 con 0x7f4a7015bcd0 2024-08-17T02:25:04.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.792+0000 7f4a6f400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a70153d70 0x7f4a7015b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:04.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.792+0000 7f4a6f400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a70153d70 0x7f4a7015b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45896/0 (socket says 172.21.15.107:45896) 2024-08-17T02:25:04.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.792+0000 7f4a6f400640 1 -- 172.21.15.107:0/954020078 learned_addr learned my addr 172.21.15.107:0/954020078 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:04.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.792+0000 7f4a6fe00640 1 --2- 172.21.15.107:0/954020078 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a54004cc0 0x7f4a701441f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:04.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.792+0000 7f4a74e00640 1 --2- 172.21.15.107:0/954020078 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a7015bcd0 0x7f4a701542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:04.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.793+0000 7f4a6f400640 1 -- 172.21.15.107:0/954020078 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a7015bcd0 msgr2=0x7f4a701542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:04.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.793+0000 7f4a6f400640 1 --2- 172.21.15.107:0/954020078 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a7015bcd0 0x7f4a701542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:04.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.793+0000 7f4a6f400640 1 -- 172.21.15.107:0/954020078 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a54004cc0 msgr2=0x7f4a701441f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:04.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.793+0000 7f4a6f400640 1 --2- 172.21.15.107:0/954020078 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a54004cc0 0x7f4a701441f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:04.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.793+0000 7f4a6f400640 1 -- 172.21.15.107:0/954020078 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a70152d10 con 0x7f4a70153d70 2024-08-17T02:25:04.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.793+0000 7f4a6fe00640 1 --2- 172.21.15.107:0/954020078 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a54004cc0 0x7f4a701441f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:04.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.793+0000 7f4a6f400640 1 --2- 172.21.15.107:0/954020078 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a70153d70 0x7f4a7015b790 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c011ba0 tx=0x7f4a5c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:04.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.793+0000 7f4a67400640 1 -- 172.21.15.107:0/954020078 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5c00fb60 con 0x7f4a70153d70 2024-08-17T02:25:04.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.793+0000 7f4a67400640 1 -- 172.21.15.107:0/954020078 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a5c00fcc0 con 0x7f4a70153d70 2024-08-17T02:25:04.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.793+0000 7f4a76e00640 1 -- 172.21.15.107:0/954020078 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a70152fb0 con 0x7f4a70153d70 2024-08-17T02:25:04.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.793+0000 7f4a67400640 1 -- 172.21.15.107:0/954020078 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5c014440 con 0x7f4a70153d70 2024-08-17T02:25:04.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.793+0000 7f4a76e00640 1 -- 172.21.15.107:0/954020078 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a70153570 con 0x7f4a70153d70 2024-08-17T02:25:04.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.794+0000 7f4a76e00640 1 -- 172.21.15.107:0/954020078 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a70071050 con 0x7f4a70153d70 2024-08-17T02:25:04.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.795+0000 7f4a67400640 1 -- 172.21.15.107:0/954020078 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4a5c0147f0 con 0x7f4a70153d70 2024-08-17T02:25:04.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.796+0000 7f4a67400640 1 --2- 172.21.15.107:0/954020078 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4a50065180 0x7f4a50067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:04.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.796+0000 7f4a67400640 1 -- 172.21.15.107:0/954020078 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4a5c018030 con 0x7f4a70153d70 2024-08-17T02:25:04.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.797+0000 7f4a6fe00640 1 --2- 172.21.15.107:0/954020078 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4a50065180 0x7f4a50067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:04.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.797+0000 7f4a6fe00640 1 --2- 172.21.15.107:0/954020078 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4a50065180 0x7f4a50067630 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4a600074f0 tx=0x7f4a60009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:04.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.800+0000 7f4a67400640 1 -- 172.21.15.107:0/954020078 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4a5c050fe0 con 0x7f4a70153d70 2024-08-17T02:25:04.969 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.969+0000 7f4a76e00640 1 -- 172.21.15.107:0/954020078 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4a70153a20 con 0x7f4a70153d70 2024-08-17T02:25:04.969 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.969+0000 7f4a67400640 1 -- 172.21.15.107:0/954020078 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4a5c054600 con 0x7f4a70153d70 2024-08-17T02:25:04.969 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2024-08-17T02:25:04.972 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.971+0000 7f4a76e00640 1 -- 172.21.15.107:0/954020078 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4a50065180 msgr2=0x7f4a50067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:04.972 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.971+0000 7f4a76e00640 1 --2- 172.21.15.107:0/954020078 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4a50065180 0x7f4a50067630 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4a600074f0 tx=0x7f4a60009040 comp rx=0 tx=0).stop 2024-08-17T02:25:04.972 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.971+0000 7f4a76e00640 1 -- 172.21.15.107:0/954020078 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a70153d70 msgr2=0x7f4a7015b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:04.972 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.971+0000 7f4a76e00640 1 --2- 172.21.15.107:0/954020078 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a70153d70 0x7f4a7015b790 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c011ba0 tx=0x7f4a5c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:04.972 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.971+0000 7f4a76e00640 1 -- 172.21.15.107:0/954020078 shutdown_connections 2024-08-17T02:25:04.972 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.971+0000 7f4a76e00640 1 --2- 172.21.15.107:0/954020078 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4a50065180 0x7f4a50067630 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:04.972 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.971+0000 7f4a76e00640 1 --2- 172.21.15.107:0/954020078 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a7015bcd0 0x7f4a701542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:04.972 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.971+0000 7f4a76e00640 1 --2- 172.21.15.107:0/954020078 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a70153d70 0x7f4a7015b790 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:04.972 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.971+0000 7f4a76e00640 1 --2- 172.21.15.107:0/954020078 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a54004cc0 0x7f4a701441f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:04.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.971+0000 7f4a76e00640 1 -- 172.21.15.107:0/954020078 >> 172.21.15.107:0/954020078 conn(0x7f4a70067750 msgr2=0x7f4a701521c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:04.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.971+0000 7f4a76e00640 1 -- 172.21.15.107:0/954020078 shutdown_connections 2024-08-17T02:25:04.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:04.971+0000 7f4a76e00640 1 -- 172.21.15.107:0/954020078 wait complete. 2024-08-17T02:25:04.987 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:25:05.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.137+0000 7fe66cc00640 1 Processor -- start 2024-08-17T02:25:05.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.137+0000 7fe66cc00640 1 -- start start 2024-08-17T02:25:05.138 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.138+0000 7fe66cc00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe6680caa20 0x7fe6680c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:05.138 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.138+0000 7fe66cc00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6680cb540 con 0x7fe6680c3390 2024-08-17T02:25:05.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.138+0000 7fe66cc00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6680cf7f0 con 0x7fe668158e20 2024-08-17T02:25:05.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.138+0000 7fe66cc00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6680caef0 con 0x7fe6680caa20 2024-08-17T02:25:05.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.138+0000 7fe666800640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fe6680c3390 0x7fe6680c7350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:50518/0 (socket says 172.21.15.107:50518) 2024-08-17T02:25:05.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.138+0000 7fe666800640 1 -- 172.21.15.107:0/3337969852 learned_addr learned my addr 172.21.15.107:0/3337969852 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:25:05.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.139+0000 7fe665400640 1 --2- 172.21.15.107:0/3337969852 >> v2:172.21.15.157:3300/0 conn(0x7fe6680caa20 0x7fe6680c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:05.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.139+0000 7fe664a00640 1 -- 172.21.15.107:0/3337969852 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 662076243 0 0) 0x7fe6680cb540 con 0x7fe6680c3390 2024-08-17T02:25:05.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.139+0000 7fe664a00640 1 -- 172.21.15.107:0/3337969852 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe64c0034e0 con 0x7fe6680c3390 2024-08-17T02:25:05.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.139+0000 7fe664a00640 1 -- 172.21.15.107:0/3337969852 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2491711471 0 0) 0x7fe6680cf7f0 con 0x7fe668158e20 2024-08-17T02:25:05.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.139+0000 7fe664a00640 1 -- 172.21.15.107:0/3337969852 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6680cb540 con 0x7fe668158e20 2024-08-17T02:25:05.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.139+0000 7fe665400640 1 -- 172.21.15.107:0/3337969852 >> v1:172.21.15.157:6789/0 conn(0x7fe668158e20 legacy=0x7fe6680ca310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:05.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.139+0000 7fe665400640 1 -- 172.21.15.107:0/3337969852 >> v1:172.21.15.107:6789/0 conn(0x7fe6680c3390 legacy=0x7fe6680c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:05.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.139+0000 7fe665400640 1 -- 172.21.15.107:0/3337969852 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6680cb1d0 con 0x7fe6680caa20 2024-08-17T02:25:05.141 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.140+0000 7fe665400640 1 --2- 172.21.15.107:0/3337969852 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6680caa20 0x7fe6680c6e10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe654009850 tx=0x7fe6540090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=540a8b9b307e4a41 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:05.141 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.140+0000 7fe664a00640 1 -- 172.21.15.107:0/3337969852 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65402ae20 con 0x7fe6680caa20 2024-08-17T02:25:05.141 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.140+0000 7fe664a00640 1 -- 172.21.15.107:0/3337969852 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe654032440 con 0x7fe6680caa20 2024-08-17T02:25:05.141 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.140+0000 7fe664a00640 1 -- 172.21.15.107:0/3337969852 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6540327e0 con 0x7fe6680caa20 2024-08-17T02:25:05.141 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.141+0000 7fe66cc00640 1 -- 172.21.15.107:0/3337969852 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6680caa20 msgr2=0x7fe6680c6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:05.141 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.141+0000 7fe66cc00640 1 --2- 172.21.15.107:0/3337969852 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6680caa20 0x7fe6680c6e10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe654009850 tx=0x7fe6540090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:05.141 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.141+0000 7fe66cc00640 1 -- 172.21.15.107:0/3337969852 shutdown_connections 2024-08-17T02:25:05.141 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.141+0000 7fe66cc00640 1 --2- 172.21.15.107:0/3337969852 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6680caa20 0x7fe6680c6e10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:05.141 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.141+0000 7fe66cc00640 1 -- 172.21.15.107:0/3337969852 >> 172.21.15.107:0/3337969852 conn(0x7fe6680cfd70 msgr2=0x7fe6680d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:05.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.141+0000 7fe66cc00640 1 -- 172.21.15.107:0/3337969852 shutdown_connections 2024-08-17T02:25:05.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.141+0000 7fe66cc00640 1 -- 172.21.15.107:0/3337969852 wait complete. 2024-08-17T02:25:05.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.142+0000 7fe66cc00640 1 Processor -- start 2024-08-17T02:25:05.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.142+0000 7fe66cc00640 1 -- start start 2024-08-17T02:25:05.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.143+0000 7fe66cc00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe6680c3390 0x7fe668158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:05.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.143+0000 7fe66cc00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6680caa20 0x7fe6680c37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:05.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.143+0000 7fe66cc00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe668158e20 0x7fe6680c5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:05.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.143+0000 7fe66cc00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66815d880 con 0x7fe6680caa20 2024-08-17T02:25:05.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.143+0000 7fe66cc00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66815cc70 con 0x7fe668158e20 2024-08-17T02:25:05.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.143+0000 7fe66cc00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe66815cf50 con 0x7fe6680c3390 2024-08-17T02:25:05.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.144+0000 7fe665400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6680caa20 0x7fe6680c37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:05.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.144+0000 7fe665400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6680caa20 0x7fe6680c37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45912/0 (socket says 172.21.15.107:45912) 2024-08-17T02:25:05.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.144+0000 7fe665400640 1 -- 172.21.15.107:0/3486737772 learned_addr learned my addr 172.21.15.107:0/3486737772 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:05.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.144+0000 7fe666800640 1 --2- 172.21.15.107:0/3486737772 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe668158e20 0x7fe6680c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:05.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.144+0000 7fe665e00640 1 --2- 172.21.15.107:0/3486737772 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe6680c3390 0x7fe668158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:05.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.144+0000 7fe665400640 1 -- 172.21.15.107:0/3486737772 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe6680c3390 msgr2=0x7fe668158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:05.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.144+0000 7fe665400640 1 --2- 172.21.15.107:0/3486737772 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe6680c3390 0x7fe668158200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:05.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.144+0000 7fe665400640 1 -- 172.21.15.107:0/3486737772 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe668158e20 msgr2=0x7fe6680c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:05.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.144+0000 7fe665400640 1 --2- 172.21.15.107:0/3486737772 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe668158e20 0x7fe6680c5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:05.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.144+0000 7fe665400640 1 -- 172.21.15.107:0/3486737772 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe654009390 con 0x7fe6680caa20 2024-08-17T02:25:05.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.144+0000 7fe665e00640 1 --2- 172.21.15.107:0/3486737772 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe6680c3390 0x7fe668158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:05.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.144+0000 7fe665400640 1 --2- 172.21.15.107:0/3486737772 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6680caa20 0x7fe6680c37d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe654009360 tx=0x7fe654032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:05.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.144+0000 7fe65d600640 1 -- 172.21.15.107:0/3486737772 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe654000c40 con 0x7fe6680caa20 2024-08-17T02:25:05.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.144+0000 7fe65d600640 1 -- 172.21.15.107:0/3486737772 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe654031a60 con 0x7fe6680caa20 2024-08-17T02:25:05.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.144+0000 7fe65d600640 1 -- 172.21.15.107:0/3486737772 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe654031e00 con 0x7fe6680caa20 2024-08-17T02:25:05.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.144+0000 7fe66cc00640 1 -- 172.21.15.107:0/3486737772 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe66815d230 con 0x7fe6680caa20 2024-08-17T02:25:05.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.145+0000 7fe66cc00640 1 -- 172.21.15.107:0/3486737772 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe66815c920 con 0x7fe6680caa20 2024-08-17T02:25:05.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.146+0000 7fe66cc00640 1 -- 172.21.15.107:0/3486737772 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe668071050 con 0x7fe6680caa20 2024-08-17T02:25:05.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.146+0000 7fe65d600640 1 -- 172.21.15.107:0/3486737772 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe654039040 con 0x7fe6680caa20 2024-08-17T02:25:05.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.147+0000 7fe65d600640 1 --2- 172.21.15.107:0/3486737772 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe648065150 0x7fe648067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:05.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.148+0000 7fe65d600640 1 -- 172.21.15.107:0/3486737772 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe6540a1ff0 con 0x7fe6680caa20 2024-08-17T02:25:05.148 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.148+0000 7fe665e00640 1 --2- 172.21.15.107:0/3486737772 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe648065150 0x7fe648067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:05.148 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.148+0000 7fe665e00640 1 --2- 172.21.15.107:0/3486737772 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe648065150 0x7fe648067600 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe658003860 tx=0x7fe658009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:05.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.151+0000 7fe65d600640 1 -- 172.21.15.107:0/3486737772 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe6540d3e40 con 0x7fe6680caa20 2024-08-17T02:25:05.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.320+0000 7fe66cc00640 1 -- 172.21.15.107:0/3486737772 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe668067260 con 0x7fe6680caa20 2024-08-17T02:25:05.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.321+0000 7fe65d600640 1 -- 172.21.15.107:0/3486737772 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe654070030 con 0x7fe6680caa20 2024-08-17T02:25:05.321 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 64 2024-08-17T02:25:05.323 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.323+0000 7fe66cc00640 1 -- 172.21.15.107:0/3486737772 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe648065150 msgr2=0x7fe648067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:05.323 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.323+0000 7fe66cc00640 1 --2- 172.21.15.107:0/3486737772 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe648065150 0x7fe648067600 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe658003860 tx=0x7fe658009040 comp rx=0 tx=0).stop 2024-08-17T02:25:05.323 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.323+0000 7fe66cc00640 1 -- 172.21.15.107:0/3486737772 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6680caa20 msgr2=0x7fe6680c37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:05.323 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.323+0000 7fe66cc00640 1 --2- 172.21.15.107:0/3486737772 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6680caa20 0x7fe6680c37d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe654009360 tx=0x7fe654032000 comp rx=0 tx=0).stop 2024-08-17T02:25:05.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.323+0000 7fe66cc00640 1 -- 172.21.15.107:0/3486737772 shutdown_connections 2024-08-17T02:25:05.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.323+0000 7fe66cc00640 1 --2- 172.21.15.107:0/3486737772 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe648065150 0x7fe648067600 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:05.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.323+0000 7fe66cc00640 1 --2- 172.21.15.107:0/3486737772 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe668158e20 0x7fe6680c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:05.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.323+0000 7fe66cc00640 1 --2- 172.21.15.107:0/3486737772 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6680caa20 0x7fe6680c37d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:05.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.323+0000 7fe66cc00640 1 --2- 172.21.15.107:0/3486737772 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe6680c3390 0x7fe668158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:05.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.323+0000 7fe66cc00640 1 -- 172.21.15.107:0/3486737772 >> 172.21.15.107:0/3486737772 conn(0x7fe6680cfd70 msgr2=0x7fe6680cec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:05.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.323+0000 7fe66cc00640 1 -- 172.21.15.107:0/3486737772 shutdown_connections 2024-08-17T02:25:05.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.323+0000 7fe66cc00640 1 -- 172.21.15.107:0/3486737772 wait complete. 2024-08-17T02:25:05.338 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:25:05.485 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.485+0000 7fd5fca00640 1 Processor -- start 2024-08-17T02:25:05.486 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.485+0000 7fd5fca00640 1 -- start start 2024-08-17T02:25:05.487 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.487+0000 7fd5fca00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd5f8155a20 0x7fd5f80adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:05.487 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.487+0000 7fd5fca00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd5f8155df0 0x7fd5f80ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:05.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.487+0000 7fd5fca00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd5f806d7f0 0x7fd5f806dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:05.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.487+0000 7fd5fca00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5f80b0350 con 0x7fd5f806d7f0 2024-08-17T02:25:05.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.487+0000 7fd5fca00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5f806e1d0 con 0x7fd5f8155df0 2024-08-17T02:25:05.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.487+0000 7fd5fca00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f8156670 con 0x7fd5f8155a20 2024-08-17T02:25:05.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.487+0000 7fd5f6800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd5f806d7f0 0x7fd5f806dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:05.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.487+0000 7fd5f6800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd5f806d7f0 0x7fd5f806dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45918/0 (socket says 172.21.15.107:45918) 2024-08-17T02:25:05.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.487+0000 7fd5f6800640 1 -- 172.21.15.107:0/991113845 learned_addr learned my addr 172.21.15.107:0/991113845 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:05.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.487+0000 7fd5f5e00640 1 --2- 172.21.15.107:0/991113845 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd5f8155a20 0x7fd5f80adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:05.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.487+0000 7fd5ed400640 1 --2- 172.21.15.107:0/991113845 >> v2:172.21.15.157:3300/0 conn(0x7fd5f8155df0 0x7fd5f80ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:05.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.487+0000 7fd5f6800640 1 -- 172.21.15.107:0/991113845 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd5f8155a20 msgr2=0x7fd5f80adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:05.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.487+0000 7fd5f6800640 1 --2- 172.21.15.107:0/991113845 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd5f8155a20 0x7fd5f80adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:05.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.487+0000 7fd5f6800640 1 -- 172.21.15.107:0/991113845 >> v2:172.21.15.157:3300/0 conn(0x7fd5f8155df0 msgr2=0x7fd5f80ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:05.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.487+0000 7fd5f6800640 1 --2- 172.21.15.107:0/991113845 >> v2:172.21.15.157:3300/0 conn(0x7fd5f8155df0 0x7fd5f80ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:05.489 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.487+0000 7fd5f6800640 1 -- 172.21.15.107:0/991113845 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f806e5e0 con 0x7fd5f806d7f0 2024-08-17T02:25:05.490 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.488+0000 7fd5f6800640 1 --2- 172.21.15.107:0/991113845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5f806d7f0 0x7fd5f806dc90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd5f806c4d0 tx=0x7fd5f0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c84e30b369894c57 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:05.490 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.489+0000 7fd5f5400640 1 -- 172.21.15.107:0/991113845 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f0031400 con 0x7fd5f806d7f0 2024-08-17T02:25:05.490 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.489+0000 7fd5f5400640 1 -- 172.21.15.107:0/991113845 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f002d050 con 0x7fd5f806d7f0 2024-08-17T02:25:05.490 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.489+0000 7fd5f5400640 1 -- 172.21.15.107:0/991113845 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f00317d0 con 0x7fd5f806d7f0 2024-08-17T02:25:05.490 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.489+0000 7fd5fca00640 1 -- 172.21.15.107:0/991113845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5f806d7f0 msgr2=0x7fd5f806dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:05.490 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.489+0000 7fd5fca00640 1 --2- 172.21.15.107:0/991113845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5f806d7f0 0x7fd5f806dc90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd5f806c4d0 tx=0x7fd5f0009840 comp rx=0 tx=0).stop 2024-08-17T02:25:05.490 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.489+0000 7fd5fca00640 1 -- 172.21.15.107:0/991113845 shutdown_connections 2024-08-17T02:25:05.490 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.489+0000 7fd5fca00640 1 --2- 172.21.15.107:0/991113845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5f806d7f0 0x7fd5f806dc90 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:05.490 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.489+0000 7fd5fca00640 1 --2- 172.21.15.107:0/991113845 >> v2:172.21.15.157:3300/0 conn(0x7fd5f8155df0 0x7fd5f80ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:05.490 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.489+0000 7fd5fca00640 1 --2- 172.21.15.107:0/991113845 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd5f8155a20 0x7fd5f80adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:05.490 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.489+0000 7fd5fca00640 1 -- 172.21.15.107:0/991113845 >> 172.21.15.107:0/991113845 conn(0x7fd5f80cb9b0 msgr2=0x7fd5f80cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:05.490 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.489+0000 7fd5fca00640 1 -- 172.21.15.107:0/991113845 shutdown_connections 2024-08-17T02:25:05.490 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.489+0000 7fd5fca00640 1 -- 172.21.15.107:0/991113845 wait complete. 2024-08-17T02:25:05.491 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.491+0000 7fd5fca00640 1 Processor -- start 2024-08-17T02:25:05.491 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.491+0000 7fd5fca00640 1 -- start start 2024-08-17T02:25:05.492 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.492+0000 7fd5fca00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5f806d7f0 0x7fd5f81495a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:05.492 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.492+0000 7fd5fca00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5f8155a20 0x7fd5f814b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:05.492 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.492+0000 7fd5fca00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd5f8155df0 0x7fd5f81541d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:05.492 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.492+0000 7fd5fca00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f8149ae0 con 0x7fd5f8155a20 2024-08-17T02:25:05.492 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.492+0000 7fd5fca00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f814d730 con 0x7fd5f806d7f0 2024-08-17T02:25:05.492 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.492+0000 7fd5fca00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f815a050 con 0x7fd5f8155df0 2024-08-17T02:25:05.492 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.492+0000 7fd5ed400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5f8155a20 0x7fd5f814b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:05.493 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.492+0000 7fd5ed400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5f8155a20 0x7fd5f814b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45934/0 (socket says 172.21.15.107:45934) 2024-08-17T02:25:05.493 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.492+0000 7fd5ed400640 1 -- 172.21.15.107:0/918216558 learned_addr learned my addr 172.21.15.107:0/918216558 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:05.493 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.492+0000 7fd5f5e00640 1 --2- 172.21.15.107:0/918216558 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5f806d7f0 0x7fd5f81495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:05.493 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.492+0000 7fd5f6800640 1 --2- 172.21.15.107:0/918216558 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd5f8155df0 0x7fd5f81541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:05.494 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.492+0000 7fd5ed400640 1 -- 172.21.15.107:0/918216558 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd5f8155df0 msgr2=0x7fd5f81541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:05.494 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.492+0000 7fd5ed400640 1 --2- 172.21.15.107:0/918216558 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd5f8155df0 0x7fd5f81541d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:05.494 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.492+0000 7fd5ed400640 1 -- 172.21.15.107:0/918216558 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5f806d7f0 msgr2=0x7fd5f81495a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:05.494 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.492+0000 7fd5ed400640 1 --2- 172.21.15.107:0/918216558 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5f806d7f0 0x7fd5f81495a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:05.494 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.492+0000 7fd5ed400640 1 -- 172.21.15.107:0/918216558 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f0009ae0 con 0x7fd5f8155a20 2024-08-17T02:25:05.494 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.493+0000 7fd5ed400640 1 --2- 172.21.15.107:0/918216558 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5f8155a20 0x7fd5f814b910 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd5e000e900 tx=0x7fd5e00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:05.494 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.493+0000 7fd5ee000640 1 -- 172.21.15.107:0/918216558 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e000c8e0 con 0x7fd5f8155a20 2024-08-17T02:25:05.494 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.493+0000 7fd5ee000640 1 -- 172.21.15.107:0/918216558 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5e000ca40 con 0x7fd5f8155a20 2024-08-17T02:25:05.494 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.493+0000 7fd5ee000640 1 -- 172.21.15.107:0/918216558 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e000cde0 con 0x7fd5f8155a20 2024-08-17T02:25:05.495 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.493+0000 7fd5fca00640 1 -- 172.21.15.107:0/918216558 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5f814d9f0 con 0x7fd5f8155a20 2024-08-17T02:25:05.495 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.493+0000 7fd5fca00640 1 -- 172.21.15.107:0/918216558 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5f8159d70 con 0x7fd5f8155a20 2024-08-17T02:25:05.495 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.494+0000 7fd5fca00640 1 -- 172.21.15.107:0/918216558 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5f814db80 con 0x7fd5f8155a20 2024-08-17T02:25:05.495 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.495+0000 7fd5ee000640 1 -- 172.21.15.107:0/918216558 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd5e0013680 con 0x7fd5f8155a20 2024-08-17T02:25:05.496 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.496+0000 7fd5ee000640 1 --2- 172.21.15.107:0/918216558 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd5d4065150 0x7fd5d4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:05.496 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.496+0000 7fd5ee000640 1 -- 172.21.15.107:0/918216558 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd5e00825f0 con 0x7fd5f8155a20 2024-08-17T02:25:05.496 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.496+0000 7fd5f5e00640 1 --2- 172.21.15.107:0/918216558 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd5d4065150 0x7fd5d4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:05.496 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.497+0000 7fd5f5e00640 1 --2- 172.21.15.107:0/918216558 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd5d4065150 0x7fd5d4067600 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8009d20 tx=0x7fd5e80090f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:05.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.500+0000 7fd5ee000640 1 -- 172.21.15.107:0/918216558 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd5e0050780 con 0x7fd5f8155a20 2024-08-17T02:25:05.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.707+0000 7fd5fca00640 1 -- 172.21.15.107:0/918216558 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd5f8064db0 con 0x7fd5f8155a20 2024-08-17T02:25:05.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.708+0000 7fd5ee000640 1 -- 172.21.15.107:0/918216558 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4600 (secure 0 0 0) 0x7fd5e0053da0 con 0x7fd5f8155a20 2024-08-17T02:25:05.708 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:25:05.708 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1386798018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1386798018},{"type":"v1","addr":"172.21.15.107:6835","nonce":1386798018}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6834/287524804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":287524804},{"type":"v1","addr":"172.21.15.157:6834","nonce":287524804}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1183198496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1183198496},{"type":"v1","addr":"172.21.15.107:6837","nonce":1183198496}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:28.816556+0000","modified":"2024-08-17T02:24:32.431137+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6835/1985555291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6833","nonce":1985555291},{"type":"v1","addr":"172.21.15.157:6835","nonce":1985555291}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:25:05.709 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 8 2024-08-17T02:25:05.710 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.710+0000 7fd5fca00640 1 -- 172.21.15.107:0/918216558 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd5d4065150 msgr2=0x7fd5d4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:05.710 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.710+0000 7fd5fca00640 1 --2- 172.21.15.107:0/918216558 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd5d4065150 0x7fd5d4067600 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8009d20 tx=0x7fd5e80090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:05.710 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.710+0000 7fd5fca00640 1 -- 172.21.15.107:0/918216558 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5f8155a20 msgr2=0x7fd5f814b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:05.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.710+0000 7fd5fca00640 1 --2- 172.21.15.107:0/918216558 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5f8155a20 0x7fd5f814b910 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd5e000e900 tx=0x7fd5e00090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:05.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.710+0000 7fd5fca00640 1 -- 172.21.15.107:0/918216558 shutdown_connections 2024-08-17T02:25:05.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.710+0000 7fd5fca00640 1 --2- 172.21.15.107:0/918216558 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd5d4065150 0x7fd5d4067600 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:05.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.710+0000 7fd5fca00640 1 --2- 172.21.15.107:0/918216558 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd5f8155df0 0x7fd5f81541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:05.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.710+0000 7fd5fca00640 1 --2- 172.21.15.107:0/918216558 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5f8155a20 0x7fd5f814b910 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:05.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.710+0000 7fd5fca00640 1 --2- 172.21.15.107:0/918216558 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5f806d7f0 0x7fd5f81495a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:05.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.710+0000 7fd5fca00640 1 -- 172.21.15.107:0/918216558 >> 172.21.15.107:0/918216558 conn(0x7fd5f80cb9b0 msgr2=0x7fd5f806a120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:05.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.710+0000 7fd5fca00640 1 -- 172.21.15.107:0/918216558 shutdown_connections 2024-08-17T02:25:05.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.710+0000 7fd5fca00640 1 -- 172.21.15.107:0/918216558 wait complete. 2024-08-17T02:25:05.725 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:05.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.873+0000 7f4b1e200640 1 Processor -- start 2024-08-17T02:25:05.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.873+0000 7f4b1e200640 1 -- start start 2024-08-17T02:25:05.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.874+0000 7f4b1e200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b180caa40 0x7f4b180ace40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:05.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.874+0000 7f4b1e200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b180cb560 con 0x7f4b18158f80 2024-08-17T02:25:05.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.874+0000 7f4b1e200640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b180cf7e0 con 0x7f4b18159350 2024-08-17T02:25:05.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.874+0000 7f4b1e200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b180cfac0 con 0x7f4b180caa40 2024-08-17T02:25:05.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.874+0000 7f4b17400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f4b18158f80 0x7f4b180ca330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:50526/0 (socket says 172.21.15.107:50526) 2024-08-17T02:25:05.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.874+0000 7f4b17400640 1 -- 172.21.15.107:0/2646438989 learned_addr learned my addr 172.21.15.107:0/2646438989 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:25:05.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.875+0000 7f4b16a00640 1 --2- 172.21.15.107:0/2646438989 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b180caa40 0x7f4b180ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:05.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.875+0000 7f4b16000640 1 -- 172.21.15.107:0/2646438989 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1375910817 0 0) 0x7f4b180cb560 con 0x7f4b18158f80 2024-08-17T02:25:05.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.875+0000 7f4b16000640 1 -- 172.21.15.107:0/2646438989 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4afc0034e0 con 0x7f4b18158f80 2024-08-17T02:25:05.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.875+0000 7f4b16000640 1 -- 172.21.15.107:0/2646438989 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2890496072 0 0) 0x7f4b180cf7e0 con 0x7f4b18159350 2024-08-17T02:25:05.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.875+0000 7f4b16000640 1 -- 172.21.15.107:0/2646438989 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b180cb560 con 0x7f4b18159350 2024-08-17T02:25:05.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.875+0000 7f4b16000640 1 -- 172.21.15.107:0/2646438989 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3641225493 0 0) 0x7f4afc0034e0 con 0x7f4b18158f80 2024-08-17T02:25:05.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.875+0000 7f4b16a00640 1 -- 172.21.15.107:0/2646438989 >> v1:172.21.15.157:6789/0 conn(0x7f4b18159350 legacy=0x7f4b180ad380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:05.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.875+0000 7f4b16a00640 1 -- 172.21.15.107:0/2646438989 >> v1:172.21.15.107:6789/0 conn(0x7f4b18158f80 legacy=0x7f4b180ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:05.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.875+0000 7f4b16a00640 1 -- 172.21.15.107:0/2646438989 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b180caf10 con 0x7f4b180caa40 2024-08-17T02:25:05.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.876+0000 7f4b16a00640 1 --2- 172.21.15.107:0/2646438989 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b180caa40 0x7f4b180ace40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4b04009880 tx=0x7f4b040090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38e80eb1b29a1320 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:05.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.877+0000 7f4b16000640 1 -- 172.21.15.107:0/2646438989 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b08001470 con 0x7f4b180caa40 2024-08-17T02:25:05.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.877+0000 7f4b16000640 1 -- 172.21.15.107:0/2646438989 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0402aac0 con 0x7f4b180caa40 2024-08-17T02:25:05.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.877+0000 7f4b16000640 1 -- 172.21.15.107:0/2646438989 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0402ae60 con 0x7f4b180caa40 2024-08-17T02:25:05.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.877+0000 7f4b1e200640 1 -- 172.21.15.107:0/2646438989 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b180caa40 msgr2=0x7f4b180ace40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:05.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.877+0000 7f4b1e200640 1 --2- 172.21.15.107:0/2646438989 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b180caa40 0x7f4b180ace40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4b04009880 tx=0x7f4b040090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:05.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.877+0000 7f4b1e200640 1 -- 172.21.15.107:0/2646438989 shutdown_connections 2024-08-17T02:25:05.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.877+0000 7f4b1e200640 1 --2- 172.21.15.107:0/2646438989 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b180caa40 0x7f4b180ace40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:05.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.877+0000 7f4b1e200640 1 -- 172.21.15.107:0/2646438989 >> 172.21.15.107:0/2646438989 conn(0x7f4b180cfd90 msgr2=0x7f4b180d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:05.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.877+0000 7f4b1e200640 1 -- 172.21.15.107:0/2646438989 shutdown_connections 2024-08-17T02:25:05.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.877+0000 7f4b1e200640 1 -- 172.21.15.107:0/2646438989 wait complete. 2024-08-17T02:25:05.879 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.879+0000 7f4b1e200640 1 Processor -- start 2024-08-17T02:25:05.879 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.879+0000 7f4b1e200640 1 -- start start 2024-08-17T02:25:05.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.879+0000 7f4b1e200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b180caa40 0x7f4b1815c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:05.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.879+0000 7f4b1e200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b18158f80 0x7f4b180c5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:05.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.880+0000 7f4b1e200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b18159350 0x7f4b180c5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:05.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.880+0000 7f4b1e200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1815bef0 con 0x7f4b180caa40 2024-08-17T02:25:05.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.880+0000 7f4b1e200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1815b660 con 0x7f4b18159350 2024-08-17T02:25:05.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.880+0000 7f4b1e200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1815b8c0 con 0x7f4b18158f80 2024-08-17T02:25:05.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.880+0000 7f4b17400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b180caa40 0x7f4b1815c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:05.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.880+0000 7f4b17400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b180caa40 0x7f4b1815c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45942/0 (socket says 172.21.15.107:45942) 2024-08-17T02:25:05.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.880+0000 7f4b17400640 1 -- 172.21.15.107:0/1853617347 learned_addr learned my addr 172.21.15.107:0/1853617347 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:05.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.880+0000 7f4b16a00640 1 --2- 172.21.15.107:0/1853617347 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b18158f80 0x7f4b180c5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:05.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.880+0000 7f4b17400640 1 -- 172.21.15.107:0/1853617347 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b18158f80 msgr2=0x7f4b180c5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:05.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.880+0000 7f4b17e00640 1 --2- 172.21.15.107:0/1853617347 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b18159350 0x7f4b180c5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:05.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.880+0000 7f4b17400640 1 --2- 172.21.15.107:0/1853617347 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b18158f80 0x7f4b180c5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:05.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.880+0000 7f4b17400640 1 -- 172.21.15.107:0/1853617347 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b18159350 msgr2=0x7f4b180c5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:05.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.880+0000 7f4b17400640 1 --2- 172.21.15.107:0/1853617347 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b18159350 0x7f4b180c5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:05.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.880+0000 7f4b17400640 1 -- 172.21.15.107:0/1853617347 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b04009390 con 0x7f4b180caa40 2024-08-17T02:25:05.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.880+0000 7f4b17e00640 1 --2- 172.21.15.107:0/1853617347 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b18159350 0x7f4b180c5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:05.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.880+0000 7f4b16a00640 1 --2- 172.21.15.107:0/1853617347 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b18158f80 0x7f4b180c5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:05.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.880+0000 7f4b17400640 1 --2- 172.21.15.107:0/1853617347 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b180caa40 0x7f4b1815c380 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4b08001380 tx=0x7f4b08001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:05.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.881+0000 7f4b0ea00640 1 -- 172.21.15.107:0/1853617347 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b08007360 con 0x7f4b180caa40 2024-08-17T02:25:05.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.881+0000 7f4b0ea00640 1 -- 172.21.15.107:0/1853617347 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b080074e0 con 0x7f4b180caa40 2024-08-17T02:25:05.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.881+0000 7f4b0ea00640 1 -- 172.21.15.107:0/1853617347 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b080049f0 con 0x7f4b180caa40 2024-08-17T02:25:05.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.881+0000 7f4b1e200640 1 -- 172.21.15.107:0/1853617347 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b18169c70 con 0x7f4b180caa40 2024-08-17T02:25:05.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.881+0000 7f4b1e200640 1 -- 172.21.15.107:0/1853617347 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b1815c8c0 con 0x7f4b180caa40 2024-08-17T02:25:05.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.882+0000 7f4b1e200640 1 -- 172.21.15.107:0/1853617347 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b18064db0 con 0x7f4b180caa40 2024-08-17T02:25:05.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.883+0000 7f4b0ea00640 1 -- 172.21.15.107:0/1853617347 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4b0800a610 con 0x7f4b180caa40 2024-08-17T02:25:05.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.883+0000 7f4b0ea00640 1 --2- 172.21.15.107:0/1853617347 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4af8065150 0x7f4af8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:05.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.883+0000 7f4b0ea00640 1 -- 172.21.15.107:0/1853617347 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4b08081db0 con 0x7f4b180caa40 2024-08-17T02:25:05.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.884+0000 7f4b16a00640 1 --2- 172.21.15.107:0/1853617347 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4af8065150 0x7f4af8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:05.885 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.884+0000 7f4b16a00640 1 --2- 172.21.15.107:0/1853617347 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4af8065150 0x7f4af8067600 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4b04034000 tx=0x7f4b04032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:05.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:05.887+0000 7f4b0ea00640 1 -- 172.21.15.107:0/1853617347 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4b08086070 con 0x7f4b180caa40 2024-08-17T02:25:06.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.061+0000 7f4b1e200640 1 -- 172.21.15.107:0/1853617347 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b1809d780 con 0x7f4b180caa40 2024-08-17T02:25:06.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.062+0000 7f4b0ea00640 1 -- 172.21.15.107:0/1853617347 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f4b08018020 con 0x7f4b180caa40 2024-08-17T02:25:06.062 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:25:06.063 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":21,"fsid":"f207b4c0-329d-46b8-b83f-aaf30bdb6ce3","created":"2024-08-17T02:24:11.038049+0000","modified":"2024-08-17T02:24:30.420018+0000","last_up_change":"2024-08-17T02:24:22.047790+0000","last_in_change":"2024-08-17T02:24:13.892720+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:23.456166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:27.078670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:27.804418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"376363f3-b8bf-4f1e-b691-51cdd39171ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37302},{"type":"v1","addr":"172.21.15.107:6801","nonce":37302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37302},{"type":"v1","addr":"172.21.15.107:6803","nonce":37302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37302},{"type":"v1","addr":"172.21.15.107:6807","nonce":37302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37302},{"type":"v1","addr":"172.21.15.107:6805","nonce":37302}]},"public_addr":"172.21.15.107:6801/37302","cluster_addr":"172.21.15.107:6803/37302","heartbeat_back_addr":"172.21.15.107:6807/37302","heartbeat_front_addr":"172.21.15.107:6805/37302","state":["exists","up"]},{"osd":1,"uuid":"cc6624e3-2ad4-4db4-b377-05dfe57424e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37305},{"type":"v1","addr":"172.21.15.107:6824","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37305},{"type":"v1","addr":"172.21.15.107:6827","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37305},{"type":"v1","addr":"172.21.15.107:6831","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37305},{"type":"v1","addr":"172.21.15.107:6829","nonce":37305}]},"public_addr":"172.21.15.107:6824/37305","cluster_addr":"172.21.15.107:6827/37305","heartbeat_back_addr":"172.21.15.107:6831/37305","heartbeat_front_addr":"172.21.15.107:6829/37305","state":["exists","up"]},{"osd":2,"uuid":"25229542-29b5-4281-bcb0-798ae0930aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37307},{"type":"v1","addr":"172.21.15.107:6817","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37307},{"type":"v1","addr":"172.21.15.107:6819","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6823","nonce":37307},{"type":"v1","addr":"172.21.15.107:6825","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37307},{"type":"v1","addr":"172.21.15.107:6821","nonce":37307}]},"public_addr":"172.21.15.107:6817/37307","cluster_addr":"172.21.15.107:6819/37307","heartbeat_back_addr":"172.21.15.107:6825/37307","heartbeat_front_addr":"172.21.15.107:6821/37307","state":["exists","up"]},{"osd":3,"uuid":"5f16aee8-8950-4268-a61a-5cf6ebd670e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37306},{"type":"v1","addr":"172.21.15.107:6809","nonce":37306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37306},{"type":"v1","addr":"172.21.15.107:6811","nonce":37306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37306},{"type":"v1","addr":"172.21.15.107:6815","nonce":37306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37306},{"type":"v1","addr":"172.21.15.107:6813","nonce":37306}]},"public_addr":"172.21.15.107:6809/37306","cluster_addr":"172.21.15.107:6811/37306","heartbeat_back_addr":"172.21.15.107:6815/37306","heartbeat_front_addr":"172.21.15.107:6813/37306","state":["exists","up"]},{"osd":4,"uuid":"23232e28-e23b-4b4e-a531-4939246dbbde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":37329},{"type":"v1","addr":"172.21.15.157:6817","nonce":37329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":37329},{"type":"v1","addr":"172.21.15.157:6819","nonce":37329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":37329},{"type":"v1","addr":"172.21.15.157:6823","nonce":37329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":37329},{"type":"v1","addr":"172.21.15.157:6821","nonce":37329}]},"public_addr":"172.21.15.157:6817/37329","cluster_addr":"172.21.15.157:6819/37329","heartbeat_back_addr":"172.21.15.157:6823/37329","heartbeat_front_addr":"172.21.15.157:6821/37329","state":["exists","up"]},{"osd":5,"uuid":"f87ec331-3e59-4886-a317-6f7e26ec8e21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":37328},{"type":"v1","addr":"172.21.15.157:6804","nonce":37328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":37328},{"type":"v1","addr":"172.21.15.157:6808","nonce":37328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":37328},{"type":"v1","addr":"172.21.15.157:6815","nonce":37328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":37328},{"type":"v1","addr":"172.21.15.157:6812","nonce":37328}]},"public_addr":"172.21.15.157:6804/37328","cluster_addr":"172.21.15.157:6808/37328","heartbeat_back_addr":"172.21.15.157:6815/37328","heartbeat_front_addr":"172.21.15.157:6812/37328","state":["exists","up"]},{"osd":6,"uuid":"92852235-ce49-4d96-a940-6f18d97b13ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":37330},{"type":"v1","addr":"172.21.15.157:6801","nonce":37330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6803","nonce":37330},{"type":"v1","addr":"172.21.15.157:6805","nonce":37330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":37330},{"type":"v1","addr":"172.21.15.157:6813","nonce":37330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":37330},{"type":"v1","addr":"172.21.15.157:6809","nonce":37330}]},"public_addr":"172.21.15.157:6801/37330","cluster_addr":"172.21.15.157:6805/37330","heartbeat_back_addr":"172.21.15.157:6813/37330","heartbeat_front_addr":"172.21.15.157:6809/37330","state":["exists","up"]},{"osd":7,"uuid":"7484a061-723d-4663-b28f-b01766d62f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":37373},{"type":"v1","addr":"172.21.15.157:6825","nonce":37373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":37373},{"type":"v1","addr":"172.21.15.157:6827","nonce":37373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":37373},{"type":"v1","addr":"172.21.15.157:6831","nonce":37373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":37373},{"type":"v1","addr":"172.21.15.157:6829","nonce":37373}]},"public_addr":"172.21.15.157:6825/37373","cluster_addr":"172.21.15.157:6827/37373","heartbeat_back_addr":"172.21.15.157:6831/37373","heartbeat_front_addr":"172.21.15.157:6829/37373","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.110188+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.280265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.252119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.267996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.284582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.144420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.174764+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.308002+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:06.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.064+0000 7f4b1e200640 1 -- 172.21.15.107:0/1853617347 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4af8065150 msgr2=0x7f4af8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:06.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.064+0000 7f4b1e200640 1 --2- 172.21.15.107:0/1853617347 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4af8065150 0x7f4af8067600 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4b04034000 tx=0x7f4b04032000 comp rx=0 tx=0).stop 2024-08-17T02:25:06.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.064+0000 7f4b1e200640 1 -- 172.21.15.107:0/1853617347 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b180caa40 msgr2=0x7f4b1815c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:06.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.064+0000 7f4b1e200640 1 --2- 172.21.15.107:0/1853617347 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b180caa40 0x7f4b1815c380 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4b08001380 tx=0x7f4b08001b50 comp rx=0 tx=0).stop 2024-08-17T02:25:06.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.064+0000 7f4b1e200640 1 -- 172.21.15.107:0/1853617347 shutdown_connections 2024-08-17T02:25:06.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.064+0000 7f4b1e200640 1 --2- 172.21.15.107:0/1853617347 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4af8065150 0x7f4af8067600 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:06.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.064+0000 7f4b1e200640 1 --2- 172.21.15.107:0/1853617347 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b18159350 0x7f4b180c5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:06.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.064+0000 7f4b1e200640 1 --2- 172.21.15.107:0/1853617347 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b18158f80 0x7f4b180c5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:06.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.064+0000 7f4b1e200640 1 --2- 172.21.15.107:0/1853617347 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b180caa40 0x7f4b1815c380 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:06.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.064+0000 7f4b1e200640 1 -- 172.21.15.107:0/1853617347 >> 172.21.15.107:0/1853617347 conn(0x7f4b180cfd90 msgr2=0x7f4b180c9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:06.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.064+0000 7f4b1e200640 1 -- 172.21.15.107:0/1853617347 shutdown_connections 2024-08-17T02:25:06.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.065+0000 7f4b1e200640 1 -- 172.21.15.107:0/1853617347 wait complete. 2024-08-17T02:25:06.079 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:25:06.080 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:25:06.226 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.225+0000 7fc0d1200640 1 Processor -- start 2024-08-17T02:25:06.226 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.226+0000 7fc0d1200640 1 -- start start 2024-08-17T02:25:06.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.227+0000 7fc0d1200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc0cc155900 0x7fc0cc155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:06.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.227+0000 7fc0d1200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0cc157690 con 0x7fc0cc0b0270 2024-08-17T02:25:06.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.227+0000 7fc0d1200640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0cc156a80 con 0x7fc0cc158b30 2024-08-17T02:25:06.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.227+0000 7fc0d1200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0cc156d60 con 0x7fc0cc155900 2024-08-17T02:25:06.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.227+0000 7fc0cb400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc0cc155900 0x7fc0cc155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:06.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.227+0000 7fc0cb400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc0cc155900 0x7fc0cc155cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45946/0 (socket says 172.21.15.107:45946) 2024-08-17T02:25:06.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.227+0000 7fc0cb400640 1 -- 172.21.15.107:0/3520321078 learned_addr learned my addr 172.21.15.107:0/3520321078 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:06.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.227+0000 7fc0c2a00640 1 --1- 172.21.15.107:0/3520321078 >> v1:172.21.15.107:6789/0 conn(0x7fc0cc0b0270 0x7fc0cc156210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:50532/0 (socket says 172.21.15.107:50532) 2024-08-17T02:25:06.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.227+0000 7fc0cb400640 1 -- 172.21.15.107:0/3520321078 >> v1:172.21.15.157:6789/0 conn(0x7fc0cc158b30 legacy=0x7fc0cc0ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:06.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.227+0000 7fc0cb400640 1 -- 172.21.15.107:0/3520321078 >> v1:172.21.15.107:6789/0 conn(0x7fc0cc0b0270 legacy=0x7fc0cc156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:06.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.227+0000 7fc0cb400640 1 -- 172.21.15.107:0/3520321078 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0cc157040 con 0x7fc0cc155900 2024-08-17T02:25:06.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.228+0000 7fc0cb400640 1 --2- 172.21.15.107:0/3520321078 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc0cc155900 0x7fc0cc155cd0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc009910 tx=0x7fc0bc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cf1352f0bf12e65 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:06.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.229+0000 7fc0caa00640 1 -- 172.21.15.107:0/3520321078 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc032440 con 0x7fc0cc155900 2024-08-17T02:25:06.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.229+0000 7fc0caa00640 1 -- 172.21.15.107:0/3520321078 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0bc0325a0 con 0x7fc0cc155900 2024-08-17T02:25:06.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.229+0000 7fc0caa00640 1 -- 172.21.15.107:0/3520321078 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc032980 con 0x7fc0cc155900 2024-08-17T02:25:06.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.229+0000 7fc0d1200640 1 -- 172.21.15.107:0/3520321078 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc0cc155900 msgr2=0x7fc0cc155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:06.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.229+0000 7fc0d1200640 1 --2- 172.21.15.107:0/3520321078 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc0cc155900 0x7fc0cc155cd0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc009910 tx=0x7fc0bc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:06.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.229+0000 7fc0d1200640 1 -- 172.21.15.107:0/3520321078 shutdown_connections 2024-08-17T02:25:06.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.229+0000 7fc0d1200640 1 --2- 172.21.15.107:0/3520321078 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc0cc155900 0x7fc0cc155cd0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:06.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.229+0000 7fc0d1200640 1 -- 172.21.15.107:0/3520321078 >> 172.21.15.107:0/3520321078 conn(0x7fc0cc067750 msgr2=0x7fc0cc0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:06.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.229+0000 7fc0d1200640 1 -- 172.21.15.107:0/3520321078 shutdown_connections 2024-08-17T02:25:06.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.229+0000 7fc0d1200640 1 -- 172.21.15.107:0/3520321078 wait complete. 2024-08-17T02:25:06.231 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.231+0000 7fc0d1200640 1 Processor -- start 2024-08-17T02:25:06.231 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.231+0000 7fc0d1200640 1 -- start start 2024-08-17T02:25:06.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.232+0000 7fc0d1200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc0cc0b0270 0x7fc0cc165b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:06.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.232+0000 7fc0d1200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc0cc155900 0x7fc0cc1624e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:06.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.232+0000 7fc0d1200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0cc158b30 0x7fc0cc0a9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:06.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.232+0000 7fc0d1200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0cc1660a0 con 0x7fc0cc0b0270 2024-08-17T02:25:06.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.232+0000 7fc0d1200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0cc0a54d0 con 0x7fc0cc158b30 2024-08-17T02:25:06.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.232+0000 7fc0d1200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0cc0a57b0 con 0x7fc0cc155900 2024-08-17T02:25:06.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.232+0000 7fc0cb400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc0cc0b0270 0x7fc0cc165b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:06.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.232+0000 7fc0cb400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc0cc0b0270 0x7fc0cc165b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45954/0 (socket says 172.21.15.107:45954) 2024-08-17T02:25:06.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.232+0000 7fc0cb400640 1 -- 172.21.15.107:0/2898534732 learned_addr learned my addr 172.21.15.107:0/2898534732 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:06.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.232+0000 7fc0cb400640 1 -- 172.21.15.107:0/2898534732 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc0cc155900 msgr2=0x7fc0cc1624e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:06.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.232+0000 7fc0cbe00640 1 --2- 172.21.15.107:0/2898534732 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0cc158b30 0x7fc0cc0a9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:06.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.232+0000 7fc0c2a00640 1 --2- 172.21.15.107:0/2898534732 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc0cc155900 0x7fc0cc1624e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:06.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.232+0000 7fc0cb400640 1 --2- 172.21.15.107:0/2898534732 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc0cc155900 0x7fc0cc1624e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:06.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.232+0000 7fc0cb400640 1 -- 172.21.15.107:0/2898534732 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0cc158b30 msgr2=0x7fc0cc0a9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:06.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.232+0000 7fc0cb400640 1 --2- 172.21.15.107:0/2898534732 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0cc158b30 0x7fc0cc0a9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:06.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.232+0000 7fc0cb400640 1 -- 172.21.15.107:0/2898534732 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0bc009450 con 0x7fc0cc0b0270 2024-08-17T02:25:06.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.232+0000 7fc0cbe00640 1 --2- 172.21.15.107:0/2898534732 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0cc158b30 0x7fc0cc0a9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:06.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.232+0000 7fc0c2a00640 1 --2- 172.21.15.107:0/2898534732 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc0cc155900 0x7fc0cc1624e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:06.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.233+0000 7fc0cb400640 1 --2- 172.21.15.107:0/2898534732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc0cc0b0270 0x7fc0cc165b60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc009970 tx=0x7fc0bc032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:06.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.233+0000 7fc0c3400640 1 -- 172.21.15.107:0/2898534732 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc031c80 con 0x7fc0cc0b0270 2024-08-17T02:25:06.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.233+0000 7fc0c3400640 1 -- 172.21.15.107:0/2898534732 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0bc031e00 con 0x7fc0cc0b0270 2024-08-17T02:25:06.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.233+0000 7fc0c3400640 1 -- 172.21.15.107:0/2898534732 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc03d670 con 0x7fc0cc0b0270 2024-08-17T02:25:06.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.233+0000 7fc0d1200640 1 -- 172.21.15.107:0/2898534732 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0cc162a20 con 0x7fc0cc0b0270 2024-08-17T02:25:06.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.233+0000 7fc0d1200640 1 -- 172.21.15.107:0/2898534732 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0cc0a9fc0 con 0x7fc0cc0b0270 2024-08-17T02:25:06.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.234+0000 7fc0d1200640 1 -- 172.21.15.107:0/2898534732 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0cc071050 con 0x7fc0cc0b0270 2024-08-17T02:25:06.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.235+0000 7fc0c3400640 1 -- 172.21.15.107:0/2898534732 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc0bc039040 con 0x7fc0cc0b0270 2024-08-17T02:25:06.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.235+0000 7fc0c3400640 1 --2- 172.21.15.107:0/2898534732 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fc0a8065150 0x7fc0a8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:06.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.236+0000 7fc0c3400640 1 -- 172.21.15.107:0/2898534732 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc0bc0a2340 con 0x7fc0cc0b0270 2024-08-17T02:25:06.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.236+0000 7fc0c2a00640 1 --2- 172.21.15.107:0/2898534732 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fc0a8065150 0x7fc0a8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:06.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.236+0000 7fc0c2a00640 1 --2- 172.21.15.107:0/2898534732 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fc0a8065150 0x7fc0a8067600 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc0a8c50 tx=0x7fc0b4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:06.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.240+0000 7fc0c3400640 1 -- 172.21.15.107:0/2898534732 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc0bc070360 con 0x7fc0cc0b0270 2024-08-17T02:25:06.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.446+0000 7fc0d1200640 1 -- 172.21.15.107:0/2898534732 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc0cc06f480 con 0x7fc0cc0b0270 2024-08-17T02:25:06.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.447+0000 7fc0c3400640 1 -- 172.21.15.107:0/2898534732 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4600 (secure 0 0 0) 0x7fc0bc073980 con 0x7fc0cc0b0270 2024-08-17T02:25:06.448 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:25:06.448 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1386798018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1386798018},{"type":"v1","addr":"172.21.15.107:6835","nonce":1386798018}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6834/287524804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":287524804},{"type":"v1","addr":"172.21.15.157:6834","nonce":287524804}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1183198496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1183198496},{"type":"v1","addr":"172.21.15.107:6837","nonce":1183198496}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:28.816556+0000","modified":"2024-08-17T02:24:32.431137+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6835/1985555291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6833","nonce":1985555291},{"type":"v1","addr":"172.21.15.157:6835","nonce":1985555291}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:25:06.448 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 8 2024-08-17T02:25:06.449 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.449+0000 7fc0d1200640 1 -- 172.21.15.107:0/2898534732 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fc0a8065150 msgr2=0x7fc0a8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:06.449 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.449+0000 7fc0d1200640 1 --2- 172.21.15.107:0/2898534732 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fc0a8065150 0x7fc0a8067600 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc0a8c50 tx=0x7fc0b4009040 comp rx=0 tx=0).stop 2024-08-17T02:25:06.449 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.449+0000 7fc0d1200640 1 -- 172.21.15.107:0/2898534732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc0cc0b0270 msgr2=0x7fc0cc165b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:06.449 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.449+0000 7fc0d1200640 1 --2- 172.21.15.107:0/2898534732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc0cc0b0270 0x7fc0cc165b60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc009970 tx=0x7fc0bc032000 comp rx=0 tx=0).stop 2024-08-17T02:25:06.450 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.449+0000 7fc0d1200640 1 -- 172.21.15.107:0/2898534732 shutdown_connections 2024-08-17T02:25:06.450 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.449+0000 7fc0d1200640 1 --2- 172.21.15.107:0/2898534732 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fc0a8065150 0x7fc0a8067600 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:06.450 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.449+0000 7fc0d1200640 1 --2- 172.21.15.107:0/2898534732 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0cc158b30 0x7fc0cc0a9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:06.450 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.449+0000 7fc0d1200640 1 --2- 172.21.15.107:0/2898534732 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc0cc155900 0x7fc0cc1624e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:06.450 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.449+0000 7fc0d1200640 1 --2- 172.21.15.107:0/2898534732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc0cc0b0270 0x7fc0cc165b60 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:06.450 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.449+0000 7fc0d1200640 1 -- 172.21.15.107:0/2898534732 >> 172.21.15.107:0/2898534732 conn(0x7fc0cc067750 msgr2=0x7fc0cc0cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:06.450 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.449+0000 7fc0d1200640 1 -- 172.21.15.107:0/2898534732 shutdown_connections 2024-08-17T02:25:06.450 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.449+0000 7fc0d1200640 1 -- 172.21.15.107:0/2898534732 wait complete. 2024-08-17T02:25:06.463 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:25:06.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.611+0000 7f6276400640 1 Processor -- start 2024-08-17T02:25:06.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.611+0000 7f6276400640 1 -- start start 2024-08-17T02:25:06.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.612+0000 7f6276400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f62701401b0 0x7f62700caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:06.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.612+0000 7f6276400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f62700b1440 0x7f62700c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:06.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.612+0000 7f6276400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62700caa80 con 0x7f6270140580 2024-08-17T02:25:06.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.612+0000 7f6276400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62700cb450 con 0x7f62700b1440 2024-08-17T02:25:06.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.612+0000 7f6276400640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62700c9e70 con 0x7f62701401b0 2024-08-17T02:25:06.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.613+0000 7f626fe00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f62700b1440 0x7f62700c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:06.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.613+0000 7f626fe00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f62700b1440 0x7f62700c9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45956/0 (socket says 172.21.15.107:45956) 2024-08-17T02:25:06.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.613+0000 7f626fe00640 1 -- 172.21.15.107:0/2680425601 learned_addr learned my addr 172.21.15.107:0/2680425601 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:06.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.613+0000 7f626ea00640 1 --1- 172.21.15.107:0/2680425601 >> v1:172.21.15.107:6789/0 conn(0x7f6270140580 0x7f62700b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:50544/0 (socket says 172.21.15.107:50544) 2024-08-17T02:25:06.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.613+0000 7f626f400640 1 --2- 172.21.15.107:0/2680425601 >> v2:172.21.15.157:3300/0 conn(0x7f62701401b0 0x7f62700caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:06.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.613+0000 7f626fe00640 1 -- 172.21.15.107:0/2680425601 >> v2:172.21.15.157:3300/0 conn(0x7f62701401b0 msgr2=0x7f62700caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:06.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.613+0000 7f626fe00640 1 --2- 172.21.15.107:0/2680425601 >> v2:172.21.15.157:3300/0 conn(0x7f62701401b0 0x7f62700caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:06.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.613+0000 7f626fe00640 1 -- 172.21.15.107:0/2680425601 >> v1:172.21.15.107:6789/0 conn(0x7f6270140580 legacy=0x7f62700b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:06.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.613+0000 7f626fe00640 1 -- 172.21.15.107:0/2680425601 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62700ca150 con 0x7f62700b1440 2024-08-17T02:25:06.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.614+0000 7f626fe00640 1 --2- 172.21.15.107:0/2680425601 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f62700b1440 0x7f62700c9040 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6270068650 tx=0x7f6268009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3881d7dd46ff7bca server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:06.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.614+0000 7f626e000640 1 -- 172.21.15.107:0/2680425601 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6268007400 con 0x7f62700b1440 2024-08-17T02:25:06.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.614+0000 7f626e000640 1 -- 172.21.15.107:0/2680425601 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6268007560 con 0x7f62700b1440 2024-08-17T02:25:06.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.614+0000 7f626e000640 1 -- 172.21.15.107:0/2680425601 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6268007940 con 0x7f62700b1440 2024-08-17T02:25:06.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.615+0000 7f6276400640 1 -- 172.21.15.107:0/2680425601 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f62700b1440 msgr2=0x7f62700c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:06.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.615+0000 7f6276400640 1 --2- 172.21.15.107:0/2680425601 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f62700b1440 0x7f62700c9040 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6270068650 tx=0x7f6268009840 comp rx=0 tx=0).stop 2024-08-17T02:25:06.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.615+0000 7f6276400640 1 -- 172.21.15.107:0/2680425601 shutdown_connections 2024-08-17T02:25:06.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.615+0000 7f6276400640 1 --2- 172.21.15.107:0/2680425601 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f62700b1440 0x7f62700c9040 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:06.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.615+0000 7f6276400640 1 --2- 172.21.15.107:0/2680425601 >> v2:172.21.15.157:3300/0 conn(0x7f62701401b0 0x7f62700caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:06.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.615+0000 7f6276400640 1 -- 172.21.15.107:0/2680425601 >> 172.21.15.107:0/2680425601 conn(0x7f62700cb9b0 msgr2=0x7f62700cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:06.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.615+0000 7f6276400640 1 -- 172.21.15.107:0/2680425601 shutdown_connections 2024-08-17T02:25:06.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.615+0000 7f6276400640 1 -- 172.21.15.107:0/2680425601 wait complete. 2024-08-17T02:25:06.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.616+0000 7f6276400640 1 Processor -- start 2024-08-17T02:25:06.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.617+0000 7f6276400640 1 -- start start 2024-08-17T02:25:06.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.617+0000 7f6276400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62700b1440 0x7f62700c2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:06.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.617+0000 7f6276400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62701401b0 0x7f62700c29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:06.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.617+0000 7f6276400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6270140580 0x7f627015b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:06.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.617+0000 7f6276400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62700c3e10 con 0x7f6270140580 2024-08-17T02:25:06.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.617+0000 7f6276400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62700c3200 con 0x7f62701401b0 2024-08-17T02:25:06.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.617+0000 7f6276400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62700c34e0 con 0x7f62700b1440 2024-08-17T02:25:06.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.618+0000 7f626fe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6270140580 0x7f627015b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:06.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.618+0000 7f626fe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6270140580 0x7f627015b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45968/0 (socket says 172.21.15.107:45968) 2024-08-17T02:25:06.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.618+0000 7f626fe00640 1 -- 172.21.15.107:0/2855699381 learned_addr learned my addr 172.21.15.107:0/2855699381 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:06.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.618+0000 7f626ea00640 1 --2- 172.21.15.107:0/2855699381 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62701401b0 0x7f62700c29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:06.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.618+0000 7f626f400640 1 --2- 172.21.15.107:0/2855699381 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62700b1440 0x7f62700c2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:06.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.618+0000 7f626fe00640 1 -- 172.21.15.107:0/2855699381 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62700b1440 msgr2=0x7f62700c2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:06.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.618+0000 7f626fe00640 1 --2- 172.21.15.107:0/2855699381 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62700b1440 0x7f62700c2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:06.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.618+0000 7f626fe00640 1 -- 172.21.15.107:0/2855699381 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62701401b0 msgr2=0x7f62700c29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:06.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.618+0000 7f626fe00640 1 --2- 172.21.15.107:0/2855699381 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62701401b0 0x7f62700c29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:06.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.618+0000 7f626fe00640 1 -- 172.21.15.107:0/2855699381 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6268009ae0 con 0x7f6270140580 2024-08-17T02:25:06.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.618+0000 7f626fe00640 1 --2- 172.21.15.107:0/2855699381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6270140580 0x7f627015b4a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6268009f50 tx=0x7f6268034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:06.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.619+0000 7f6266a00640 1 -- 172.21.15.107:0/2855699381 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6268007400 con 0x7f6270140580 2024-08-17T02:25:06.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.619+0000 7f6266a00640 1 -- 172.21.15.107:0/2855699381 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6268032e30 con 0x7f6270140580 2024-08-17T02:25:06.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.619+0000 7f6276400640 1 -- 172.21.15.107:0/2855699381 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62700c37c0 con 0x7f6270140580 2024-08-17T02:25:06.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.619+0000 7f6266a00640 1 -- 172.21.15.107:0/2855699381 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626803d660 con 0x7f6270140580 2024-08-17T02:25:06.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.619+0000 7f6276400640 1 -- 172.21.15.107:0/2855699381 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62700c2ee0 con 0x7f6270140580 2024-08-17T02:25:06.621 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.620+0000 7f6276400640 1 -- 172.21.15.107:0/2855699381 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62700c3fc0 con 0x7f6270140580 2024-08-17T02:25:06.621 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.621+0000 7f6266a00640 1 -- 172.21.15.107:0/2855699381 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f626803da50 con 0x7f6270140580 2024-08-17T02:25:06.621 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.621+0000 7f6266a00640 1 --2- 172.21.15.107:0/2855699381 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6250065150 0x7f6250067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:06.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.622+0000 7f6266a00640 1 -- 172.21.15.107:0/2855699381 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f62680a3a10 con 0x7f6270140580 2024-08-17T02:25:06.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.622+0000 7f626f400640 1 --2- 172.21.15.107:0/2855699381 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6250065150 0x7f6250067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:06.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.622+0000 7f626f400640 1 --2- 172.21.15.107:0/2855699381 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6250065150 0x7f6250067600 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6260009cb0 tx=0x7f6260008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:06.626 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.626+0000 7f6266a00640 1 -- 172.21.15.107:0/2855699381 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f62700c3fc0 con 0x7f6270140580 2024-08-17T02:25:06.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.837+0000 7f6276400640 1 -- 172.21.15.107:0/2855699381 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6270064db0 con 0x7f6270140580 2024-08-17T02:25:06.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.838+0000 7f6266a00640 1 -- 172.21.15.107:0/2855699381 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f6268071ad0 con 0x7f6270140580 2024-08-17T02:25:06.838 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:25:06.838 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1386798018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1386798018},{"type":"v1","addr":"172.21.15.107:6835","nonce":1386798018}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6834/287524804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":287524804},{"type":"v1","addr":"172.21.15.157:6834","nonce":287524804}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1183198496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1183198496},{"type":"v1","addr":"172.21.15.107:6837","nonce":1183198496}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:28.816556+0000","modified":"2024-08-17T02:24:32.431137+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6835/1985555291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6833","nonce":1985555291},{"type":"v1","addr":"172.21.15.157:6835","nonce":1985555291}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:25:06.838 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 8 2024-08-17T02:25:06.840 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.840+0000 7f6276400640 1 -- 172.21.15.107:0/2855699381 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6250065150 msgr2=0x7f6250067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:06.840 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.840+0000 7f6276400640 1 --2- 172.21.15.107:0/2855699381 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6250065150 0x7f6250067600 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6260009cb0 tx=0x7f6260008040 comp rx=0 tx=0).stop 2024-08-17T02:25:06.840 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.840+0000 7f6276400640 1 -- 172.21.15.107:0/2855699381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6270140580 msgr2=0x7f627015b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:06.840 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.840+0000 7f6276400640 1 --2- 172.21.15.107:0/2855699381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6270140580 0x7f627015b4a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6268009f50 tx=0x7f6268034000 comp rx=0 tx=0).stop 2024-08-17T02:25:06.840 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.840+0000 7f6276400640 1 -- 172.21.15.107:0/2855699381 shutdown_connections 2024-08-17T02:25:06.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.840+0000 7f6276400640 1 --2- 172.21.15.107:0/2855699381 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6250065150 0x7f6250067600 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:06.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.840+0000 7f6276400640 1 --2- 172.21.15.107:0/2855699381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6270140580 0x7f627015b4a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:06.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.840+0000 7f6276400640 1 --2- 172.21.15.107:0/2855699381 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62701401b0 0x7f62700c29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:06.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.840+0000 7f6276400640 1 --2- 172.21.15.107:0/2855699381 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62700b1440 0x7f62700c2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:06.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.840+0000 7f6276400640 1 -- 172.21.15.107:0/2855699381 >> 172.21.15.107:0/2855699381 conn(0x7f62700cb9b0 msgr2=0x7f62700c09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:06.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.840+0000 7f6276400640 1 -- 172.21.15.107:0/2855699381 shutdown_connections 2024-08-17T02:25:06.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:06.840+0000 7f6276400640 1 -- 172.21.15.107:0/2855699381 wait complete. 2024-08-17T02:25:06.856 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:07.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.002+0000 7fe4d0200640 1 Processor -- start 2024-08-17T02:25:07.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.002+0000 7fe4d0200640 1 -- start start 2024-08-17T02:25:07.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.003+0000 7fe4d0200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe4c81401b0 0x7fe4c80caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:07.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.003+0000 7fe4d0200640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe4c8140580 0x7fe4c80b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:07.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.003+0000 7fe4d0200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4c80b16d0 con 0x7fe4c80b1270 2024-08-17T02:25:07.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.003+0000 7fe4d0200640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4c80cb450 con 0x7fe4c8140580 2024-08-17T02:25:07.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.003+0000 7fe4d0200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c80caa80 con 0x7fe4c81401b0 2024-08-17T02:25:07.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.004+0000 7fe4ce200640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fe4c80b1270 0x7fe4c80c9040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:59582/0 (socket says 172.21.15.107:59582) 2024-08-17T02:25:07.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.004+0000 7fe4ce200640 1 -- 172.21.15.107:0/1167220613 learned_addr learned my addr 172.21.15.107:0/1167220613 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:25:07.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.004+0000 7fe4cce00640 1 --2- 172.21.15.107:0/1167220613 >> v2:172.21.15.157:3300/0 conn(0x7fe4c8140580 0x7fe4c80b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:07.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.004+0000 7fe4cd800640 1 --2- 172.21.15.107:0/1167220613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe4c81401b0 0x7fe4c80caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:07.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.004+0000 7fe4c7e00640 1 -- 172.21.15.107:0/1167220613 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1499465684 0 0) 0x7fe4c0001490 con 0x7fe4c80b1270 2024-08-17T02:25:07.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.004+0000 7fe4c7e00640 1 -- 172.21.15.107:0/1167220613 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4b00034e0 con 0x7fe4c80b1270 2024-08-17T02:25:07.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.004+0000 7fe4c7e00640 1 -- 172.21.15.107:0/1167220613 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2331375061 0 0) 0x7fe4b00034e0 con 0x7fe4c80b1270 2024-08-17T02:25:07.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.004+0000 7fe4c7e00640 1 -- 172.21.15.107:0/1167220613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe4c81401b0 msgr2=0x7fe4c80caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:07.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.004+0000 7fe4c7e00640 1 --2- 172.21.15.107:0/1167220613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe4c81401b0 0x7fe4c80caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:07.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.004+0000 7fe4c7e00640 1 -- 172.21.15.107:0/1167220613 >> v2:172.21.15.157:3300/0 conn(0x7fe4c8140580 msgr2=0x7fe4c80b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:07.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.004+0000 7fe4c7e00640 1 --2- 172.21.15.107:0/1167220613 >> v2:172.21.15.157:3300/0 conn(0x7fe4c8140580 0x7fe4c80b0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:07.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.004+0000 7fe4c7e00640 1 -- 172.21.15.107:0/1167220613 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c80c9e70 con 0x7fe4c80b1270 2024-08-17T02:25:07.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.004+0000 7fe4c7e00640 1 -- 172.21.15.107:0/1167220613 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 537989081 0 0) 0x7fe4c0001980 con 0x7fe4c80b1270 2024-08-17T02:25:07.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.004+0000 7fe4cce00640 1 --2- 172.21.15.107:0/1167220613 >> v2:172.21.15.157:3300/0 conn(0x7fe4c8140580 0x7fe4c80b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:07.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.004+0000 7fe4c7e00640 1 -- 172.21.15.107:0/1167220613 >> v1:172.21.15.107:6789/0 conn(0x7fe4c80b1270 legacy=0x7fe4c80c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:07.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.004+0000 7fe4c7e00640 1 --2- 172.21.15.107:0/1167220613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe4c81401b0 0x7fe4b00039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:07.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.005+0000 7fe4c7e00640 1 --2- 172.21.15.107:0/1167220613 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4b0003f50 0x7fe4b0004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:07.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.005+0000 7fe4c7e00640 1 --2- 172.21.15.107:0/1167220613 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4b0004cc0 0x7fe4b0005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:07.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.005+0000 7fe4c7e00640 1 -- 172.21.15.107:0/1167220613 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c80cb450 con 0x7fe4b0003f50 2024-08-17T02:25:07.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.005+0000 7fe4c7e00640 1 -- 172.21.15.107:0/1167220613 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c80caa80 con 0x7fe4b0004cc0 2024-08-17T02:25:07.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.005+0000 7fe4c7e00640 1 -- 172.21.15.107:0/1167220613 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b000ba00 con 0x7fe4c81401b0 2024-08-17T02:25:07.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.005+0000 7fe4cce00640 1 --2- 172.21.15.107:0/1167220613 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4b0003f50 0x7fe4b0004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:07.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.005+0000 7fe4cd800640 1 --2- 172.21.15.107:0/1167220613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe4c81401b0 0x7fe4b00039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:07.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.005+0000 7fe4ce200640 1 --2- 172.21.15.107:0/1167220613 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4b0004cc0 0x7fe4b0005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:07.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.005+0000 7fe4cce00640 1 -- 172.21.15.107:0/1167220613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe4c81401b0 msgr2=0x7fe4b00039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:07.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.005+0000 7fe4cce00640 1 --2- 172.21.15.107:0/1167220613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe4c81401b0 0x7fe4b00039d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:07.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.005+0000 7fe4cce00640 1 -- 172.21.15.107:0/1167220613 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4b0004cc0 msgr2=0x7fe4b0005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:07.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.005+0000 7fe4cce00640 1 --2- 172.21.15.107:0/1167220613 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4b0004cc0 0x7fe4b0005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:07.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.005+0000 7fe4cce00640 1 -- 172.21.15.107:0/1167220613 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b00034e0 con 0x7fe4b0003f50 2024-08-17T02:25:07.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.005+0000 7fe4ce200640 1 --2- 172.21.15.107:0/1167220613 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4b0004cc0 0x7fe4b0005130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:07.011 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.006+0000 7fe4cce00640 1 --2- 172.21.15.107:0/1167220613 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4b0003f50 0x7fe4b0004780 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4009d60 tx=0x7fe4b40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c179e58ecdb79da3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:07.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.006+0000 7fe4c7e00640 1 -- 172.21.15.107:0/1167220613 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b4031400 con 0x7fe4b0003f50 2024-08-17T02:25:07.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.006+0000 7fe4c7e00640 1 -- 172.21.15.107:0/1167220613 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b402d050 con 0x7fe4b0003f50 2024-08-17T02:25:07.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.006+0000 7fe4c7e00640 1 -- 172.21.15.107:0/1167220613 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b4031770 con 0x7fe4b0003f50 2024-08-17T02:25:07.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.007+0000 7fe4d0200640 1 -- 172.21.15.107:0/1167220613 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4b0003f50 msgr2=0x7fe4b0004780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:07.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.007+0000 7fe4d0200640 1 --2- 172.21.15.107:0/1167220613 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4b0003f50 0x7fe4b0004780 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4009d60 tx=0x7fe4b40090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:07.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.007+0000 7fe4ce200640 1 -- 172.21.15.107:0/1167220613 reap_dead start 2024-08-17T02:25:07.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.007+0000 7fe4d0200640 1 -- 172.21.15.107:0/1167220613 shutdown_connections 2024-08-17T02:25:07.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.007+0000 7fe4d0200640 1 -- 172.21.15.107:0/1167220613 >> 172.21.15.107:0/1167220613 conn(0x7fe4c80cb9b0 msgr2=0x7fe4c80cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:07.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.007+0000 7fe4d0200640 1 -- 172.21.15.107:0/1167220613 shutdown_connections 2024-08-17T02:25:07.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.007+0000 7fe4d0200640 1 -- 172.21.15.107:0/1167220613 wait complete. 2024-08-17T02:25:07.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.008+0000 7fe4d0200640 1 Processor -- start 2024-08-17T02:25:07.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.008+0000 7fe4d0200640 1 -- start start 2024-08-17T02:25:07.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.009+0000 7fe4d0200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4b0003f50 0x7fe4c80c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:07.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.009+0000 7fe4d0200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4c815e570 0x7fe4c813bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:07.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.009+0000 7fe4d0200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe4c80c4fe0 0x7fe4c8155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:07.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.009+0000 7fe4d0200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c80c5bc0 con 0x7fe4c815e570 2024-08-17T02:25:07.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.009+0000 7fe4d0200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c80c82e0 con 0x7fe4b0003f50 2024-08-17T02:25:07.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.009+0000 7fe4d0200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c806c780 con 0x7fe4c80c4fe0 2024-08-17T02:25:07.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.010+0000 7fe4cce00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4c815e570 0x7fe4c813bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:07.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.010+0000 7fe4cce00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4c815e570 0x7fe4c813bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51634/0 (socket says 172.21.15.107:51634) 2024-08-17T02:25:07.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.010+0000 7fe4cce00640 1 -- 172.21.15.107:0/3822681266 learned_addr learned my addr 172.21.15.107:0/3822681266 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:07.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.010+0000 7fe4cd800640 1 --2- 172.21.15.107:0/3822681266 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4b0003f50 0x7fe4c80c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:07.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.010+0000 7fe4ce200640 1 --2- 172.21.15.107:0/3822681266 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe4c80c4fe0 0x7fe4c8155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:07.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.010+0000 7fe4cce00640 1 -- 172.21.15.107:0/3822681266 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe4c80c4fe0 msgr2=0x7fe4c8155140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:07.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.010+0000 7fe4cce00640 1 --2- 172.21.15.107:0/3822681266 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe4c80c4fe0 0x7fe4c8155140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:07.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.010+0000 7fe4cce00640 1 -- 172.21.15.107:0/3822681266 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4b0003f50 msgr2=0x7fe4c80c7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:07.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.010+0000 7fe4cce00640 1 --2- 172.21.15.107:0/3822681266 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4b0003f50 0x7fe4c80c7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:07.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.010+0000 7fe4cce00640 1 -- 172.21.15.107:0/3822681266 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c806ca60 con 0x7fe4c815e570 2024-08-17T02:25:07.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.010+0000 7fe4cce00640 1 --2- 172.21.15.107:0/3822681266 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4c815e570 0x7fe4c813bd50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4009d60 tx=0x7fe4b4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:07.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.011+0000 7fe4c4c00640 1 -- 172.21.15.107:0/3822681266 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b4000cb0 con 0x7fe4c815e570 2024-08-17T02:25:07.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.011+0000 7fe4c4c00640 1 -- 172.21.15.107:0/3822681266 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b4031e60 con 0x7fe4c815e570 2024-08-17T02:25:07.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.011+0000 7fe4d0200640 1 -- 172.21.15.107:0/3822681266 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4c806cd40 con 0x7fe4c815e570 2024-08-17T02:25:07.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.011+0000 7fe4c4c00640 1 -- 172.21.15.107:0/3822681266 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b4030cd0 con 0x7fe4c815e570 2024-08-17T02:25:07.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.011+0000 7fe4d0200640 1 -- 172.21.15.107:0/3822681266 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4c80c8000 con 0x7fe4c815e570 2024-08-17T02:25:07.015 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.012+0000 7fe4d0200640 1 -- 172.21.15.107:0/3822681266 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4c806d1c0 con 0x7fe4c815e570 2024-08-17T02:25:07.015 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.013+0000 7fe4c4c00640 1 -- 172.21.15.107:0/3822681266 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe4b4045670 con 0x7fe4c815e570 2024-08-17T02:25:07.015 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.014+0000 7fe4c4c00640 1 --2- 172.21.15.107:0/3822681266 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe4a8065180 0x7fe4a8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:07.015 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.014+0000 7fe4c4c00640 1 -- 172.21.15.107:0/3822681266 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe4b40a35d0 con 0x7fe4c815e570 2024-08-17T02:25:07.015 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.014+0000 7fe4cd800640 1 --2- 172.21.15.107:0/3822681266 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe4a8065180 0x7fe4a8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:07.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.015+0000 7fe4cd800640 1 --2- 172.21.15.107:0/3822681266 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe4a8065180 0x7fe4a8067630 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009d70 tx=0x7fe4bc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:07.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.018+0000 7fe4c4c00640 1 -- 172.21.15.107:0/3822681266 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe4b4071740 con 0x7fe4c815e570 2024-08-17T02:25:07.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.194+0000 7fe4d0200640 1 -- 172.21.15.107:0/3822681266 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4c8064db0 con 0x7fe4c815e570 2024-08-17T02:25:07.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.195+0000 7fe4c4c00640 1 -- 172.21.15.107:0/3822681266 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fe4b4074d60 con 0x7fe4c815e570 2024-08-17T02:25:07.195 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:25:07.195 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":21,"fsid":"f207b4c0-329d-46b8-b83f-aaf30bdb6ce3","created":"2024-08-17T02:24:11.038049+0000","modified":"2024-08-17T02:24:30.420018+0000","last_up_change":"2024-08-17T02:24:22.047790+0000","last_in_change":"2024-08-17T02:24:13.892720+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:23.456166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:27.078670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:27.804418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"376363f3-b8bf-4f1e-b691-51cdd39171ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37302},{"type":"v1","addr":"172.21.15.107:6801","nonce":37302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37302},{"type":"v1","addr":"172.21.15.107:6803","nonce":37302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37302},{"type":"v1","addr":"172.21.15.107:6807","nonce":37302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37302},{"type":"v1","addr":"172.21.15.107:6805","nonce":37302}]},"public_addr":"172.21.15.107:6801/37302","cluster_addr":"172.21.15.107:6803/37302","heartbeat_back_addr":"172.21.15.107:6807/37302","heartbeat_front_addr":"172.21.15.107:6805/37302","state":["exists","up"]},{"osd":1,"uuid":"cc6624e3-2ad4-4db4-b377-05dfe57424e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37305},{"type":"v1","addr":"172.21.15.107:6824","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37305},{"type":"v1","addr":"172.21.15.107:6827","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37305},{"type":"v1","addr":"172.21.15.107:6831","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37305},{"type":"v1","addr":"172.21.15.107:6829","nonce":37305}]},"public_addr":"172.21.15.107:6824/37305","cluster_addr":"172.21.15.107:6827/37305","heartbeat_back_addr":"172.21.15.107:6831/37305","heartbeat_front_addr":"172.21.15.107:6829/37305","state":["exists","up"]},{"osd":2,"uuid":"25229542-29b5-4281-bcb0-798ae0930aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37307},{"type":"v1","addr":"172.21.15.107:6817","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37307},{"type":"v1","addr":"172.21.15.107:6819","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6823","nonce":37307},{"type":"v1","addr":"172.21.15.107:6825","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37307},{"type":"v1","addr":"172.21.15.107:6821","nonce":37307}]},"public_addr":"172.21.15.107:6817/37307","cluster_addr":"172.21.15.107:6819/37307","heartbeat_back_addr":"172.21.15.107:6825/37307","heartbeat_front_addr":"172.21.15.107:6821/37307","state":["exists","up"]},{"osd":3,"uuid":"5f16aee8-8950-4268-a61a-5cf6ebd670e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37306},{"type":"v1","addr":"172.21.15.107:6809","nonce":37306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37306},{"type":"v1","addr":"172.21.15.107:6811","nonce":37306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37306},{"type":"v1","addr":"172.21.15.107:6815","nonce":37306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37306},{"type":"v1","addr":"172.21.15.107:6813","nonce":37306}]},"public_addr":"172.21.15.107:6809/37306","cluster_addr":"172.21.15.107:6811/37306","heartbeat_back_addr":"172.21.15.107:6815/37306","heartbeat_front_addr":"172.21.15.107:6813/37306","state":["exists","up"]},{"osd":4,"uuid":"23232e28-e23b-4b4e-a531-4939246dbbde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":37329},{"type":"v1","addr":"172.21.15.157:6817","nonce":37329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":37329},{"type":"v1","addr":"172.21.15.157:6819","nonce":37329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":37329},{"type":"v1","addr":"172.21.15.157:6823","nonce":37329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":37329},{"type":"v1","addr":"172.21.15.157:6821","nonce":37329}]},"public_addr":"172.21.15.157:6817/37329","cluster_addr":"172.21.15.157:6819/37329","heartbeat_back_addr":"172.21.15.157:6823/37329","heartbeat_front_addr":"172.21.15.157:6821/37329","state":["exists","up"]},{"osd":5,"uuid":"f87ec331-3e59-4886-a317-6f7e26ec8e21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":37328},{"type":"v1","addr":"172.21.15.157:6804","nonce":37328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":37328},{"type":"v1","addr":"172.21.15.157:6808","nonce":37328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":37328},{"type":"v1","addr":"172.21.15.157:6815","nonce":37328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":37328},{"type":"v1","addr":"172.21.15.157:6812","nonce":37328}]},"public_addr":"172.21.15.157:6804/37328","cluster_addr":"172.21.15.157:6808/37328","heartbeat_back_addr":"172.21.15.157:6815/37328","heartbeat_front_addr":"172.21.15.157:6812/37328","state":["exists","up"]},{"osd":6,"uuid":"92852235-ce49-4d96-a940-6f18d97b13ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":37330},{"type":"v1","addr":"172.21.15.157:6801","nonce":37330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6803","nonce":37330},{"type":"v1","addr":"172.21.15.157:6805","nonce":37330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":37330},{"type":"v1","addr":"172.21.15.157:6813","nonce":37330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":37330},{"type":"v1","addr":"172.21.15.157:6809","nonce":37330}]},"public_addr":"172.21.15.157:6801/37330","cluster_addr":"172.21.15.157:6805/37330","heartbeat_back_addr":"172.21.15.157:6813/37330","heartbeat_front_addr":"172.21.15.157:6809/37330","state":["exists","up"]},{"osd":7,"uuid":"7484a061-723d-4663-b28f-b01766d62f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":37373},{"type":"v1","addr":"172.21.15.157:6825","nonce":37373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":37373},{"type":"v1","addr":"172.21.15.157:6827","nonce":37373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":37373},{"type":"v1","addr":"172.21.15.157:6831","nonce":37373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":37373},{"type":"v1","addr":"172.21.15.157:6829","nonce":37373}]},"public_addr":"172.21.15.157:6825/37373","cluster_addr":"172.21.15.157:6827/37373","heartbeat_back_addr":"172.21.15.157:6831/37373","heartbeat_front_addr":"172.21.15.157:6829/37373","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.110188+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.280265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.252119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.267996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.284582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.144420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.174764+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.308002+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:07.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.197+0000 7fe4d0200640 1 -- 172.21.15.107:0/3822681266 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe4a8065180 msgr2=0x7fe4a8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:07.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.197+0000 7fe4d0200640 1 --2- 172.21.15.107:0/3822681266 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe4a8065180 0x7fe4a8067630 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009d70 tx=0x7fe4bc008040 comp rx=0 tx=0).stop 2024-08-17T02:25:07.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.197+0000 7fe4d0200640 1 -- 172.21.15.107:0/3822681266 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4c815e570 msgr2=0x7fe4c813bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:07.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.197+0000 7fe4d0200640 1 --2- 172.21.15.107:0/3822681266 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4c815e570 0x7fe4c813bd50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4009d60 tx=0x7fe4b4032000 comp rx=0 tx=0).stop 2024-08-17T02:25:07.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.197+0000 7fe4d0200640 1 -- 172.21.15.107:0/3822681266 shutdown_connections 2024-08-17T02:25:07.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.197+0000 7fe4d0200640 1 --2- 172.21.15.107:0/3822681266 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe4a8065180 0x7fe4a8067630 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:07.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.197+0000 7fe4d0200640 1 --2- 172.21.15.107:0/3822681266 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe4c80c4fe0 0x7fe4c8155140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:07.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.197+0000 7fe4d0200640 1 --2- 172.21.15.107:0/3822681266 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4c815e570 0x7fe4c813bd50 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:07.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.197+0000 7fe4d0200640 1 --2- 172.21.15.107:0/3822681266 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4b0003f50 0x7fe4c80c7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:07.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.197+0000 7fe4d0200640 1 -- 172.21.15.107:0/3822681266 >> 172.21.15.107:0/3822681266 conn(0x7fe4c80cb9b0 msgr2=0x7fe4c815a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:07.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.197+0000 7fe4d0200640 1 -- 172.21.15.107:0/3822681266 shutdown_connections 2024-08-17T02:25:07.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.197+0000 7fe4d0200640 1 -- 172.21.15.107:0/3822681266 wait complete. 2024-08-17T02:25:07.215 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-17T02:25:07.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.366+0000 7fa25f200640 1 Processor -- start 2024-08-17T02:25:07.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.366+0000 7fa25f200640 1 -- start start 2024-08-17T02:25:07.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.367+0000 7fa25f200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2581401b0 0x7fa2580caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:07.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.367+0000 7fa25f200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa258140580 0x7fa2580b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:07.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.367+0000 7fa25f200640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2580b16d0 con 0x7fa2580b1270 2024-08-17T02:25:07.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.367+0000 7fa25f200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2580cb450 con 0x7fa258140580 2024-08-17T02:25:07.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.367+0000 7fa25f200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2580caa80 con 0x7fa2581401b0 2024-08-17T02:25:07.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.367+0000 7fa257400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa258140580 0x7fa2580b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:07.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.367+0000 7fa257400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa258140580 0x7fa2580b0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51642/0 (socket says 172.21.15.107:51642) 2024-08-17T02:25:07.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.367+0000 7fa257400640 1 -- 172.21.15.107:0/2186274789 learned_addr learned my addr 172.21.15.107:0/2186274789 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:07.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.368+0000 7fa257e00640 1 --2- 172.21.15.107:0/2186274789 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2581401b0 0x7fa2580caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:07.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.368+0000 7fa257400640 1 -- 172.21.15.107:0/2186274789 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2581401b0 msgr2=0x7fa2580caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:07.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.368+0000 7fa257400640 1 --2- 172.21.15.107:0/2186274789 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2581401b0 0x7fa2580caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:07.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.368+0000 7fa257400640 1 -- 172.21.15.107:0/2186274789 >> v1:172.21.15.157:6789/0 conn(0x7fa2580b1270 legacy=0x7fa2580c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:07.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.368+0000 7fa257400640 1 -- 172.21.15.107:0/2186274789 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2580c9e70 con 0x7fa258140580 2024-08-17T02:25:07.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.369+0000 7fa257400640 1 --2- 172.21.15.107:0/2186274789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa258140580 0x7fa2580b0d30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa244009910 tx=0x7fa2440091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f94905346cd26be server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:07.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.369+0000 7fa256a00640 1 -- 172.21.15.107:0/2186274789 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24402add0 con 0x7fa258140580 2024-08-17T02:25:07.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.369+0000 7fa256a00640 1 -- 172.21.15.107:0/2186274789 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa244032440 con 0x7fa258140580 2024-08-17T02:25:07.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.369+0000 7fa256a00640 1 -- 172.21.15.107:0/2186274789 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa244032820 con 0x7fa258140580 2024-08-17T02:25:07.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.370+0000 7fa25f200640 1 -- 172.21.15.107:0/2186274789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa258140580 msgr2=0x7fa2580b0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:07.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.370+0000 7fa25f200640 1 --2- 172.21.15.107:0/2186274789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa258140580 0x7fa2580b0d30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa244009910 tx=0x7fa2440091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:07.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.370+0000 7fa25f200640 1 -- 172.21.15.107:0/2186274789 shutdown_connections 2024-08-17T02:25:07.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.370+0000 7fa25f200640 1 --2- 172.21.15.107:0/2186274789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa258140580 0x7fa2580b0d30 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:07.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.370+0000 7fa25f200640 1 --2- 172.21.15.107:0/2186274789 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2581401b0 0x7fa2580caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:07.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.370+0000 7fa25f200640 1 -- 172.21.15.107:0/2186274789 >> 172.21.15.107:0/2186274789 conn(0x7fa2580cb9b0 msgr2=0x7fa2580cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:07.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.370+0000 7fa25f200640 1 -- 172.21.15.107:0/2186274789 shutdown_connections 2024-08-17T02:25:07.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.370+0000 7fa25f200640 1 -- 172.21.15.107:0/2186274789 wait complete. 2024-08-17T02:25:07.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.372+0000 7fa25f200640 1 Processor -- start 2024-08-17T02:25:07.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.372+0000 7fa25f200640 1 -- start start 2024-08-17T02:25:07.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.373+0000 7fa25f200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa2580b1270 0x7fa25816a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:07.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.373+0000 7fa25f200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2581401b0 0x7fa258158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:07.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.373+0000 7fa25f200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa258140580 0x7fa2580c0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:07.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.373+0000 7fa25f200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2580aa5e0 con 0x7fa2580b1270 2024-08-17T02:25:07.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.373+0000 7fa25f200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2580aa8c0 con 0x7fa258140580 2024-08-17T02:25:07.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.373+0000 7fa25f200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2580aaba0 con 0x7fa2581401b0 2024-08-17T02:25:07.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.373+0000 7fa257e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa2580b1270 0x7fa25816a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:07.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.373+0000 7fa257e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa2580b1270 0x7fa25816a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51644/0 (socket says 172.21.15.107:51644) 2024-08-17T02:25:07.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.373+0000 7fa257e00640 1 -- 172.21.15.107:0/2228153326 learned_addr learned my addr 172.21.15.107:0/2228153326 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:07.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.373+0000 7fa257400640 1 --2- 172.21.15.107:0/2228153326 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2581401b0 0x7fa258158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:07.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.373+0000 7fa25d200640 1 --2- 172.21.15.107:0/2228153326 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa258140580 0x7fa2580c0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:07.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.373+0000 7fa257e00640 1 -- 172.21.15.107:0/2228153326 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2581401b0 msgr2=0x7fa258158950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:07.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.373+0000 7fa257e00640 1 --2- 172.21.15.107:0/2228153326 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2581401b0 0x7fa258158950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:07.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.373+0000 7fa257e00640 1 -- 172.21.15.107:0/2228153326 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa258140580 msgr2=0x7fa2580c0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:07.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.373+0000 7fa257e00640 1 --2- 172.21.15.107:0/2228153326 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa258140580 0x7fa2580c0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:07.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.373+0000 7fa257e00640 1 -- 172.21.15.107:0/2228153326 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa244009450 con 0x7fa2580b1270 2024-08-17T02:25:07.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.374+0000 7fa257e00640 1 --2- 172.21.15.107:0/2228153326 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa2580b1270 0x7fa25816a210 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa24800d890 tx=0x7fa248008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:07.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.374+0000 7fa24f400640 1 -- 172.21.15.107:0/2228153326 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24800de20 con 0x7fa2580b1270 2024-08-17T02:25:07.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.374+0000 7fa24f400640 1 -- 172.21.15.107:0/2228153326 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2480098b0 con 0x7fa2580b1270 2024-08-17T02:25:07.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.374+0000 7fa24f400640 1 -- 172.21.15.107:0/2228153326 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa248009c70 con 0x7fa2580b1270 2024-08-17T02:25:07.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.374+0000 7fa25f200640 1 -- 172.21.15.107:0/2228153326 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2580aae80 con 0x7fa2580b1270 2024-08-17T02:25:07.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.374+0000 7fa25f200640 1 -- 172.21.15.107:0/2228153326 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2581590b0 con 0x7fa2580b1270 2024-08-17T02:25:07.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.375+0000 7fa25f200640 1 -- 172.21.15.107:0/2228153326 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa258064db0 con 0x7fa2580b1270 2024-08-17T02:25:07.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.376+0000 7fa24f400640 1 -- 172.21.15.107:0/2228153326 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa248014410 con 0x7fa2580b1270 2024-08-17T02:25:07.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.377+0000 7fa24f400640 1 --2- 172.21.15.107:0/2228153326 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fa238065150 0x7fa238067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:07.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.377+0000 7fa24f400640 1 -- 172.21.15.107:0/2228153326 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa248082d20 con 0x7fa2580b1270 2024-08-17T02:25:07.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.377+0000 7fa257400640 1 --2- 172.21.15.107:0/2228153326 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fa238065150 0x7fa238067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:07.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.378+0000 7fa257400640 1 --2- 172.21.15.107:0/2228153326 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fa238065150 0x7fa238067600 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa244034000 tx=0x7fa244032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:07.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.381+0000 7fa24f400640 1 -- 172.21.15.107:0/2228153326 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa248050ea0 con 0x7fa2580b1270 2024-08-17T02:25:07.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.601+0000 7fa25f200640 1 -- 172.21.15.107:0/2228153326 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa2580cc100 con 0x7fa2580b1270 2024-08-17T02:25:07.602 INFO:tasks.ceph.mon.a.smithi107.stderr:2024-08-17T02:25:07.602+0000 7ff651400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:25:07.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.607+0000 7fa24f400640 1 -- 172.21.15.107:0/2228153326 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa248018090 con 0x7fa2580b1270 2024-08-17T02:25:07.607 INFO:teuthology.orchestra.run.smithi107.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:25:07.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.610+0000 7fa25f200640 1 -- 172.21.15.107:0/2228153326 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fa238065150 msgr2=0x7fa238067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:07.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.610+0000 7fa25f200640 1 --2- 172.21.15.107:0/2228153326 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fa238065150 0x7fa238067600 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa244034000 tx=0x7fa244032000 comp rx=0 tx=0).stop 2024-08-17T02:25:07.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.610+0000 7fa25f200640 1 -- 172.21.15.107:0/2228153326 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa2580b1270 msgr2=0x7fa25816a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:07.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.610+0000 7fa25f200640 1 --2- 172.21.15.107:0/2228153326 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa2580b1270 0x7fa25816a210 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa24800d890 tx=0x7fa248008040 comp rx=0 tx=0).stop 2024-08-17T02:25:07.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.610+0000 7fa25f200640 1 -- 172.21.15.107:0/2228153326 shutdown_connections 2024-08-17T02:25:07.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.610+0000 7fa25f200640 1 --2- 172.21.15.107:0/2228153326 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fa238065150 0x7fa238067600 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:07.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.610+0000 7fa25f200640 1 --2- 172.21.15.107:0/2228153326 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa258140580 0x7fa2580c0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:07.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.610+0000 7fa25f200640 1 --2- 172.21.15.107:0/2228153326 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2581401b0 0x7fa258158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:07.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.610+0000 7fa25f200640 1 --2- 172.21.15.107:0/2228153326 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa2580b1270 0x7fa25816a210 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:07.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.610+0000 7fa25f200640 1 -- 172.21.15.107:0/2228153326 >> 172.21.15.107:0/2228153326 conn(0x7fa2580cb9b0 msgr2=0x7fa25813ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:07.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.611+0000 7fa25f200640 1 -- 172.21.15.107:0/2228153326 shutdown_connections 2024-08-17T02:25:07.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.611+0000 7fa25f200640 1 -- 172.21.15.107:0/2228153326 wait complete. 2024-08-17T02:25:07.613 INFO:tasks.ceph.mds.d.smithi157.stderr: -1979> 2024-08-17T02:24:33.554+0000 7f48f4600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:25:07.633 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-17T02:25:07.655 INFO:tasks.ceph.mds.d.smithi157.stdout:starting mds.d at 2024-08-17T02:25:07.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.786+0000 7fe090600640 1 Processor -- start 2024-08-17T02:25:07.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.787+0000 7fe090600640 1 -- start start 2024-08-17T02:25:07.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.788+0000 7fe090600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe088158ea0 0x7fe0880d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:07.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.788+0000 7fe090600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe08806f240 con 0x7fe0880caa00 2024-08-17T02:25:07.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.788+0000 7fe090600640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0880cf410 con 0x7fe0880d09a0 2024-08-17T02:25:07.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.788+0000 7fe090600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0880c6f20 con 0x7fe088158ea0 2024-08-17T02:25:07.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.788+0000 7fe08e600640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fe0880caa00 0x7fe0880c7370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:59594/0 (socket says 172.21.15.107:59594) 2024-08-17T02:25:07.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.788+0000 7fe08e600640 1 -- 172.21.15.107:0/4099087845 learned_addr learned my addr 172.21.15.107:0/4099087845 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:25:07.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.788+0000 7fe08dc00640 1 --2- 172.21.15.107:0/4099087845 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe088158ea0 0x7fe0880d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:07.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.789+0000 7fe087e00640 1 -- 172.21.15.107:0/4099087845 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3769517849 0 0) 0x7fe08806f240 con 0x7fe0880caa00 2024-08-17T02:25:07.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.789+0000 7fe087e00640 1 -- 172.21.15.107:0/4099087845 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0700034e0 con 0x7fe0880caa00 2024-08-17T02:25:07.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.789+0000 7fe08dc00640 1 -- 172.21.15.107:0/4099087845 >> v1:172.21.15.157:6789/0 conn(0x7fe0880d09a0 legacy=0x7fe0880ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:07.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.789+0000 7fe08dc00640 1 -- 172.21.15.107:0/4099087845 >> v1:172.21.15.107:6789/0 conn(0x7fe0880caa00 legacy=0x7fe0880c7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:07.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.789+0000 7fe08dc00640 1 -- 172.21.15.107:0/4099087845 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0880ceb70 con 0x7fe088158ea0 2024-08-17T02:25:07.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.790+0000 7fe08dc00640 1 --2- 172.21.15.107:0/4099087845 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe088158ea0 0x7fe0880d0460 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe07c009880 tx=0x7fe07c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7e9f412c188be46 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:07.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.790+0000 7fe087e00640 1 -- 172.21.15.107:0/4099087845 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07c02ad80 con 0x7fe088158ea0 2024-08-17T02:25:07.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.790+0000 7fe087e00640 1 -- 172.21.15.107:0/4099087845 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07c032440 con 0x7fe088158ea0 2024-08-17T02:25:07.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.790+0000 7fe087e00640 1 -- 172.21.15.107:0/4099087845 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07c0327c0 con 0x7fe088158ea0 2024-08-17T02:25:07.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.791+0000 7fe090600640 1 -- 172.21.15.107:0/4099087845 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe088158ea0 msgr2=0x7fe0880d0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:07.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.791+0000 7fe090600640 1 --2- 172.21.15.107:0/4099087845 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe088158ea0 0x7fe0880d0460 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe07c009880 tx=0x7fe07c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:07.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.791+0000 7fe090600640 1 -- 172.21.15.107:0/4099087845 shutdown_connections 2024-08-17T02:25:07.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.791+0000 7fe090600640 1 --2- 172.21.15.107:0/4099087845 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe088158ea0 0x7fe0880d0460 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:07.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.791+0000 7fe090600640 1 -- 172.21.15.107:0/4099087845 >> 172.21.15.107:0/4099087845 conn(0x7fe08806eb90 msgr2=0x7fe0880cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:07.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.791+0000 7fe090600640 1 -- 172.21.15.107:0/4099087845 shutdown_connections 2024-08-17T02:25:07.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.791+0000 7fe090600640 1 -- 172.21.15.107:0/4099087845 wait complete. 2024-08-17T02:25:07.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.793+0000 7fe090600640 1 Processor -- start 2024-08-17T02:25:07.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.793+0000 7fe090600640 1 -- start start 2024-08-17T02:25:07.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.794+0000 7fe090600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0880caa00 0x7fe0881576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:07.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.794+0000 7fe090600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe0880d09a0 0x7fe08814bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:07.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.794+0000 7fe090600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe088158ea0 0x7fe08816c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:07.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.794+0000 7fe090600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08809bea0 con 0x7fe088158ea0 2024-08-17T02:25:07.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.794+0000 7fe090600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08809c180 con 0x7fe0880caa00 2024-08-17T02:25:07.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.794+0000 7fe090600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe08809c460 con 0x7fe0880d09a0 2024-08-17T02:25:07.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.794+0000 7fe08e600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe088158ea0 0x7fe08816c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:07.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.794+0000 7fe08d200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe0880d09a0 0x7fe08814bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:07.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.794+0000 7fe08dc00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0880caa00 0x7fe0881576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:07.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.794+0000 7fe08dc00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0880caa00 0x7fe0881576f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:48552/0 (socket says 172.21.15.107:48552) 2024-08-17T02:25:07.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.794+0000 7fe08dc00640 1 -- 172.21.15.107:0/4207743292 learned_addr learned my addr 172.21.15.107:0/4207743292 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:07.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.794+0000 7fe08d200640 1 -- 172.21.15.107:0/4207743292 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0880caa00 msgr2=0x7fe0881576f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:07.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.794+0000 7fe08d200640 1 --2- 172.21.15.107:0/4207743292 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0880caa00 0x7fe0881576f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:07.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.794+0000 7fe08d200640 1 -- 172.21.15.107:0/4207743292 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe088158ea0 msgr2=0x7fe08816c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:07.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.794+0000 7fe08d200640 1 --2- 172.21.15.107:0/4207743292 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe088158ea0 0x7fe08816c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:07.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.794+0000 7fe08d200640 1 -- 172.21.15.107:0/4207743292 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe07c009390 con 0x7fe0880d09a0 2024-08-17T02:25:07.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.794+0000 7fe08e600640 1 --2- 172.21.15.107:0/4207743292 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe088158ea0 0x7fe08816c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:07.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.795+0000 7fe08d200640 1 --2- 172.21.15.107:0/4207743292 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe0880d09a0 0x7fe08814bc00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe074000c00 tx=0x7fe074007e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:07.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.795+0000 7fe084c00640 1 -- 172.21.15.107:0/4207743292 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe074011590 con 0x7fe0880d09a0 2024-08-17T02:25:07.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.795+0000 7fe084c00640 1 -- 172.21.15.107:0/4207743292 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0740116f0 con 0x7fe0880d09a0 2024-08-17T02:25:07.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.795+0000 7fe084c00640 1 -- 172.21.15.107:0/4207743292 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe074011ab0 con 0x7fe0880d09a0 2024-08-17T02:25:07.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.795+0000 7fe090600640 1 -- 172.21.15.107:0/4207743292 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe08809c740 con 0x7fe0880d09a0 2024-08-17T02:25:07.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.795+0000 7fe090600640 1 -- 172.21.15.107:0/4207743292 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe08814c140 con 0x7fe0880d09a0 2024-08-17T02:25:07.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.797+0000 7fe090600640 1 -- 172.21.15.107:0/4207743292 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe088071050 con 0x7fe0880d09a0 2024-08-17T02:25:07.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.797+0000 7fe084c00640 1 -- 172.21.15.107:0/4207743292 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe07401b3b0 con 0x7fe0880d09a0 2024-08-17T02:25:07.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.798+0000 7fe084c00640 1 --2- 172.21.15.107:0/4207743292 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe068065150 0x7fe068067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:07.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.798+0000 7fe084c00640 1 -- 172.21.15.107:0/4207743292 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fe074081850 con 0x7fe0880d09a0 2024-08-17T02:25:07.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.798+0000 7fe08dc00640 1 --2- 172.21.15.107:0/4207743292 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe068065150 0x7fe068067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:07.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.799+0000 7fe08dc00640 1 --2- 172.21.15.107:0/4207743292 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe068065150 0x7fe068067600 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe07c009130 tx=0x7fe07c032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:07.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:07.803+0000 7fe084c00640 1 -- 172.21.15.107:0/4207743292 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe07404f8d0 con 0x7fe0880d09a0 2024-08-17T02:25:08.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.120+0000 7fe090600640 1 -- 172.21.15.107:0/4207743292 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe0880cf600 con 0x7fe0880d09a0 2024-08-17T02:25:08.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.608+0000 7fe084c00640 1 -- 172.21.15.107:0/4207743292 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe0740170a0 con 0x7fe0880d09a0 2024-08-17T02:25:08.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.610+0000 7fe090600640 1 -- 172.21.15.107:0/4207743292 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe068065150 msgr2=0x7fe068067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:08.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.610+0000 7fe090600640 1 --2- 172.21.15.107:0/4207743292 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe068065150 0x7fe068067600 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe07c009130 tx=0x7fe07c032000 comp rx=0 tx=0).stop 2024-08-17T02:25:08.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.610+0000 7fe090600640 1 -- 172.21.15.107:0/4207743292 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe0880d09a0 msgr2=0x7fe08814bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:08.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.610+0000 7fe090600640 1 --2- 172.21.15.107:0/4207743292 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe0880d09a0 0x7fe08814bc00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe074000c00 tx=0x7fe074007e10 comp rx=0 tx=0).stop 2024-08-17T02:25:08.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.611+0000 7fe090600640 1 -- 172.21.15.107:0/4207743292 shutdown_connections 2024-08-17T02:25:08.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.611+0000 7fe090600640 1 --2- 172.21.15.107:0/4207743292 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe068065150 0x7fe068067600 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:08.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.611+0000 7fe090600640 1 --2- 172.21.15.107:0/4207743292 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe088158ea0 0x7fe08816c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:08.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.611+0000 7fe090600640 1 --2- 172.21.15.107:0/4207743292 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe0880d09a0 0x7fe08814bc00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:08.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.611+0000 7fe090600640 1 --2- 172.21.15.107:0/4207743292 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0880caa00 0x7fe0881576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:08.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.611+0000 7fe090600640 1 -- 172.21.15.107:0/4207743292 >> 172.21.15.107:0/4207743292 conn(0x7fe08806eb90 msgr2=0x7fe0880cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:08.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.611+0000 7fe090600640 1 -- 172.21.15.107:0/4207743292 shutdown_connections 2024-08-17T02:25:08.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.611+0000 7fe090600640 1 -- 172.21.15.107:0/4207743292 wait complete. 2024-08-17T02:25:08.626 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-17T02:25:08.783 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.783+0000 7f4b34a00640 1 Processor -- start 2024-08-17T02:25:08.783 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.783+0000 7f4b34a00640 1 -- start start 2024-08-17T02:25:08.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.784+0000 7f4b34a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4b301510b0 0x7f4b300af110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:08.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.784+0000 7f4b34a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b30157850 0x7f4b300ad910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:08.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.784+0000 7f4b34a00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b300aec80 con 0x7f4b300ad4a0 2024-08-17T02:25:08.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.784+0000 7f4b34a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b300af650 con 0x7f4b301510b0 2024-08-17T02:25:08.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.784+0000 7f4b34a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b300cc6a0 con 0x7f4b30157850 2024-08-17T02:25:08.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.784+0000 7f4b2f400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4b301510b0 0x7f4b300af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:08.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.784+0000 7f4b2f400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4b301510b0 0x7f4b300af110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51668/0 (socket says 172.21.15.107:51668) 2024-08-17T02:25:08.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.784+0000 7f4b2f400640 1 -- 172.21.15.107:0/2725532981 learned_addr learned my addr 172.21.15.107:0/2725532981 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:08.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.785+0000 7f4b2fe00640 1 --2- 172.21.15.107:0/2725532981 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b30157850 0x7f4b300ad910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:08.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.785+0000 7f4b2f400640 1 -- 172.21.15.107:0/2725532981 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b30157850 msgr2=0x7f4b300ad910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:08.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.785+0000 7f4b2f400640 1 --2- 172.21.15.107:0/2725532981 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b30157850 0x7f4b300ad910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:08.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.785+0000 7f4b2f400640 1 -- 172.21.15.107:0/2725532981 >> v1:172.21.15.157:6789/0 conn(0x7f4b300ad4a0 legacy=0x7f4b30157140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:08.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.785+0000 7f4b2f400640 1 -- 172.21.15.107:0/2725532981 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b300ade50 con 0x7f4b301510b0 2024-08-17T02:25:08.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.786+0000 7f4b2f400640 1 --2- 172.21.15.107:0/2725532981 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b301510b0 0x7f4b300af110 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4b30064630 tx=0x7f4b200091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63acd57141303426 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:08.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.786+0000 7f4b2ea00640 1 -- 172.21.15.107:0/2725532981 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2002ad90 con 0x7f4b301510b0 2024-08-17T02:25:08.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.786+0000 7f4b2ea00640 1 -- 172.21.15.107:0/2725532981 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b20032440 con 0x7f4b301510b0 2024-08-17T02:25:08.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.786+0000 7f4b2ea00640 1 -- 172.21.15.107:0/2725532981 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b20032820 con 0x7f4b301510b0 2024-08-17T02:25:08.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.787+0000 7f4b34a00640 1 -- 172.21.15.107:0/2725532981 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b301510b0 msgr2=0x7f4b300af110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:08.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.787+0000 7f4b34a00640 1 --2- 172.21.15.107:0/2725532981 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b301510b0 0x7f4b300af110 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4b30064630 tx=0x7f4b200091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:08.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.787+0000 7f4b34a00640 1 -- 172.21.15.107:0/2725532981 shutdown_connections 2024-08-17T02:25:08.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.787+0000 7f4b34a00640 1 --2- 172.21.15.107:0/2725532981 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b30157850 0x7f4b300ad910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:08.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.787+0000 7f4b34a00640 1 --2- 172.21.15.107:0/2725532981 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b301510b0 0x7f4b300af110 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:08.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.787+0000 7f4b34a00640 1 -- 172.21.15.107:0/2725532981 >> 172.21.15.107:0/2725532981 conn(0x7f4b30067750 msgr2=0x7f4b300cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:08.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.787+0000 7f4b34a00640 1 -- 172.21.15.107:0/2725532981 shutdown_connections 2024-08-17T02:25:08.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.787+0000 7f4b34a00640 1 -- 172.21.15.107:0/2725532981 wait complete. 2024-08-17T02:25:08.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.788+0000 7f4b34a00640 1 Processor -- start 2024-08-17T02:25:08.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.788+0000 7f4b34a00640 1 -- start start 2024-08-17T02:25:08.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.789+0000 7f4b34a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b300ad4a0 0x7f4b30168670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:08.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.789+0000 7f4b34a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b301510b0 0x7f4b30168bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:08.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.789+0000 7f4b34a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b30157850 0x7f4b3006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:08.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.789+0000 7f4b34a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3016d660 con 0x7f4b300ad4a0 2024-08-17T02:25:08.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.789+0000 7f4b34a00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b300c9ef0 con 0x7f4b301510b0 2024-08-17T02:25:08.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.789+0000 7f4b34a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b300c95c0 con 0x7f4b30157850 2024-08-17T02:25:08.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.789+0000 7f4b2f400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b300ad4a0 0x7f4b30168670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:08.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.789+0000 7f4b2f400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b300ad4a0 0x7f4b30168670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51680/0 (socket says 172.21.15.107:51680) 2024-08-17T02:25:08.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.789+0000 7f4b2f400640 1 -- 172.21.15.107:0/1515352850 learned_addr learned my addr 172.21.15.107:0/1515352850 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:08.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.789+0000 7f4b2fe00640 1 --2- 172.21.15.107:0/1515352850 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b30157850 0x7f4b3006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:08.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.789+0000 7f4b27e00640 1 --2- 172.21.15.107:0/1515352850 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b301510b0 0x7f4b30168bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:08.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.790+0000 7f4b2f400640 1 -- 172.21.15.107:0/1515352850 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b30157850 msgr2=0x7f4b3006d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:08.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.790+0000 7f4b2f400640 1 --2- 172.21.15.107:0/1515352850 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b30157850 0x7f4b3006d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:08.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.790+0000 7f4b2f400640 1 -- 172.21.15.107:0/1515352850 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b301510b0 msgr2=0x7f4b30168bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:08.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.790+0000 7f4b2f400640 1 --2- 172.21.15.107:0/1515352850 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b301510b0 0x7f4b30168bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:08.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.790+0000 7f4b2f400640 1 -- 172.21.15.107:0/1515352850 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b20009450 con 0x7f4b300ad4a0 2024-08-17T02:25:08.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.790+0000 7f4b27e00640 1 --2- 172.21.15.107:0/1515352850 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b301510b0 0x7f4b30168bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:08.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.790+0000 7f4b2f400640 1 --2- 172.21.15.107:0/1515352850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b300ad4a0 0x7f4b30168670 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4b20035040 tx=0x7f4b20032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:08.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.790+0000 7f4b26a00640 1 -- 172.21.15.107:0/1515352850 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b20000d10 con 0x7f4b300ad4a0 2024-08-17T02:25:08.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.790+0000 7f4b26a00640 1 -- 172.21.15.107:0/1515352850 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b20031de0 con 0x7f4b300ad4a0 2024-08-17T02:25:08.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.790+0000 7f4b34a00640 1 -- 172.21.15.107:0/1515352850 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b300c98a0 con 0x7f4b300ad4a0 2024-08-17T02:25:08.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.790+0000 7f4b26a00640 1 -- 172.21.15.107:0/1515352850 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2003d670 con 0x7f4b300ad4a0 2024-08-17T02:25:08.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.791+0000 7f4b34a00640 1 -- 172.21.15.107:0/1515352850 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b30144420 con 0x7f4b300ad4a0 2024-08-17T02:25:08.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.792+0000 7f4b34a00640 1 -- 172.21.15.107:0/1515352850 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b30071050 con 0x7f4b300ad4a0 2024-08-17T02:25:08.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.792+0000 7f4b26a00640 1 -- 172.21.15.107:0/1515352850 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4b20039040 con 0x7f4b300ad4a0 2024-08-17T02:25:08.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.793+0000 7f4b26a00640 1 --2- 172.21.15.107:0/1515352850 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4b0c065150 0x7f4b0c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:08.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.793+0000 7f4b26a00640 1 -- 172.21.15.107:0/1515352850 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f4b200a2710 con 0x7f4b300ad4a0 2024-08-17T02:25:08.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.793+0000 7f4b27e00640 1 --2- 172.21.15.107:0/1515352850 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4b0c065150 0x7f4b0c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:08.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.794+0000 7f4b27e00640 1 --2- 172.21.15.107:0/1515352850 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4b0c065150 0x7f4b0c067600 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4b18002860 tx=0x7f4b18009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:08.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.797+0000 7f4b26a00640 1 -- 172.21.15.107:0/1515352850 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4b20070790 con 0x7f4b300ad4a0 2024-08-17T02:25:08.971 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:08.971+0000 7f4b34a00640 1 -- 172.21.15.107:0/1515352850 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4b30064720 con 0x7f4b300ad4a0 2024-08-17T02:25:09.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.613+0000 7f4b26a00640 1 -- 172.21.15.107:0/1515352850 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4b20073db0 con 0x7f4b300ad4a0 2024-08-17T02:25:09.614 INFO:teuthology.orchestra.run.smithi107.stderr:pool 'cephfs_metadata' removed 2024-08-17T02:25:09.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.617+0000 7f4b34a00640 1 -- 172.21.15.107:0/1515352850 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4b0c065150 msgr2=0x7f4b0c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:09.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.617+0000 7f4b34a00640 1 --2- 172.21.15.107:0/1515352850 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4b0c065150 0x7f4b0c067600 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4b18002860 tx=0x7f4b18009040 comp rx=0 tx=0).stop 2024-08-17T02:25:09.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.617+0000 7f4b34a00640 1 -- 172.21.15.107:0/1515352850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b300ad4a0 msgr2=0x7f4b30168670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:09.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.617+0000 7f4b34a00640 1 --2- 172.21.15.107:0/1515352850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b300ad4a0 0x7f4b30168670 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4b20035040 tx=0x7f4b20032000 comp rx=0 tx=0).stop 2024-08-17T02:25:09.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.618+0000 7f4b34a00640 1 -- 172.21.15.107:0/1515352850 shutdown_connections 2024-08-17T02:25:09.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.618+0000 7f4b34a00640 1 --2- 172.21.15.107:0/1515352850 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4b0c065150 0x7f4b0c067600 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:09.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.618+0000 7f4b34a00640 1 --2- 172.21.15.107:0/1515352850 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b30157850 0x7f4b3006d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:09.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.618+0000 7f4b34a00640 1 --2- 172.21.15.107:0/1515352850 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b301510b0 0x7f4b30168bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:09.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.618+0000 7f4b34a00640 1 --2- 172.21.15.107:0/1515352850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b300ad4a0 0x7f4b30168670 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:09.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.618+0000 7f4b34a00640 1 -- 172.21.15.107:0/1515352850 >> 172.21.15.107:0/1515352850 conn(0x7f4b30067750 msgr2=0x7f4b30155e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:09.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.618+0000 7f4b34a00640 1 -- 172.21.15.107:0/1515352850 shutdown_connections 2024-08-17T02:25:09.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.618+0000 7f4b34a00640 1 -- 172.21.15.107:0/1515352850 wait complete. 2024-08-17T02:25:09.635 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-17T02:25:09.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.791+0000 7f94c4c00640 1 Processor -- start 2024-08-17T02:25:09.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.791+0000 7f94c4c00640 1 -- start start 2024-08-17T02:25:09.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.792+0000 7f94c4c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94c0156890 0x7f94c006dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:09.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.792+0000 7f94c4c00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f94c0156c60 0x7f94c006e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:09.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.792+0000 7f94c4c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94c00ae9b0 con 0x7f94c00c8130 2024-08-17T02:25:09.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.792+0000 7f94c4c00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94c00aa730 con 0x7f94c0156c60 2024-08-17T02:25:09.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.792+0000 7f94c4c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c00aa9f0 con 0x7f94c0156890 2024-08-17T02:25:09.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.793+0000 7f94be800640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f94c00c8130 0x7f94c00c85b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:59610/0 (socket says 172.21.15.107:59610) 2024-08-17T02:25:09.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.793+0000 7f94be800640 1 -- 172.21.15.107:0/2190889929 learned_addr learned my addr 172.21.15.107:0/2190889929 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:25:09.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.793+0000 7f94b5400640 1 --2- 172.21.15.107:0/2190889929 >> v2:172.21.15.157:3300/0 conn(0x7f94c0156c60 0x7f94c006e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:09.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.793+0000 7f94bde00640 1 --2- 172.21.15.107:0/2190889929 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94c0156890 0x7f94c006dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:09.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.793+0000 7f94bd400640 1 -- 172.21.15.107:0/2190889929 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3803265112 0 0) 0x7f94c00ae9b0 con 0x7f94c00c8130 2024-08-17T02:25:09.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.793+0000 7f94bd400640 1 -- 172.21.15.107:0/2190889929 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94a40034e0 con 0x7f94c00c8130 2024-08-17T02:25:09.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.793+0000 7f94bd400640 1 -- 172.21.15.107:0/2190889929 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1279197373 0 0) 0x7f94a40034e0 con 0x7f94c00c8130 2024-08-17T02:25:09.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.793+0000 7f94bd400640 1 -- 172.21.15.107:0/2190889929 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94c0156890 msgr2=0x7f94c006dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:09.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.793+0000 7f94bd400640 1 --2- 172.21.15.107:0/2190889929 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94c0156890 0x7f94c006dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:09.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.793+0000 7f94bd400640 1 -- 172.21.15.107:0/2190889929 >> v2:172.21.15.157:3300/0 conn(0x7f94c0156c60 msgr2=0x7f94c006e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:09.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.793+0000 7f94bd400640 1 --2- 172.21.15.107:0/2190889929 >> v2:172.21.15.157:3300/0 conn(0x7f94c0156c60 0x7f94c006e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:09.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.793+0000 7f94bd400640 1 -- 172.21.15.107:0/2190889929 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c00ab320 con 0x7f94c00c8130 2024-08-17T02:25:09.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.794+0000 7f94bd400640 1 -- 172.21.15.107:0/2190889929 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 537989081 0 0) 0x7f94b80017f0 con 0x7f94c00c8130 2024-08-17T02:25:09.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.794+0000 7f94bd400640 1 -- 172.21.15.107:0/2190889929 >> v1:172.21.15.107:6789/0 conn(0x7f94c00c8130 legacy=0x7f94c00c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:09.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.794+0000 7f94bd400640 1 --2- 172.21.15.107:0/2190889929 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94a40039d0 0x7f94a4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:09.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.794+0000 7f94bd400640 1 --2- 172.21.15.107:0/2190889929 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94c0156890 0x7f94a4004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:09.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.794+0000 7f94bd400640 1 --2- 172.21.15.107:0/2190889929 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94a4004cc0 0x7f94a4005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:09.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.794+0000 7f94bd400640 1 -- 172.21.15.107:0/2190889929 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c00aa730 con 0x7f94a4004cc0 2024-08-17T02:25:09.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.794+0000 7f94bd400640 1 -- 172.21.15.107:0/2190889929 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c00aa9f0 con 0x7f94a40039d0 2024-08-17T02:25:09.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.794+0000 7f94bd400640 1 -- 172.21.15.107:0/2190889929 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a400b9d0 con 0x7f94c0156890 2024-08-17T02:25:09.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.794+0000 7f94be800640 1 --2- 172.21.15.107:0/2190889929 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94a4004cc0 0x7f94a4005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:09.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.794+0000 7f94b5400640 1 --2- 172.21.15.107:0/2190889929 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94c0156890 0x7f94a4004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:09.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.794+0000 7f94bde00640 1 --2- 172.21.15.107:0/2190889929 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94a40039d0 0x7f94a4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:09.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.794+0000 7f94be800640 1 -- 172.21.15.107:0/2190889929 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94c0156890 msgr2=0x7f94a4004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:09.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.794+0000 7f94be800640 1 --2- 172.21.15.107:0/2190889929 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94c0156890 0x7f94a4004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:09.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.794+0000 7f94be800640 1 -- 172.21.15.107:0/2190889929 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94a40039d0 msgr2=0x7f94a4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:09.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.794+0000 7f94be800640 1 --2- 172.21.15.107:0/2190889929 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94a40039d0 0x7f94a4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:09.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.794+0000 7f94be800640 1 -- 172.21.15.107:0/2190889929 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a40034e0 con 0x7f94a4004cc0 2024-08-17T02:25:09.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.795+0000 7f94be800640 1 --2- 172.21.15.107:0/2190889929 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94a4004cc0 0x7f94a4005130 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f94b800a970 tx=0x7f94b8002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=268c5837f5b6d307 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:09.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.795+0000 7f94bd400640 1 -- 172.21.15.107:0/2190889929 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b802c510 con 0x7f94a4004cc0 2024-08-17T02:25:09.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.796+0000 7f94bd400640 1 -- 172.21.15.107:0/2190889929 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b802c6b0 con 0x7f94a4004cc0 2024-08-17T02:25:09.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.796+0000 7f94bd400640 1 -- 172.21.15.107:0/2190889929 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b802cab0 con 0x7f94a4004cc0 2024-08-17T02:25:09.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.796+0000 7f94c4c00640 1 -- 172.21.15.107:0/2190889929 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94a4004cc0 msgr2=0x7f94a4005130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:09.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.796+0000 7f94c4c00640 1 --2- 172.21.15.107:0/2190889929 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94a4004cc0 0x7f94a4005130 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f94b800a970 tx=0x7f94b8002210 comp rx=0 tx=0).stop 2024-08-17T02:25:09.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.796+0000 7f94be800640 1 -- 172.21.15.107:0/2190889929 reap_dead start 2024-08-17T02:25:09.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.796+0000 7f94c4c00640 1 -- 172.21.15.107:0/2190889929 shutdown_connections 2024-08-17T02:25:09.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.796+0000 7f94c4c00640 1 -- 172.21.15.107:0/2190889929 >> 172.21.15.107:0/2190889929 conn(0x7f94c0067750 msgr2=0x7f94c006c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:09.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.796+0000 7f94c4c00640 1 -- 172.21.15.107:0/2190889929 shutdown_connections 2024-08-17T02:25:09.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.796+0000 7f94c4c00640 1 -- 172.21.15.107:0/2190889929 wait complete. 2024-08-17T02:25:09.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.798+0000 7f94c4c00640 1 Processor -- start 2024-08-17T02:25:09.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.798+0000 7f94c4c00640 1 -- start start 2024-08-17T02:25:09.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.799+0000 7f94c4c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94a4004cc0 0x7f94c0152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:09.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.799+0000 7f94c4c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94c0153050 0x7f94c00acc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:09.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.799+0000 7f94c4c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94c00ad1d0 0x7f94c00ab610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:09.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.799+0000 7f94c4c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c014bfa0 con 0x7f94a4004cc0 2024-08-17T02:25:09.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.799+0000 7f94c4c00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c01534a0 con 0x7f94c0153050 2024-08-17T02:25:09.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.799+0000 7f94c4c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c00ad640 con 0x7f94c00ad1d0 2024-08-17T02:25:09.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.799+0000 7f94bde00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94a4004cc0 0x7f94c0152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:09.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.799+0000 7f94bde00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94a4004cc0 0x7f94c0152b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51696/0 (socket says 172.21.15.107:51696) 2024-08-17T02:25:09.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.799+0000 7f94bde00640 1 -- 172.21.15.107:0/921447663 learned_addr learned my addr 172.21.15.107:0/921447663 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:09.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.799+0000 7f94b5400640 1 --2- 172.21.15.107:0/921447663 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94c0153050 0x7f94c00acc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:09.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.799+0000 7f94be800640 1 --2- 172.21.15.107:0/921447663 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94c00ad1d0 0x7f94c00ab610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:09.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.799+0000 7f94bde00640 1 -- 172.21.15.107:0/921447663 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94c00ad1d0 msgr2=0x7f94c00ab610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:09.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.799+0000 7f94bde00640 1 --2- 172.21.15.107:0/921447663 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94c00ad1d0 0x7f94c00ab610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:09.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.799+0000 7f94bde00640 1 -- 172.21.15.107:0/921447663 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94c0153050 msgr2=0x7f94c00acc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:09.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.799+0000 7f94bde00640 1 --2- 172.21.15.107:0/921447663 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94c0153050 0x7f94c00acc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:09.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.799+0000 7f94bde00640 1 -- 172.21.15.107:0/921447663 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c014c4a0 con 0x7f94a4004cc0 2024-08-17T02:25:09.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.800+0000 7f94bde00640 1 --2- 172.21.15.107:0/921447663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94a4004cc0 0x7f94c0152b10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f94b0011a90 tx=0x7f94b00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:09.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.800+0000 7f94b6000640 1 -- 172.21.15.107:0/921447663 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b000fb00 con 0x7f94a4004cc0 2024-08-17T02:25:09.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.800+0000 7f94b6000640 1 -- 172.21.15.107:0/921447663 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b000fc60 con 0x7f94a4004cc0 2024-08-17T02:25:09.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.800+0000 7f94b6000640 1 -- 172.21.15.107:0/921447663 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b0014440 con 0x7f94a4004cc0 2024-08-17T02:25:09.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.800+0000 7f94c4c00640 1 -- 172.21.15.107:0/921447663 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94c014c780 con 0x7f94a4004cc0 2024-08-17T02:25:09.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.800+0000 7f94c4c00640 1 -- 172.21.15.107:0/921447663 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94c014cd40 con 0x7f94a4004cc0 2024-08-17T02:25:09.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.801+0000 7f94c4c00640 1 -- 172.21.15.107:0/921447663 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94c00710c0 con 0x7f94a4004cc0 2024-08-17T02:25:09.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.802+0000 7f94b6000640 1 -- 172.21.15.107:0/921447663 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f94b0014870 con 0x7f94a4004cc0 2024-08-17T02:25:09.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.803+0000 7f94b6000640 1 --2- 172.21.15.107:0/921447663 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f949c065180 0x7f949c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:09.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.803+0000 7f94b6000640 1 -- 172.21.15.107:0/921447663 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f94b0018030 con 0x7f94a4004cc0 2024-08-17T02:25:09.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.803+0000 7f94b5400640 1 --2- 172.21.15.107:0/921447663 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f949c065180 0x7f949c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:09.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.804+0000 7f94b5400640 1 --2- 172.21.15.107:0/921447663 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f949c065180 0x7f949c067630 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f94c00ac780 tx=0x7f94a80090f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:09.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.807+0000 7f94b6000640 1 -- 172.21.15.107:0/921447663 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f94b0050f10 con 0x7f94a4004cc0 2024-08-17T02:25:09.978 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:09.978+0000 7f94c4c00640 1 -- 172.21.15.107:0/921447663 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f94c0155980 con 0x7f94a4004cc0 2024-08-17T02:25:10.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.618+0000 7f94b6000640 1 -- 172.21.15.107:0/921447663 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7f94b0022020 con 0x7f94a4004cc0 2024-08-17T02:25:10.619 INFO:teuthology.orchestra.run.smithi107.stderr:pool 'cephfs_data' removed 2024-08-17T02:25:10.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.621+0000 7f94c4c00640 1 -- 172.21.15.107:0/921447663 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f949c065180 msgr2=0x7f949c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:10.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.621+0000 7f94c4c00640 1 --2- 172.21.15.107:0/921447663 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f949c065180 0x7f949c067630 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f94c00ac780 tx=0x7f94a80090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:10.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.621+0000 7f94c4c00640 1 -- 172.21.15.107:0/921447663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94a4004cc0 msgr2=0x7f94c0152b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:10.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.621+0000 7f94c4c00640 1 --2- 172.21.15.107:0/921447663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94a4004cc0 0x7f94c0152b10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f94b0011a90 tx=0x7f94b00090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:10.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.622+0000 7f94c4c00640 1 -- 172.21.15.107:0/921447663 shutdown_connections 2024-08-17T02:25:10.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.622+0000 7f94c4c00640 1 --2- 172.21.15.107:0/921447663 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f949c065180 0x7f949c067630 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:10.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.622+0000 7f94c4c00640 1 --2- 172.21.15.107:0/921447663 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94c00ad1d0 0x7f94c00ab610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:10.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.622+0000 7f94c4c00640 1 --2- 172.21.15.107:0/921447663 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94c0153050 0x7f94c00acc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:10.623 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.622+0000 7f94c4c00640 1 --2- 172.21.15.107:0/921447663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94a4004cc0 0x7f94c0152b10 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:10.623 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.622+0000 7f94c4c00640 1 -- 172.21.15.107:0/921447663 >> 172.21.15.107:0/921447663 conn(0x7f94c0067750 msgr2=0x7f94c00686f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:10.623 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.623+0000 7f94c4c00640 1 -- 172.21.15.107:0/921447663 shutdown_connections 2024-08-17T02:25:10.623 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.623+0000 7f94c4c00640 1 -- 172.21.15.107:0/921447663 wait complete. 2024-08-17T02:25:10.643 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-17T02:25:10.643 INFO:tasks.ceph.mds.a:Stopping old one... 2024-08-17T02:25:10.643 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-17T02:25:10.644 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:25:10.644 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-17T02:25:10.644 INFO:tasks.ceph.mds.c:Stopping old one... 2024-08-17T02:25:10.644 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-17T02:25:10.644 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:25:10.644 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-17T02:25:10.644 INFO:tasks.ceph.mds.b:Stopping old one... 2024-08-17T02:25:10.645 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-17T02:25:10.645 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:25:10.645 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-17T02:25:10.645 INFO:tasks.ceph.mds.d:Stopping old one... 2024-08-17T02:25:10.645 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-17T02:25:10.645 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:25:10.663 INFO:tasks.ceph.mds.b:Stopped 2024-08-17T02:25:10.663 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-17T02:25:10.664 INFO:tasks.ceph.mds.d:Stopped 2024-08-17T02:25:10.664 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-17T02:25:10.665 INFO:tasks.ceph.mds.c:Stopped 2024-08-17T02:25:10.665 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-17T02:25:10.666 INFO:tasks.ceph.mds.a:Stopped 2024-08-17T02:25:10.666 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-17T02:25:10.707 INFO:tasks.ceph.mds.b:Started 2024-08-17T02:25:10.707 DEBUG:teuthology.parallel:result is None 2024-08-17T02:25:10.709 INFO:tasks.ceph.mds.c:Started 2024-08-17T02:25:10.709 DEBUG:teuthology.parallel:result is None 2024-08-17T02:25:10.710 INFO:tasks.ceph.mds.d:Started 2024-08-17T02:25:10.710 DEBUG:teuthology.parallel:result is None 2024-08-17T02:25:10.711 INFO:tasks.ceph.mds.a:Started 2024-08-17T02:25:10.711 DEBUG:teuthology.parallel:result is None 2024-08-17T02:25:10.712 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-08-17T02:25:10.835 INFO:tasks.ceph.mds.c.smithi107.stdout:starting mds.c at 2024-08-17T02:25:10.835 INFO:tasks.ceph.mds.a.smithi107.stdout:starting mds.a at 2024-08-17T02:25:10.839 INFO:tasks.ceph.mds.b.smithi157.stdout:starting mds.b at 2024-08-17T02:25:10.840 INFO:tasks.ceph.mds.d.smithi157.stdout:starting mds.d at 2024-08-17T02:25:10.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.869+0000 7f6be6000640 1 Processor -- start 2024-08-17T02:25:10.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.870+0000 7f6be6000640 1 -- start start 2024-08-17T02:25:10.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.871+0000 7f6be6000640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6be0159ca0 0x7f6be00ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:10.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.871+0000 7f6be6000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6be00ccca0 0x7f6be0162860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:10.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.871+0000 7f6be6000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6be00cadc0 con 0x7f6be00ca8a0 2024-08-17T02:25:10.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.871+0000 7f6be6000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6be00cd6e0 con 0x7f6be00ccca0 2024-08-17T02:25:10.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.871+0000 7f6be6000640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6be00cb060 con 0x7f6be0159ca0 2024-08-17T02:25:10.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.871+0000 7f6be4c00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6be0159ca0 0x7f6be00ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:10.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.871+0000 7f6be5600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6be00ccca0 0x7f6be0162860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:10.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.871+0000 7f6be4c00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6be0159ca0 0x7f6be00ca360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:48614/0 (socket says 172.21.15.107:48614) 2024-08-17T02:25:10.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.871+0000 7f6be4c00640 1 -- 172.21.15.107:0/972311812 learned_addr learned my addr 172.21.15.107:0/972311812 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:10.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.871+0000 7f6be4c00640 1 -- 172.21.15.107:0/972311812 >> v2:172.21.15.107:3300/0 conn(0x7f6be00ccca0 msgr2=0x7f6be0162860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:10.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.871+0000 7f6be4c00640 1 --2- 172.21.15.107:0/972311812 >> v2:172.21.15.107:3300/0 conn(0x7f6be00ccca0 0x7f6be0162860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:10.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.871+0000 7f6be4c00640 1 -- 172.21.15.107:0/972311812 >> v1:172.21.15.107:6789/0 conn(0x7f6be00ca8a0 legacy=0x7f6be00cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:10.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.871+0000 7f6be4c00640 1 -- 172.21.15.107:0/972311812 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be00cb300 con 0x7f6be0159ca0 2024-08-17T02:25:10.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.872+0000 7f6be4c00640 1 --2- 172.21.15.107:0/972311812 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6be0159ca0 0x7f6be00ca360 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6be008a320 tx=0x7f6bd00091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72e12d29ef354a39 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:10.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.873+0000 7f6bdfe00640 1 -- 172.21.15.107:0/972311812 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd002ae70 con 0x7f6be0159ca0 2024-08-17T02:25:10.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.873+0000 7f6bdfe00640 1 -- 172.21.15.107:0/972311812 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd0032440 con 0x7f6be0159ca0 2024-08-17T02:25:10.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.873+0000 7f6bdfe00640 1 -- 172.21.15.107:0/972311812 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd0032820 con 0x7f6be0159ca0 2024-08-17T02:25:10.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.873+0000 7f6be6000640 1 -- 172.21.15.107:0/972311812 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6be0159ca0 msgr2=0x7f6be00ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:10.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.873+0000 7f6be6000640 1 --2- 172.21.15.107:0/972311812 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6be0159ca0 0x7f6be00ca360 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6be008a320 tx=0x7f6bd00091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:10.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.873+0000 7f6be6000640 1 -- 172.21.15.107:0/972311812 shutdown_connections 2024-08-17T02:25:10.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.873+0000 7f6be6000640 1 --2- 172.21.15.107:0/972311812 >> v2:172.21.15.107:3300/0 conn(0x7f6be00ccca0 0x7f6be0162860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:10.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.873+0000 7f6be6000640 1 --2- 172.21.15.107:0/972311812 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6be0159ca0 0x7f6be00ca360 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:10.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.873+0000 7f6be6000640 1 -- 172.21.15.107:0/972311812 >> 172.21.15.107:0/972311812 conn(0x7f6be0098e00 msgr2=0x7f6be006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:10.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.874+0000 7f6be6000640 1 -- 172.21.15.107:0/972311812 shutdown_connections 2024-08-17T02:25:10.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.874+0000 7f6be6000640 1 -- 172.21.15.107:0/972311812 wait complete. 2024-08-17T02:25:10.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.875+0000 7f6be6000640 1 Processor -- start 2024-08-17T02:25:10.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.875+0000 7f6be6000640 1 -- start start 2024-08-17T02:25:10.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.876+0000 7f6be6000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6be00ca8a0 0x7f6be00c9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:10.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.876+0000 7f6be6000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6be00ccca0 0x7f6be00c6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:10.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.876+0000 7f6be6000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6be0159ca0 0x7f6be0168e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:10.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.876+0000 7f6be6000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be00c77d0 con 0x7f6be00ca8a0 2024-08-17T02:25:10.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.876+0000 7f6be6000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be00c7c60 con 0x7f6be00ccca0 2024-08-17T02:25:10.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.876+0000 7f6be6000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be00c6bc0 con 0x7f6be0159ca0 2024-08-17T02:25:10.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.876+0000 7f6be4c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6be00ca8a0 0x7f6be00c9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:10.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.876+0000 7f6be4c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6be00ca8a0 0x7f6be00c9300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51730/0 (socket says 172.21.15.107:51730) 2024-08-17T02:25:10.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.876+0000 7f6be4c00640 1 -- 172.21.15.107:0/1435889247 learned_addr learned my addr 172.21.15.107:0/1435889247 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:10.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.877+0000 7f6be5600640 1 --2- 172.21.15.107:0/1435889247 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6be0159ca0 0x7f6be0168e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:10.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.877+0000 7f6bd7e00640 1 --2- 172.21.15.107:0/1435889247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6be00ccca0 0x7f6be00c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:10.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.877+0000 7f6be4c00640 1 -- 172.21.15.107:0/1435889247 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6be0159ca0 msgr2=0x7f6be0168e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:10.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.877+0000 7f6be4c00640 1 --2- 172.21.15.107:0/1435889247 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6be0159ca0 0x7f6be0168e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:10.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.877+0000 7f6be4c00640 1 -- 172.21.15.107:0/1435889247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6be00ccca0 msgr2=0x7f6be00c6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:10.879 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.877+0000 7f6be4c00640 1 --2- 172.21.15.107:0/1435889247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6be00ccca0 0x7f6be00c6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:10.879 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.877+0000 7f6be4c00640 1 -- 172.21.15.107:0/1435889247 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd0009450 con 0x7f6be00ca8a0 2024-08-17T02:25:10.879 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.877+0000 7f6bd7e00640 1 --2- 172.21.15.107:0/1435889247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6be00ccca0 0x7f6be00c6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:10.879 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.877+0000 7f6be5600640 1 --2- 172.21.15.107:0/1435889247 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6be0159ca0 0x7f6be0168e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:10.879 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.877+0000 7f6be4c00640 1 --2- 172.21.15.107:0/1435889247 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6be00ca8a0 0x7f6be00c9300 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0009210 tx=0x7f6bd0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:10.879 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.877+0000 7f6bdcc00640 1 -- 172.21.15.107:0/1435889247 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd0031c80 con 0x7f6be00ca8a0 2024-08-17T02:25:10.879 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.877+0000 7f6bdcc00640 1 -- 172.21.15.107:0/1435889247 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd0031e00 con 0x7f6be00ca8a0 2024-08-17T02:25:10.879 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.877+0000 7f6bdcc00640 1 -- 172.21.15.107:0/1435889247 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd003d670 con 0x7f6be00ca8a0 2024-08-17T02:25:10.879 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.877+0000 7f6be6000640 1 -- 172.21.15.107:0/1435889247 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6be00c6ea0 con 0x7f6be00ca8a0 2024-08-17T02:25:10.879 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.877+0000 7f6be6000640 1 -- 172.21.15.107:0/1435889247 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be00c7460 con 0x7f6be00ca8a0 2024-08-17T02:25:10.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.878+0000 7f6be6000640 1 -- 172.21.15.107:0/1435889247 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6be0071050 con 0x7f6be00ca8a0 2024-08-17T02:25:10.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.879+0000 7f6bdcc00640 1 -- 172.21.15.107:0/1435889247 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6bd0039040 con 0x7f6be00ca8a0 2024-08-17T02:25:10.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.880+0000 7f6bdcc00640 1 --2- 172.21.15.107:0/1435889247 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6bbc065150 0x7f6bbc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:10.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.880+0000 7f6bdcc00640 1 -- 172.21.15.107:0/1435889247 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f6bd00a1ff0 con 0x7f6be00ca8a0 2024-08-17T02:25:10.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.880+0000 7f6bd7e00640 1 --2- 172.21.15.107:0/1435889247 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6bbc065150 0x7f6bbc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:10.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.881+0000 7f6bd7e00640 1 --2- 172.21.15.107:0/1435889247 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6bbc065150 0x7f6bbc067600 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6be009a050 tx=0x7f6bc8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:10.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:10.884+0000 7f6bdcc00640 1 -- 172.21.15.107:0/1435889247 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6bd0070370 con 0x7f6be00ca8a0 2024-08-17T02:25:11.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.068+0000 7f6be6000640 1 -- 172.21.15.107:0/1435889247 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f6be00698f0 con 0x7f6be00ca8a0 2024-08-17T02:25:11.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.639+0000 7f6bdcc00640 1 -- 172.21.15.107:0/1435889247 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6bd0073990 con 0x7f6be00ca8a0 2024-08-17T02:25:11.640 INFO:teuthology.orchestra.run.smithi107.stderr: removed all blocklist entries 2024-08-17T02:25:11.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.642+0000 7f6be6000640 1 -- 172.21.15.107:0/1435889247 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6bbc065150 msgr2=0x7f6bbc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:11.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.642+0000 7f6be6000640 1 --2- 172.21.15.107:0/1435889247 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6bbc065150 0x7f6bbc067600 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6be009a050 tx=0x7f6bc8009040 comp rx=0 tx=0).stop 2024-08-17T02:25:11.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.642+0000 7f6be6000640 1 -- 172.21.15.107:0/1435889247 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6be00ca8a0 msgr2=0x7f6be00c9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:11.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.642+0000 7f6be6000640 1 --2- 172.21.15.107:0/1435889247 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6be00ca8a0 0x7f6be00c9300 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0009210 tx=0x7f6bd0032000 comp rx=0 tx=0).stop 2024-08-17T02:25:11.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.642+0000 7f6be6000640 1 -- 172.21.15.107:0/1435889247 shutdown_connections 2024-08-17T02:25:11.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.642+0000 7f6be6000640 1 --2- 172.21.15.107:0/1435889247 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6bbc065150 0x7f6bbc067600 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.642+0000 7f6be6000640 1 --2- 172.21.15.107:0/1435889247 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6be0159ca0 0x7f6be0168e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.642+0000 7f6be6000640 1 --2- 172.21.15.107:0/1435889247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6be00ccca0 0x7f6be00c6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.642+0000 7f6be6000640 1 --2- 172.21.15.107:0/1435889247 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6be00ca8a0 0x7f6be00c9300 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.642+0000 7f6be6000640 1 -- 172.21.15.107:0/1435889247 >> 172.21.15.107:0/1435889247 conn(0x7f6be0098e00 msgr2=0x7f6be0156de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:11.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.642+0000 7f6be6000640 1 -- 172.21.15.107:0/1435889247 shutdown_connections 2024-08-17T02:25:11.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.642+0000 7f6be6000640 1 -- 172.21.15.107:0/1435889247 wait complete. 2024-08-17T02:25:11.659 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-08-17T02:25:11.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.809+0000 7f488b400640 1 Processor -- start 2024-08-17T02:25:11.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.809+0000 7f488b400640 1 -- start start 2024-08-17T02:25:11.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.810+0000 7f488b400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4884155a20 0x7f48840adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:11.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.810+0000 7f488b400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4884155df0 0x7f48840ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:11.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.810+0000 7f488b400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4884156670 con 0x7f488406d7f0 2024-08-17T02:25:11.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.810+0000 7f488b400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48840b0350 con 0x7f4884155a20 2024-08-17T02:25:11.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.810+0000 7f488b400640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f488406e5e0 con 0x7f4884155df0 2024-08-17T02:25:11.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.810+0000 7f4888a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4884155a20 0x7f48840adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:11.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.810+0000 7f4889400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f488406d7f0 0x7f48840ac790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:59654/0 (socket says 172.21.15.107:59654) 2024-08-17T02:25:11.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.810+0000 7f4889400640 1 -- 172.21.15.107:0/1018892060 learned_addr learned my addr 172.21.15.107:0/1018892060 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:25:11.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.811+0000 7f4883e00640 1 --2- 172.21.15.107:0/1018892060 >> v2:172.21.15.157:3300/0 conn(0x7f4884155df0 0x7f48840ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:11.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.811+0000 7f4888a00640 1 -- 172.21.15.107:0/1018892060 >> v2:172.21.15.157:3300/0 conn(0x7f4884155df0 msgr2=0x7f48840ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:11.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.811+0000 7f4888a00640 1 --2- 172.21.15.107:0/1018892060 >> v2:172.21.15.157:3300/0 conn(0x7f4884155df0 0x7f48840ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.811+0000 7f4888a00640 1 -- 172.21.15.107:0/1018892060 >> v1:172.21.15.107:6789/0 conn(0x7f488406d7f0 legacy=0x7f48840ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:11.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.811+0000 7f4888a00640 1 -- 172.21.15.107:0/1018892060 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f488406e8c0 con 0x7f4884155a20 2024-08-17T02:25:11.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.812+0000 7f4888a00640 1 --2- 172.21.15.107:0/1018892060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4884155a20 0x7f48840adf10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f488406aa10 tx=0x7f48780090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25ed7dd37e0c0f7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:11.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.812+0000 7f4883400640 1 -- 172.21.15.107:0/1018892060 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487802adb0 con 0x7f4884155a20 2024-08-17T02:25:11.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.812+0000 7f4883400640 1 -- 172.21.15.107:0/1018892060 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4878032440 con 0x7f4884155a20 2024-08-17T02:25:11.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.812+0000 7f4883400640 1 -- 172.21.15.107:0/1018892060 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4878032820 con 0x7f4884155a20 2024-08-17T02:25:11.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.813+0000 7f488b400640 1 -- 172.21.15.107:0/1018892060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4884155a20 msgr2=0x7f48840adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:11.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.813+0000 7f488b400640 1 --2- 172.21.15.107:0/1018892060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4884155a20 0x7f48840adf10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f488406aa10 tx=0x7f48780090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.813+0000 7f488b400640 1 -- 172.21.15.107:0/1018892060 shutdown_connections 2024-08-17T02:25:11.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.813+0000 7f488b400640 1 --2- 172.21.15.107:0/1018892060 >> v2:172.21.15.157:3300/0 conn(0x7f4884155df0 0x7f48840ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.813+0000 7f488b400640 1 --2- 172.21.15.107:0/1018892060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4884155a20 0x7f48840adf10 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.813+0000 7f488b400640 1 -- 172.21.15.107:0/1018892060 >> 172.21.15.107:0/1018892060 conn(0x7f48840cb9b0 msgr2=0x7f48840cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:11.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.813+0000 7f488b400640 1 -- 172.21.15.107:0/1018892060 shutdown_connections 2024-08-17T02:25:11.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.813+0000 7f488b400640 1 -- 172.21.15.107:0/1018892060 wait complete. 2024-08-17T02:25:11.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.814+0000 7f488b400640 1 Processor -- start 2024-08-17T02:25:11.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.815+0000 7f488b400640 1 -- start start 2024-08-17T02:25:11.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.815+0000 7f488b400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f488406d7f0 0x7f48840ac800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:11.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.815+0000 7f488b400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4884155a20 0x7f48840acd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:11.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.815+0000 7f488b400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4884155df0 0x7f488416c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:11.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.815+0000 7f488b400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4884166ba0 con 0x7f488406d7f0 2024-08-17T02:25:11.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.815+0000 7f488b400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4884167160 con 0x7f4884155df0 2024-08-17T02:25:11.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.815+0000 7f488b400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4884069e80 con 0x7f4884155a20 2024-08-17T02:25:11.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.816+0000 7f4888a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f488406d7f0 0x7f48840ac800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:11.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.816+0000 7f4888a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f488406d7f0 0x7f48840ac800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51750/0 (socket says 172.21.15.107:51750) 2024-08-17T02:25:11.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.816+0000 7f4888a00640 1 -- 172.21.15.107:0/77063755 learned_addr learned my addr 172.21.15.107:0/77063755 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:11.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.816+0000 7f4883e00640 1 --2- 172.21.15.107:0/77063755 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4884155a20 0x7f48840acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:11.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.816+0000 7f4889400640 1 --2- 172.21.15.107:0/77063755 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4884155df0 0x7f488416c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:11.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.816+0000 7f4883e00640 1 -- 172.21.15.107:0/77063755 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4884155df0 msgr2=0x7f488416c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:11.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.816+0000 7f4883e00640 1 --2- 172.21.15.107:0/77063755 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4884155df0 0x7f488416c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.816+0000 7f4883e00640 1 -- 172.21.15.107:0/77063755 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f488406d7f0 msgr2=0x7f48840ac800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:11.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.816+0000 7f4883e00640 1 --2- 172.21.15.107:0/77063755 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f488406d7f0 0x7f48840ac800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.816+0000 7f4883e00640 1 -- 172.21.15.107:0/77063755 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4878009390 con 0x7f4884155a20 2024-08-17T02:25:11.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.816+0000 7f4888a00640 1 --2- 172.21.15.107:0/77063755 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f488406d7f0 0x7f48840ac800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:11.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.816+0000 7f4883e00640 1 --2- 172.21.15.107:0/77063755 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4884155a20 0x7f48840acd40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f487000e900 tx=0x7f48700090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:11.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.817+0000 7f4877e00640 1 -- 172.21.15.107:0/77063755 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487000ee90 con 0x7f4884155a20 2024-08-17T02:25:11.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.817+0000 7f4877e00640 1 -- 172.21.15.107:0/77063755 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f487000c940 con 0x7f4884155a20 2024-08-17T02:25:11.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.817+0000 7f4877e00640 1 -- 172.21.15.107:0/77063755 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487000cd00 con 0x7f4884155a20 2024-08-17T02:25:11.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.817+0000 7f488b400640 1 -- 172.21.15.107:0/77063755 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f488406a160 con 0x7f4884155a20 2024-08-17T02:25:11.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.817+0000 7f488b400640 1 -- 172.21.15.107:0/77063755 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f488416caa0 con 0x7f4884155a20 2024-08-17T02:25:11.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.818+0000 7f488b400640 1 -- 172.21.15.107:0/77063755 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48841672f0 con 0x7f4884155a20 2024-08-17T02:25:11.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.819+0000 7f4877e00640 1 -- 172.21.15.107:0/77063755 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4870013680 con 0x7f4884155a20 2024-08-17T02:25:11.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.819+0000 7f4877e00640 1 --2- 172.21.15.107:0/77063755 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4864065150 0x7f4864067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:11.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.820+0000 7f4877e00640 1 -- 172.21.15.107:0/77063755 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f48700821b0 con 0x7f4884155a20 2024-08-17T02:25:11.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.820+0000 7f4888a00640 1 --2- 172.21.15.107:0/77063755 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4864065150 0x7f4864067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:11.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.820+0000 7f4888a00640 1 --2- 172.21.15.107:0/77063755 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4864065150 0x7f4864067600 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f48780030c0 tx=0x7f4878032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:11.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:11.824+0000 7f4877e00640 1 -- 172.21.15.107:0/77063755 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f48700505d0 con 0x7f4884155a20 2024-08-17T02:25:12.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.055+0000 7f488b400640 1 -- 172.21.15.107:0/77063755 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f4884064db0 con 0x7f4884155a20 2024-08-17T02:25:12.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.056+0000 7f4877e00640 1 -- 172.21.15.107:0/77063755 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f4870059020 con 0x7f4884155a20 2024-08-17T02:25:12.056 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:25:12.056 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-08-17T02:25:12.056 INFO:teuthology.orchestra.run.smithi107.stdout: "auth_dump": [ 2024-08-17T02:25:12.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-08-17T02:25:12.056 INFO:teuthology.orchestra.run.smithi107.stdout: "entity": "mds.a", 2024-08-17T02:25:12.056 INFO:teuthology.orchestra.run.smithi107.stdout: "key": "AQCpCcBmxPRCDRAAhT78Gnl8jk0XJW0wGCxrfA==", 2024-08-17T02:25:12.057 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": { 2024-08-17T02:25:12.057 INFO:teuthology.orchestra.run.smithi107.stdout: "mds": "allow", 2024-08-17T02:25:12.057 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr": "allow *", 2024-08-17T02:25:12.057 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": "allow *", 2024-08-17T02:25:12.057 INFO:teuthology.orchestra.run.smithi107.stdout: "osd": "allow *" 2024-08-17T02:25:12.057 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-08-17T02:25:12.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-08-17T02:25:12.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-08-17T02:25:12.057 INFO:teuthology.orchestra.run.smithi107.stdout: "entity": "mds.b", 2024-08-17T02:25:12.057 INFO:teuthology.orchestra.run.smithi107.stdout: "key": "AQCpCcBmLnAfIBAAVyO94XU3FmnxBY9RysDzVw==", 2024-08-17T02:25:12.057 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": { 2024-08-17T02:25:12.058 INFO:teuthology.orchestra.run.smithi107.stdout: "mds": "allow", 2024-08-17T02:25:12.058 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr": "allow *", 2024-08-17T02:25:12.058 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": "allow *", 2024-08-17T02:25:12.058 INFO:teuthology.orchestra.run.smithi107.stdout: "osd": "allow *" 2024-08-17T02:25:12.058 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-08-17T02:25:12.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-08-17T02:25:12.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-08-17T02:25:12.058 INFO:teuthology.orchestra.run.smithi107.stdout: "entity": "mds.c", 2024-08-17T02:25:12.059 INFO:teuthology.orchestra.run.smithi107.stdout: "key": "AQCpCcBmr+mcFhAAKFHlxANodo399NowgZyKhg==", 2024-08-17T02:25:12.059 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": { 2024-08-17T02:25:12.059 INFO:teuthology.orchestra.run.smithi107.stdout: "mds": "allow", 2024-08-17T02:25:12.059 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr": "allow *", 2024-08-17T02:25:12.059 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": "allow *", 2024-08-17T02:25:12.059 INFO:teuthology.orchestra.run.smithi107.stdout: "osd": "allow *" 2024-08-17T02:25:12.059 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-08-17T02:25:12.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-08-17T02:25:12.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-08-17T02:25:12.059 INFO:teuthology.orchestra.run.smithi107.stdout: "entity": "mds.d", 2024-08-17T02:25:12.059 INFO:teuthology.orchestra.run.smithi107.stdout: "key": "AQCpCcBmmqiRKRAA5siSxI57VLYZBbMm3CwjGA==", 2024-08-17T02:25:12.059 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": { 2024-08-17T02:25:12.060 INFO:teuthology.orchestra.run.smithi107.stdout: "mds": "allow", 2024-08-17T02:25:12.060 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr": "allow *", 2024-08-17T02:25:12.060 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": "allow *", 2024-08-17T02:25:12.060 INFO:teuthology.orchestra.run.smithi107.stdout: "osd": "allow *" 2024-08-17T02:25:12.060 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-08-17T02:25:12.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-08-17T02:25:12.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-08-17T02:25:12.060 INFO:teuthology.orchestra.run.smithi107.stdout: "entity": "osd.0", 2024-08-17T02:25:12.060 INFO:teuthology.orchestra.run.smithi107.stdout: "key": "AQCtCcBm+VcmAhAAtkGTP+l6geE4odiK8RiL9w==", 2024-08-17T02:25:12.060 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": { 2024-08-17T02:25:12.060 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr": "allow profile osd", 2024-08-17T02:25:12.060 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": "allow profile osd", 2024-08-17T02:25:12.060 INFO:teuthology.orchestra.run.smithi107.stdout: "osd": "allow *" 2024-08-17T02:25:12.061 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-08-17T02:25:12.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-08-17T02:25:12.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-08-17T02:25:12.061 INFO:teuthology.orchestra.run.smithi107.stdout: "entity": "osd.1", 2024-08-17T02:25:12.061 INFO:teuthology.orchestra.run.smithi107.stdout: "key": "AQCwCcBm7EGKBhAAgVz+H8m/NKAt4rabJK2n8A==", 2024-08-17T02:25:12.061 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": { 2024-08-17T02:25:12.061 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr": "allow profile osd", 2024-08-17T02:25:12.061 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": "allow profile osd", 2024-08-17T02:25:12.061 INFO:teuthology.orchestra.run.smithi107.stdout: "osd": "allow *" 2024-08-17T02:25:12.061 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-08-17T02:25:12.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-08-17T02:25:12.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-08-17T02:25:12.062 INFO:teuthology.orchestra.run.smithi107.stdout: "entity": "osd.2", 2024-08-17T02:25:12.062 INFO:teuthology.orchestra.run.smithi107.stdout: "key": "AQCzCcBmpApdCRAApp3QoHpsQ6zn/5HDWqj7CQ==", 2024-08-17T02:25:12.062 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": { 2024-08-17T02:25:12.062 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr": "allow profile osd", 2024-08-17T02:25:12.062 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": "allow profile osd", 2024-08-17T02:25:12.062 INFO:teuthology.orchestra.run.smithi107.stdout: "osd": "allow *" 2024-08-17T02:25:12.062 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-08-17T02:25:12.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-08-17T02:25:12.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-08-17T02:25:12.062 INFO:teuthology.orchestra.run.smithi107.stdout: "entity": "osd.3", 2024-08-17T02:25:12.062 INFO:teuthology.orchestra.run.smithi107.stdout: "key": "AQC2CcBmi5GQDRAA3AIW/HKLm7h2QhhCBfeiSQ==", 2024-08-17T02:25:12.062 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": { 2024-08-17T02:25:12.063 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr": "allow profile osd", 2024-08-17T02:25:12.063 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": "allow profile osd", 2024-08-17T02:25:12.063 INFO:teuthology.orchestra.run.smithi107.stdout: "osd": "allow *" 2024-08-17T02:25:12.063 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-08-17T02:25:12.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-08-17T02:25:12.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-08-17T02:25:12.063 INFO:teuthology.orchestra.run.smithi107.stdout: "entity": "osd.4", 2024-08-17T02:25:12.063 INFO:teuthology.orchestra.run.smithi107.stdout: "key": "AQC6CcBmvHHrHhAAPjwOr8n7O3uLl4sUZvKevQ==", 2024-08-17T02:25:12.063 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": { 2024-08-17T02:25:12.063 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr": "allow profile osd", 2024-08-17T02:25:12.063 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": "allow profile osd", 2024-08-17T02:25:12.063 INFO:teuthology.orchestra.run.smithi107.stdout: "osd": "allow *" 2024-08-17T02:25:12.064 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-08-17T02:25:12.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-08-17T02:25:12.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-08-17T02:25:12.064 INFO:teuthology.orchestra.run.smithi107.stdout: "entity": "osd.5", 2024-08-17T02:25:12.064 INFO:teuthology.orchestra.run.smithi107.stdout: "key": "AQC9CcBmEPwNJBAAUOLYp0TLPCSHaqJ2Bh4SMA==", 2024-08-17T02:25:12.064 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": { 2024-08-17T02:25:12.064 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr": "allow profile osd", 2024-08-17T02:25:12.064 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": "allow profile osd", 2024-08-17T02:25:12.064 INFO:teuthology.orchestra.run.smithi107.stdout: "osd": "allow *" 2024-08-17T02:25:12.064 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-08-17T02:25:12.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-08-17T02:25:12.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-08-17T02:25:12.064 INFO:teuthology.orchestra.run.smithi107.stdout: "entity": "osd.6", 2024-08-17T02:25:12.065 INFO:teuthology.orchestra.run.smithi107.stdout: "key": "AQDACcBmXHEtJxAA8yOvl/+o8ENwwOTaMlZfww==", 2024-08-17T02:25:12.065 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": { 2024-08-17T02:25:12.065 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr": "allow profile osd", 2024-08-17T02:25:12.065 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": "allow profile osd", 2024-08-17T02:25:12.065 INFO:teuthology.orchestra.run.smithi107.stdout: "osd": "allow *" 2024-08-17T02:25:12.065 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-08-17T02:25:12.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-08-17T02:25:12.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-08-17T02:25:12.066 INFO:teuthology.orchestra.run.smithi107.stdout: "entity": "osd.7", 2024-08-17T02:25:12.066 INFO:teuthology.orchestra.run.smithi107.stdout: "key": "AQDDCcBmGAUGKxAAwuCBNbKgcBVcAz5rdBgtxw==", 2024-08-17T02:25:12.066 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": { 2024-08-17T02:25:12.066 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr": "allow profile osd", 2024-08-17T02:25:12.066 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": "allow profile osd", 2024-08-17T02:25:12.066 INFO:teuthology.orchestra.run.smithi107.stdout: "osd": "allow *" 2024-08-17T02:25:12.066 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-08-17T02:25:12.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-08-17T02:25:12.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-08-17T02:25:12.066 INFO:teuthology.orchestra.run.smithi107.stdout: "entity": "client.0", 2024-08-17T02:25:12.066 INFO:teuthology.orchestra.run.smithi107.stdout: "key": "AQCpCcBmWtSxMRAArb++PjeYtDeqQLOQqVxZxw==", 2024-08-17T02:25:12.067 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": { 2024-08-17T02:25:12.067 INFO:teuthology.orchestra.run.smithi107.stdout: "mds": "allow", 2024-08-17T02:25:12.067 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr": "allow r", 2024-08-17T02:25:12.067 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": "allow rw", 2024-08-17T02:25:12.067 INFO:teuthology.orchestra.run.smithi107.stdout: "osd": "allow rwx" 2024-08-17T02:25:12.067 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-08-17T02:25:12.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-08-17T02:25:12.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-08-17T02:25:12.067 INFO:teuthology.orchestra.run.smithi107.stdout: "entity": "client.1", 2024-08-17T02:25:12.067 INFO:teuthology.orchestra.run.smithi107.stdout: "key": "AQCqCcBmowBOAxAAZnOJ1GCJDMLGy8u5FxjsWw==", 2024-08-17T02:25:12.067 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": { 2024-08-17T02:25:12.067 INFO:teuthology.orchestra.run.smithi107.stdout: "mds": "allow", 2024-08-17T02:25:12.067 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr": "allow r", 2024-08-17T02:25:12.068 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": "allow rw", 2024-08-17T02:25:12.068 INFO:teuthology.orchestra.run.smithi107.stdout: "osd": "allow rwx" 2024-08-17T02:25:12.068 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-08-17T02:25:12.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-08-17T02:25:12.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-08-17T02:25:12.068 INFO:teuthology.orchestra.run.smithi107.stdout: "entity": "client.2", 2024-08-17T02:25:12.068 INFO:teuthology.orchestra.run.smithi107.stdout: "key": "AQCpCcBmjbS4NxAAe8XtbKcfcmi1loSpHk2/5Q==", 2024-08-17T02:25:12.068 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": { 2024-08-17T02:25:12.068 INFO:teuthology.orchestra.run.smithi107.stdout: "mds": "allow", 2024-08-17T02:25:12.068 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr": "allow r", 2024-08-17T02:25:12.068 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": "allow rw", 2024-08-17T02:25:12.068 INFO:teuthology.orchestra.run.smithi107.stdout: "osd": "allow rwx" 2024-08-17T02:25:12.068 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-08-17T02:25:12.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-08-17T02:25:12.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-08-17T02:25:12.069 INFO:teuthology.orchestra.run.smithi107.stdout: "entity": "client.3", 2024-08-17T02:25:12.069 INFO:teuthology.orchestra.run.smithi107.stdout: "key": "AQCqCcBmXPhnCRAAVN8EdxDnGz/2Pf2yrIwZ6g==", 2024-08-17T02:25:12.069 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": { 2024-08-17T02:25:12.069 INFO:teuthology.orchestra.run.smithi107.stdout: "mds": "allow", 2024-08-17T02:25:12.069 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr": "allow r", 2024-08-17T02:25:12.069 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": "allow rw", 2024-08-17T02:25:12.069 INFO:teuthology.orchestra.run.smithi107.stdout: "osd": "allow rwx" 2024-08-17T02:25:12.069 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-08-17T02:25:12.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-08-17T02:25:12.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-08-17T02:25:12.069 INFO:teuthology.orchestra.run.smithi107.stdout: "entity": "client.admin", 2024-08-17T02:25:12.070 INFO:teuthology.orchestra.run.smithi107.stdout: "key": "AQCoCcBmnybRGRAAfB14quRXFbsQH8skBkx6pg==", 2024-08-17T02:25:12.070 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": { 2024-08-17T02:25:12.070 INFO:teuthology.orchestra.run.smithi107.stdout: "mds": "allow *", 2024-08-17T02:25:12.070 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr": "allow *", 2024-08-17T02:25:12.070 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": "allow *", 2024-08-17T02:25:12.070 INFO:teuthology.orchestra.run.smithi107.stdout: "osd": "allow *" 2024-08-17T02:25:12.070 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-08-17T02:25:12.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-08-17T02:25:12.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-08-17T02:25:12.070 INFO:teuthology.orchestra.run.smithi107.stdout: "entity": "client.bootstrap-mds", 2024-08-17T02:25:12.070 INFO:teuthology.orchestra.run.smithi107.stdout: "key": "AQDLCcBmZWJMAhAAo5+APZE4hNBsE2fD1dmJ+A==", 2024-08-17T02:25:12.070 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": { 2024-08-17T02:25:12.070 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": "allow profile bootstrap-mds" 2024-08-17T02:25:12.071 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-08-17T02:25:12.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-08-17T02:25:12.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-08-17T02:25:12.071 INFO:teuthology.orchestra.run.smithi107.stdout: "entity": "client.bootstrap-mgr", 2024-08-17T02:25:12.071 INFO:teuthology.orchestra.run.smithi107.stdout: "key": "AQDLCcBmUGxMAhAATqXKM3JsJseigEaAZVNXEQ==", 2024-08-17T02:25:12.071 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": { 2024-08-17T02:25:12.071 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": "allow profile bootstrap-mgr" 2024-08-17T02:25:12.071 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-08-17T02:25:12.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-08-17T02:25:12.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-08-17T02:25:12.071 INFO:teuthology.orchestra.run.smithi107.stdout: "entity": "client.bootstrap-osd", 2024-08-17T02:25:12.071 INFO:teuthology.orchestra.run.smithi107.stdout: "key": "AQDLCcBm/HRMAhAAaX4HwSXwbNH3cyzCGo/Gew==", 2024-08-17T02:25:12.071 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": { 2024-08-17T02:25:12.071 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": "allow profile bootstrap-osd" 2024-08-17T02:25:12.071 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-08-17T02:25:12.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-08-17T02:25:12.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-08-17T02:25:12.072 INFO:teuthology.orchestra.run.smithi107.stdout: "entity": "client.bootstrap-rbd", 2024-08-17T02:25:12.072 INFO:teuthology.orchestra.run.smithi107.stdout: "key": "AQDLCcBm/XxMAhAAfCSgPPjdFuh4Qov1Od6q1g==", 2024-08-17T02:25:12.072 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": { 2024-08-17T02:25:12.072 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": "allow profile bootstrap-rbd" 2024-08-17T02:25:12.072 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-08-17T02:25:12.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-08-17T02:25:12.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-08-17T02:25:12.072 INFO:teuthology.orchestra.run.smithi107.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-08-17T02:25:12.072 INFO:teuthology.orchestra.run.smithi107.stdout: "key": "AQDLCcBmZ4ZMAhAA54r5TenZ/GSptEnSvbeIGA==", 2024-08-17T02:25:12.072 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": { 2024-08-17T02:25:12.072 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-08-17T02:25:12.073 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-08-17T02:25:12.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-08-17T02:25:12.073 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-08-17T02:25:12.073 INFO:teuthology.orchestra.run.smithi107.stdout: "entity": "client.bootstrap-rgw", 2024-08-17T02:25:12.073 INFO:teuthology.orchestra.run.smithi107.stdout: "key": "AQDLCcBmP5BMAhAAVjW1aCIlZjKVkQhOLxO6Ug==", 2024-08-17T02:25:12.073 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": { 2024-08-17T02:25:12.073 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": "allow profile bootstrap-rgw" 2024-08-17T02:25:12.073 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-08-17T02:25:12.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-08-17T02:25:12.073 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-08-17T02:25:12.073 INFO:teuthology.orchestra.run.smithi107.stdout: "entity": "mgr.x", 2024-08-17T02:25:12.073 INFO:teuthology.orchestra.run.smithi107.stdout: "key": "AQCpCcBmBlsHBxAA9Q+VtkQflrNzWt+JFzOk4A==", 2024-08-17T02:25:12.073 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": { 2024-08-17T02:25:12.073 INFO:teuthology.orchestra.run.smithi107.stdout: "mds": "allow *", 2024-08-17T02:25:12.074 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": "allow profile mgr", 2024-08-17T02:25:12.074 INFO:teuthology.orchestra.run.smithi107.stdout: "osd": "allow *" 2024-08-17T02:25:12.074 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-08-17T02:25:12.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-08-17T02:25:12.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-08-17T02:25:12.074 INFO:teuthology.orchestra.run.smithi107.stdout: "entity": "mgr.y", 2024-08-17T02:25:12.074 INFO:teuthology.orchestra.run.smithi107.stdout: "key": "AQCoCcBmXPRqOxAAR9ibILpYy+B7dvqJ7ikXgg==", 2024-08-17T02:25:12.074 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": { 2024-08-17T02:25:12.074 INFO:teuthology.orchestra.run.smithi107.stdout: "mds": "allow *", 2024-08-17T02:25:12.074 INFO:teuthology.orchestra.run.smithi107.stdout: "mon": "allow profile mgr", 2024-08-17T02:25:12.074 INFO:teuthology.orchestra.run.smithi107.stdout: "osd": "allow *" 2024-08-17T02:25:12.074 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-08-17T02:25:12.074 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-08-17T02:25:12.074 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-08-17T02:25:12.075 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-08-17T02:25:12.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.058+0000 7f488b400640 1 -- 172.21.15.107:0/77063755 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4864065150 msgr2=0x7f4864067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:12.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.058+0000 7f488b400640 1 --2- 172.21.15.107:0/77063755 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4864065150 0x7f4864067600 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f48780030c0 tx=0x7f4878032000 comp rx=0 tx=0).stop 2024-08-17T02:25:12.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.058+0000 7f488b400640 1 -- 172.21.15.107:0/77063755 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4884155a20 msgr2=0x7f48840acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:12.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.058+0000 7f488b400640 1 --2- 172.21.15.107:0/77063755 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4884155a20 0x7f48840acd40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f487000e900 tx=0x7f48700090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:12.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.058+0000 7f488b400640 1 -- 172.21.15.107:0/77063755 shutdown_connections 2024-08-17T02:25:12.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.058+0000 7f488b400640 1 --2- 172.21.15.107:0/77063755 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4864065150 0x7f4864067600 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:12.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.058+0000 7f488b400640 1 --2- 172.21.15.107:0/77063755 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4884155df0 0x7f488416c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:12.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.058+0000 7f488b400640 1 --2- 172.21.15.107:0/77063755 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4884155a20 0x7f48840acd40 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:12.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.058+0000 7f488b400640 1 --2- 172.21.15.107:0/77063755 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f488406d7f0 0x7f48840ac800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:12.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.058+0000 7f488b400640 1 -- 172.21.15.107:0/77063755 >> 172.21.15.107:0/77063755 conn(0x7f48840cb9b0 msgr2=0x7f48841530a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:12.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.058+0000 7f488b400640 1 -- 172.21.15.107:0/77063755 shutdown_connections 2024-08-17T02:25:12.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.058+0000 7f488b400640 1 -- 172.21.15.107:0/77063755 wait complete. 2024-08-17T02:25:12.077 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-08-17T02:25:12.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.225+0000 7f4c88800640 1 Processor -- start 2024-08-17T02:25:12.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.225+0000 7f4c88800640 1 -- start start 2024-08-17T02:25:12.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.226+0000 7f4c88800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4c80155a20 0x7f4c800adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:12.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.226+0000 7f4c88800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c80155df0 0x7f4c800ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:12.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.226+0000 7f4c88800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c80156670 con 0x7f4c8006d7f0 2024-08-17T02:25:12.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.226+0000 7f4c88800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c800b0350 con 0x7f4c80155a20 2024-08-17T02:25:12.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.226+0000 7f4c88800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8006e5e0 con 0x7f4c80155df0 2024-08-17T02:25:12.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.227+0000 7f4c85e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4c80155a20 0x7f4c800adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:12.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.227+0000 7f4c85e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4c80155a20 0x7f4c800adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51762/0 (socket says 172.21.15.107:51762) 2024-08-17T02:25:12.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.227+0000 7f4c85e00640 1 -- 172.21.15.107:0/2589527136 learned_addr learned my addr 172.21.15.107:0/2589527136 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:12.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.227+0000 7f4c85400640 1 --2- 172.21.15.107:0/2589527136 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c80155df0 0x7f4c800ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:12.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.227+0000 7f4c85e00640 1 -- 172.21.15.107:0/2589527136 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c80155df0 msgr2=0x7f4c800ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:12.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.227+0000 7f4c85e00640 1 --2- 172.21.15.107:0/2589527136 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c80155df0 0x7f4c800ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:12.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.227+0000 7f4c85e00640 1 -- 172.21.15.107:0/2589527136 >> v1:172.21.15.107:6789/0 conn(0x7f4c8006d7f0 legacy=0x7f4c800ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:12.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.227+0000 7f4c85e00640 1 -- 172.21.15.107:0/2589527136 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c8006e8c0 con 0x7f4c80155a20 2024-08-17T02:25:12.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.228+0000 7f4c85e00640 1 --2- 172.21.15.107:0/2589527136 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c80155a20 0x7f4c800adf10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4c74009910 tx=0x7f4c740091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef2a30c4b92a6dc2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:12.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.228+0000 7f4c84a00640 1 -- 172.21.15.107:0/2589527136 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7402ae40 con 0x7f4c80155a20 2024-08-17T02:25:12.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.228+0000 7f4c84a00640 1 -- 172.21.15.107:0/2589527136 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c74032440 con 0x7f4c80155a20 2024-08-17T02:25:12.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.228+0000 7f4c84a00640 1 -- 172.21.15.107:0/2589527136 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c74032820 con 0x7f4c80155a20 2024-08-17T02:25:12.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.229+0000 7f4c88800640 1 -- 172.21.15.107:0/2589527136 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c80155a20 msgr2=0x7f4c800adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:12.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.229+0000 7f4c88800640 1 --2- 172.21.15.107:0/2589527136 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c80155a20 0x7f4c800adf10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4c74009910 tx=0x7f4c740091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:12.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.229+0000 7f4c88800640 1 -- 172.21.15.107:0/2589527136 shutdown_connections 2024-08-17T02:25:12.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.229+0000 7f4c88800640 1 --2- 172.21.15.107:0/2589527136 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c80155df0 0x7f4c800ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:12.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.229+0000 7f4c88800640 1 --2- 172.21.15.107:0/2589527136 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c80155a20 0x7f4c800adf10 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:12.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.229+0000 7f4c88800640 1 -- 172.21.15.107:0/2589527136 >> 172.21.15.107:0/2589527136 conn(0x7f4c800cb9b0 msgr2=0x7f4c800cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:12.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.229+0000 7f4c88800640 1 -- 172.21.15.107:0/2589527136 shutdown_connections 2024-08-17T02:25:12.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.229+0000 7f4c88800640 1 -- 172.21.15.107:0/2589527136 wait complete. 2024-08-17T02:25:12.231 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.230+0000 7f4c88800640 1 Processor -- start 2024-08-17T02:25:12.231 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.231+0000 7f4c88800640 1 -- start start 2024-08-17T02:25:12.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.231+0000 7f4c88800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c8006d7f0 0x7f4c8013dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:12.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.231+0000 7f4c88800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c80155a20 0x7f4c8015e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:12.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.231+0000 7f4c88800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c80155df0 0x7f4c8015eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:12.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.231+0000 7f4c88800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8013e270 con 0x7f4c80155a20 2024-08-17T02:25:12.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.231+0000 7f4c88800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8015d100 con 0x7f4c8006d7f0 2024-08-17T02:25:12.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.231+0000 7f4c88800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8015f160 con 0x7f4c80155df0 2024-08-17T02:25:12.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.232+0000 7f4c85400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c80155a20 0x7f4c8015e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:12.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.232+0000 7f4c85400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c80155a20 0x7f4c8015e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51766/0 (socket says 172.21.15.107:51766) 2024-08-17T02:25:12.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.232+0000 7f4c85400640 1 -- 172.21.15.107:0/2833599662 learned_addr learned my addr 172.21.15.107:0/2833599662 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:12.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.232+0000 7f4c86800640 1 --2- 172.21.15.107:0/2833599662 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c80155df0 0x7f4c8015eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:12.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.232+0000 7f4c85e00640 1 --2- 172.21.15.107:0/2833599662 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c8006d7f0 0x7f4c8013dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:12.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.232+0000 7f4c85400640 1 -- 172.21.15.107:0/2833599662 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c80155df0 msgr2=0x7f4c8015eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:12.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.232+0000 7f4c85400640 1 --2- 172.21.15.107:0/2833599662 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c80155df0 0x7f4c8015eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:12.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.232+0000 7f4c85400640 1 -- 172.21.15.107:0/2833599662 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c8006d7f0 msgr2=0x7f4c8013dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:12.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.232+0000 7f4c85400640 1 --2- 172.21.15.107:0/2833599662 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c8006d7f0 0x7f4c8013dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:12.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.232+0000 7f4c85400640 1 -- 172.21.15.107:0/2833599662 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c74009450 con 0x7f4c80155a20 2024-08-17T02:25:12.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.232+0000 7f4c86800640 1 --2- 172.21.15.107:0/2833599662 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c80155df0 0x7f4c8015eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:12.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.232+0000 7f4c85e00640 1 --2- 172.21.15.107:0/2833599662 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c8006d7f0 0x7f4c8013dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:12.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.232+0000 7f4c85400640 1 --2- 172.21.15.107:0/2833599662 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c80155a20 0x7f4c8015e5c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4c7000d890 tx=0x7f4c70008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:12.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.233+0000 7f4c79600640 1 -- 172.21.15.107:0/2833599662 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7000de20 con 0x7f4c80155a20 2024-08-17T02:25:12.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.233+0000 7f4c79600640 1 -- 172.21.15.107:0/2833599662 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c700098b0 con 0x7f4c80155a20 2024-08-17T02:25:12.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.233+0000 7f4c79600640 1 -- 172.21.15.107:0/2833599662 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c70009c50 con 0x7f4c80155a20 2024-08-17T02:25:12.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.233+0000 7f4c88800640 1 -- 172.21.15.107:0/2833599662 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c8015f440 con 0x7f4c80155a20 2024-08-17T02:25:12.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.233+0000 7f4c88800640 1 -- 172.21.15.107:0/2833599662 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c800aae10 con 0x7f4c80155a20 2024-08-17T02:25:12.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.234+0000 7f4c88800640 1 -- 172.21.15.107:0/2833599662 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c800aac50 con 0x7f4c80155a20 2024-08-17T02:25:12.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.234+0000 7f4c79600640 1 -- 172.21.15.107:0/2833599662 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4c70014620 con 0x7f4c80155a20 2024-08-17T02:25:12.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.235+0000 7f4c79600640 1 --2- 172.21.15.107:0/2833599662 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4c64065150 0x7f4c64067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:12.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.236+0000 7f4c79600640 1 -- 172.21.15.107:0/2833599662 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4c700829f0 con 0x7f4c80155a20 2024-08-17T02:25:12.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.236+0000 7f4c85e00640 1 --2- 172.21.15.107:0/2833599662 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4c64065150 0x7f4c64067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:12.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.237+0000 7f4c85e00640 1 --2- 172.21.15.107:0/2833599662 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4c64065150 0x7f4c64067600 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4c74034000 tx=0x7f4c74032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:12.239 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.239+0000 7f4c79600640 1 -- 172.21.15.107:0/2833599662 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4c70050d60 con 0x7f4c80155a20 2024-08-17T02:25:12.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.472+0000 7f4c88800640 1 -- 172.21.15.107:0/2833599662 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f4c8015f940 con 0x7f4c80155a20 2024-08-17T02:25:12.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.476+0000 7f4c79600640 1 -- 172.21.15.107:0/2833599662 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f4c70009db0 con 0x7f4c80155a20 2024-08-17T02:25:12.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.478+0000 7f4c88800640 1 -- 172.21.15.107:0/2833599662 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4c64065150 msgr2=0x7f4c64067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:12.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.478+0000 7f4c88800640 1 --2- 172.21.15.107:0/2833599662 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4c64065150 0x7f4c64067600 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4c74034000 tx=0x7f4c74032000 comp rx=0 tx=0).stop 2024-08-17T02:25:12.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.478+0000 7f4c88800640 1 -- 172.21.15.107:0/2833599662 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c80155a20 msgr2=0x7f4c8015e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:12.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.478+0000 7f4c88800640 1 --2- 172.21.15.107:0/2833599662 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c80155a20 0x7f4c8015e5c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4c7000d890 tx=0x7f4c70008040 comp rx=0 tx=0).stop 2024-08-17T02:25:12.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.478+0000 7f4c88800640 1 -- 172.21.15.107:0/2833599662 shutdown_connections 2024-08-17T02:25:12.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.478+0000 7f4c88800640 1 --2- 172.21.15.107:0/2833599662 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4c64065150 0x7f4c64067600 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:12.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.478+0000 7f4c88800640 1 --2- 172.21.15.107:0/2833599662 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c80155df0 0x7f4c8015eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:12.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.478+0000 7f4c88800640 1 --2- 172.21.15.107:0/2833599662 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c80155a20 0x7f4c8015e5c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:12.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.478+0000 7f4c88800640 1 --2- 172.21.15.107:0/2833599662 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c8006d7f0 0x7f4c8013dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:12.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.478+0000 7f4c88800640 1 -- 172.21.15.107:0/2833599662 >> 172.21.15.107:0/2833599662 conn(0x7f4c800cb9b0 msgr2=0x7f4c800ada70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:12.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.478+0000 7f4c88800640 1 -- 172.21.15.107:0/2833599662 shutdown_connections 2024-08-17T02:25:12.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.478+0000 7f4c88800640 1 -- 172.21.15.107:0/2833599662 wait complete. 2024-08-17T02:25:12.492 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-08-17T02:25:12.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.642+0000 7fdf87c00640 1 Processor -- start 2024-08-17T02:25:12.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.642+0000 7fdf87c00640 1 -- start start 2024-08-17T02:25:12.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.643+0000 7fdf87c00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdf80158d60 0x7fdf800b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:12.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.643+0000 7fdf87c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf800b18d0 con 0x7fdf8015cb30 2024-08-17T02:25:12.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.643+0000 7fdf87c00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf800b0d00 con 0x7fdf800c7420 2024-08-17T02:25:12.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.643+0000 7fdf87c00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf800b0fa0 con 0x7fdf80158d60 2024-08-17T02:25:12.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.643+0000 7fdf7fe00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fdf8015cb30 0x7fdf800c6d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:59674/0 (socket says 172.21.15.107:59674) 2024-08-17T02:25:12.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.643+0000 7fdf7fe00640 1 -- 172.21.15.107:0/4104775098 learned_addr learned my addr 172.21.15.107:0/4104775098 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:25:12.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.643+0000 7fdf85200640 1 --2- 172.21.15.107:0/4104775098 >> v2:172.21.15.157:3300/0 conn(0x7fdf80158d60 0x7fdf800b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:12.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.644+0000 7fdf7f400640 1 -- 172.21.15.107:0/4104775098 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 880182825 0 0) 0x7fdf800b18d0 con 0x7fdf8015cb30 2024-08-17T02:25:12.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.644+0000 7fdf7f400640 1 -- 172.21.15.107:0/4104775098 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf680034e0 con 0x7fdf8015cb30 2024-08-17T02:25:12.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.644+0000 7fdf85200640 1 -- 172.21.15.107:0/4104775098 >> v1:172.21.15.157:6789/0 conn(0x7fdf800c7420 legacy=0x7fdf80096a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:12.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.644+0000 7fdf7f400640 1 -- 172.21.15.107:0/4104775098 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1503768342 0 0) 0x7fdf800b0d00 con 0x7fdf800c7420 2024-08-17T02:25:12.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.644+0000 7fdf85200640 1 -- 172.21.15.107:0/4104775098 >> v1:172.21.15.107:6789/0 conn(0x7fdf8015cb30 legacy=0x7fdf800c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:12.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.644+0000 7fdf85200640 1 -- 172.21.15.107:0/4104775098 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf800b1280 con 0x7fdf80158d60 2024-08-17T02:25:12.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.645+0000 7fdf85200640 1 --2- 172.21.15.107:0/4104775098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf80158d60 0x7fdf800b1d60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdf74009880 tx=0x7fdf740090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bac0c48d20500628 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:12.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.645+0000 7fdf7f400640 1 -- 172.21.15.107:0/4104775098 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7402ad90 con 0x7fdf80158d60 2024-08-17T02:25:12.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.646+0000 7fdf7f400640 1 -- 172.21.15.107:0/4104775098 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf74032440 con 0x7fdf80158d60 2024-08-17T02:25:12.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.646+0000 7fdf7f400640 1 -- 172.21.15.107:0/4104775098 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf740327e0 con 0x7fdf80158d60 2024-08-17T02:25:12.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.646+0000 7fdf87c00640 1 -- 172.21.15.107:0/4104775098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf80158d60 msgr2=0x7fdf800b1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:12.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.646+0000 7fdf87c00640 1 --2- 172.21.15.107:0/4104775098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf80158d60 0x7fdf800b1d60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdf74009880 tx=0x7fdf740090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:12.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.646+0000 7fdf87c00640 1 -- 172.21.15.107:0/4104775098 shutdown_connections 2024-08-17T02:25:12.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.646+0000 7fdf87c00640 1 --2- 172.21.15.107:0/4104775098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf80158d60 0x7fdf800b1d60 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:12.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.646+0000 7fdf87c00640 1 -- 172.21.15.107:0/4104775098 >> 172.21.15.107:0/4104775098 conn(0x7fdf800b3040 msgr2=0x7fdf800b3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:12.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.647+0000 7fdf87c00640 1 -- 172.21.15.107:0/4104775098 shutdown_connections 2024-08-17T02:25:12.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.647+0000 7fdf87c00640 1 -- 172.21.15.107:0/4104775098 wait complete. 2024-08-17T02:25:12.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.648+0000 7fdf87c00640 1 Processor -- start 2024-08-17T02:25:12.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.648+0000 7fdf87c00640 1 -- start start 2024-08-17T02:25:12.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.649+0000 7fdf87c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf800c7420 0x7fdf800af760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:12.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.649+0000 7fdf87c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf80158d60 0x7fdf8015aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:12.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.649+0000 7fdf87c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdf8015cb30 0x7fdf8015b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:12.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.649+0000 7fdf87c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf800afca0 con 0x7fdf800c7420 2024-08-17T02:25:12.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.649+0000 7fdf87c00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8015b640 con 0x7fdf80158d60 2024-08-17T02:25:12.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.649+0000 7fdf87c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8015b920 con 0x7fdf8015cb30 2024-08-17T02:25:12.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.649+0000 7fdf85200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf800c7420 0x7fdf800af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:12.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.649+0000 7fdf85200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf800c7420 0x7fdf800af760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51774/0 (socket says 172.21.15.107:51774) 2024-08-17T02:25:12.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.649+0000 7fdf85200640 1 -- 172.21.15.107:0/420097465 learned_addr learned my addr 172.21.15.107:0/420097465 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:12.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.649+0000 7fdf85c00640 1 --2- 172.21.15.107:0/420097465 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdf8015cb30 0x7fdf8015b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:12.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.649+0000 7fdf7fe00640 1 --2- 172.21.15.107:0/420097465 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf80158d60 0x7fdf8015aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:12.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.649+0000 7fdf85200640 1 -- 172.21.15.107:0/420097465 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdf8015cb30 msgr2=0x7fdf8015b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:12.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.649+0000 7fdf85200640 1 --2- 172.21.15.107:0/420097465 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdf8015cb30 0x7fdf8015b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:12.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.649+0000 7fdf85200640 1 -- 172.21.15.107:0/420097465 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf80158d60 msgr2=0x7fdf8015aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:12.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.649+0000 7fdf85200640 1 --2- 172.21.15.107:0/420097465 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf80158d60 0x7fdf8015aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:12.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.649+0000 7fdf85200640 1 -- 172.21.15.107:0/420097465 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf74009390 con 0x7fdf800c7420 2024-08-17T02:25:12.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.649+0000 7fdf7fe00640 1 --2- 172.21.15.107:0/420097465 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf80158d60 0x7fdf8015aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:12.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.650+0000 7fdf85200640 1 --2- 172.21.15.107:0/420097465 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf800c7420 0x7fdf800af760 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdf74009880 tx=0x7fdf74032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:12.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.650+0000 7fdf73e00640 1 -- 172.21.15.107:0/420097465 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf74031a60 con 0x7fdf800c7420 2024-08-17T02:25:12.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.650+0000 7fdf73e00640 1 -- 172.21.15.107:0/420097465 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf74031bc0 con 0x7fdf800c7420 2024-08-17T02:25:12.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.650+0000 7fdf73e00640 1 -- 172.21.15.107:0/420097465 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7403d420 con 0x7fdf800c7420 2024-08-17T02:25:12.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.650+0000 7fdf87c00640 1 -- 172.21.15.107:0/420097465 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf8016a4e0 con 0x7fdf800c7420 2024-08-17T02:25:12.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.650+0000 7fdf87c00640 1 -- 172.21.15.107:0/420097465 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf8016aaa0 con 0x7fdf800c7420 2024-08-17T02:25:12.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.651+0000 7fdf87c00640 1 -- 172.21.15.107:0/420097465 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf80064db0 con 0x7fdf800c7420 2024-08-17T02:25:12.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.652+0000 7fdf73e00640 1 -- 172.21.15.107:0/420097465 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fdf74039040 con 0x7fdf800c7420 2024-08-17T02:25:12.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.653+0000 7fdf73e00640 1 --2- 172.21.15.107:0/420097465 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fdf600651d0 0x7fdf60067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:12.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.653+0000 7fdf73e00640 1 -- 172.21.15.107:0/420097465 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fdf740a1d50 con 0x7fdf800c7420 2024-08-17T02:25:12.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.653+0000 7fdf7fe00640 1 --2- 172.21.15.107:0/420097465 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fdf600651d0 0x7fdf60067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:12.654 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.654+0000 7fdf7fe00640 1 --2- 172.21.15.107:0/420097465 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fdf600651d0 0x7fdf60067680 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c005840 tx=0x7fdf6c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:12.657 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.657+0000 7fdf73e00640 1 -- 172.21.15.107:0/420097465 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fdf740700c0 con 0x7fdf800c7420 2024-08-17T02:25:12.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.892+0000 7fdf87c00640 1 -- 172.21.15.107:0/420097465 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fdf80068c90 con 0x7fdf800c7420 2024-08-17T02:25:12.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.896+0000 7fdf73e00640 1 -- 172.21.15.107:0/420097465 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fdf740736e0 con 0x7fdf800c7420 2024-08-17T02:25:12.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.898+0000 7fdf87c00640 1 -- 172.21.15.107:0/420097465 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fdf600651d0 msgr2=0x7fdf60067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:12.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.898+0000 7fdf87c00640 1 --2- 172.21.15.107:0/420097465 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fdf600651d0 0x7fdf60067680 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c005840 tx=0x7fdf6c009040 comp rx=0 tx=0).stop 2024-08-17T02:25:12.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.898+0000 7fdf87c00640 1 -- 172.21.15.107:0/420097465 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf800c7420 msgr2=0x7fdf800af760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:12.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.898+0000 7fdf87c00640 1 --2- 172.21.15.107:0/420097465 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf800c7420 0x7fdf800af760 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdf74009880 tx=0x7fdf74032000 comp rx=0 tx=0).stop 2024-08-17T02:25:12.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.898+0000 7fdf87c00640 1 -- 172.21.15.107:0/420097465 shutdown_connections 2024-08-17T02:25:12.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.898+0000 7fdf87c00640 1 --2- 172.21.15.107:0/420097465 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fdf600651d0 0x7fdf60067680 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:12.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.898+0000 7fdf87c00640 1 --2- 172.21.15.107:0/420097465 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdf8015cb30 0x7fdf8015b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:12.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.898+0000 7fdf87c00640 1 --2- 172.21.15.107:0/420097465 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf80158d60 0x7fdf8015aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:12.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.898+0000 7fdf87c00640 1 --2- 172.21.15.107:0/420097465 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf800c7420 0x7fdf800af760 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:12.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.898+0000 7fdf87c00640 1 -- 172.21.15.107:0/420097465 >> 172.21.15.107:0/420097465 conn(0x7fdf800b3040 msgr2=0x7fdf800b1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:12.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.899+0000 7fdf87c00640 1 -- 172.21.15.107:0/420097465 shutdown_connections 2024-08-17T02:25:12.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:12.899+0000 7fdf87c00640 1 -- 172.21.15.107:0/420097465 wait complete. 2024-08-17T02:25:12.913 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-08-17T02:25:13.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.060+0000 7fef64400640 1 Processor -- start 2024-08-17T02:25:13.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.060+0000 7fef64400640 1 -- start start 2024-08-17T02:25:13.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.061+0000 7fef64400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fef5c158d60 0x7fef5c0b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:13.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.061+0000 7fef64400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fef5c15cb30 0x7fef5c0b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:13.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.061+0000 7fef64400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fef5c159130 0x7fef5c0c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:13.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.061+0000 7fef64400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef5c0b18d0 con 0x7fef5c158d60 2024-08-17T02:25:13.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.061+0000 7fef64400640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef5c0b0d00 con 0x7fef5c159130 2024-08-17T02:25:13.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.061+0000 7fef64400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c0b0fa0 con 0x7fef5c15cb30 2024-08-17T02:25:13.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.061+0000 7fef61a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fef5c158d60 0x7fef5c0b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:13.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.062+0000 7fef61a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fef5c158d60 0x7fef5c0b1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51784/0 (socket says 172.21.15.107:51784) 2024-08-17T02:25:13.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.062+0000 7fef61a00640 1 -- 172.21.15.107:0/2793115022 learned_addr learned my addr 172.21.15.107:0/2793115022 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:13.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.062+0000 7fef61000640 1 --2- 172.21.15.107:0/2793115022 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fef5c15cb30 0x7fef5c0b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:13.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.062+0000 7fef62400640 1 --2- 172.21.15.107:0/2793115022 >> v2:172.21.15.157:3300/0 conn(0x7fef5c159130 0x7fef5c0c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:13.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.062+0000 7fef61a00640 1 -- 172.21.15.107:0/2793115022 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fef5c15cb30 msgr2=0x7fef5c0b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:13.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.062+0000 7fef61a00640 1 --2- 172.21.15.107:0/2793115022 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fef5c15cb30 0x7fef5c0b22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.062+0000 7fef61a00640 1 -- 172.21.15.107:0/2793115022 >> v2:172.21.15.157:3300/0 conn(0x7fef5c159130 msgr2=0x7fef5c0c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:13.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.062+0000 7fef61a00640 1 --2- 172.21.15.107:0/2793115022 >> v2:172.21.15.157:3300/0 conn(0x7fef5c159130 0x7fef5c0c6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.062+0000 7fef61a00640 1 -- 172.21.15.107:0/2793115022 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef5c0b1280 con 0x7fef5c158d60 2024-08-17T02:25:13.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.063+0000 7fef61a00640 1 --2- 172.21.15.107:0/2793115022 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef5c158d60 0x7fef5c0b1d60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fef5c06a240 tx=0x7fef500091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=535b501d52659d21 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:13.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.063+0000 7fef5be00640 1 -- 172.21.15.107:0/2793115022 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5002add0 con 0x7fef5c158d60 2024-08-17T02:25:13.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.063+0000 7fef5be00640 1 -- 172.21.15.107:0/2793115022 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef50032440 con 0x7fef5c158d60 2024-08-17T02:25:13.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.063+0000 7fef5be00640 1 -- 172.21.15.107:0/2793115022 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef50032820 con 0x7fef5c158d60 2024-08-17T02:25:13.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.064+0000 7fef64400640 1 -- 172.21.15.107:0/2793115022 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef5c158d60 msgr2=0x7fef5c0b1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:13.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.064+0000 7fef64400640 1 --2- 172.21.15.107:0/2793115022 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef5c158d60 0x7fef5c0b1d60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fef5c06a240 tx=0x7fef500091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.064+0000 7fef64400640 1 -- 172.21.15.107:0/2793115022 shutdown_connections 2024-08-17T02:25:13.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.064+0000 7fef64400640 1 --2- 172.21.15.107:0/2793115022 >> v2:172.21.15.157:3300/0 conn(0x7fef5c159130 0x7fef5c0c6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.064+0000 7fef64400640 1 --2- 172.21.15.107:0/2793115022 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fef5c15cb30 0x7fef5c0b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.064+0000 7fef64400640 1 --2- 172.21.15.107:0/2793115022 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef5c158d60 0x7fef5c0b1d60 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.064+0000 7fef64400640 1 -- 172.21.15.107:0/2793115022 >> 172.21.15.107:0/2793115022 conn(0x7fef5c0b3040 msgr2=0x7fef5c0b3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:13.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.064+0000 7fef64400640 1 -- 172.21.15.107:0/2793115022 shutdown_connections 2024-08-17T02:25:13.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.064+0000 7fef64400640 1 -- 172.21.15.107:0/2793115022 wait complete. 2024-08-17T02:25:13.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.065+0000 7fef64400640 1 Processor -- start 2024-08-17T02:25:13.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.065+0000 7fef64400640 1 -- start start 2024-08-17T02:25:13.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.066+0000 7fef64400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fef5c158d60 0x7fef5c15b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:13.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.066+0000 7fef64400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef5c159130 0x7fef5c09afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:13.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.066+0000 7fef64400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef5c15cb30 0x7fef5c09b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:13.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.066+0000 7fef64400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c169770 con 0x7fef5c159130 2024-08-17T02:25:13.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.066+0000 7fef64400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c16a590 con 0x7fef5c15cb30 2024-08-17T02:25:13.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.066+0000 7fef64400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c169980 con 0x7fef5c158d60 2024-08-17T02:25:13.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.066+0000 7fef61000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef5c159130 0x7fef5c09afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:13.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.066+0000 7fef61000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef5c159130 0x7fef5c09afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51786/0 (socket says 172.21.15.107:51786) 2024-08-17T02:25:13.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.066+0000 7fef61000640 1 -- 172.21.15.107:0/1700844614 learned_addr learned my addr 172.21.15.107:0/1700844614 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:13.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.066+0000 7fef61a00640 1 --2- 172.21.15.107:0/1700844614 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fef5c158d60 0x7fef5c15b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:13.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.067+0000 7fef62400640 1 --2- 172.21.15.107:0/1700844614 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef5c15cb30 0x7fef5c09b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:13.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.067+0000 7fef61000640 1 -- 172.21.15.107:0/1700844614 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fef5c158d60 msgr2=0x7fef5c15b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:13.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.067+0000 7fef61000640 1 --2- 172.21.15.107:0/1700844614 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fef5c158d60 0x7fef5c15b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.067+0000 7fef61000640 1 -- 172.21.15.107:0/1700844614 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef5c15cb30 msgr2=0x7fef5c09b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:13.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.067+0000 7fef61000640 1 --2- 172.21.15.107:0/1700844614 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef5c15cb30 0x7fef5c09b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.067+0000 7fef61000640 1 -- 172.21.15.107:0/1700844614 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef50009450 con 0x7fef5c159130 2024-08-17T02:25:13.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.067+0000 7fef62400640 1 --2- 172.21.15.107:0/1700844614 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef5c15cb30 0x7fef5c09b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:13.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.067+0000 7fef61000640 1 --2- 172.21.15.107:0/1700844614 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef5c159130 0x7fef5c09afc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fef4800d890 tx=0x7fef48008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:13.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.067+0000 7fef58c00640 1 -- 172.21.15.107:0/1700844614 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4800de20 con 0x7fef5c159130 2024-08-17T02:25:13.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.067+0000 7fef58c00640 1 -- 172.21.15.107:0/1700844614 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef480098b0 con 0x7fef5c159130 2024-08-17T02:25:13.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.067+0000 7fef58c00640 1 -- 172.21.15.107:0/1700844614 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef48009c50 con 0x7fef5c159130 2024-08-17T02:25:13.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.067+0000 7fef64400640 1 -- 172.21.15.107:0/1700844614 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef5c169c60 con 0x7fef5c159130 2024-08-17T02:25:13.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.067+0000 7fef64400640 1 -- 172.21.15.107:0/1700844614 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef5c16a220 con 0x7fef5c159130 2024-08-17T02:25:13.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.068+0000 7fef64400640 1 -- 172.21.15.107:0/1700844614 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef5c064db0 con 0x7fef5c159130 2024-08-17T02:25:13.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.069+0000 7fef58c00640 1 -- 172.21.15.107:0/1700844614 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fef48014620 con 0x7fef5c159130 2024-08-17T02:25:13.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.070+0000 7fef58c00640 1 --2- 172.21.15.107:0/1700844614 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fef3c065150 0x7fef3c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:13.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.070+0000 7fef58c00640 1 -- 172.21.15.107:0/1700844614 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fef48082910 con 0x7fef5c159130 2024-08-17T02:25:13.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.070+0000 7fef61a00640 1 --2- 172.21.15.107:0/1700844614 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fef3c065150 0x7fef3c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:13.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.071+0000 7fef61a00640 1 --2- 172.21.15.107:0/1700844614 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fef3c065150 0x7fef3c067600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fef50034000 tx=0x7fef50032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:13.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.074+0000 7fef58c00640 1 -- 172.21.15.107:0/1700844614 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fef48050c80 con 0x7fef5c159130 2024-08-17T02:25:13.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.309+0000 7fef64400640 1 -- 172.21.15.107:0/1700844614 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fef5c06c420 con 0x7fef5c159130 2024-08-17T02:25:13.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.313+0000 7fef58c00640 1 -- 172.21.15.107:0/1700844614 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fef480542a0 con 0x7fef5c159130 2024-08-17T02:25:13.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.315+0000 7fef64400640 1 -- 172.21.15.107:0/1700844614 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fef3c065150 msgr2=0x7fef3c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:13.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.315+0000 7fef64400640 1 --2- 172.21.15.107:0/1700844614 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fef3c065150 0x7fef3c067600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fef50034000 tx=0x7fef50032000 comp rx=0 tx=0).stop 2024-08-17T02:25:13.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.315+0000 7fef64400640 1 -- 172.21.15.107:0/1700844614 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef5c159130 msgr2=0x7fef5c09afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:13.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.315+0000 7fef64400640 1 --2- 172.21.15.107:0/1700844614 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef5c159130 0x7fef5c09afc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fef4800d890 tx=0x7fef48008040 comp rx=0 tx=0).stop 2024-08-17T02:25:13.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.315+0000 7fef64400640 1 -- 172.21.15.107:0/1700844614 shutdown_connections 2024-08-17T02:25:13.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.315+0000 7fef64400640 1 --2- 172.21.15.107:0/1700844614 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fef3c065150 0x7fef3c067600 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.315+0000 7fef64400640 1 --2- 172.21.15.107:0/1700844614 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fef5c15cb30 0x7fef5c09b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.315+0000 7fef64400640 1 --2- 172.21.15.107:0/1700844614 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef5c159130 0x7fef5c09afc0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.315+0000 7fef64400640 1 --2- 172.21.15.107:0/1700844614 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fef5c158d60 0x7fef5c15b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.315+0000 7fef64400640 1 -- 172.21.15.107:0/1700844614 >> 172.21.15.107:0/1700844614 conn(0x7fef5c0b3040 msgr2=0x7fef5c0c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:13.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.315+0000 7fef64400640 1 -- 172.21.15.107:0/1700844614 shutdown_connections 2024-08-17T02:25:13.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.315+0000 7fef64400640 1 -- 172.21.15.107:0/1700844614 wait complete. 2024-08-17T02:25:13.330 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-08-17T02:25:13.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.479+0000 7febe9200640 1 Processor -- start 2024-08-17T02:25:13.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.479+0000 7febe9200640 1 -- start start 2024-08-17T02:25:13.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.480+0000 7febe9200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7febe4140580 0x7febe40c9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:13.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.480+0000 7febe9200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe40caa80 con 0x7febe40b1440 2024-08-17T02:25:13.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.480+0000 7febe9200640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe40c9e70 con 0x7febe41401b0 2024-08-17T02:25:13.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.480+0000 7febe9200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe40c9c90 con 0x7febe4140580 2024-08-17T02:25:13.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.480+0000 7febe1400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7febe40b1440 0x7febe40c9040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:59676/0 (socket says 172.21.15.107:59676) 2024-08-17T02:25:13.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.480+0000 7febe1400640 1 -- 172.21.15.107:0/2340573745 learned_addr learned my addr 172.21.15.107:0/2340573745 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:25:13.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.480+0000 7febe2800640 1 --2- 172.21.15.107:0/2340573745 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7febe4140580 0x7febe40c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:13.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.481+0000 7febe0a00640 1 -- 172.21.15.107:0/2340573745 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1664628800 0 0) 0x7febe40caa80 con 0x7febe40b1440 2024-08-17T02:25:13.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.481+0000 7febe0a00640 1 -- 172.21.15.107:0/2340573745 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febc80034e0 con 0x7febe40b1440 2024-08-17T02:25:13.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.481+0000 7febe0a00640 1 -- 172.21.15.107:0/2340573745 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 370508831 0 0) 0x7febe40c9e70 con 0x7febe41401b0 2024-08-17T02:25:13.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.481+0000 7febe0a00640 1 -- 172.21.15.107:0/2340573745 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febe40caa80 con 0x7febe41401b0 2024-08-17T02:25:13.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.481+0000 7febe2800640 1 -- 172.21.15.107:0/2340573745 >> v1:172.21.15.157:6789/0 conn(0x7febe41401b0 legacy=0x7febe40b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:13.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.481+0000 7febe2800640 1 -- 172.21.15.107:0/2340573745 >> v1:172.21.15.107:6789/0 conn(0x7febe40b1440 legacy=0x7febe40c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:13.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.481+0000 7febe2800640 1 -- 172.21.15.107:0/2340573745 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe40ca150 con 0x7febe4140580 2024-08-17T02:25:13.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.482+0000 7febe2800640 1 --2- 172.21.15.107:0/2340573745 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7febe4140580 0x7febe40c9750 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7febdc009e90 tx=0x7febdc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42222406164ec62b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:13.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.482+0000 7febe0a00640 1 -- 172.21.15.107:0/2340573745 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febdc007550 con 0x7febe4140580 2024-08-17T02:25:13.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.482+0000 7febe0a00640 1 -- 172.21.15.107:0/2340573745 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febdc02d050 con 0x7febe4140580 2024-08-17T02:25:13.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.482+0000 7febe0a00640 1 -- 172.21.15.107:0/2340573745 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febdc0078e0 con 0x7febe4140580 2024-08-17T02:25:13.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.483+0000 7febe9200640 1 -- 172.21.15.107:0/2340573745 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7febe4140580 msgr2=0x7febe40c9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:13.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.483+0000 7febe9200640 1 --2- 172.21.15.107:0/2340573745 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7febe4140580 0x7febe40c9750 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7febdc009e90 tx=0x7febdc009780 comp rx=0 tx=0).stop 2024-08-17T02:25:13.484 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.483+0000 7febe9200640 1 -- 172.21.15.107:0/2340573745 shutdown_connections 2024-08-17T02:25:13.484 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.483+0000 7febe9200640 1 --2- 172.21.15.107:0/2340573745 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7febe4140580 0x7febe40c9750 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.484 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.483+0000 7febe9200640 1 -- 172.21.15.107:0/2340573745 >> 172.21.15.107:0/2340573745 conn(0x7febe40cb9b0 msgr2=0x7febe40cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:13.484 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.483+0000 7febe9200640 1 -- 172.21.15.107:0/2340573745 shutdown_connections 2024-08-17T02:25:13.484 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.483+0000 7febe9200640 1 -- 172.21.15.107:0/2340573745 wait complete. 2024-08-17T02:25:13.484 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.484+0000 7febe9200640 1 Processor -- start 2024-08-17T02:25:13.484 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.485+0000 7febe9200640 1 -- start start 2024-08-17T02:25:13.487 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.485+0000 7febe9200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7febe40b1440 0x7febe40af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:13.487 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.485+0000 7febe9200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7febe41401b0 0x7febe40af820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:13.487 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.485+0000 7febe9200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febe4140580 0x7febe4168c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:13.487 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.485+0000 7febe9200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe40a9c90 con 0x7febe4140580 2024-08-17T02:25:13.487 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.485+0000 7febe9200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe40abcd0 con 0x7febe40b1440 2024-08-17T02:25:13.487 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.485+0000 7febe9200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe40b0420 con 0x7febe41401b0 2024-08-17T02:25:13.487 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.486+0000 7febe2800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febe4140580 0x7febe4168c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:13.487 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.486+0000 7febe2800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febe4140580 0x7febe4168c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51800/0 (socket says 172.21.15.107:51800) 2024-08-17T02:25:13.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.486+0000 7febe2800640 1 -- 172.21.15.107:0/2185216110 learned_addr learned my addr 172.21.15.107:0/2185216110 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:13.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.486+0000 7febe1e00640 1 --2- 172.21.15.107:0/2185216110 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7febe40b1440 0x7febe40af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:13.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.486+0000 7febe1400640 1 --2- 172.21.15.107:0/2185216110 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7febe41401b0 0x7febe40af820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:13.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.486+0000 7febe2800640 1 -- 172.21.15.107:0/2185216110 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7febe41401b0 msgr2=0x7febe40af820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:13.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.486+0000 7febe2800640 1 --2- 172.21.15.107:0/2185216110 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7febe41401b0 0x7febe40af820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.486+0000 7febe2800640 1 -- 172.21.15.107:0/2185216110 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7febe40b1440 msgr2=0x7febe40af2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:13.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.486+0000 7febe2800640 1 --2- 172.21.15.107:0/2185216110 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7febe40b1440 0x7febe40af2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.486+0000 7febe2800640 1 -- 172.21.15.107:0/2185216110 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febdc009a20 con 0x7febe4140580 2024-08-17T02:25:13.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.486+0000 7febe1e00640 1 --2- 172.21.15.107:0/2185216110 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7febe40b1440 0x7febe40af2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:13.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.486+0000 7febe2800640 1 --2- 172.21.15.107:0/2185216110 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febe4140580 0x7febe4168c40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7febdc009de0 tx=0x7febdc037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:13.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.487+0000 7febd9600640 1 -- 172.21.15.107:0/2185216110 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febdc031ac0 con 0x7febe4140580 2024-08-17T02:25:13.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.487+0000 7febd9600640 1 -- 172.21.15.107:0/2185216110 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febdc031c20 con 0x7febe4140580 2024-08-17T02:25:13.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.487+0000 7febd9600640 1 -- 172.21.15.107:0/2185216110 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febdc03c420 con 0x7febe4140580 2024-08-17T02:25:13.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.487+0000 7febe9200640 1 -- 172.21.15.107:0/2185216110 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe40b0140 con 0x7febe4140580 2024-08-17T02:25:13.489 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.487+0000 7febe9200640 1 -- 172.21.15.107:0/2185216110 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febe40ab960 con 0x7febe4140580 2024-08-17T02:25:13.489 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.488+0000 7febe9200640 1 -- 172.21.15.107:0/2185216110 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febe40ab4e0 con 0x7febe4140580 2024-08-17T02:25:13.489 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.488+0000 7febd9600640 1 -- 172.21.15.107:0/2185216110 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7febdc03c830 con 0x7febe4140580 2024-08-17T02:25:13.489 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.489+0000 7febd9600640 1 --2- 172.21.15.107:0/2185216110 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7febc4065150 0x7febc4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:13.490 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.489+0000 7febd9600640 1 -- 172.21.15.107:0/2185216110 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7febdc0a31f0 con 0x7febe4140580 2024-08-17T02:25:13.490 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.489+0000 7febe1e00640 1 --2- 172.21.15.107:0/2185216110 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7febc4065150 0x7febc4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:13.490 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.490+0000 7febe1e00640 1 --2- 172.21.15.107:0/2185216110 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7febc4065150 0x7febc4067600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7febe40b0d00 tx=0x7febd4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:13.493 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.493+0000 7febd9600640 1 -- 172.21.15.107:0/2185216110 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7febe40ab4e0 con 0x7febe4140580 2024-08-17T02:25:13.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.729+0000 7febe9200640 1 -- 172.21.15.107:0/2185216110 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7febe40ab4e0 con 0x7febe4140580 2024-08-17T02:25:13.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.733+0000 7febd9600640 1 -- 172.21.15.107:0/2185216110 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7febe40ab4e0 con 0x7febe4140580 2024-08-17T02:25:13.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.735+0000 7febe9200640 1 -- 172.21.15.107:0/2185216110 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7febc4065150 msgr2=0x7febc4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:13.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.735+0000 7febe9200640 1 --2- 172.21.15.107:0/2185216110 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7febc4065150 0x7febc4067600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7febe40b0d00 tx=0x7febd4009040 comp rx=0 tx=0).stop 2024-08-17T02:25:13.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.735+0000 7febe9200640 1 -- 172.21.15.107:0/2185216110 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febe4140580 msgr2=0x7febe4168c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:13.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.735+0000 7febe9200640 1 --2- 172.21.15.107:0/2185216110 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febe4140580 0x7febe4168c40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7febdc009de0 tx=0x7febdc037000 comp rx=0 tx=0).stop 2024-08-17T02:25:13.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.735+0000 7febe9200640 1 -- 172.21.15.107:0/2185216110 shutdown_connections 2024-08-17T02:25:13.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.735+0000 7febe9200640 1 --2- 172.21.15.107:0/2185216110 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7febc4065150 0x7febc4067600 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.735+0000 7febe9200640 1 --2- 172.21.15.107:0/2185216110 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febe4140580 0x7febe4168c40 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.735+0000 7febe9200640 1 --2- 172.21.15.107:0/2185216110 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7febe41401b0 0x7febe40af820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.735+0000 7febe9200640 1 --2- 172.21.15.107:0/2185216110 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7febe40b1440 0x7febe40af2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.735+0000 7febe9200640 1 -- 172.21.15.107:0/2185216110 >> 172.21.15.107:0/2185216110 conn(0x7febe40cb9b0 msgr2=0x7febe40c9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:13.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.736+0000 7febe9200640 1 -- 172.21.15.107:0/2185216110 shutdown_connections 2024-08-17T02:25:13.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.736+0000 7febe9200640 1 -- 172.21.15.107:0/2185216110 wait complete. 2024-08-17T02:25:13.750 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-08-17T02:25:13.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.898+0000 7f6e15600640 1 Processor -- start 2024-08-17T02:25:13.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.898+0000 7f6e15600640 1 -- start start 2024-08-17T02:25:13.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.900+0000 7f6e15600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6e101401b0 0x7f6e100caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:13.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.900+0000 7f6e15600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e100caa80 con 0x7f6e100b1440 2024-08-17T02:25:13.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.900+0000 7f6e15600640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e100c9e70 con 0x7f6e10140580 2024-08-17T02:25:13.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.900+0000 7f6e15600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e100cb450 con 0x7f6e101401b0 2024-08-17T02:25:13.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.900+0000 7f6e0ea00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6e101401b0 0x7f6e100caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:13.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.900+0000 7f6e0ea00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6e101401b0 0x7f6e100caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51806/0 (socket says 172.21.15.107:51806) 2024-08-17T02:25:13.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.900+0000 7f6e0ea00640 1 -- 172.21.15.107:0/2983313016 learned_addr learned my addr 172.21.15.107:0/2983313016 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:13.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.900+0000 7f6e0f400640 1 --1- 172.21.15.107:0/2983313016 >> v1:172.21.15.107:6789/0 conn(0x7f6e100b1440 0x7f6e100c9040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:59678/0 (socket says 172.21.15.107:59678) 2024-08-17T02:25:13.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.901+0000 7f6e0ea00640 1 -- 172.21.15.107:0/2983313016 >> v1:172.21.15.157:6789/0 conn(0x7f6e10140580 legacy=0x7f6e100b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:13.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.901+0000 7f6e0ea00640 1 -- 172.21.15.107:0/2983313016 >> v1:172.21.15.107:6789/0 conn(0x7f6e100b1440 legacy=0x7f6e100c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:13.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.901+0000 7f6e0ea00640 1 -- 172.21.15.107:0/2983313016 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e100ca150 con 0x7f6e101401b0 2024-08-17T02:25:13.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.901+0000 7f6e0e000640 1 -- 172.21.15.107:0/2983313016 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1564507341 0 0) 0x7f6e100caa80 con 0x7f6e100b1440 2024-08-17T02:25:13.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.902+0000 7f6e0ea00640 1 --2- 172.21.15.107:0/2983313016 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e101401b0 0x7f6e100caf10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6e00009910 tx=0x7f6e000091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ca7de210f326dc4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:13.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.902+0000 7f6e0e000640 1 -- 172.21.15.107:0/2983313016 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0002add0 con 0x7f6e101401b0 2024-08-17T02:25:13.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.902+0000 7f6e0e000640 1 -- 172.21.15.107:0/2983313016 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e00032440 con 0x7f6e101401b0 2024-08-17T02:25:13.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.902+0000 7f6e0e000640 1 -- 172.21.15.107:0/2983313016 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e000327e0 con 0x7f6e101401b0 2024-08-17T02:25:13.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.902+0000 7f6e15600640 1 -- 172.21.15.107:0/2983313016 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e101401b0 msgr2=0x7f6e100caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:13.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.902+0000 7f6e15600640 1 --2- 172.21.15.107:0/2983313016 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e101401b0 0x7f6e100caf10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6e00009910 tx=0x7f6e000091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.903+0000 7f6e15600640 1 -- 172.21.15.107:0/2983313016 shutdown_connections 2024-08-17T02:25:13.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.903+0000 7f6e15600640 1 --2- 172.21.15.107:0/2983313016 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e101401b0 0x7f6e100caf10 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.903+0000 7f6e15600640 1 -- 172.21.15.107:0/2983313016 >> 172.21.15.107:0/2983313016 conn(0x7f6e100cb9b0 msgr2=0x7f6e100cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:13.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.903+0000 7f6e15600640 1 -- 172.21.15.107:0/2983313016 shutdown_connections 2024-08-17T02:25:13.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.903+0000 7f6e15600640 1 -- 172.21.15.107:0/2983313016 wait complete. 2024-08-17T02:25:13.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.904+0000 7f6e15600640 1 Processor -- start 2024-08-17T02:25:13.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.904+0000 7f6e15600640 1 -- start start 2024-08-17T02:25:13.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.905+0000 7f6e15600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e100b1440 0x7f6e10167ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:13.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.905+0000 7f6e15600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6e101401b0 0x7f6e101699a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:13.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.905+0000 7f6e15600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e10140580 0x7f6e10166cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:13.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.905+0000 7f6e15600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e100c6680 con 0x7f6e100b1440 2024-08-17T02:25:13.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.905+0000 7f6e15600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e10167670 con 0x7f6e10140580 2024-08-17T02:25:13.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.905+0000 7f6e15600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e10167950 con 0x7f6e101401b0 2024-08-17T02:25:13.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.905+0000 7f6e0ea00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e100b1440 0x7f6e10167ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:13.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.905+0000 7f6e0ea00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e100b1440 0x7f6e10167ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51816/0 (socket says 172.21.15.107:51816) 2024-08-17T02:25:13.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.905+0000 7f6e0ea00640 1 -- 172.21.15.107:0/2474128102 learned_addr learned my addr 172.21.15.107:0/2474128102 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:13.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.906+0000 7f6e0f400640 1 --2- 172.21.15.107:0/2474128102 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e10140580 0x7f6e10166cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:13.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.906+0000 7f6e06000640 1 --2- 172.21.15.107:0/2474128102 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6e101401b0 0x7f6e101699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:13.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.906+0000 7f6e0ea00640 1 -- 172.21.15.107:0/2474128102 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6e101401b0 msgr2=0x7f6e101699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:13.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.906+0000 7f6e0ea00640 1 --2- 172.21.15.107:0/2474128102 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6e101401b0 0x7f6e101699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.906+0000 7f6e0ea00640 1 -- 172.21.15.107:0/2474128102 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e10140580 msgr2=0x7f6e10166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:13.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.906+0000 7f6e0ea00640 1 --2- 172.21.15.107:0/2474128102 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e10140580 0x7f6e10166cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.906+0000 7f6e0ea00640 1 -- 172.21.15.107:0/2474128102 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e00009450 con 0x7f6e100b1440 2024-08-17T02:25:13.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.906+0000 7f6e06000640 1 --2- 172.21.15.107:0/2474128102 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6e101401b0 0x7f6e101699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:13.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.906+0000 7f6e0ea00640 1 --2- 172.21.15.107:0/2474128102 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e100b1440 0x7f6e10167ed0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6e00009970 tx=0x7f6e00032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:13.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.907+0000 7f6e06a00640 1 -- 172.21.15.107:0/2474128102 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e00031b30 con 0x7f6e100b1440 2024-08-17T02:25:13.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.907+0000 7f6e15600640 1 -- 172.21.15.107:0/2474128102 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e100c6920 con 0x7f6e100b1440 2024-08-17T02:25:13.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.907+0000 7f6e06a00640 1 -- 172.21.15.107:0/2474128102 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e00031c90 con 0x7f6e100b1440 2024-08-17T02:25:13.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.907+0000 7f6e06a00640 1 -- 172.21.15.107:0/2474128102 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0003c660 con 0x7f6e100b1440 2024-08-17T02:25:13.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.907+0000 7f6e15600640 1 -- 172.21.15.107:0/2474128102 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e10169ee0 con 0x7f6e100b1440 2024-08-17T02:25:13.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.908+0000 7f6e15600640 1 -- 172.21.15.107:0/2474128102 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e10064db0 con 0x7f6e100b1440 2024-08-17T02:25:13.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.909+0000 7f6e06a00640 1 -- 172.21.15.107:0/2474128102 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6e00039050 con 0x7f6e100b1440 2024-08-17T02:25:13.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.909+0000 7f6e06a00640 1 --2- 172.21.15.107:0/2474128102 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6dec065150 0x7f6dec067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:13.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.909+0000 7f6e06a00640 1 -- 172.21.15.107:0/2474128102 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6e000a2d90 con 0x7f6e100b1440 2024-08-17T02:25:13.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.910+0000 7f6e06000640 1 --2- 172.21.15.107:0/2474128102 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6dec065150 0x7f6dec067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:13.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.910+0000 7f6e06000640 1 --2- 172.21.15.107:0/2474128102 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6dec065150 0x7f6dec067600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6e100c5c70 tx=0x7f6df8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:13.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:13.913+0000 7f6e06a00640 1 -- 172.21.15.107:0/2474128102 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6e000711c0 con 0x7f6e100b1440 2024-08-17T02:25:14.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.152+0000 7f6e15600640 1 -- 172.21.15.107:0/2474128102 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f6e1016a070 con 0x7f6e100b1440 2024-08-17T02:25:14.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.155+0000 7f6e06a00640 1 -- 172.21.15.107:0/2474128102 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6e000370a0 con 0x7f6e100b1440 2024-08-17T02:25:14.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.158+0000 7f6e15600640 1 -- 172.21.15.107:0/2474128102 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6dec065150 msgr2=0x7f6dec067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:14.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.158+0000 7f6e15600640 1 --2- 172.21.15.107:0/2474128102 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6dec065150 0x7f6dec067600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6e100c5c70 tx=0x7f6df8008040 comp rx=0 tx=0).stop 2024-08-17T02:25:14.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.158+0000 7f6e15600640 1 -- 172.21.15.107:0/2474128102 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e100b1440 msgr2=0x7f6e10167ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:14.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.158+0000 7f6e15600640 1 --2- 172.21.15.107:0/2474128102 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e100b1440 0x7f6e10167ed0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6e00009970 tx=0x7f6e00032000 comp rx=0 tx=0).stop 2024-08-17T02:25:14.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.158+0000 7f6e15600640 1 -- 172.21.15.107:0/2474128102 shutdown_connections 2024-08-17T02:25:14.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.158+0000 7f6e15600640 1 --2- 172.21.15.107:0/2474128102 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6dec065150 0x7f6dec067600 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.158+0000 7f6e15600640 1 --2- 172.21.15.107:0/2474128102 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e10140580 0x7f6e10166cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.158+0000 7f6e15600640 1 --2- 172.21.15.107:0/2474128102 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6e101401b0 0x7f6e101699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.158+0000 7f6e15600640 1 --2- 172.21.15.107:0/2474128102 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e100b1440 0x7f6e10167ed0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.158+0000 7f6e15600640 1 -- 172.21.15.107:0/2474128102 >> 172.21.15.107:0/2474128102 conn(0x7f6e100cb9b0 msgr2=0x7f6e1013f080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:14.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.158+0000 7f6e15600640 1 -- 172.21.15.107:0/2474128102 shutdown_connections 2024-08-17T02:25:14.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.158+0000 7f6e15600640 1 -- 172.21.15.107:0/2474128102 wait complete. 2024-08-17T02:25:14.178 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-08-17T02:25:14.327 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.326+0000 7f2ec8a00640 1 Processor -- start 2024-08-17T02:25:14.327 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.326+0000 7f2ec8a00640 1 -- start start 2024-08-17T02:25:14.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.328+0000 7f2ec8a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2ec406df00 0x7f2ec40adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:14.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.328+0000 7f2ec8a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ec4155df0 0x7f2ec40ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:14.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.328+0000 7f2ec8a00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ec4156670 con 0x7f2ec4155a20 2024-08-17T02:25:14.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.328+0000 7f2ec8a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ec40b0350 con 0x7f2ec406df00 2024-08-17T02:25:14.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.328+0000 7f2ec8a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec406e5e0 con 0x7f2ec4155df0 2024-08-17T02:25:14.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.328+0000 7f2eb9400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2ec406df00 0x7f2ec40adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:14.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.328+0000 7f2eb9400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2ec406df00 0x7f2ec40adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51822/0 (socket says 172.21.15.107:51822) 2024-08-17T02:25:14.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.328+0000 7f2eb9400640 1 -- 172.21.15.107:0/1988978219 learned_addr learned my addr 172.21.15.107:0/1988978219 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:14.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.328+0000 7f2ec2800640 1 --2- 172.21.15.107:0/1988978219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ec4155df0 0x7f2ec40ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:14.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.328+0000 7f2eb9400640 1 -- 172.21.15.107:0/1988978219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ec4155df0 msgr2=0x7f2ec40ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:14.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.328+0000 7f2eb9400640 1 --2- 172.21.15.107:0/1988978219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ec4155df0 0x7f2ec40ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.328+0000 7f2eb9400640 1 -- 172.21.15.107:0/1988978219 >> v1:172.21.15.157:6789/0 conn(0x7f2ec4155a20 legacy=0x7f2ec406d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:14.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.328+0000 7f2eb9400640 1 -- 172.21.15.107:0/1988978219 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec406e8c0 con 0x7f2ec406df00 2024-08-17T02:25:14.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.329+0000 7f2eb9400640 1 --2- 172.21.15.107:0/1988978219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ec406df00 0x7f2ec40adf10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2eac009910 tx=0x7f2eac0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97d4ded0d18fc2b3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:14.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.330+0000 7f2ec1400640 1 -- 172.21.15.107:0/1988978219 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac02ae40 con 0x7f2ec406df00 2024-08-17T02:25:14.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.330+0000 7f2ec1400640 1 -- 172.21.15.107:0/1988978219 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eac032440 con 0x7f2ec406df00 2024-08-17T02:25:14.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.330+0000 7f2ec1400640 1 -- 172.21.15.107:0/1988978219 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac032820 con 0x7f2ec406df00 2024-08-17T02:25:14.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.330+0000 7f2ec8a00640 1 -- 172.21.15.107:0/1988978219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ec406df00 msgr2=0x7f2ec40adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:14.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.330+0000 7f2ec8a00640 1 --2- 172.21.15.107:0/1988978219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ec406df00 0x7f2ec40adf10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2eac009910 tx=0x7f2eac0091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.330+0000 7f2ec8a00640 1 -- 172.21.15.107:0/1988978219 shutdown_connections 2024-08-17T02:25:14.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.330+0000 7f2ec8a00640 1 --2- 172.21.15.107:0/1988978219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ec4155df0 0x7f2ec40ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.330+0000 7f2ec8a00640 1 --2- 172.21.15.107:0/1988978219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ec406df00 0x7f2ec40adf10 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.330+0000 7f2ec8a00640 1 -- 172.21.15.107:0/1988978219 >> 172.21.15.107:0/1988978219 conn(0x7f2ec40cb9b0 msgr2=0x7f2ec40cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:14.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.330+0000 7f2ec8a00640 1 -- 172.21.15.107:0/1988978219 shutdown_connections 2024-08-17T02:25:14.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.330+0000 7f2ec8a00640 1 -- 172.21.15.107:0/1988978219 wait complete. 2024-08-17T02:25:14.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.332+0000 7f2ec8a00640 1 Processor -- start 2024-08-17T02:25:14.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.332+0000 7f2ec8a00640 1 -- start start 2024-08-17T02:25:14.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.333+0000 7f2ec8a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ec406df00 0x7f2ec4142f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:14.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.333+0000 7f2ec8a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ec4155a20 0x7f2ec4144140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:14.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.333+0000 7f2ec8a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ec4155df0 0x7f2ec4144680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:14.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.333+0000 7f2ec8a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec414a7e0 con 0x7f2ec4155a20 2024-08-17T02:25:14.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.333+0000 7f2ec8a00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec414aa30 con 0x7f2ec4155df0 2024-08-17T02:25:14.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.333+0000 7f2ec8a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec414ad10 con 0x7f2ec406df00 2024-08-17T02:25:14.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.333+0000 7f2eb9400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ec4155a20 0x7f2ec4144140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:14.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.333+0000 7f2eb9400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ec4155a20 0x7f2ec4144140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51834/0 (socket says 172.21.15.107:51834) 2024-08-17T02:25:14.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.333+0000 7f2eb9400640 1 -- 172.21.15.107:0/1588241107 learned_addr learned my addr 172.21.15.107:0/1588241107 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:14.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.333+0000 7f2ec2800640 1 --2- 172.21.15.107:0/1588241107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ec4155df0 0x7f2ec4144680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:14.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.333+0000 7f2ec1e00640 1 --2- 172.21.15.107:0/1588241107 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ec406df00 0x7f2ec4142f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:14.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.333+0000 7f2eb9400640 1 -- 172.21.15.107:0/1588241107 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ec406df00 msgr2=0x7f2ec4142f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:14.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.333+0000 7f2eb9400640 1 --2- 172.21.15.107:0/1588241107 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ec406df00 0x7f2ec4142f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.333+0000 7f2eb9400640 1 -- 172.21.15.107:0/1588241107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ec4155df0 msgr2=0x7f2ec4144680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:14.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.333+0000 7f2eb9400640 1 --2- 172.21.15.107:0/1588241107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ec4155df0 0x7f2ec4144680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.333+0000 7f2eb9400640 1 -- 172.21.15.107:0/1588241107 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eac009450 con 0x7f2ec4155a20 2024-08-17T02:25:14.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.333+0000 7f2ec1e00640 1 --2- 172.21.15.107:0/1588241107 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ec406df00 0x7f2ec4142f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:14.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.334+0000 7f2eb9400640 1 --2- 172.21.15.107:0/1588241107 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ec4155a20 0x7f2ec4144140 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2eac035040 tx=0x7f2eac032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:14.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.334+0000 7f2eba000640 1 -- 172.21.15.107:0/1588241107 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac031bb0 con 0x7f2ec4155a20 2024-08-17T02:25:14.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.334+0000 7f2eba000640 1 -- 172.21.15.107:0/1588241107 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eac031d30 con 0x7f2ec4155a20 2024-08-17T02:25:14.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.334+0000 7f2eba000640 1 -- 172.21.15.107:0/1588241107 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac031ea0 con 0x7f2ec4155a20 2024-08-17T02:25:14.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.334+0000 7f2ec8a00640 1 -- 172.21.15.107:0/1588241107 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ec414aff0 con 0x7f2ec4155a20 2024-08-17T02:25:14.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.334+0000 7f2ec8a00640 1 -- 172.21.15.107:0/1588241107 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ec414d400 con 0x7f2ec4155a20 2024-08-17T02:25:14.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.335+0000 7f2ec8a00640 1 -- 172.21.15.107:0/1588241107 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ec414b4f0 con 0x7f2ec4155a20 2024-08-17T02:25:14.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.336+0000 7f2eba000640 1 -- 172.21.15.107:0/1588241107 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2eac039040 con 0x7f2ec4155a20 2024-08-17T02:25:14.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.336+0000 7f2eba000640 1 --2- 172.21.15.107:0/1588241107 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f2ea0065150 0x7f2ea0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:14.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.337+0000 7f2eba000640 1 -- 172.21.15.107:0/1588241107 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f2eac02ae40 con 0x7f2ec4155a20 2024-08-17T02:25:14.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.337+0000 7f2ec1e00640 1 --2- 172.21.15.107:0/1588241107 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f2ea0065150 0x7f2ea0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:14.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.337+0000 7f2ec1e00640 1 --2- 172.21.15.107:0/1588241107 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f2ea0065150 0x7f2ea0067600 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2ec414f5c0 tx=0x7f2eb4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:14.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.340+0000 7f2eba000640 1 -- 172.21.15.107:0/1588241107 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2eac070410 con 0x7f2ec4155a20 2024-08-17T02:25:14.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.572+0000 7f2ec8a00640 1 -- 172.21.15.107:0/1588241107 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f2ec4064db0 con 0x7f2ec4155a20 2024-08-17T02:25:14.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.577+0000 7f2eba000640 1 -- 172.21.15.107:0/1588241107 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2eac0370a0 con 0x7f2ec4155a20 2024-08-17T02:25:14.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.579+0000 7f2ec8a00640 1 -- 172.21.15.107:0/1588241107 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f2ea0065150 msgr2=0x7f2ea0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:14.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.579+0000 7f2ec8a00640 1 --2- 172.21.15.107:0/1588241107 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f2ea0065150 0x7f2ea0067600 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2ec414f5c0 tx=0x7f2eb4009040 comp rx=0 tx=0).stop 2024-08-17T02:25:14.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.579+0000 7f2ec8a00640 1 -- 172.21.15.107:0/1588241107 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ec4155a20 msgr2=0x7f2ec4144140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:14.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.579+0000 7f2ec8a00640 1 --2- 172.21.15.107:0/1588241107 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ec4155a20 0x7f2ec4144140 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2eac035040 tx=0x7f2eac032000 comp rx=0 tx=0).stop 2024-08-17T02:25:14.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.579+0000 7f2ec8a00640 1 -- 172.21.15.107:0/1588241107 shutdown_connections 2024-08-17T02:25:14.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.579+0000 7f2ec8a00640 1 --2- 172.21.15.107:0/1588241107 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f2ea0065150 0x7f2ea0067600 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.579+0000 7f2ec8a00640 1 --2- 172.21.15.107:0/1588241107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ec4155df0 0x7f2ec4144680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.579+0000 7f2ec8a00640 1 --2- 172.21.15.107:0/1588241107 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ec4155a20 0x7f2ec4144140 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.579+0000 7f2ec8a00640 1 --2- 172.21.15.107:0/1588241107 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ec406df00 0x7f2ec4142f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.579+0000 7f2ec8a00640 1 -- 172.21.15.107:0/1588241107 >> 172.21.15.107:0/1588241107 conn(0x7f2ec40cb9b0 msgr2=0x7f2ec41484c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:14.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.579+0000 7f2ec8a00640 1 -- 172.21.15.107:0/1588241107 shutdown_connections 2024-08-17T02:25:14.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.579+0000 7f2ec8a00640 1 -- 172.21.15.107:0/1588241107 wait complete. 2024-08-17T02:25:14.593 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:14.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.742+0000 7f39d6600640 1 Processor -- start 2024-08-17T02:25:14.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.742+0000 7f39d6600640 1 -- start start 2024-08-17T02:25:14.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.744+0000 7f39d6600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39d006da20 0x7f39d006ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:14.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.744+0000 7f39d6600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39d00a9a10 con 0x7f39d0158fa0 2024-08-17T02:25:14.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.744+0000 7f39d6600640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39d00a9cf0 con 0x7f39d00aa7d0 2024-08-17T02:25:14.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.744+0000 7f39d6600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d00ac400 con 0x7f39d006da20 2024-08-17T02:25:14.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.744+0000 7f39cfe00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f39d0158fa0 0x7f39d00ab6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:59684/0 (socket says 172.21.15.107:59684) 2024-08-17T02:25:14.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.744+0000 7f39cfe00640 1 -- 172.21.15.107:0/741238997 learned_addr learned my addr 172.21.15.107:0/741238997 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:25:14.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.744+0000 7f39cf400640 1 --2- 172.21.15.107:0/741238997 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39d006da20 0x7f39d006ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:14.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.744+0000 7f39cea00640 1 -- 172.21.15.107:0/741238997 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 335724133 0 0) 0x7f39d00a9a10 con 0x7f39d0158fa0 2024-08-17T02:25:14.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.744+0000 7f39cea00640 1 -- 172.21.15.107:0/741238997 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39b40034e0 con 0x7f39d0158fa0 2024-08-17T02:25:14.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.744+0000 7f39cea00640 1 -- 172.21.15.107:0/741238997 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2643924737 0 0) 0x7f39d00a9cf0 con 0x7f39d00aa7d0 2024-08-17T02:25:14.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.744+0000 7f39cea00640 1 -- 172.21.15.107:0/741238997 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39d00a9a10 con 0x7f39d00aa7d0 2024-08-17T02:25:14.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.745+0000 7f39cf400640 1 -- 172.21.15.107:0/741238997 >> v1:172.21.15.157:6789/0 conn(0x7f39d00aa7d0 legacy=0x7f39d0158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:14.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.745+0000 7f39cf400640 1 -- 172.21.15.107:0/741238997 >> v1:172.21.15.107:6789/0 conn(0x7f39d0158fa0 legacy=0x7f39d00ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:14.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.745+0000 7f39cf400640 1 -- 172.21.15.107:0/741238997 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d00a9fd0 con 0x7f39d006da20 2024-08-17T02:25:14.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.746+0000 7f39cf400640 1 --2- 172.21.15.107:0/741238997 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39d006da20 0x7f39d006ddf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f39c0009880 tx=0x7f39c00090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4568f9f2484063bf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:14.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.746+0000 7f39cea00640 1 -- 172.21.15.107:0/741238997 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c002ad80 con 0x7f39d006da20 2024-08-17T02:25:14.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.746+0000 7f39cea00640 1 -- 172.21.15.107:0/741238997 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c0032440 con 0x7f39d006da20 2024-08-17T02:25:14.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.746+0000 7f39cea00640 1 -- 172.21.15.107:0/741238997 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c00327e0 con 0x7f39d006da20 2024-08-17T02:25:14.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.746+0000 7f39d6600640 1 -- 172.21.15.107:0/741238997 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39d006da20 msgr2=0x7f39d006ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:14.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.746+0000 7f39d6600640 1 --2- 172.21.15.107:0/741238997 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39d006da20 0x7f39d006ddf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f39c0009880 tx=0x7f39c00090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.746+0000 7f39d6600640 1 -- 172.21.15.107:0/741238997 shutdown_connections 2024-08-17T02:25:14.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.746+0000 7f39d6600640 1 --2- 172.21.15.107:0/741238997 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39d006da20 0x7f39d006ddf0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.747+0000 7f39d6600640 1 -- 172.21.15.107:0/741238997 >> 172.21.15.107:0/741238997 conn(0x7f39d00cb9b0 msgr2=0x7f39d00cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:14.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.747+0000 7f39d6600640 1 -- 172.21.15.107:0/741238997 shutdown_connections 2024-08-17T02:25:14.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.747+0000 7f39d6600640 1 -- 172.21.15.107:0/741238997 wait complete. 2024-08-17T02:25:14.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.748+0000 7f39d6600640 1 Processor -- start 2024-08-17T02:25:14.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.748+0000 7f39d6600640 1 -- start start 2024-08-17T02:25:14.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.749+0000 7f39d6600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39d006da20 0x7f39d014d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:14.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.749+0000 7f39d6600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39d00aa7d0 0x7f39d0169d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:14.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.749+0000 7f39d6600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39d0158fa0 0x7f39d015bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:14.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.749+0000 7f39d6600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d014d390 con 0x7f39d0158fa0 2024-08-17T02:25:14.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.749+0000 7f39d6600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d014dd60 con 0x7f39d00aa7d0 2024-08-17T02:25:14.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.749+0000 7f39d6600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d016a2c0 con 0x7f39d006da20 2024-08-17T02:25:14.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.749+0000 7f39cfe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39d0158fa0 0x7f39d015bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:14.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.749+0000 7f39cfe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39d0158fa0 0x7f39d015bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51844/0 (socket says 172.21.15.107:51844) 2024-08-17T02:25:14.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.749+0000 7f39cfe00640 1 -- 172.21.15.107:0/1375458186 learned_addr learned my addr 172.21.15.107:0/1375458186 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:14.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.749+0000 7f39cf400640 1 --2- 172.21.15.107:0/1375458186 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39d006da20 0x7f39d014d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:14.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.749+0000 7f39c6a00640 1 --2- 172.21.15.107:0/1375458186 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39d00aa7d0 0x7f39d0169d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:14.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.750+0000 7f39cfe00640 1 -- 172.21.15.107:0/1375458186 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39d006da20 msgr2=0x7f39d014d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:14.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.750+0000 7f39cfe00640 1 --2- 172.21.15.107:0/1375458186 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39d006da20 0x7f39d014d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.750+0000 7f39cfe00640 1 -- 172.21.15.107:0/1375458186 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39d00aa7d0 msgr2=0x7f39d0169d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:14.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.750+0000 7f39cfe00640 1 --2- 172.21.15.107:0/1375458186 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39d00aa7d0 0x7f39d0169d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.750+0000 7f39cfe00640 1 -- 172.21.15.107:0/1375458186 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c0009390 con 0x7f39d0158fa0 2024-08-17T02:25:14.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.750+0000 7f39cf400640 1 --2- 172.21.15.107:0/1375458186 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39d006da20 0x7f39d014d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:14.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.750+0000 7f39cfe00640 1 --2- 172.21.15.107:0/1375458186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39d0158fa0 0x7f39d015bbd0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f39c800cc20 tx=0x7f39c8001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:14.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.750+0000 7f39c7400640 1 -- 172.21.15.107:0/1375458186 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c800ce40 con 0x7f39d0158fa0 2024-08-17T02:25:14.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.750+0000 7f39c7400640 1 -- 172.21.15.107:0/1375458186 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c800a7f0 con 0x7f39d0158fa0 2024-08-17T02:25:14.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.750+0000 7f39c7400640 1 -- 172.21.15.107:0/1375458186 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c800abb0 con 0x7f39d0158fa0 2024-08-17T02:25:14.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.750+0000 7f39d6600640 1 -- 172.21.15.107:0/1375458186 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39d014c780 con 0x7f39d0158fa0 2024-08-17T02:25:14.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.750+0000 7f39d6600640 1 -- 172.21.15.107:0/1375458186 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39d014cd40 con 0x7f39d0158fa0 2024-08-17T02:25:14.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.751+0000 7f39d6600640 1 -- 172.21.15.107:0/1375458186 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39d014d500 con 0x7f39d0158fa0 2024-08-17T02:25:14.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.752+0000 7f39c7400640 1 -- 172.21.15.107:0/1375458186 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f39c80070f0 con 0x7f39d0158fa0 2024-08-17T02:25:14.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.753+0000 7f39c7400640 1 --2- 172.21.15.107:0/1375458186 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f39ac065150 0x7f39ac067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:14.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.753+0000 7f39c7400640 1 -- 172.21.15.107:0/1375458186 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f39c80822a0 con 0x7f39d0158fa0 2024-08-17T02:25:14.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.753+0000 7f39cf400640 1 --2- 172.21.15.107:0/1375458186 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f39ac065150 0x7f39ac067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:14.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.753+0000 7f39cf400640 1 --2- 172.21.15.107:0/1375458186 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f39ac065150 0x7f39ac067600 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f39c0034000 tx=0x7f39c0032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:14.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.756+0000 7f39c7400640 1 -- 172.21.15.107:0/1375458186 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f39c8054120 con 0x7f39d0158fa0 2024-08-17T02:25:14.929 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.929+0000 7f39d6600640 1 -- 172.21.15.107:0/1375458186 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39d0064db0 con 0x7f39d0158fa0 2024-08-17T02:25:14.930 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.930+0000 7f39c7400640 1 -- 172.21.15.107:0/1375458186 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+12182 (secure 0 0 0) 0x7f39c8053cb0 con 0x7f39d0158fa0 2024-08-17T02:25:14.930 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:25:14.930 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":28,"fsid":"f207b4c0-329d-46b8-b83f-aaf30bdb6ce3","created":"2024-08-17T02:24:11.038049+0000","modified":"2024-08-17T02:25:11.645267+0000","last_up_change":"2024-08-17T02:24:22.047790+0000","last_in_change":"2024-08-17T02:24:13.892720+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:23.456166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"376363f3-b8bf-4f1e-b691-51cdd39171ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37302},{"type":"v1","addr":"172.21.15.107:6801","nonce":37302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37302},{"type":"v1","addr":"172.21.15.107:6803","nonce":37302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37302},{"type":"v1","addr":"172.21.15.107:6807","nonce":37302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37302},{"type":"v1","addr":"172.21.15.107:6805","nonce":37302}]},"public_addr":"172.21.15.107:6801/37302","cluster_addr":"172.21.15.107:6803/37302","heartbeat_back_addr":"172.21.15.107:6807/37302","heartbeat_front_addr":"172.21.15.107:6805/37302","state":["exists","up"]},{"osd":1,"uuid":"cc6624e3-2ad4-4db4-b377-05dfe57424e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37305},{"type":"v1","addr":"172.21.15.107:6824","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37305},{"type":"v1","addr":"172.21.15.107:6827","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37305},{"type":"v1","addr":"172.21.15.107:6831","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37305},{"type":"v1","addr":"172.21.15.107:6829","nonce":37305}]},"public_addr":"172.21.15.107:6824/37305","cluster_addr":"172.21.15.107:6827/37305","heartbeat_back_addr":"172.21.15.107:6831/37305","heartbeat_front_addr":"172.21.15.107:6829/37305","state":["exists","up"]},{"osd":2,"uuid":"25229542-29b5-4281-bcb0-798ae0930aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37307},{"type":"v1","addr":"172.21.15.107:6817","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37307},{"type":"v1","addr":"172.21.15.107:6819","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6823","nonce":37307},{"type":"v1","addr":"172.21.15.107:6825","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37307},{"type":"v1","addr":"172.21.15.107:6821","nonce":37307}]},"public_addr":"172.21.15.107:6817/37307","cluster_addr":"172.21.15.107:6819/37307","heartbeat_back_addr":"172.21.15.107:6825/37307","heartbeat_front_addr":"172.21.15.107:6821/37307","state":["exists","up"]},{"osd":3,"uuid":"5f16aee8-8950-4268-a61a-5cf6ebd670e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37306},{"type":"v1","addr":"172.21.15.107:6809","nonce":37306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37306},{"type":"v1","addr":"172.21.15.107:6811","nonce":37306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37306},{"type":"v1","addr":"172.21.15.107:6815","nonce":37306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37306},{"type":"v1","addr":"172.21.15.107:6813","nonce":37306}]},"public_addr":"172.21.15.107:6809/37306","cluster_addr":"172.21.15.107:6811/37306","heartbeat_back_addr":"172.21.15.107:6815/37306","heartbeat_front_addr":"172.21.15.107:6813/37306","state":["exists","up"]},{"osd":4,"uuid":"23232e28-e23b-4b4e-a531-4939246dbbde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":37329},{"type":"v1","addr":"172.21.15.157:6817","nonce":37329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":37329},{"type":"v1","addr":"172.21.15.157:6819","nonce":37329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":37329},{"type":"v1","addr":"172.21.15.157:6823","nonce":37329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":37329},{"type":"v1","addr":"172.21.15.157:6821","nonce":37329}]},"public_addr":"172.21.15.157:6817/37329","cluster_addr":"172.21.15.157:6819/37329","heartbeat_back_addr":"172.21.15.157:6823/37329","heartbeat_front_addr":"172.21.15.157:6821/37329","state":["exists","up"]},{"osd":5,"uuid":"f87ec331-3e59-4886-a317-6f7e26ec8e21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":37328},{"type":"v1","addr":"172.21.15.157:6804","nonce":37328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":37328},{"type":"v1","addr":"172.21.15.157:6808","nonce":37328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":37328},{"type":"v1","addr":"172.21.15.157:6815","nonce":37328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":37328},{"type":"v1","addr":"172.21.15.157:6812","nonce":37328}]},"public_addr":"172.21.15.157:6804/37328","cluster_addr":"172.21.15.157:6808/37328","heartbeat_back_addr":"172.21.15.157:6815/37328","heartbeat_front_addr":"172.21.15.157:6812/37328","state":["exists","up"]},{"osd":6,"uuid":"92852235-ce49-4d96-a940-6f18d97b13ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":37330},{"type":"v1","addr":"172.21.15.157:6801","nonce":37330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6803","nonce":37330},{"type":"v1","addr":"172.21.15.157:6805","nonce":37330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":37330},{"type":"v1","addr":"172.21.15.157:6813","nonce":37330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":37330},{"type":"v1","addr":"172.21.15.157:6809","nonce":37330}]},"public_addr":"172.21.15.157:6801/37330","cluster_addr":"172.21.15.157:6805/37330","heartbeat_back_addr":"172.21.15.157:6813/37330","heartbeat_front_addr":"172.21.15.157:6809/37330","state":["exists","up"]},{"osd":7,"uuid":"7484a061-723d-4663-b28f-b01766d62f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":37373},{"type":"v1","addr":"172.21.15.157:6825","nonce":37373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":37373},{"type":"v1","addr":"172.21.15.157:6827","nonce":37373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":37373},{"type":"v1","addr":"172.21.15.157:6831","nonce":37373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":37373},{"type":"v1","addr":"172.21.15.157:6829","nonce":37373}]},"public_addr":"172.21.15.157:6825/37373","cluster_addr":"172.21.15.157:6827/37373","heartbeat_back_addr":"172.21.15.157:6831/37373","heartbeat_front_addr":"172.21.15.157:6829/37373","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.110188+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.280265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.252119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.267996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.284582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.144420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.174764+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.308002+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:14.932 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.932+0000 7f39d6600640 1 -- 172.21.15.107:0/1375458186 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f39ac065150 msgr2=0x7f39ac067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:14.932 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.932+0000 7f39d6600640 1 --2- 172.21.15.107:0/1375458186 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f39ac065150 0x7f39ac067600 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f39c0034000 tx=0x7f39c0032000 comp rx=0 tx=0).stop 2024-08-17T02:25:14.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.932+0000 7f39d6600640 1 -- 172.21.15.107:0/1375458186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39d0158fa0 msgr2=0x7f39d015bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:14.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.932+0000 7f39d6600640 1 --2- 172.21.15.107:0/1375458186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39d0158fa0 0x7f39d015bbd0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f39c800cc20 tx=0x7f39c8001a40 comp rx=0 tx=0).stop 2024-08-17T02:25:14.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.932+0000 7f39d6600640 1 -- 172.21.15.107:0/1375458186 shutdown_connections 2024-08-17T02:25:14.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.932+0000 7f39d6600640 1 --2- 172.21.15.107:0/1375458186 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f39ac065150 0x7f39ac067600 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.932+0000 7f39d6600640 1 --2- 172.21.15.107:0/1375458186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39d0158fa0 0x7f39d015bbd0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.932+0000 7f39d6600640 1 --2- 172.21.15.107:0/1375458186 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39d00aa7d0 0x7f39d0169d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.932+0000 7f39d6600640 1 --2- 172.21.15.107:0/1375458186 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39d006da20 0x7f39d014d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.932+0000 7f39d6600640 1 -- 172.21.15.107:0/1375458186 >> 172.21.15.107:0/1375458186 conn(0x7f39d00cb9b0 msgr2=0x7f39d006c730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:14.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.932+0000 7f39d6600640 1 -- 172.21.15.107:0/1375458186 shutdown_connections 2024-08-17T02:25:14.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:14.932+0000 7f39d6600640 1 -- 172.21.15.107:0/1375458186 wait complete. 2024-08-17T02:25:14.947 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:24:23.456166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:25:14.947 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:25:15.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.098+0000 7fa80fc00640 1 Processor -- start 2024-08-17T02:25:15.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.098+0000 7fa80fc00640 1 -- start start 2024-08-17T02:25:15.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.099+0000 7fa80fc00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa808155420 0x7fa808160140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.100+0000 7fa80fc00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8080c83e0 con 0x7fa80806d9e0 2024-08-17T02:25:15.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.100+0000 7fa80fc00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8080cb7d0 con 0x7fa80806ddb0 2024-08-17T02:25:15.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.100+0000 7fa80fc00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8080aed90 con 0x7fa808155420 2024-08-17T02:25:15.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.100+0000 7fa80d200640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fa80806d9e0 0x7fa8080cb0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:59698/0 (socket says 172.21.15.107:59698) 2024-08-17T02:25:15.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.100+0000 7fa80d200640 1 -- 172.21.15.107:0/283862647 learned_addr learned my addr 172.21.15.107:0/283862647 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:25:15.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.100+0000 7fa80dc00640 1 --2- 172.21.15.107:0/283862647 >> v2:172.21.15.107:3300/0 conn(0x7fa808155420 0x7fa808160140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.100+0000 7fa807e00640 1 -- 172.21.15.107:0/283862647 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3447232127 0 0) 0x7fa8080c83e0 con 0x7fa80806d9e0 2024-08-17T02:25:15.103 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.100+0000 7fa807e00640 1 -- 172.21.15.107:0/283862647 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7ec0045f0 con 0x7fa80806d9e0 2024-08-17T02:25:15.103 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.100+0000 7fa80dc00640 1 -- 172.21.15.107:0/283862647 >> v1:172.21.15.157:6789/0 conn(0x7fa80806ddb0 legacy=0x7fa808154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:15.103 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.100+0000 7fa80dc00640 1 -- 172.21.15.107:0/283862647 >> v1:172.21.15.107:6789/0 conn(0x7fa80806d9e0 legacy=0x7fa8080cb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.103 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.100+0000 7fa80dc00640 1 -- 172.21.15.107:0/283862647 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8080af070 con 0x7fa808155420 2024-08-17T02:25:15.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.101+0000 7fa80dc00640 1 --2- 172.21.15.107:0/283862647 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa808155420 0x7fa808160140 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa800009e60 tx=0x7fa800009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4e1ed9be5e849e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:15.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.102+0000 7fa807e00640 1 -- 172.21.15.107:0/283862647 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa800007550 con 0x7fa808155420 2024-08-17T02:25:15.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.102+0000 7fa807e00640 1 -- 172.21.15.107:0/283862647 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80002d050 con 0x7fa808155420 2024-08-17T02:25:15.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.102+0000 7fa807e00640 1 -- 172.21.15.107:0/283862647 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8000078e0 con 0x7fa808155420 2024-08-17T02:25:15.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.102+0000 7fa80fc00640 1 -- 172.21.15.107:0/283862647 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa808155420 msgr2=0x7fa808160140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.102+0000 7fa80fc00640 1 --2- 172.21.15.107:0/283862647 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa808155420 0x7fa808160140 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa800009e60 tx=0x7fa800009780 comp rx=0 tx=0).stop 2024-08-17T02:25:15.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.102+0000 7fa80fc00640 1 -- 172.21.15.107:0/283862647 shutdown_connections 2024-08-17T02:25:15.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.102+0000 7fa80fc00640 1 --2- 172.21.15.107:0/283862647 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa808155420 0x7fa808160140 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.102+0000 7fa80fc00640 1 -- 172.21.15.107:0/283862647 >> 172.21.15.107:0/283862647 conn(0x7fa808067750 msgr2=0x7fa8080cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:15.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.102+0000 7fa80fc00640 1 -- 172.21.15.107:0/283862647 shutdown_connections 2024-08-17T02:25:15.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.102+0000 7fa80fc00640 1 -- 172.21.15.107:0/283862647 wait complete. 2024-08-17T02:25:15.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.104+0000 7fa80fc00640 1 Processor -- start 2024-08-17T02:25:15.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.104+0000 7fa80fc00640 1 -- start start 2024-08-17T02:25:15.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.105+0000 7fa80fc00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa80806d9e0 0x7fa8081688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.105+0000 7fa80fc00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa80806ddb0 0x7fa8080c5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.105+0000 7fa80fc00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa808155420 0x7fa808152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.105+0000 7fa80fc00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8080c6430 con 0x7fa80806d9e0 2024-08-17T02:25:15.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.105+0000 7fa80fc00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa808153460 con 0x7fa808155420 2024-08-17T02:25:15.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.105+0000 7fa80fc00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8080c6620 con 0x7fa80806ddb0 2024-08-17T02:25:15.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.105+0000 7fa80d200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa80806d9e0 0x7fa8081688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.105+0000 7fa80d200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa80806d9e0 0x7fa8081688a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51854/0 (socket says 172.21.15.107:51854) 2024-08-17T02:25:15.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.105+0000 7fa80d200640 1 -- 172.21.15.107:0/2660084863 learned_addr learned my addr 172.21.15.107:0/2660084863 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:15.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.105+0000 7fa7ffe00640 1 --2- 172.21.15.107:0/2660084863 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa80806ddb0 0x7fa8080c5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.105+0000 7fa80dc00640 1 --2- 172.21.15.107:0/2660084863 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa808155420 0x7fa808152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.105+0000 7fa80d200640 1 -- 172.21.15.107:0/2660084863 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa80806ddb0 msgr2=0x7fa8080c5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.105+0000 7fa80d200640 1 --2- 172.21.15.107:0/2660084863 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa80806ddb0 0x7fa8080c5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.105+0000 7fa80d200640 1 -- 172.21.15.107:0/2660084863 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa808155420 msgr2=0x7fa808152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.105+0000 7fa80d200640 1 --2- 172.21.15.107:0/2660084863 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa808155420 0x7fa808152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.105+0000 7fa80d200640 1 -- 172.21.15.107:0/2660084863 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa800009a20 con 0x7fa80806d9e0 2024-08-17T02:25:15.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.105+0000 7fa80d200640 1 --2- 172.21.15.107:0/2660084863 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa80806d9e0 0x7fa8081688a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa7f800c5b0 tx=0x7fa7f8007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:15.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.106+0000 7fa804c00640 1 -- 172.21.15.107:0/2660084863 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8005b70 con 0x7fa80806d9e0 2024-08-17T02:25:15.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.106+0000 7fa804c00640 1 -- 172.21.15.107:0/2660084863 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f8005cf0 con 0x7fa80806d9e0 2024-08-17T02:25:15.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.106+0000 7fa80fc00640 1 -- 172.21.15.107:0/2660084863 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8080c6900 con 0x7fa80806d9e0 2024-08-17T02:25:15.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.106+0000 7fa804c00640 1 -- 172.21.15.107:0/2660084863 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8007340 con 0x7fa80806d9e0 2024-08-17T02:25:15.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.106+0000 7fa80fc00640 1 -- 172.21.15.107:0/2660084863 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8080c6ec0 con 0x7fa80806d9e0 2024-08-17T02:25:15.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.107+0000 7fa80fc00640 1 -- 172.21.15.107:0/2660084863 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa808064db0 con 0x7fa80806d9e0 2024-08-17T02:25:15.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.108+0000 7fa804c00640 1 -- 172.21.15.107:0/2660084863 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa7f801b400 con 0x7fa80806d9e0 2024-08-17T02:25:15.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.109+0000 7fa804c00640 1 --2- 172.21.15.107:0/2660084863 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fa7e4065150 0x7fa7e4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.109+0000 7fa804c00640 1 -- 172.21.15.107:0/2660084863 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa7f8081d40 con 0x7fa80806d9e0 2024-08-17T02:25:15.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.109+0000 7fa7ffe00640 1 --2- 172.21.15.107:0/2660084863 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fa7e4065150 0x7fa7e4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.110+0000 7fa7ffe00640 1 --2- 172.21.15.107:0/2660084863 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fa7e4065150 0x7fa7e4067600 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa8080b0700 tx=0x7fa7f0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:15.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.113+0000 7fa804c00640 1 -- 172.21.15.107:0/2660084863 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa7f8050130 con 0x7fa80806d9e0 2024-08-17T02:25:15.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.285+0000 7fa80fc00640 1 -- 172.21.15.107:0/2660084863 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa808156750 con 0x7fa80806d9e0 2024-08-17T02:25:15.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.286+0000 7fa804c00640 1 -- 172.21.15.107:0/2660084863 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa7f8053750 con 0x7fa80806d9e0 2024-08-17T02:25:15.349 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2024-08-17T02:25:15.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.288+0000 7fa80fc00640 1 -- 172.21.15.107:0/2660084863 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fa7e4065150 msgr2=0x7fa7e4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.288+0000 7fa80fc00640 1 --2- 172.21.15.107:0/2660084863 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fa7e4065150 0x7fa7e4067600 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa8080b0700 tx=0x7fa7f0009040 comp rx=0 tx=0).stop 2024-08-17T02:25:15.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.288+0000 7fa80fc00640 1 -- 172.21.15.107:0/2660084863 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa80806d9e0 msgr2=0x7fa8081688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.288+0000 7fa80fc00640 1 --2- 172.21.15.107:0/2660084863 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa80806d9e0 0x7fa8081688a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa7f800c5b0 tx=0x7fa7f8007d70 comp rx=0 tx=0).stop 2024-08-17T02:25:15.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.288+0000 7fa80fc00640 1 -- 172.21.15.107:0/2660084863 shutdown_connections 2024-08-17T02:25:15.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.288+0000 7fa80fc00640 1 --2- 172.21.15.107:0/2660084863 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fa7e4065150 0x7fa7e4067600 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.288+0000 7fa80fc00640 1 --2- 172.21.15.107:0/2660084863 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa808155420 0x7fa808152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.288+0000 7fa80fc00640 1 --2- 172.21.15.107:0/2660084863 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa80806ddb0 0x7fa8080c5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.288+0000 7fa80fc00640 1 --2- 172.21.15.107:0/2660084863 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa80806d9e0 0x7fa8081688a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.288+0000 7fa80fc00640 1 -- 172.21.15.107:0/2660084863 >> 172.21.15.107:0/2660084863 conn(0x7fa808067750 msgr2=0x7fa8080ca6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:15.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.288+0000 7fa80fc00640 1 -- 172.21.15.107:0/2660084863 shutdown_connections 2024-08-17T02:25:15.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.288+0000 7fa80fc00640 1 -- 172.21.15.107:0/2660084863 wait complete. 2024-08-17T02:25:15.352 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-17T02:25:15.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.499+0000 7fe601a00640 1 Processor -- start 2024-08-17T02:25:15.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.499+0000 7fe601a00640 1 -- start start 2024-08-17T02:25:15.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.501+0000 7fe601a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe5fc06df00 0x7fe5fc0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.501+0000 7fe601a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5fc156670 con 0x7fe5fc155df0 2024-08-17T02:25:15.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.501+0000 7fe601a00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5fc06e5e0 con 0x7fe5fc155a20 2024-08-17T02:25:15.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.501+0000 7fe601a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5fc0b0350 con 0x7fe5fc06df00 2024-08-17T02:25:15.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.501+0000 7fe5f2000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe5fc06df00 0x7fe5fc0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.501+0000 7fe5fb400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fe5fc155df0 0x7fe5fc156b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:59708/0 (socket says 172.21.15.107:59708) 2024-08-17T02:25:15.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.501+0000 7fe5fb400640 1 -- 172.21.15.107:0/3096399739 learned_addr learned my addr 172.21.15.107:0/3096399739 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:25:15.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.501+0000 7fe5f2000640 1 -- 172.21.15.107:0/3096399739 >> v1:172.21.15.157:6789/0 conn(0x7fe5fc155a20 legacy=0x7fe5fc06d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.501+0000 7fe5f2000640 1 -- 172.21.15.107:0/3096399739 >> v1:172.21.15.107:6789/0 conn(0x7fe5fc155df0 legacy=0x7fe5fc156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.501+0000 7fe5f2000640 1 -- 172.21.15.107:0/3096399739 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5fc06e8c0 con 0x7fe5fc06df00 2024-08-17T02:25:15.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.502+0000 7fe5f2000640 1 --2- 172.21.15.107:0/3096399739 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5fc06df00 0x7fe5fc0adf10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe5e400baf0 tx=0x7fe5e400b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f06b54e26b85824 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:15.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.503+0000 7fe5fa000640 1 -- 172.21.15.107:0/3096399739 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e4032600 con 0x7fe5fc06df00 2024-08-17T02:25:15.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.503+0000 7fe5fa000640 1 -- 172.21.15.107:0/3096399739 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e4032760 con 0x7fe5fc06df00 2024-08-17T02:25:15.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.503+0000 7fe5fa000640 1 -- 172.21.15.107:0/3096399739 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e4032b40 con 0x7fe5fc06df00 2024-08-17T02:25:15.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.503+0000 7fe601a00640 1 -- 172.21.15.107:0/3096399739 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5fc06df00 msgr2=0x7fe5fc0adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.503+0000 7fe601a00640 1 --2- 172.21.15.107:0/3096399739 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5fc06df00 0x7fe5fc0adf10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe5e400baf0 tx=0x7fe5e400b3b0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.503+0000 7fe601a00640 1 -- 172.21.15.107:0/3096399739 shutdown_connections 2024-08-17T02:25:15.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.503+0000 7fe601a00640 1 --2- 172.21.15.107:0/3096399739 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5fc06df00 0x7fe5fc0adf10 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.503+0000 7fe601a00640 1 -- 172.21.15.107:0/3096399739 >> 172.21.15.107:0/3096399739 conn(0x7fe5fc0cb9b0 msgr2=0x7fe5fc0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:15.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.503+0000 7fe601a00640 1 -- 172.21.15.107:0/3096399739 shutdown_connections 2024-08-17T02:25:15.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.503+0000 7fe601a00640 1 -- 172.21.15.107:0/3096399739 wait complete. 2024-08-17T02:25:15.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.505+0000 7fe601a00640 1 Processor -- start 2024-08-17T02:25:15.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.505+0000 7fe601a00640 1 -- start start 2024-08-17T02:25:15.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.506+0000 7fe601a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5fc06df00 0x7fe5fc1495a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.506+0000 7fe601a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5fc155a20 0x7fe5fc169410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.506+0000 7fe601a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5fc155df0 0x7fe5fc0c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.506+0000 7fe601a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc0c20a0 con 0x7fe5fc155a20 2024-08-17T02:25:15.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.506+0000 7fe601a00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc0aa6a0 con 0x7fe5fc06df00 2024-08-17T02:25:15.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.506+0000 7fe601a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc0aa980 con 0x7fe5fc155df0 2024-08-17T02:25:15.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.506+0000 7fe5f2000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5fc155a20 0x7fe5fc169410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.506+0000 7fe5f2000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5fc155a20 0x7fe5fc169410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51884/0 (socket says 172.21.15.107:51884) 2024-08-17T02:25:15.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.506+0000 7fe5f2000640 1 -- 172.21.15.107:0/4076095460 learned_addr learned my addr 172.21.15.107:0/4076095460 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:15.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.506+0000 7fe5faa00640 1 --2- 172.21.15.107:0/4076095460 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5fc06df00 0x7fe5fc1495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.506+0000 7fe5fb400640 1 --2- 172.21.15.107:0/4076095460 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5fc155df0 0x7fe5fc0c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.508 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.506+0000 7fe5f2000640 1 -- 172.21.15.107:0/4076095460 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5fc155df0 msgr2=0x7fe5fc0c2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.508 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.506+0000 7fe5f2000640 1 --2- 172.21.15.107:0/4076095460 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5fc155df0 0x7fe5fc0c2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.508 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.506+0000 7fe5f2000640 1 -- 172.21.15.107:0/4076095460 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5fc06df00 msgr2=0x7fe5fc1495a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.508 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.506+0000 7fe5f2000640 1 --2- 172.21.15.107:0/4076095460 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5fc06df00 0x7fe5fc1495a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.508 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.506+0000 7fe5f2000640 1 -- 172.21.15.107:0/4076095460 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e400b630 con 0x7fe5fc155a20 2024-08-17T02:25:15.508 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.506+0000 7fe5faa00640 1 --2- 172.21.15.107:0/4076095460 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5fc06df00 0x7fe5fc1495a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:15.508 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.507+0000 7fe5f2000640 1 --2- 172.21.15.107:0/4076095460 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5fc155a20 0x7fe5fc169410 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe5e400baf0 tx=0x7fe5e403a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:15.509 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.507+0000 7fe5f2a00640 1 -- 172.21.15.107:0/4076095460 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e4000d10 con 0x7fe5fc155a20 2024-08-17T02:25:15.509 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.507+0000 7fe5f2a00640 1 -- 172.21.15.107:0/4076095460 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e403be00 con 0x7fe5fc155a20 2024-08-17T02:25:15.509 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.507+0000 7fe601a00640 1 -- 172.21.15.107:0/4076095460 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5fc0aac60 con 0x7fe5fc155a20 2024-08-17T02:25:15.509 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.507+0000 7fe5f2a00640 1 -- 172.21.15.107:0/4076095460 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e403c640 con 0x7fe5fc155a20 2024-08-17T02:25:15.509 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.507+0000 7fe601a00640 1 -- 172.21.15.107:0/4076095460 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5fc169950 con 0x7fe5fc155a20 2024-08-17T02:25:15.509 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.508+0000 7fe601a00640 1 -- 172.21.15.107:0/4076095460 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5fc0ab160 con 0x7fe5fc155a20 2024-08-17T02:25:15.509 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.509+0000 7fe5f2a00640 1 -- 172.21.15.107:0/4076095460 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe5e4044030 con 0x7fe5fc155a20 2024-08-17T02:25:15.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.510+0000 7fe5f2a00640 1 --2- 172.21.15.107:0/4076095460 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe5d8065150 0x7fe5d8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.510+0000 7fe5f2a00640 1 -- 172.21.15.107:0/4076095460 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe5e4042070 con 0x7fe5fc155a20 2024-08-17T02:25:15.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.510+0000 7fe5faa00640 1 --2- 172.21.15.107:0/4076095460 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe5d8065150 0x7fe5d8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.511+0000 7fe5faa00640 1 --2- 172.21.15.107:0/4076095460 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe5d8065150 0x7fe5d8067600 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec001820 tx=0x7fe5ec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:15.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.514+0000 7fe5f2a00640 1 -- 172.21.15.107:0/4076095460 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe5e4071590 con 0x7fe5fc155a20 2024-08-17T02:25:15.692 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.692+0000 7fe601a00640 1 -- 172.21.15.107:0/4076095460 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe5fc064db0 con 0x7fe5fc155a20 2024-08-17T02:25:15.692 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.692+0000 7fe5f2a00640 1 -- 172.21.15.107:0/4076095460 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) v1 ==== 84+0+65 (secure 0 0 0) 0x7fe5e4074bb0 con 0x7fe5fc155a20 2024-08-17T02:25:15.693 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:25:15.693 INFO:teuthology.orchestra.run.smithi107.stdout:[ 2024-08-17T02:25:15.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-08-17T02:25:15.693 INFO:teuthology.orchestra.run.smithi107.stdout: "poolnum": 1, 2024-08-17T02:25:15.693 INFO:teuthology.orchestra.run.smithi107.stdout: "poolname": ".mgr" 2024-08-17T02:25:15.693 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-08-17T02:25:15.693 INFO:teuthology.orchestra.run.smithi107.stdout:] 2024-08-17T02:25:15.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.694+0000 7fe601a00640 1 -- 172.21.15.107:0/4076095460 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe5d8065150 msgr2=0x7fe5d8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.694+0000 7fe601a00640 1 --2- 172.21.15.107:0/4076095460 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe5d8065150 0x7fe5d8067600 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec001820 tx=0x7fe5ec009040 comp rx=0 tx=0).stop 2024-08-17T02:25:15.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.694+0000 7fe601a00640 1 -- 172.21.15.107:0/4076095460 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5fc155a20 msgr2=0x7fe5fc169410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.694+0000 7fe601a00640 1 --2- 172.21.15.107:0/4076095460 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5fc155a20 0x7fe5fc169410 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe5e400baf0 tx=0x7fe5e403a000 comp rx=0 tx=0).stop 2024-08-17T02:25:15.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.694+0000 7fe601a00640 1 -- 172.21.15.107:0/4076095460 shutdown_connections 2024-08-17T02:25:15.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.694+0000 7fe601a00640 1 --2- 172.21.15.107:0/4076095460 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe5d8065150 0x7fe5d8067600 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.694+0000 7fe601a00640 1 --2- 172.21.15.107:0/4076095460 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5fc155df0 0x7fe5fc0c2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.694+0000 7fe601a00640 1 --2- 172.21.15.107:0/4076095460 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5fc155a20 0x7fe5fc169410 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.694+0000 7fe601a00640 1 --2- 172.21.15.107:0/4076095460 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5fc06df00 0x7fe5fc1495a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.696 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.694+0000 7fe601a00640 1 -- 172.21.15.107:0/4076095460 >> 172.21.15.107:0/4076095460 conn(0x7fe5fc0cb9b0 msgr2=0x7fe5fc154900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:15.696 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.695+0000 7fe601a00640 1 -- 172.21.15.107:0/4076095460 shutdown_connections 2024-08-17T02:25:15.696 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.695+0000 7fe601a00640 1 -- 172.21.15.107:0/4076095460 wait complete. 2024-08-17T02:25:15.710 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-17T02:25:15.710 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-17T02:25:15.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.860+0000 7fc30e800640 1 Processor -- start 2024-08-17T02:25:15.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.861+0000 7fc30e800640 1 -- start start 2024-08-17T02:25:15.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.862+0000 7fc30e800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc308158c20 0x7fc3080ac040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.862+0000 7fc30e800640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc3080ac580 0x7fc308068fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.862+0000 7fc30e800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3080aeca0 con 0x7fc308069510 2024-08-17T02:25:15.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.862+0000 7fc30e800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3080ac9d0 con 0x7fc308158c20 2024-08-17T02:25:15.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.862+0000 7fc30e800640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3080ae3e0 con 0x7fc3080ac580 2024-08-17T02:25:15.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.862+0000 7fc30d400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc308158c20 0x7fc3080ac040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.862+0000 7fc30d400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc308158c20 0x7fc3080ac040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51898/0 (socket says 172.21.15.107:51898) 2024-08-17T02:25:15.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.862+0000 7fc30d400640 1 -- 172.21.15.107:0/465347667 learned_addr learned my addr 172.21.15.107:0/465347667 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:15.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.862+0000 7fc30de00640 1 --1- 172.21.15.107:0/465347667 >> v1:172.21.15.107:6789/0 conn(0x7fc308069510 0x7fc3080aa7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:59710/0 (socket says 172.21.15.107:59710) 2024-08-17T02:25:15.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.862+0000 7fc30ca00640 1 --2- 172.21.15.107:0/465347667 >> v2:172.21.15.157:3300/0 conn(0x7fc3080ac580 0x7fc308068fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.863+0000 7fc30d400640 1 -- 172.21.15.107:0/465347667 >> v2:172.21.15.157:3300/0 conn(0x7fc3080ac580 msgr2=0x7fc308068fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:15.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.863+0000 7fc30d400640 1 --2- 172.21.15.107:0/465347667 >> v2:172.21.15.157:3300/0 conn(0x7fc3080ac580 0x7fc308068fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.863+0000 7fc30d400640 1 -- 172.21.15.107:0/465347667 >> v1:172.21.15.107:6789/0 conn(0x7fc308069510 legacy=0x7fc3080aa7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.863+0000 7fc30d400640 1 -- 172.21.15.107:0/465347667 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3080ae650 con 0x7fc308158c20 2024-08-17T02:25:15.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.863+0000 7fc307e00640 1 -- 172.21.15.107:0/465347667 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3584331033 0 0) 0x7fc3080aeca0 con 0x7fc308069510 2024-08-17T02:25:15.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.864+0000 7fc30d400640 1 --2- 172.21.15.107:0/465347667 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc308158c20 0x7fc3080ac040 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc30806d250 tx=0x7fc2fc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=154c538136cbbf6f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:15.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.864+0000 7fc307e00640 1 -- 172.21.15.107:0/465347667 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc02add0 con 0x7fc308158c20 2024-08-17T02:25:15.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.864+0000 7fc307e00640 1 -- 172.21.15.107:0/465347667 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2fc032440 con 0x7fc308158c20 2024-08-17T02:25:15.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.864+0000 7fc307e00640 1 -- 172.21.15.107:0/465347667 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc0327e0 con 0x7fc308158c20 2024-08-17T02:25:15.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.864+0000 7fc30e800640 1 -- 172.21.15.107:0/465347667 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc308158c20 msgr2=0x7fc3080ac040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.864+0000 7fc30e800640 1 --2- 172.21.15.107:0/465347667 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc308158c20 0x7fc3080ac040 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc30806d250 tx=0x7fc2fc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.865+0000 7fc30e800640 1 -- 172.21.15.107:0/465347667 shutdown_connections 2024-08-17T02:25:15.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.865+0000 7fc30e800640 1 --2- 172.21.15.107:0/465347667 >> v2:172.21.15.157:3300/0 conn(0x7fc3080ac580 0x7fc308068fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.865+0000 7fc30e800640 1 --2- 172.21.15.107:0/465347667 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc308158c20 0x7fc3080ac040 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.865+0000 7fc30e800640 1 -- 172.21.15.107:0/465347667 >> 172.21.15.107:0/465347667 conn(0x7fc308096a70 msgr2=0x7fc308096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:15.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.865+0000 7fc30e800640 1 -- 172.21.15.107:0/465347667 shutdown_connections 2024-08-17T02:25:15.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.865+0000 7fc30e800640 1 -- 172.21.15.107:0/465347667 wait complete. 2024-08-17T02:25:15.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.866+0000 7fc30e800640 1 Processor -- start 2024-08-17T02:25:15.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.866+0000 7fc30e800640 1 -- start start 2024-08-17T02:25:15.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.867+0000 7fc30e800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc308069510 0x7fc308169a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.867+0000 7fc30e800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3080ac580 0x7fc308149fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.867+0000 7fc30e800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc308158c20 0x7fc308068650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.867+0000 7fc30e800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30816c700 con 0x7fc3080ac580 2024-08-17T02:25:15.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.867+0000 7fc30e800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc308169f40 con 0x7fc308158c20 2024-08-17T02:25:15.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.867+0000 7fc30e800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc30814a520 con 0x7fc308069510 2024-08-17T02:25:15.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.867+0000 7fc30ca00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3080ac580 0x7fc308149fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.867+0000 7fc30ca00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3080ac580 0x7fc308149fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51902/0 (socket says 172.21.15.107:51902) 2024-08-17T02:25:15.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.867+0000 7fc30ca00640 1 -- 172.21.15.107:0/1169484140 learned_addr learned my addr 172.21.15.107:0/1169484140 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:15.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.867+0000 7fc30d400640 1 --2- 172.21.15.107:0/1169484140 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc308069510 0x7fc308169a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.867+0000 7fc30de00640 1 --2- 172.21.15.107:0/1169484140 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc308158c20 0x7fc308068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.868+0000 7fc30ca00640 1 -- 172.21.15.107:0/1169484140 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc308069510 msgr2=0x7fc308169a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.868+0000 7fc30ca00640 1 --2- 172.21.15.107:0/1169484140 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc308069510 0x7fc308169a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.868+0000 7fc30ca00640 1 -- 172.21.15.107:0/1169484140 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc308158c20 msgr2=0x7fc308068650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.868+0000 7fc30ca00640 1 --2- 172.21.15.107:0/1169484140 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc308158c20 0x7fc308068650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.868+0000 7fc30ca00640 1 -- 172.21.15.107:0/1169484140 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2fc009450 con 0x7fc3080ac580 2024-08-17T02:25:15.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.868+0000 7fc30de00640 1 --2- 172.21.15.107:0/1169484140 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc308158c20 0x7fc308068650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:15.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.868+0000 7fc30ca00640 1 --2- 172.21.15.107:0/1169484140 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3080ac580 0x7fc308149fe0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc2f400d890 tx=0x7fc2f4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:15.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.868+0000 7fc304c00640 1 -- 172.21.15.107:0/1169484140 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f400de20 con 0x7fc3080ac580 2024-08-17T02:25:15.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.868+0000 7fc304c00640 1 -- 172.21.15.107:0/1169484140 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f400b8d0 con 0x7fc3080ac580 2024-08-17T02:25:15.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.868+0000 7fc30e800640 1 -- 172.21.15.107:0/1169484140 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc30816c950 con 0x7fc3080ac580 2024-08-17T02:25:15.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.868+0000 7fc304c00640 1 -- 172.21.15.107:0/1169484140 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f400bc70 con 0x7fc3080ac580 2024-08-17T02:25:15.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.868+0000 7fc30e800640 1 -- 172.21.15.107:0/1169484140 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc30816cf10 con 0x7fc3080ac580 2024-08-17T02:25:15.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.869+0000 7fc30e800640 1 -- 172.21.15.107:0/1169484140 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc308071050 con 0x7fc3080ac580 2024-08-17T02:25:15.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.870+0000 7fc304c00640 1 -- 172.21.15.107:0/1169484140 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc2f4014640 con 0x7fc3080ac580 2024-08-17T02:25:15.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.871+0000 7fc304c00640 1 --2- 172.21.15.107:0/1169484140 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fc2e8065150 0x7fc2e8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.871+0000 7fc304c00640 1 -- 172.21.15.107:0/1169484140 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc2f4082760 con 0x7fc3080ac580 2024-08-17T02:25:15.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.871+0000 7fc30d400640 1 --2- 172.21.15.107:0/1169484140 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fc2e8065150 0x7fc2e8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.872+0000 7fc30d400640 1 --2- 172.21.15.107:0/1169484140 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fc2e8065150 0x7fc2e8067600 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc034000 tx=0x7fc2fc032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:15.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:15.875+0000 7fc304c00640 1 -- 172.21.15.107:0/1169484140 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc2f4050b90 con 0x7fc3080ac580 2024-08-17T02:25:16.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.047+0000 7fc30e800640 1 -- 172.21.15.107:0/1169484140 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc3081548b0 con 0x7fc3080ac580 2024-08-17T02:25:16.657 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.657+0000 7fc304c00640 1 -- 172.21.15.107:0/1169484140 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc2f40541b0 con 0x7fc3080ac580 2024-08-17T02:25:16.660 INFO:teuthology.orchestra.run.smithi107.stderr:pool 'cephfs_metadata' created 2024-08-17T02:25:16.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.661+0000 7fc30e800640 1 -- 172.21.15.107:0/1169484140 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fc2e8065150 msgr2=0x7fc2e8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:16.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.661+0000 7fc30e800640 1 --2- 172.21.15.107:0/1169484140 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fc2e8065150 0x7fc2e8067600 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc034000 tx=0x7fc2fc032000 comp rx=0 tx=0).stop 2024-08-17T02:25:16.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.661+0000 7fc30e800640 1 -- 172.21.15.107:0/1169484140 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3080ac580 msgr2=0x7fc308149fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:16.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.661+0000 7fc30e800640 1 --2- 172.21.15.107:0/1169484140 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3080ac580 0x7fc308149fe0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc2f400d890 tx=0x7fc2f4008040 comp rx=0 tx=0).stop 2024-08-17T02:25:16.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.662+0000 7fc30e800640 1 -- 172.21.15.107:0/1169484140 shutdown_connections 2024-08-17T02:25:16.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.662+0000 7fc30e800640 1 --2- 172.21.15.107:0/1169484140 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fc2e8065150 0x7fc2e8067600 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.662+0000 7fc30e800640 1 --2- 172.21.15.107:0/1169484140 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc308158c20 0x7fc308068650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.662+0000 7fc30e800640 1 --2- 172.21.15.107:0/1169484140 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3080ac580 0x7fc308149fe0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.662+0000 7fc30e800640 1 --2- 172.21.15.107:0/1169484140 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc308069510 0x7fc308169a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.662+0000 7fc30e800640 1 -- 172.21.15.107:0/1169484140 >> 172.21.15.107:0/1169484140 conn(0x7fc308096a70 msgr2=0x7fc308155c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:16.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.662+0000 7fc30e800640 1 -- 172.21.15.107:0/1169484140 shutdown_connections 2024-08-17T02:25:16.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.662+0000 7fc30e800640 1 -- 172.21.15.107:0/1169484140 wait complete. 2024-08-17T02:25:16.679 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-17T02:25:16.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.833+0000 7fdaa3c00640 1 Processor -- start 2024-08-17T02:25:16.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.834+0000 7fdaa3c00640 1 -- start start 2024-08-17T02:25:16.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.835+0000 7fdaa3c00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fda9c1561c0 0x7fda9c0cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:16.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.835+0000 7fdaa3c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda9c156910 con 0x7fda9c0ad170 2024-08-17T02:25:16.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.835+0000 7fdaa3c00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda9c0cb580 con 0x7fda9c152d80 2024-08-17T02:25:16.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.835+0000 7fdaa3c00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda9c1565b0 con 0x7fda9c1561c0 2024-08-17T02:25:16.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.835+0000 7fda93e00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fda9c0ad170 0x7fda9c157920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:47690/0 (socket says 172.21.15.107:47690) 2024-08-17T02:25:16.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.835+0000 7fda93e00640 1 -- 172.21.15.107:0/2548912827 learned_addr learned my addr 172.21.15.107:0/2548912827 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:25:16.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.836+0000 7fda9be00640 1 -- 172.21.15.107:0/2548912827 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 512227886 0 0) 0x7fda9c156910 con 0x7fda9c0ad170 2024-08-17T02:25:16.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.836+0000 7fda9be00640 1 -- 172.21.15.107:0/2548912827 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda800034e0 con 0x7fda9c0ad170 2024-08-17T02:25:16.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.836+0000 7fdaa1c00640 1 --2- 172.21.15.107:0/2548912827 >> v2:172.21.15.157:3300/0 conn(0x7fda9c1561c0 0x7fda9c0cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:16.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.836+0000 7fda9be00640 1 -- 172.21.15.107:0/2548912827 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2646300015 0 0) 0x7fda800034e0 con 0x7fda9c0ad170 2024-08-17T02:25:16.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.836+0000 7fda9be00640 1 -- 172.21.15.107:0/2548912827 >> v2:172.21.15.157:3300/0 conn(0x7fda9c1561c0 msgr2=0x7fda9c0cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:16.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.836+0000 7fda9be00640 1 --2- 172.21.15.107:0/2548912827 >> v2:172.21.15.157:3300/0 conn(0x7fda9c1561c0 0x7fda9c0cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.836+0000 7fda9be00640 1 -- 172.21.15.107:0/2548912827 >> v1:172.21.15.157:6789/0 conn(0x7fda9c152d80 legacy=0x7fda9c0aca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:16.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.836+0000 7fda9be00640 1 -- 172.21.15.107:0/2548912827 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9c153150 con 0x7fda9c0ad170 2024-08-17T02:25:16.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.836+0000 7fda9be00640 1 -- 172.21.15.107:0/2548912827 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 537989081 0 0) 0x7fda84001470 con 0x7fda9c0ad170 2024-08-17T02:25:16.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.836+0000 7fdaa1c00640 1 --2- 172.21.15.107:0/2548912827 >> v2:172.21.15.157:3300/0 conn(0x7fda9c1561c0 0x7fda9c0cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:16.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.836+0000 7fda9be00640 1 -- 172.21.15.107:0/2548912827 >> v1:172.21.15.107:6789/0 conn(0x7fda9c0ad170 legacy=0x7fda9c157920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:16.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.836+0000 7fda9be00640 1 --2- 172.21.15.107:0/2548912827 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda800039d0 0x7fda80003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:16.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.836+0000 7fda9be00640 1 --2- 172.21.15.107:0/2548912827 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fda80004780 0x7fda80004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:16.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.836+0000 7fda9be00640 1 --2- 172.21.15.107:0/2548912827 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda80005250 0x7fda8000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:16.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.836+0000 7fda9be00640 1 -- 172.21.15.107:0/2548912827 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c1565b0 con 0x7fda80005250 2024-08-17T02:25:16.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.836+0000 7fda9be00640 1 -- 172.21.15.107:0/2548912827 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8000c100 con 0x7fda80004780 2024-08-17T02:25:16.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.836+0000 7fda9be00640 1 -- 172.21.15.107:0/2548912827 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda8000c2c0 con 0x7fda800039d0 2024-08-17T02:25:16.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.836+0000 7fdaa1c00640 1 --2- 172.21.15.107:0/2548912827 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda80005250 0x7fda8000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:16.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.837+0000 7fda93e00640 1 --2- 172.21.15.107:0/2548912827 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fda80004780 0x7fda80004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:16.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.837+0000 7fdaa1200640 1 --2- 172.21.15.107:0/2548912827 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda800039d0 0x7fda80003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:16.840 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.837+0000 7fdaa1c00640 1 -- 172.21.15.107:0/2548912827 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda800039d0 msgr2=0x7fda80003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:16.840 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.837+0000 7fdaa1c00640 1 --2- 172.21.15.107:0/2548912827 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda800039d0 0x7fda80003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.840 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.837+0000 7fdaa1c00640 1 -- 172.21.15.107:0/2548912827 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fda80004780 msgr2=0x7fda80004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:16.840 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.837+0000 7fdaa1c00640 1 --2- 172.21.15.107:0/2548912827 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fda80004780 0x7fda80004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.840 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.837+0000 7fdaa1c00640 1 -- 172.21.15.107:0/2548912827 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda800034e0 con 0x7fda80005250 2024-08-17T02:25:16.840 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.838+0000 7fdaa1c00640 1 -- 172.21.15.107:0/2548912827 reap_dead start 2024-08-17T02:25:16.840 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.838+0000 7fdaa1c00640 1 --2- 172.21.15.107:0/2548912827 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda80005250 0x7fda8000b9d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fda9400a980 tx=0x7fda9400a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac988f7d75897102 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:16.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.838+0000 7fda9be00640 1 -- 172.21.15.107:0/2548912827 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9402e040 con 0x7fda80005250 2024-08-17T02:25:16.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.838+0000 7fda9be00640 1 -- 172.21.15.107:0/2548912827 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda94034410 con 0x7fda80005250 2024-08-17T02:25:16.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.838+0000 7fda9be00640 1 -- 172.21.15.107:0/2548912827 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda940347b0 con 0x7fda80005250 2024-08-17T02:25:16.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.839+0000 7fdaa3c00640 1 -- 172.21.15.107:0/2548912827 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda80005250 msgr2=0x7fda8000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:16.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.839+0000 7fdaa3c00640 1 --2- 172.21.15.107:0/2548912827 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda80005250 0x7fda8000b9d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fda9400a980 tx=0x7fda9400a200 comp rx=0 tx=0).stop 2024-08-17T02:25:16.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.839+0000 7fdaa3c00640 1 -- 172.21.15.107:0/2548912827 shutdown_connections 2024-08-17T02:25:16.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.839+0000 7fdaa3c00640 1 --2- 172.21.15.107:0/2548912827 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda80005250 0x7fda8000b9d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.839+0000 7fdaa3c00640 1 -- 172.21.15.107:0/2548912827 >> 172.21.15.107:0/2548912827 conn(0x7fda9c067750 msgr2=0x7fda9c06c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:16.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.839+0000 7fdaa3c00640 1 -- 172.21.15.107:0/2548912827 shutdown_connections 2024-08-17T02:25:16.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.839+0000 7fdaa3c00640 1 -- 172.21.15.107:0/2548912827 wait complete. 2024-08-17T02:25:16.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.840+0000 7fdaa3c00640 1 Processor -- start 2024-08-17T02:25:16.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.840+0000 7fdaa3c00640 1 -- start start 2024-08-17T02:25:16.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.841+0000 7fdaa3c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda80005250 0x7fda9c16d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:16.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.841+0000 7fdaa3c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fda9c14c0d0 0x7fda9c0a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:16.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.841+0000 7fdaa3c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda9c0a9e20 0x7fda9c0afb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:16.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.841+0000 7fdaa3c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c16d140 con 0x7fda80005250 2024-08-17T02:25:16.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.841+0000 7fdaa3c00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c0aa330 con 0x7fda9c14c0d0 2024-08-17T02:25:16.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.841+0000 7fdaa3c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c0aa610 con 0x7fda9c0a9e20 2024-08-17T02:25:16.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.841+0000 7fdaa1200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda80005250 0x7fda9c16d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:16.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.841+0000 7fdaa1200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda80005250 0x7fda9c16d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57896/0 (socket says 172.21.15.107:57896) 2024-08-17T02:25:16.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.841+0000 7fdaa1200640 1 -- 172.21.15.107:0/3394590647 learned_addr learned my addr 172.21.15.107:0/3394590647 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:16.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.842+0000 7fda93e00640 1 --2- 172.21.15.107:0/3394590647 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fda9c14c0d0 0x7fda9c0a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:16.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.842+0000 7fdaa1c00640 1 --2- 172.21.15.107:0/3394590647 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda9c0a9e20 0x7fda9c0afb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:16.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.842+0000 7fdaa1200640 1 -- 172.21.15.107:0/3394590647 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda9c0a9e20 msgr2=0x7fda9c0afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:16.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.842+0000 7fdaa1200640 1 --2- 172.21.15.107:0/3394590647 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda9c0a9e20 0x7fda9c0afb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.842+0000 7fdaa1200640 1 -- 172.21.15.107:0/3394590647 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fda9c14c0d0 msgr2=0x7fda9c0a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:16.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.842+0000 7fdaa1200640 1 --2- 172.21.15.107:0/3394590647 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fda9c14c0d0 0x7fda9c0a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.842+0000 7fdaa1200640 1 -- 172.21.15.107:0/3394590647 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9c16caf0 con 0x7fda80005250 2024-08-17T02:25:16.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.842+0000 7fdaa1200640 1 --2- 172.21.15.107:0/3394590647 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda80005250 0x7fda9c16d5d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00e560 tx=0x7fda8c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:16.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.842+0000 7fda98c00640 1 -- 172.21.15.107:0/3394590647 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c012500 con 0x7fda80005250 2024-08-17T02:25:16.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.842+0000 7fda98c00640 1 -- 172.21.15.107:0/3394590647 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8c010040 con 0x7fda80005250 2024-08-17T02:25:16.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.842+0000 7fda98c00640 1 -- 172.21.15.107:0/3394590647 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c0128b0 con 0x7fda80005250 2024-08-17T02:25:16.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.842+0000 7fdaa3c00640 1 -- 172.21.15.107:0/3394590647 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda9c16cdd0 con 0x7fda80005250 2024-08-17T02:25:16.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.843+0000 7fdaa3c00640 1 -- 172.21.15.107:0/3394590647 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda9c14ca00 con 0x7fda80005250 2024-08-17T02:25:16.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.843+0000 7fdaa3c00640 1 -- 172.21.15.107:0/3394590647 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda9c0710c0 con 0x7fda80005250 2024-08-17T02:25:16.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.845+0000 7fda98c00640 1 -- 172.21.15.107:0/3394590647 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fda8c012c20 con 0x7fda80005250 2024-08-17T02:25:16.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.845+0000 7fda98c00640 1 --2- 172.21.15.107:0/3394590647 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fda78065150 0x7fda78067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:16.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.845+0000 7fda98c00640 1 -- 172.21.15.107:0/3394590647 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fda8c081ce0 con 0x7fda80005250 2024-08-17T02:25:16.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.846+0000 7fda93e00640 1 --2- 172.21.15.107:0/3394590647 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fda78065150 0x7fda78067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:16.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.846+0000 7fda93e00640 1 --2- 172.21.15.107:0/3394590647 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fda78065150 0x7fda78067600 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fda84001050 tx=0x7fda84001e50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:16.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:16.850+0000 7fda98c00640 1 -- 172.21.15.107:0/3394590647 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fda8c04ff90 con 0x7fda80005250 2024-08-17T02:25:17.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.022+0000 7fdaa3c00640 1 -- 172.21.15.107:0/3394590647 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fda9c0aa7d0 con 0x7fda80005250 2024-08-17T02:25:17.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.662+0000 7fda98c00640 1 -- 172.21.15.107:0/3394590647 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) v1 ==== 170+0+0 (secure 0 0 0) 0x7fda8c012ed0 con 0x7fda80005250 2024-08-17T02:25:17.663 INFO:teuthology.orchestra.run.smithi107.stderr:pool 'cephfs_data' created 2024-08-17T02:25:17.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.665+0000 7fdaa3c00640 1 -- 172.21.15.107:0/3394590647 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fda78065150 msgr2=0x7fda78067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:17.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.665+0000 7fdaa3c00640 1 --2- 172.21.15.107:0/3394590647 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fda78065150 0x7fda78067600 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fda84001050 tx=0x7fda84001e50 comp rx=0 tx=0).stop 2024-08-17T02:25:17.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.666+0000 7fdaa3c00640 1 -- 172.21.15.107:0/3394590647 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda80005250 msgr2=0x7fda9c16d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:17.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.666+0000 7fdaa3c00640 1 --2- 172.21.15.107:0/3394590647 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda80005250 0x7fda9c16d5d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00e560 tx=0x7fda8c009040 comp rx=0 tx=0).stop 2024-08-17T02:25:17.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.666+0000 7fdaa3c00640 1 -- 172.21.15.107:0/3394590647 shutdown_connections 2024-08-17T02:25:17.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.666+0000 7fdaa3c00640 1 --2- 172.21.15.107:0/3394590647 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fda78065150 0x7fda78067600 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.666+0000 7fdaa3c00640 1 --2- 172.21.15.107:0/3394590647 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda9c0a9e20 0x7fda9c0afb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.666+0000 7fdaa3c00640 1 --2- 172.21.15.107:0/3394590647 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fda9c14c0d0 0x7fda9c0a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.666+0000 7fdaa3c00640 1 --2- 172.21.15.107:0/3394590647 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda80005250 0x7fda9c16d5d0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.666+0000 7fdaa3c00640 1 -- 172.21.15.107:0/3394590647 >> 172.21.15.107:0/3394590647 conn(0x7fda9c067750 msgr2=0x7fda9c14e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:17.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.668+0000 7fdaa3c00640 1 -- 172.21.15.107:0/3394590647 shutdown_connections 2024-08-17T02:25:17.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.669+0000 7fdaa3c00640 1 -- 172.21.15.107:0/3394590647 wait complete. 2024-08-17T02:25:17.696 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-17T02:25:17.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.846+0000 7fbec1c00640 1 Processor -- start 2024-08-17T02:25:17.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.846+0000 7fbec1c00640 1 -- start start 2024-08-17T02:25:17.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.847+0000 7fbec1c00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fbebc155660 0x7fbebc0c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:17.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.847+0000 7fbec1c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbebc0afc40 con 0x7fbebc155a30 2024-08-17T02:25:17.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.847+0000 7fbec1c00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbebc0af030 con 0x7fbebc0adfb0 2024-08-17T02:25:17.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.847+0000 7fbec1c00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbebc0af310 con 0x7fbebc155660 2024-08-17T02:25:17.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.848+0000 7fbec1200640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fbebc155a30 0x7fbebc06dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:47698/0 (socket says 172.21.15.107:47698) 2024-08-17T02:25:17.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.848+0000 7fbec1200640 1 -- 172.21.15.107:0/4085757928 learned_addr learned my addr 172.21.15.107:0/4085757928 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:25:17.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.848+0000 7fbebbe00640 1 --2- 172.21.15.107:0/4085757928 >> v2:172.21.15.157:3300/0 conn(0x7fbebc155660 0x7fbebc0c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:17.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.848+0000 7fbebb400640 1 -- 172.21.15.107:0/4085757928 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2221208008 0 0) 0x7fbebc0afc40 con 0x7fbebc155a30 2024-08-17T02:25:17.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.848+0000 7fbebb400640 1 -- 172.21.15.107:0/4085757928 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbea00034e0 con 0x7fbebc155a30 2024-08-17T02:25:17.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.848+0000 7fbebb400640 1 -- 172.21.15.107:0/4085757928 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 862102823 0 0) 0x7fbebc0af030 con 0x7fbebc0adfb0 2024-08-17T02:25:17.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.848+0000 7fbebb400640 1 -- 172.21.15.107:0/4085757928 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbebc0afc40 con 0x7fbebc0adfb0 2024-08-17T02:25:17.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.848+0000 7fbebbe00640 1 -- 172.21.15.107:0/4085757928 >> v1:172.21.15.157:6789/0 conn(0x7fbebc0adfb0 legacy=0x7fbebc0ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:17.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.848+0000 7fbebbe00640 1 -- 172.21.15.107:0/4085757928 >> v1:172.21.15.107:6789/0 conn(0x7fbebc155a30 legacy=0x7fbebc06dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:17.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.848+0000 7fbebbe00640 1 -- 172.21.15.107:0/4085757928 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbebc0af5f0 con 0x7fbebc155660 2024-08-17T02:25:17.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.850+0000 7fbebbe00640 1 --2- 172.21.15.107:0/4085757928 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbebc155660 0x7fbebc0c7fe0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbeac009850 tx=0x7fbeac0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94a5c32b4acc1118 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:17.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.850+0000 7fbebb400640 1 -- 172.21.15.107:0/4085757928 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeac02ae20 con 0x7fbebc155660 2024-08-17T02:25:17.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.850+0000 7fbebb400640 1 -- 172.21.15.107:0/4085757928 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeac032440 con 0x7fbebc155660 2024-08-17T02:25:17.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.850+0000 7fbebb400640 1 -- 172.21.15.107:0/4085757928 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeac0327e0 con 0x7fbebc155660 2024-08-17T02:25:17.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.850+0000 7fbec1c00640 1 -- 172.21.15.107:0/4085757928 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbebc155660 msgr2=0x7fbebc0c7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:17.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.850+0000 7fbec1c00640 1 --2- 172.21.15.107:0/4085757928 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbebc155660 0x7fbebc0c7fe0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbeac009850 tx=0x7fbeac0090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.850+0000 7fbec1c00640 1 -- 172.21.15.107:0/4085757928 shutdown_connections 2024-08-17T02:25:17.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.850+0000 7fbec1c00640 1 --2- 172.21.15.107:0/4085757928 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbebc155660 0x7fbebc0c7fe0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.850+0000 7fbec1c00640 1 -- 172.21.15.107:0/4085757928 >> 172.21.15.107:0/4085757928 conn(0x7fbebc066cd0 msgr2=0x7fbebc0670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:17.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.850+0000 7fbec1c00640 1 -- 172.21.15.107:0/4085757928 shutdown_connections 2024-08-17T02:25:17.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.851+0000 7fbec1c00640 1 -- 172.21.15.107:0/4085757928 wait complete. 2024-08-17T02:25:17.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.852+0000 7fbec1c00640 1 Processor -- start 2024-08-17T02:25:17.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.852+0000 7fbec1c00640 1 -- start start 2024-08-17T02:25:17.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.853+0000 7fbec1c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbebc0adfb0 0x7fbebc158a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:17.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.853+0000 7fbec1c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbebc155660 0x7fbebc13f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:17.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.853+0000 7fbec1c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbebc155a30 0x7fbebc13fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:17.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.853+0000 7fbec1c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc16a1d0 con 0x7fbebc155a30 2024-08-17T02:25:17.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.853+0000 7fbec1c00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc152ce0 con 0x7fbebc155660 2024-08-17T02:25:17.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.853+0000 7fbec1c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc152fc0 con 0x7fbebc0adfb0 2024-08-17T02:25:17.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.853+0000 7fbec1200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbebc155a30 0x7fbebc13fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:17.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.853+0000 7fbec1200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbebc155a30 0x7fbebc13fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57900/0 (socket says 172.21.15.107:57900) 2024-08-17T02:25:17.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.853+0000 7fbec1200640 1 -- 172.21.15.107:0/2761004334 learned_addr learned my addr 172.21.15.107:0/2761004334 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:17.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.853+0000 7fbebbe00640 1 --2- 172.21.15.107:0/2761004334 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbebc0adfb0 0x7fbebc158a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:17.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.853+0000 7fbeb3e00640 1 --2- 172.21.15.107:0/2761004334 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbebc155660 0x7fbebc13f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:17.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.854+0000 7fbec1200640 1 -- 172.21.15.107:0/2761004334 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbebc0adfb0 msgr2=0x7fbebc158a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:17.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.854+0000 7fbec1200640 1 --2- 172.21.15.107:0/2761004334 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbebc0adfb0 0x7fbebc158a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.854+0000 7fbec1200640 1 -- 172.21.15.107:0/2761004334 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbebc155660 msgr2=0x7fbebc13f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:17.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.854+0000 7fbec1200640 1 --2- 172.21.15.107:0/2761004334 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbebc155660 0x7fbebc13f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.854+0000 7fbec1200640 1 -- 172.21.15.107:0/2761004334 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeac009390 con 0x7fbebc155a30 2024-08-17T02:25:17.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.854+0000 7fbec1200640 1 --2- 172.21.15.107:0/2761004334 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbebc155a30 0x7fbebc13fe60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbeb400cc20 tx=0x7fbeb4001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:17.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.854+0000 7fbeb3400640 1 -- 172.21.15.107:0/2761004334 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb400ce40 con 0x7fbebc155a30 2024-08-17T02:25:17.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.854+0000 7fbeb3400640 1 -- 172.21.15.107:0/2761004334 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeb400a7f0 con 0x7fbebc155a30 2024-08-17T02:25:17.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.854+0000 7fbeb3400640 1 -- 172.21.15.107:0/2761004334 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb400abb0 con 0x7fbebc155a30 2024-08-17T02:25:17.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.854+0000 7fbec1c00640 1 -- 172.21.15.107:0/2761004334 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbebc1532a0 con 0x7fbebc155a30 2024-08-17T02:25:17.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.854+0000 7fbec1c00640 1 -- 172.21.15.107:0/2761004334 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbebc158f80 con 0x7fbebc155a30 2024-08-17T02:25:17.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.855+0000 7fbec1c00640 1 -- 172.21.15.107:0/2761004334 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbebc153720 con 0x7fbebc155a30 2024-08-17T02:25:17.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.856+0000 7fbeb3400640 1 -- 172.21.15.107:0/2761004334 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbeb40070f0 con 0x7fbebc155a30 2024-08-17T02:25:17.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.857+0000 7fbeb3400640 1 --2- 172.21.15.107:0/2761004334 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbe98065150 0x7fbe98067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:17.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.857+0000 7fbeb3400640 1 -- 172.21.15.107:0/2761004334 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fbeb4082560 con 0x7fbebc155a30 2024-08-17T02:25:17.858 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.857+0000 7fbebbe00640 1 --2- 172.21.15.107:0/2761004334 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbe98065150 0x7fbe98067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:17.858 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.858+0000 7fbebbe00640 1 --2- 172.21.15.107:0/2761004334 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbe98065150 0x7fbe98067600 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbeac034000 tx=0x7fbeac032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:17.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:17.861+0000 7fbeb3400640 1 -- 172.21.15.107:0/2761004334 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbeb40540f0 con 0x7fbebc155a30 2024-08-17T02:25:18.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.070+0000 7fbec1c00640 1 -- 172.21.15.107:0/2761004334 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fbebc071050 con 0x7fbebc155a30 2024-08-17T02:25:18.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.663+0000 7fbeb3400640 1 -- 172.21.15.107:0/2761004334 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7fbeb4080e60 con 0x7fbebc155a30 2024-08-17T02:25:18.664 INFO:teuthology.orchestra.run.smithi107.stderr:new fs with metadata pool 4 and data pool 5 2024-08-17T02:25:18.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.667+0000 7fbec1c00640 1 -- 172.21.15.107:0/2761004334 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbe98065150 msgr2=0x7fbe98067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:18.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.667+0000 7fbec1c00640 1 --2- 172.21.15.107:0/2761004334 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbe98065150 0x7fbe98067600 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbeac034000 tx=0x7fbeac032000 comp rx=0 tx=0).stop 2024-08-17T02:25:18.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.667+0000 7fbec1c00640 1 -- 172.21.15.107:0/2761004334 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbebc155a30 msgr2=0x7fbebc13fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:18.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.667+0000 7fbec1c00640 1 --2- 172.21.15.107:0/2761004334 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbebc155a30 0x7fbebc13fe60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbeb400cc20 tx=0x7fbeb4001a40 comp rx=0 tx=0).stop 2024-08-17T02:25:18.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.667+0000 7fbec1c00640 1 -- 172.21.15.107:0/2761004334 shutdown_connections 2024-08-17T02:25:18.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.667+0000 7fbec1c00640 1 --2- 172.21.15.107:0/2761004334 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbe98065150 0x7fbe98067600 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.667+0000 7fbec1c00640 1 --2- 172.21.15.107:0/2761004334 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbebc155a30 0x7fbebc13fe60 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.667+0000 7fbec1c00640 1 --2- 172.21.15.107:0/2761004334 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbebc155660 0x7fbebc13f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.667+0000 7fbec1c00640 1 --2- 172.21.15.107:0/2761004334 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbebc0adfb0 0x7fbebc158a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.667+0000 7fbec1c00640 1 -- 172.21.15.107:0/2761004334 >> 172.21.15.107:0/2761004334 conn(0x7fbebc066cd0 msgr2=0x7fbebc0ac3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:18.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.667+0000 7fbec1c00640 1 -- 172.21.15.107:0/2761004334 shutdown_connections 2024-08-17T02:25:18.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.668+0000 7fbec1c00640 1 -- 172.21.15.107:0/2761004334 wait complete. 2024-08-17T02:25:18.698 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:18.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.857+0000 7f31f0600640 1 Processor -- start 2024-08-17T02:25:18.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.857+0000 7f31f0600640 1 -- start start 2024-08-17T02:25:18.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.858+0000 7f31f0600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f31e81401b0 0x7f31e80caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:18.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.858+0000 7f31f0600640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f31e80b1440 0x7f31e80c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:18.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.859+0000 7f31f0600640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e80caa80 con 0x7f31e8140580 2024-08-17T02:25:18.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.859+0000 7f31f0600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e80cb450 con 0x7f31e81401b0 2024-08-17T02:25:18.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.859+0000 7f31f0600640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e80c9e70 con 0x7f31e80b1440 2024-08-17T02:25:18.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.859+0000 7f31edc00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f31e81401b0 0x7f31e80caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:18.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.859+0000 7f31edc00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f31e81401b0 0x7f31e80caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57916/0 (socket says 172.21.15.107:57916) 2024-08-17T02:25:18.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.859+0000 7f31edc00640 1 -- 172.21.15.107:0/3499040850 learned_addr learned my addr 172.21.15.107:0/3499040850 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:18.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.859+0000 7f31ee600640 1 --2- 172.21.15.107:0/3499040850 >> v2:172.21.15.157:3300/0 conn(0x7f31e80b1440 0x7f31e80c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:18.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.859+0000 7f31edc00640 1 -- 172.21.15.107:0/3499040850 >> v2:172.21.15.157:3300/0 conn(0x7f31e80b1440 msgr2=0x7f31e80c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:18.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.859+0000 7f31edc00640 1 --2- 172.21.15.107:0/3499040850 >> v2:172.21.15.157:3300/0 conn(0x7f31e80b1440 0x7f31e80c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.859+0000 7f31edc00640 1 -- 172.21.15.107:0/3499040850 >> v1:172.21.15.157:6789/0 conn(0x7f31e8140580 legacy=0x7f31e80b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:18.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.859+0000 7f31edc00640 1 -- 172.21.15.107:0/3499040850 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e80ca150 con 0x7f31e81401b0 2024-08-17T02:25:18.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.860+0000 7f31edc00640 1 --2- 172.21.15.107:0/3499040850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31e81401b0 0x7f31e80caf10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f31e80ca9f0 tx=0x7f31dc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60054ed2f8e02b15 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:18.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.861+0000 7f31e7e00640 1 -- 172.21.15.107:0/3499040850 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31dc02adf0 con 0x7f31e81401b0 2024-08-17T02:25:18.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.861+0000 7f31e7e00640 1 -- 172.21.15.107:0/3499040850 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31dc032440 con 0x7f31e81401b0 2024-08-17T02:25:18.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.861+0000 7f31e7e00640 1 -- 172.21.15.107:0/3499040850 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31dc032820 con 0x7f31e81401b0 2024-08-17T02:25:18.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.861+0000 7f31f0600640 1 -- 172.21.15.107:0/3499040850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31e81401b0 msgr2=0x7f31e80caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:18.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.861+0000 7f31f0600640 1 --2- 172.21.15.107:0/3499040850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31e81401b0 0x7f31e80caf10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f31e80ca9f0 tx=0x7f31dc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.861+0000 7f31f0600640 1 -- 172.21.15.107:0/3499040850 shutdown_connections 2024-08-17T02:25:18.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.861+0000 7f31f0600640 1 --2- 172.21.15.107:0/3499040850 >> v2:172.21.15.157:3300/0 conn(0x7f31e80b1440 0x7f31e80c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.861+0000 7f31f0600640 1 --2- 172.21.15.107:0/3499040850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31e81401b0 0x7f31e80caf10 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.861+0000 7f31f0600640 1 -- 172.21.15.107:0/3499040850 >> 172.21.15.107:0/3499040850 conn(0x7f31e80cb9b0 msgr2=0x7f31e80cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:18.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.861+0000 7f31f0600640 1 -- 172.21.15.107:0/3499040850 shutdown_connections 2024-08-17T02:25:18.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.861+0000 7f31f0600640 1 -- 172.21.15.107:0/3499040850 wait complete. 2024-08-17T02:25:18.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.863+0000 7f31f0600640 1 Processor -- start 2024-08-17T02:25:18.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.863+0000 7f31f0600640 1 -- start start 2024-08-17T02:25:18.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.864+0000 7f31f0600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f31e80b1440 0x7f31e80aba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:18.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.864+0000 7f31f0600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31e81401b0 0x7f31e813b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:18.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.864+0000 7f31f0600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31e8140580 0x7f31e815a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:18.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.864+0000 7f31f0600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e813b6a0 con 0x7f31e8140580 2024-08-17T02:25:18.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.864+0000 7f31f0600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e813c4c0 con 0x7f31e81401b0 2024-08-17T02:25:18.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.864+0000 7f31f0600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e813b8b0 con 0x7f31e80b1440 2024-08-17T02:25:18.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.864+0000 7f31ee600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31e8140580 0x7f31e815a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:18.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.864+0000 7f31ee600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31e8140580 0x7f31e815a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57932/0 (socket says 172.21.15.107:57932) 2024-08-17T02:25:18.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.864+0000 7f31ee600640 1 -- 172.21.15.107:0/3373733240 learned_addr learned my addr 172.21.15.107:0/3373733240 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:18.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.864+0000 7f31edc00640 1 --2- 172.21.15.107:0/3373733240 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f31e80b1440 0x7f31e80aba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:18.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.864+0000 7f31ed200640 1 --2- 172.21.15.107:0/3373733240 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31e81401b0 0x7f31e813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:18.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.864+0000 7f31ee600640 1 -- 172.21.15.107:0/3373733240 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f31e80b1440 msgr2=0x7f31e80aba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:18.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.864+0000 7f31ee600640 1 --2- 172.21.15.107:0/3373733240 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f31e80b1440 0x7f31e80aba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.864+0000 7f31ee600640 1 -- 172.21.15.107:0/3373733240 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31e81401b0 msgr2=0x7f31e813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:18.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.864+0000 7f31ee600640 1 --2- 172.21.15.107:0/3373733240 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31e81401b0 0x7f31e813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.864+0000 7f31ee600640 1 -- 172.21.15.107:0/3373733240 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31dc009450 con 0x7f31e8140580 2024-08-17T02:25:18.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.864+0000 7f31edc00640 1 --2- 172.21.15.107:0/3373733240 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f31e80b1440 0x7f31e80aba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:18.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.864+0000 7f31ed200640 1 --2- 172.21.15.107:0/3373733240 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31e81401b0 0x7f31e813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:18.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.865+0000 7f31ee600640 1 --2- 172.21.15.107:0/3373733240 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31e8140580 0x7f31e815a580 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f31e0007ef0 tx=0x7f31e0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:18.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.865+0000 7f31e4c00640 1 -- 172.21.15.107:0/3373733240 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e000edd0 con 0x7f31e8140580 2024-08-17T02:25:18.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.865+0000 7f31e4c00640 1 -- 172.21.15.107:0/3373733240 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e0014420 con 0x7f31e8140580 2024-08-17T02:25:18.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.865+0000 7f31e4c00640 1 -- 172.21.15.107:0/3373733240 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e00147e0 con 0x7f31e8140580 2024-08-17T02:25:18.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.865+0000 7f31f0600640 1 -- 172.21.15.107:0/3373733240 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e813bb90 con 0x7f31e8140580 2024-08-17T02:25:18.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.865+0000 7f31f0600640 1 -- 172.21.15.107:0/3373733240 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e813c150 con 0x7f31e8140580 2024-08-17T02:25:18.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.866+0000 7f31f0600640 1 -- 172.21.15.107:0/3373733240 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31e8064db0 con 0x7f31e8140580 2024-08-17T02:25:18.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.867+0000 7f31e4c00640 1 -- 172.21.15.107:0/3373733240 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f31e0014bd0 con 0x7f31e8140580 2024-08-17T02:25:18.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.867+0000 7f31e4c00640 1 --2- 172.21.15.107:0/3373733240 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f31c8065150 0x7f31c8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:18.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.868+0000 7f31e4c00640 1 -- 172.21.15.107:0/3373733240 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f31e0082c20 con 0x7f31e8140580 2024-08-17T02:25:18.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.868+0000 7f31edc00640 1 --2- 172.21.15.107:0/3373733240 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f31c8065150 0x7f31c8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:18.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.868+0000 7f31edc00640 1 --2- 172.21.15.107:0/3373733240 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f31c8065150 0x7f31c8067600 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f31dc034000 tx=0x7f31dc032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:18.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:18.872+0000 7f31e4c00640 1 -- 172.21.15.107:0/3373733240 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f31e0050c40 con 0x7f31e8140580 2024-08-17T02:25:19.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.046+0000 7f31f0600640 1 -- 172.21.15.107:0/3373733240 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31e8069ed0 con 0x7f31e8140580 2024-08-17T02:25:19.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.046+0000 7f31e4c00640 1 -- 172.21.15.107:0/3373733240 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+15411 (secure 0 0 0) 0x7f31e0054260 con 0x7f31e8140580 2024-08-17T02:25:19.047 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:25:19.047 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":31,"fsid":"f207b4c0-329d-46b8-b83f-aaf30bdb6ce3","created":"2024-08-17T02:24:11.038049+0000","modified":"2024-08-17T02:25:18.070960+0000","last_up_change":"2024-08-17T02:24:22.047790+0000","last_in_change":"2024-08-17T02:24:13.892720+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:23.456166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:16.086009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:17.060399+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"376363f3-b8bf-4f1e-b691-51cdd39171ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37302},{"type":"v1","addr":"172.21.15.107:6801","nonce":37302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37302},{"type":"v1","addr":"172.21.15.107:6803","nonce":37302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37302},{"type":"v1","addr":"172.21.15.107:6807","nonce":37302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37302},{"type":"v1","addr":"172.21.15.107:6805","nonce":37302}]},"public_addr":"172.21.15.107:6801/37302","cluster_addr":"172.21.15.107:6803/37302","heartbeat_back_addr":"172.21.15.107:6807/37302","heartbeat_front_addr":"172.21.15.107:6805/37302","state":["exists","up"]},{"osd":1,"uuid":"cc6624e3-2ad4-4db4-b377-05dfe57424e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37305},{"type":"v1","addr":"172.21.15.107:6824","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37305},{"type":"v1","addr":"172.21.15.107:6827","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37305},{"type":"v1","addr":"172.21.15.107:6831","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37305},{"type":"v1","addr":"172.21.15.107:6829","nonce":37305}]},"public_addr":"172.21.15.107:6824/37305","cluster_addr":"172.21.15.107:6827/37305","heartbeat_back_addr":"172.21.15.107:6831/37305","heartbeat_front_addr":"172.21.15.107:6829/37305","state":["exists","up"]},{"osd":2,"uuid":"25229542-29b5-4281-bcb0-798ae0930aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37307},{"type":"v1","addr":"172.21.15.107:6817","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37307},{"type":"v1","addr":"172.21.15.107:6819","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6823","nonce":37307},{"type":"v1","addr":"172.21.15.107:6825","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37307},{"type":"v1","addr":"172.21.15.107:6821","nonce":37307}]},"public_addr":"172.21.15.107:6817/37307","cluster_addr":"172.21.15.107:6819/37307","heartbeat_back_addr":"172.21.15.107:6825/37307","heartbeat_front_addr":"172.21.15.107:6821/37307","state":["exists","up"]},{"osd":3,"uuid":"5f16aee8-8950-4268-a61a-5cf6ebd670e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37306},{"type":"v1","addr":"172.21.15.107:6809","nonce":37306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37306},{"type":"v1","addr":"172.21.15.107:6811","nonce":37306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37306},{"type":"v1","addr":"172.21.15.107:6815","nonce":37306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37306},{"type":"v1","addr":"172.21.15.107:6813","nonce":37306}]},"public_addr":"172.21.15.107:6809/37306","cluster_addr":"172.21.15.107:6811/37306","heartbeat_back_addr":"172.21.15.107:6815/37306","heartbeat_front_addr":"172.21.15.107:6813/37306","state":["exists","up"]},{"osd":4,"uuid":"23232e28-e23b-4b4e-a531-4939246dbbde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":37329},{"type":"v1","addr":"172.21.15.157:6817","nonce":37329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":37329},{"type":"v1","addr":"172.21.15.157:6819","nonce":37329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":37329},{"type":"v1","addr":"172.21.15.157:6823","nonce":37329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":37329},{"type":"v1","addr":"172.21.15.157:6821","nonce":37329}]},"public_addr":"172.21.15.157:6817/37329","cluster_addr":"172.21.15.157:6819/37329","heartbeat_back_addr":"172.21.15.157:6823/37329","heartbeat_front_addr":"172.21.15.157:6821/37329","state":["exists","up"]},{"osd":5,"uuid":"f87ec331-3e59-4886-a317-6f7e26ec8e21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":37328},{"type":"v1","addr":"172.21.15.157:6804","nonce":37328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":37328},{"type":"v1","addr":"172.21.15.157:6808","nonce":37328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":37328},{"type":"v1","addr":"172.21.15.157:6815","nonce":37328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":37328},{"type":"v1","addr":"172.21.15.157:6812","nonce":37328}]},"public_addr":"172.21.15.157:6804/37328","cluster_addr":"172.21.15.157:6808/37328","heartbeat_back_addr":"172.21.15.157:6815/37328","heartbeat_front_addr":"172.21.15.157:6812/37328","state":["exists","up"]},{"osd":6,"uuid":"92852235-ce49-4d96-a940-6f18d97b13ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":37330},{"type":"v1","addr":"172.21.15.157:6801","nonce":37330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6803","nonce":37330},{"type":"v1","addr":"172.21.15.157:6805","nonce":37330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":37330},{"type":"v1","addr":"172.21.15.157:6813","nonce":37330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":37330},{"type":"v1","addr":"172.21.15.157:6809","nonce":37330}]},"public_addr":"172.21.15.157:6801/37330","cluster_addr":"172.21.15.157:6805/37330","heartbeat_back_addr":"172.21.15.157:6813/37330","heartbeat_front_addr":"172.21.15.157:6809/37330","state":["exists","up"]},{"osd":7,"uuid":"7484a061-723d-4663-b28f-b01766d62f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":37373},{"type":"v1","addr":"172.21.15.157:6825","nonce":37373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":37373},{"type":"v1","addr":"172.21.15.157:6827","nonce":37373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":37373},{"type":"v1","addr":"172.21.15.157:6831","nonce":37373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":37373},{"type":"v1","addr":"172.21.15.157:6829","nonce":37373}]},"public_addr":"172.21.15.157:6825/37373","cluster_addr":"172.21.15.157:6827/37373","heartbeat_back_addr":"172.21.15.157:6831/37373","heartbeat_front_addr":"172.21.15.157:6829/37373","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.110188+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.280265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.252119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.267996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.284582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.144420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.174764+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.308002+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:19.049 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.049+0000 7f31f0600640 1 -- 172.21.15.107:0/3373733240 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f31c8065150 msgr2=0x7f31c8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.049 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.049+0000 7f31f0600640 1 --2- 172.21.15.107:0/3373733240 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f31c8065150 0x7f31c8067600 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f31dc034000 tx=0x7f31dc032000 comp rx=0 tx=0).stop 2024-08-17T02:25:19.049 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.049+0000 7f31f0600640 1 -- 172.21.15.107:0/3373733240 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31e8140580 msgr2=0x7f31e815a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.049 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.049+0000 7f31f0600640 1 --2- 172.21.15.107:0/3373733240 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31e8140580 0x7f31e815a580 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f31e0007ef0 tx=0x7f31e0009840 comp rx=0 tx=0).stop 2024-08-17T02:25:19.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.049+0000 7f31f0600640 1 -- 172.21.15.107:0/3373733240 shutdown_connections 2024-08-17T02:25:19.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.049+0000 7f31f0600640 1 --2- 172.21.15.107:0/3373733240 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f31c8065150 0x7f31c8067600 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.049+0000 7f31f0600640 1 --2- 172.21.15.107:0/3373733240 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31e8140580 0x7f31e815a580 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.049+0000 7f31f0600640 1 --2- 172.21.15.107:0/3373733240 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31e81401b0 0x7f31e813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.049+0000 7f31f0600640 1 --2- 172.21.15.107:0/3373733240 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f31e80b1440 0x7f31e80aba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.049+0000 7f31f0600640 1 -- 172.21.15.107:0/3373733240 >> 172.21.15.107:0/3373733240 conn(0x7f31e80cb9b0 msgr2=0x7f31e80aecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:19.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.049+0000 7f31f0600640 1 -- 172.21.15.107:0/3373733240 shutdown_connections 2024-08-17T02:25:19.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.049+0000 7f31f0600640 1 -- 172.21.15.107:0/3373733240 wait complete. 2024-08-17T02:25:19.065 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:19.212 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.211+0000 7f8999400640 1 Processor -- start 2024-08-17T02:25:19.212 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.212+0000 7f8999400640 1 -- start start 2024-08-17T02:25:19.214 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.213+0000 7f8999400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f89940ada20 0x7f89940c8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.214 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.213+0000 7f8999400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8994159c40 0x7f89940addf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.214 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.213+0000 7f8999400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89940ae6b0 con 0x7f89940cae60 2024-08-17T02:25:19.214 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.213+0000 7f8999400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89940af230 con 0x7f89940ada20 2024-08-17T02:25:19.214 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.213+0000 7f8999400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89940ae900 con 0x7f8994159c40 2024-08-17T02:25:19.214 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.213+0000 7f8993e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f89940ada20 0x7f89940c8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.214 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.213+0000 7f8993e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f89940ada20 0x7f89940c8060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57936/0 (socket says 172.21.15.107:57936) 2024-08-17T02:25:19.214 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.213+0000 7f8993e00640 1 -- 172.21.15.107:0/2097509441 learned_addr learned my addr 172.21.15.107:0/2097509441 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:19.214 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.213+0000 7f8998a00640 1 --1- 172.21.15.107:0/2097509441 >> v1:172.21.15.107:6789/0 conn(0x7f89940cae60 0x7f8994154e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:47710/0 (socket says 172.21.15.107:47710) 2024-08-17T02:25:19.214 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.213+0000 7f898b400640 1 --2- 172.21.15.107:0/2097509441 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8994159c40 0x7f89940addf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.214 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.213+0000 7f8993e00640 1 -- 172.21.15.107:0/2097509441 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8994159c40 msgr2=0x7f89940addf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:19.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.213+0000 7f8993e00640 1 --2- 172.21.15.107:0/2097509441 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8994159c40 0x7f89940addf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.214+0000 7f8993e00640 1 -- 172.21.15.107:0/2097509441 >> v1:172.21.15.107:6789/0 conn(0x7f89940cae60 legacy=0x7f8994154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.214+0000 7f8993e00640 1 -- 172.21.15.107:0/2097509441 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89940aebe0 con 0x7f89940ada20 2024-08-17T02:25:19.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.214+0000 7f8993e00640 1 --2- 172.21.15.107:0/2097509441 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89940ada20 0x7f89940c8060 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8984009910 tx=0x7f89840091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a0b0a16ed5b6e7c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:19.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.215+0000 7f8993400640 1 -- 172.21.15.107:0/2097509441 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898402ae40 con 0x7f89940ada20 2024-08-17T02:25:19.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.215+0000 7f8993400640 1 -- 172.21.15.107:0/2097509441 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8984032440 con 0x7f89940ada20 2024-08-17T02:25:19.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.215+0000 7f8993400640 1 -- 172.21.15.107:0/2097509441 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8984032820 con 0x7f89940ada20 2024-08-17T02:25:19.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.215+0000 7f8999400640 1 -- 172.21.15.107:0/2097509441 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89940ada20 msgr2=0x7f89940c8060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.215+0000 7f8999400640 1 --2- 172.21.15.107:0/2097509441 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89940ada20 0x7f89940c8060 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8984009910 tx=0x7f89840091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.215+0000 7f8999400640 1 -- 172.21.15.107:0/2097509441 shutdown_connections 2024-08-17T02:25:19.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.215+0000 7f8999400640 1 --2- 172.21.15.107:0/2097509441 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8994159c40 0x7f89940addf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.215+0000 7f8999400640 1 --2- 172.21.15.107:0/2097509441 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89940ada20 0x7f89940c8060 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.215+0000 7f8999400640 1 -- 172.21.15.107:0/2097509441 >> 172.21.15.107:0/2097509441 conn(0x7f8994067750 msgr2=0x7f89940cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:19.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.215+0000 7f8999400640 1 -- 172.21.15.107:0/2097509441 shutdown_connections 2024-08-17T02:25:19.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.215+0000 7f8999400640 1 -- 172.21.15.107:0/2097509441 wait complete. 2024-08-17T02:25:19.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.217+0000 7f8999400640 1 Processor -- start 2024-08-17T02:25:19.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.217+0000 7f8999400640 1 -- start start 2024-08-17T02:25:19.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.218+0000 7f8999400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f89940ada20 0x7f899413f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.218+0000 7f8999400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89940cae60 0x7f8994156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.218+0000 7f8999400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8994159c40 0x7f8994157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.218+0000 7f8999400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89941579c0 con 0x7f89940cae60 2024-08-17T02:25:19.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.218+0000 7f8999400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8994157c90 con 0x7f8994159c40 2024-08-17T02:25:19.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.218+0000 7f8999400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8994157f70 con 0x7f89940ada20 2024-08-17T02:25:19.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.218+0000 7f898b400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89940cae60 0x7f8994156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.218+0000 7f898b400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89940cae60 0x7f8994156f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57946/0 (socket says 172.21.15.107:57946) 2024-08-17T02:25:19.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.218+0000 7f898b400640 1 -- 172.21.15.107:0/3665997411 learned_addr learned my addr 172.21.15.107:0/3665997411 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:19.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.218+0000 7f8998a00640 1 --2- 172.21.15.107:0/3665997411 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8994159c40 0x7f8994157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.218+0000 7f8993e00640 1 --2- 172.21.15.107:0/3665997411 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f89940ada20 0x7f899413f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.218+0000 7f898b400640 1 -- 172.21.15.107:0/3665997411 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f89940ada20 msgr2=0x7f899413f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.218+0000 7f898b400640 1 --2- 172.21.15.107:0/3665997411 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f89940ada20 0x7f899413f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.218+0000 7f898b400640 1 -- 172.21.15.107:0/3665997411 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8994159c40 msgr2=0x7f8994157480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.218+0000 7f898b400640 1 --2- 172.21.15.107:0/3665997411 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8994159c40 0x7f8994157480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.218+0000 7f898b400640 1 -- 172.21.15.107:0/3665997411 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8984009450 con 0x7f89940cae60 2024-08-17T02:25:19.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.219+0000 7f8998a00640 1 --2- 172.21.15.107:0/3665997411 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8994159c40 0x7f8994157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:19.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.219+0000 7f8993e00640 1 --2- 172.21.15.107:0/3665997411 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f89940ada20 0x7f899413f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:19.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.219+0000 7f898b400640 1 --2- 172.21.15.107:0/3665997411 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89940cae60 0x7f8994156f40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f897c00d890 tx=0x7f897c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:19.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.219+0000 7f898be00640 1 -- 172.21.15.107:0/3665997411 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897c00de20 con 0x7f89940cae60 2024-08-17T02:25:19.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.219+0000 7f898be00640 1 -- 172.21.15.107:0/3665997411 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897c0098b0 con 0x7f89940cae60 2024-08-17T02:25:19.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.219+0000 7f8999400640 1 -- 172.21.15.107:0/3665997411 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8994158250 con 0x7f89940cae60 2024-08-17T02:25:19.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.219+0000 7f898be00640 1 -- 172.21.15.107:0/3665997411 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897c009c50 con 0x7f89940cae60 2024-08-17T02:25:19.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.219+0000 7f8999400640 1 -- 172.21.15.107:0/3665997411 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8994158810 con 0x7f89940cae60 2024-08-17T02:25:19.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.220+0000 7f8999400640 1 -- 172.21.15.107:0/3665997411 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8994071050 con 0x7f89940cae60 2024-08-17T02:25:19.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.221+0000 7f898be00640 1 -- 172.21.15.107:0/3665997411 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f897c014620 con 0x7f89940cae60 2024-08-17T02:25:19.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.222+0000 7f898be00640 1 --2- 172.21.15.107:0/3665997411 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f8970065150 0x7f8970067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.222+0000 7f898be00640 1 -- 172.21.15.107:0/3665997411 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f897c082d90 con 0x7f89940cae60 2024-08-17T02:25:19.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.222+0000 7f8993e00640 1 --2- 172.21.15.107:0/3665997411 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f8970065150 0x7f8970067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.223+0000 7f8993e00640 1 --2- 172.21.15.107:0/3665997411 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f8970065150 0x7f8970067600 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8984034000 tx=0x7f8984032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:19.226 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.226+0000 7f898be00640 1 -- 172.21.15.107:0/3665997411 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f897c050db0 con 0x7f89940cae60 2024-08-17T02:25:19.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.398+0000 7f8999400640 1 -- 172.21.15.107:0/3665997411 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89940cc530 con 0x7f89940cae60 2024-08-17T02:25:19.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.400+0000 7f898be00640 1 -- 172.21.15.107:0/3665997411 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+15411 (secure 0 0 0) 0x7f897c009db0 con 0x7f89940cae60 2024-08-17T02:25:19.400 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:25:19.400 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":31,"fsid":"f207b4c0-329d-46b8-b83f-aaf30bdb6ce3","created":"2024-08-17T02:24:11.038049+0000","modified":"2024-08-17T02:25:18.070960+0000","last_up_change":"2024-08-17T02:24:22.047790+0000","last_in_change":"2024-08-17T02:24:13.892720+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:23.456166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:16.086009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:17.060399+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"376363f3-b8bf-4f1e-b691-51cdd39171ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37302},{"type":"v1","addr":"172.21.15.107:6801","nonce":37302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37302},{"type":"v1","addr":"172.21.15.107:6803","nonce":37302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37302},{"type":"v1","addr":"172.21.15.107:6807","nonce":37302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37302},{"type":"v1","addr":"172.21.15.107:6805","nonce":37302}]},"public_addr":"172.21.15.107:6801/37302","cluster_addr":"172.21.15.107:6803/37302","heartbeat_back_addr":"172.21.15.107:6807/37302","heartbeat_front_addr":"172.21.15.107:6805/37302","state":["exists","up"]},{"osd":1,"uuid":"cc6624e3-2ad4-4db4-b377-05dfe57424e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37305},{"type":"v1","addr":"172.21.15.107:6824","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37305},{"type":"v1","addr":"172.21.15.107:6827","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37305},{"type":"v1","addr":"172.21.15.107:6831","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37305},{"type":"v1","addr":"172.21.15.107:6829","nonce":37305}]},"public_addr":"172.21.15.107:6824/37305","cluster_addr":"172.21.15.107:6827/37305","heartbeat_back_addr":"172.21.15.107:6831/37305","heartbeat_front_addr":"172.21.15.107:6829/37305","state":["exists","up"]},{"osd":2,"uuid":"25229542-29b5-4281-bcb0-798ae0930aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37307},{"type":"v1","addr":"172.21.15.107:6817","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37307},{"type":"v1","addr":"172.21.15.107:6819","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6823","nonce":37307},{"type":"v1","addr":"172.21.15.107:6825","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37307},{"type":"v1","addr":"172.21.15.107:6821","nonce":37307}]},"public_addr":"172.21.15.107:6817/37307","cluster_addr":"172.21.15.107:6819/37307","heartbeat_back_addr":"172.21.15.107:6825/37307","heartbeat_front_addr":"172.21.15.107:6821/37307","state":["exists","up"]},{"osd":3,"uuid":"5f16aee8-8950-4268-a61a-5cf6ebd670e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37306},{"type":"v1","addr":"172.21.15.107:6809","nonce":37306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37306},{"type":"v1","addr":"172.21.15.107:6811","nonce":37306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37306},{"type":"v1","addr":"172.21.15.107:6815","nonce":37306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37306},{"type":"v1","addr":"172.21.15.107:6813","nonce":37306}]},"public_addr":"172.21.15.107:6809/37306","cluster_addr":"172.21.15.107:6811/37306","heartbeat_back_addr":"172.21.15.107:6815/37306","heartbeat_front_addr":"172.21.15.107:6813/37306","state":["exists","up"]},{"osd":4,"uuid":"23232e28-e23b-4b4e-a531-4939246dbbde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":37329},{"type":"v1","addr":"172.21.15.157:6817","nonce":37329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":37329},{"type":"v1","addr":"172.21.15.157:6819","nonce":37329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":37329},{"type":"v1","addr":"172.21.15.157:6823","nonce":37329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":37329},{"type":"v1","addr":"172.21.15.157:6821","nonce":37329}]},"public_addr":"172.21.15.157:6817/37329","cluster_addr":"172.21.15.157:6819/37329","heartbeat_back_addr":"172.21.15.157:6823/37329","heartbeat_front_addr":"172.21.15.157:6821/37329","state":["exists","up"]},{"osd":5,"uuid":"f87ec331-3e59-4886-a317-6f7e26ec8e21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":37328},{"type":"v1","addr":"172.21.15.157:6804","nonce":37328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":37328},{"type":"v1","addr":"172.21.15.157:6808","nonce":37328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":37328},{"type":"v1","addr":"172.21.15.157:6815","nonce":37328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":37328},{"type":"v1","addr":"172.21.15.157:6812","nonce":37328}]},"public_addr":"172.21.15.157:6804/37328","cluster_addr":"172.21.15.157:6808/37328","heartbeat_back_addr":"172.21.15.157:6815/37328","heartbeat_front_addr":"172.21.15.157:6812/37328","state":["exists","up"]},{"osd":6,"uuid":"92852235-ce49-4d96-a940-6f18d97b13ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":37330},{"type":"v1","addr":"172.21.15.157:6801","nonce":37330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6803","nonce":37330},{"type":"v1","addr":"172.21.15.157:6805","nonce":37330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":37330},{"type":"v1","addr":"172.21.15.157:6813","nonce":37330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":37330},{"type":"v1","addr":"172.21.15.157:6809","nonce":37330}]},"public_addr":"172.21.15.157:6801/37330","cluster_addr":"172.21.15.157:6805/37330","heartbeat_back_addr":"172.21.15.157:6813/37330","heartbeat_front_addr":"172.21.15.157:6809/37330","state":["exists","up"]},{"osd":7,"uuid":"7484a061-723d-4663-b28f-b01766d62f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":37373},{"type":"v1","addr":"172.21.15.157:6825","nonce":37373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":37373},{"type":"v1","addr":"172.21.15.157:6827","nonce":37373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":37373},{"type":"v1","addr":"172.21.15.157:6831","nonce":37373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":37373},{"type":"v1","addr":"172.21.15.157:6829","nonce":37373}]},"public_addr":"172.21.15.157:6825/37373","cluster_addr":"172.21.15.157:6827/37373","heartbeat_back_addr":"172.21.15.157:6831/37373","heartbeat_front_addr":"172.21.15.157:6829/37373","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.110188+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.280265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.252119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.267996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.284582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.144420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.174764+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.308002+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:19.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.402+0000 7f8999400640 1 -- 172.21.15.107:0/3665997411 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f8970065150 msgr2=0x7f8970067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.402+0000 7f8999400640 1 --2- 172.21.15.107:0/3665997411 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f8970065150 0x7f8970067600 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8984034000 tx=0x7f8984032000 comp rx=0 tx=0).stop 2024-08-17T02:25:19.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.402+0000 7f8999400640 1 -- 172.21.15.107:0/3665997411 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89940cae60 msgr2=0x7f8994156f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.402+0000 7f8999400640 1 --2- 172.21.15.107:0/3665997411 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89940cae60 0x7f8994156f40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f897c00d890 tx=0x7f897c008040 comp rx=0 tx=0).stop 2024-08-17T02:25:19.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.402+0000 7f8999400640 1 -- 172.21.15.107:0/3665997411 shutdown_connections 2024-08-17T02:25:19.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.402+0000 7f8999400640 1 --2- 172.21.15.107:0/3665997411 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f8970065150 0x7f8970067600 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.402+0000 7f8999400640 1 --2- 172.21.15.107:0/3665997411 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8994159c40 0x7f8994157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.402+0000 7f8999400640 1 --2- 172.21.15.107:0/3665997411 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89940cae60 0x7f8994156f40 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.402+0000 7f8999400640 1 --2- 172.21.15.107:0/3665997411 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f89940ada20 0x7f899413f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.402+0000 7f8999400640 1 -- 172.21.15.107:0/3665997411 >> 172.21.15.107:0/3665997411 conn(0x7f8994067750 msgr2=0x7f8994069960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:19.404 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.402+0000 7f8999400640 1 -- 172.21.15.107:0/3665997411 shutdown_connections 2024-08-17T02:25:19.404 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.402+0000 7f8999400640 1 -- 172.21.15.107:0/3665997411 wait complete. 2024-08-17T02:25:19.419 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-17T02:25:19.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.568+0000 7fdc11400640 1 Processor -- start 2024-08-17T02:25:19.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.569+0000 7fdc11400640 1 -- start start 2024-08-17T02:25:19.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.570+0000 7fdc11400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdc0c0ab3b0 0x7fdc0c0aa7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.570+0000 7fdc11400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fdc0c15c220 0x7fdc0c0aace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.570+0000 7fdc11400640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc0c06d4a0 con 0x7fdc0c15be50 2024-08-17T02:25:19.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.570+0000 7fdc11400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc0c0b05b0 con 0x7fdc0c15c220 2024-08-17T02:25:19.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.570+0000 7fdc11400640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc0c0aee60 con 0x7fdc0c0ab3b0 2024-08-17T02:25:19.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.570+0000 7fdc10a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fdc0c15c220 0x7fdc0c0aace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.570+0000 7fdc10a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fdc0c15c220 0x7fdc0c0aace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57950/0 (socket says 172.21.15.107:57950) 2024-08-17T02:25:19.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.570+0000 7fdc10a00640 1 -- 172.21.15.107:0/4006155753 learned_addr learned my addr 172.21.15.107:0/4006155753 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:19.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.570+0000 7fdc03400640 1 --2- 172.21.15.107:0/4006155753 >> v2:172.21.15.157:3300/0 conn(0x7fdc0c0ab3b0 0x7fdc0c0aa7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.571+0000 7fdc10a00640 1 -- 172.21.15.107:0/4006155753 >> v2:172.21.15.157:3300/0 conn(0x7fdc0c0ab3b0 msgr2=0x7fdc0c0aa7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:19.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.571+0000 7fdc10a00640 1 --2- 172.21.15.107:0/4006155753 >> v2:172.21.15.157:3300/0 conn(0x7fdc0c0ab3b0 0x7fdc0c0aa7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.571+0000 7fdc10a00640 1 -- 172.21.15.107:0/4006155753 >> v1:172.21.15.157:6789/0 conn(0x7fdc0c15be50 legacy=0x7fdc0c0ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.571+0000 7fdc10a00640 1 -- 172.21.15.107:0/4006155753 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc0c06c890 con 0x7fdc0c15c220 2024-08-17T02:25:19.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.571+0000 7fdc10a00640 1 --2- 172.21.15.107:0/4006155753 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc0c15c220 0x7fdc0c0aace0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c0ae510 tx=0x7fdc04009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87844eea60a2e430 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:19.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.572+0000 7fdc0b400640 1 -- 172.21.15.107:0/4006155753 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0402e050 con 0x7fdc0c15c220 2024-08-17T02:25:19.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.572+0000 7fdc0b400640 1 -- 172.21.15.107:0/4006155753 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc04007400 con 0x7fdc0c15c220 2024-08-17T02:25:19.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.572+0000 7fdc0b400640 1 -- 172.21.15.107:0/4006155753 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc040077e0 con 0x7fdc0c15c220 2024-08-17T02:25:19.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.572+0000 7fdc11400640 1 -- 172.21.15.107:0/4006155753 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc0c15c220 msgr2=0x7fdc0c0aace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.572+0000 7fdc11400640 1 --2- 172.21.15.107:0/4006155753 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc0c15c220 0x7fdc0c0aace0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c0ae510 tx=0x7fdc04009840 comp rx=0 tx=0).stop 2024-08-17T02:25:19.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.572+0000 7fdc11400640 1 -- 172.21.15.107:0/4006155753 shutdown_connections 2024-08-17T02:25:19.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.572+0000 7fdc11400640 1 --2- 172.21.15.107:0/4006155753 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc0c15c220 0x7fdc0c0aace0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.572+0000 7fdc11400640 1 --2- 172.21.15.107:0/4006155753 >> v2:172.21.15.157:3300/0 conn(0x7fdc0c0ab3b0 0x7fdc0c0aa7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.572+0000 7fdc11400640 1 -- 172.21.15.107:0/4006155753 >> 172.21.15.107:0/4006155753 conn(0x7fdc0c066cd0 msgr2=0x7fdc0c0670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:19.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.573+0000 7fdc11400640 1 -- 172.21.15.107:0/4006155753 shutdown_connections 2024-08-17T02:25:19.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.573+0000 7fdc11400640 1 -- 172.21.15.107:0/4006155753 wait complete. 2024-08-17T02:25:19.574 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.574+0000 7fdc11400640 1 Processor -- start 2024-08-17T02:25:19.574 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.574+0000 7fdc11400640 1 -- start start 2024-08-17T02:25:19.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.575+0000 7fdc11400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc0c0ab3b0 0x7fdc0c148130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.575+0000 7fdc11400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc0c15be50 0x7fdc0c0c0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.575+0000 7fdc11400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdc0c15c220 0x7fdc0c0c14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.575+0000 7fdc11400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c15a2f0 con 0x7fdc0c15be50 2024-08-17T02:25:19.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.575+0000 7fdc11400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c1596e0 con 0x7fdc0c0ab3b0 2024-08-17T02:25:19.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.575+0000 7fdc11400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c1599c0 con 0x7fdc0c15c220 2024-08-17T02:25:19.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.575+0000 7fdc03400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc0c15be50 0x7fdc0c0c0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.575+0000 7fdc03400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc0c15be50 0x7fdc0c0c0f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57962/0 (socket says 172.21.15.107:57962) 2024-08-17T02:25:19.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.575+0000 7fdc03400640 1 -- 172.21.15.107:0/3090890174 learned_addr learned my addr 172.21.15.107:0/3090890174 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:19.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.575+0000 7fdc0be00640 1 --2- 172.21.15.107:0/3090890174 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc0c0ab3b0 0x7fdc0c148130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.575+0000 7fdc10a00640 1 --2- 172.21.15.107:0/3090890174 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdc0c15c220 0x7fdc0c0c14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.575+0000 7fdc03400640 1 -- 172.21.15.107:0/3090890174 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdc0c15c220 msgr2=0x7fdc0c0c14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.575+0000 7fdc03400640 1 --2- 172.21.15.107:0/3090890174 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdc0c15c220 0x7fdc0c0c14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.575+0000 7fdc03400640 1 -- 172.21.15.107:0/3090890174 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc0c0ab3b0 msgr2=0x7fdc0c148130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.575+0000 7fdc03400640 1 --2- 172.21.15.107:0/3090890174 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc0c0ab3b0 0x7fdc0c148130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.576+0000 7fdc03400640 1 -- 172.21.15.107:0/3090890174 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc04009ae0 con 0x7fdc0c15be50 2024-08-17T02:25:19.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.576+0000 7fdc0be00640 1 --2- 172.21.15.107:0/3090890174 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc0c0ab3b0 0x7fdc0c148130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:19.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.576+0000 7fdc03400640 1 --2- 172.21.15.107:0/3090890174 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc0c15be50 0x7fdc0c0c0f80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fdbf400e900 tx=0x7fdbf40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:19.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.576+0000 7fdc03e00640 1 -- 172.21.15.107:0/3090890174 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf400c8e0 con 0x7fdc0c15be50 2024-08-17T02:25:19.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.576+0000 7fdc03e00640 1 -- 172.21.15.107:0/3090890174 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf400ca40 con 0x7fdc0c15be50 2024-08-17T02:25:19.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.576+0000 7fdc11400640 1 -- 172.21.15.107:0/3090890174 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc0c159ca0 con 0x7fdc0c15be50 2024-08-17T02:25:19.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.576+0000 7fdc03e00640 1 -- 172.21.15.107:0/3090890174 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf400cde0 con 0x7fdc0c15be50 2024-08-17T02:25:19.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.576+0000 7fdc11400640 1 -- 172.21.15.107:0/3090890174 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc0c148670 con 0x7fdc0c15be50 2024-08-17T02:25:19.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.577+0000 7fdc11400640 1 -- 172.21.15.107:0/3090890174 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc0c15a460 con 0x7fdc0c15be50 2024-08-17T02:25:19.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.578+0000 7fdc03e00640 1 -- 172.21.15.107:0/3090890174 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fdbf4013680 con 0x7fdc0c15be50 2024-08-17T02:25:19.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.579+0000 7fdc03e00640 1 --2- 172.21.15.107:0/3090890174 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fdbe8065150 0x7fdbe8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.579+0000 7fdc03e00640 1 -- 172.21.15.107:0/3090890174 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdbf40826a0 con 0x7fdc0c15be50 2024-08-17T02:25:19.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.580+0000 7fdc0be00640 1 --2- 172.21.15.107:0/3090890174 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fdbe8065150 0x7fdbe8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.580+0000 7fdc0be00640 1 --2- 172.21.15.107:0/3090890174 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fdbe8065150 0x7fdbe8067600 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc001780 tx=0x7fdbfc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:19.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.583+0000 7fdc03e00640 1 -- 172.21.15.107:0/3090890174 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fdbf4050780 con 0x7fdc0c15be50 2024-08-17T02:25:19.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:19.797+0000 7fdc11400640 1 -- 172.21.15.107:0/3090890174 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fdc0c071050 con 0x7fdc0c15be50 2024-08-17T02:25:20.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.686+0000 7fdc03e00640 1 -- 172.21.15.107:0/3090890174 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7fdbf4053da0 con 0x7fdc0c15be50 2024-08-17T02:25:20.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.689+0000 7fdc11400640 1 -- 172.21.15.107:0/3090890174 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fdbe8065150 msgr2=0x7fdbe8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:20.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.689+0000 7fdc11400640 1 --2- 172.21.15.107:0/3090890174 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fdbe8065150 0x7fdbe8067600 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc001780 tx=0x7fdbfc009040 comp rx=0 tx=0).stop 2024-08-17T02:25:20.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.689+0000 7fdc11400640 1 -- 172.21.15.107:0/3090890174 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc0c15be50 msgr2=0x7fdc0c0c0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:20.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.689+0000 7fdc11400640 1 --2- 172.21.15.107:0/3090890174 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc0c15be50 0x7fdc0c0c0f80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fdbf400e900 tx=0x7fdbf40090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:20.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.689+0000 7fdc11400640 1 -- 172.21.15.107:0/3090890174 shutdown_connections 2024-08-17T02:25:20.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.689+0000 7fdc11400640 1 --2- 172.21.15.107:0/3090890174 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fdbe8065150 0x7fdbe8067600 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:20.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.689+0000 7fdc11400640 1 --2- 172.21.15.107:0/3090890174 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdc0c15c220 0x7fdc0c0c14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:20.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.689+0000 7fdc11400640 1 --2- 172.21.15.107:0/3090890174 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc0c15be50 0x7fdc0c0c0f80 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:20.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.689+0000 7fdc11400640 1 --2- 172.21.15.107:0/3090890174 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc0c0ab3b0 0x7fdc0c148130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:20.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.689+0000 7fdc11400640 1 -- 172.21.15.107:0/3090890174 >> 172.21.15.107:0/3090890174 conn(0x7fdc0c066cd0 msgr2=0x7fdc0c0a98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:20.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.689+0000 7fdc11400640 1 -- 172.21.15.107:0/3090890174 shutdown_connections 2024-08-17T02:25:20.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.689+0000 7fdc11400640 1 -- 172.21.15.107:0/3090890174 wait complete. 2024-08-17T02:25:20.707 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-17T02:25:20.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.862+0000 7f87d4600640 1 Processor -- start 2024-08-17T02:25:20.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.862+0000 7f87d4600640 1 -- start start 2024-08-17T02:25:20.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.863+0000 7f87d4600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f87cc0adcf0 0x7f87cc0ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:20.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.863+0000 7f87d4600640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f87cc0abb00 0x7f87cc0c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:20.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.863+0000 7f87d4600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87cc0ab130 con 0x7f87cc156c50 2024-08-17T02:25:20.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.863+0000 7f87d4600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87cc0ae5a0 con 0x7f87cc0adcf0 2024-08-17T02:25:20.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.863+0000 7f87d4600640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87cc0ae2c0 con 0x7f87cc0abb00 2024-08-17T02:25:20.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.864+0000 7f87d1200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f87cc0adcf0 0x7f87cc0ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:20.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.864+0000 7f87d1200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f87cc0adcf0 0x7f87cc0ab5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57978/0 (socket says 172.21.15.107:57978) 2024-08-17T02:25:20.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.864+0000 7f87d1200640 1 -- 172.21.15.107:0/1676806854 learned_addr learned my addr 172.21.15.107:0/1676806854 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:20.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.864+0000 7f87d1c00640 1 --1- 172.21.15.107:0/1676806854 >> v1:172.21.15.107:6789/0 conn(0x7f87cc156c50 0x7f87cc0c7cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:47714/0 (socket says 172.21.15.107:47714) 2024-08-17T02:25:20.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.864+0000 7f87d2600640 1 --2- 172.21.15.107:0/1676806854 >> v2:172.21.15.157:3300/0 conn(0x7f87cc0abb00 0x7f87cc0c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:20.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.864+0000 7f87d1200640 1 -- 172.21.15.107:0/1676806854 >> v2:172.21.15.157:3300/0 conn(0x7f87cc0abb00 msgr2=0x7f87cc0c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:20.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.864+0000 7f87d1200640 1 --2- 172.21.15.107:0/1676806854 >> v2:172.21.15.157:3300/0 conn(0x7f87cc0abb00 0x7f87cc0c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:20.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.864+0000 7f87d1200640 1 -- 172.21.15.107:0/1676806854 >> v1:172.21.15.107:6789/0 conn(0x7f87cc156c50 legacy=0x7f87cc0c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:20.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.864+0000 7f87d1200640 1 -- 172.21.15.107:0/1676806854 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87cc0aaae0 con 0x7f87cc0adcf0 2024-08-17T02:25:20.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.864+0000 7f87d2600640 1 --2- 172.21.15.107:0/1676806854 >> v2:172.21.15.157:3300/0 conn(0x7f87cc0abb00 0x7f87cc0c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:20.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.865+0000 7f87d1200640 1 --2- 172.21.15.107:0/1676806854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87cc0adcf0 0x7f87cc0ab5c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f87cc070660 tx=0x7f87b80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76b3ac07c0f99451 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:20.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.865+0000 7f87cbe00640 1 -- 172.21.15.107:0/1676806854 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b802ad40 con 0x7f87cc0adcf0 2024-08-17T02:25:20.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.865+0000 7f87cbe00640 1 -- 172.21.15.107:0/1676806854 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b8032440 con 0x7f87cc0adcf0 2024-08-17T02:25:20.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.865+0000 7f87cbe00640 1 -- 172.21.15.107:0/1676806854 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b802aea0 con 0x7f87cc0adcf0 2024-08-17T02:25:20.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.866+0000 7f87d4600640 1 -- 172.21.15.107:0/1676806854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87cc0adcf0 msgr2=0x7f87cc0ab5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:20.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.866+0000 7f87d4600640 1 --2- 172.21.15.107:0/1676806854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87cc0adcf0 0x7f87cc0ab5c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f87cc070660 tx=0x7f87b80091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:20.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.866+0000 7f87d4600640 1 -- 172.21.15.107:0/1676806854 shutdown_connections 2024-08-17T02:25:20.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.866+0000 7f87d4600640 1 --2- 172.21.15.107:0/1676806854 >> v2:172.21.15.157:3300/0 conn(0x7f87cc0abb00 0x7f87cc0c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:20.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.866+0000 7f87d4600640 1 --2- 172.21.15.107:0/1676806854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87cc0adcf0 0x7f87cc0ab5c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:20.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.866+0000 7f87d4600640 1 -- 172.21.15.107:0/1676806854 >> 172.21.15.107:0/1676806854 conn(0x7f87cc067750 msgr2=0x7f87cc0c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:20.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.866+0000 7f87d4600640 1 -- 172.21.15.107:0/1676806854 shutdown_connections 2024-08-17T02:25:20.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.866+0000 7f87d4600640 1 -- 172.21.15.107:0/1676806854 wait complete. 2024-08-17T02:25:20.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.867+0000 7f87d4600640 1 Processor -- start 2024-08-17T02:25:20.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.868+0000 7f87d4600640 1 -- start start 2024-08-17T02:25:20.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.868+0000 7f87d4600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f87cc0abb00 0x7f87cc149400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:20.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.868+0000 7f87d4600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f87cc0adcf0 0x7f87cc06ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:20.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.868+0000 7f87d4600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87cc156c50 0x7f87cc154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:20.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.869+0000 7f87d4600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87cc1579f0 con 0x7f87cc156c50 2024-08-17T02:25:20.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.869+0000 7f87d4600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87cc06e690 con 0x7f87cc0abb00 2024-08-17T02:25:20.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.869+0000 7f87d4600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87cc1570c0 con 0x7f87cc0adcf0 2024-08-17T02:25:20.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.869+0000 7f87d2600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87cc156c50 0x7f87cc154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:20.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.869+0000 7f87d2600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87cc156c50 0x7f87cc154ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57980/0 (socket says 172.21.15.107:57980) 2024-08-17T02:25:20.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.869+0000 7f87d2600640 1 -- 172.21.15.107:0/1855106966 learned_addr learned my addr 172.21.15.107:0/1855106966 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:20.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.869+0000 7f87d1200640 1 --2- 172.21.15.107:0/1855106966 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f87cc0adcf0 0x7f87cc06ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:20.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.869+0000 7f87d1c00640 1 --2- 172.21.15.107:0/1855106966 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f87cc0abb00 0x7f87cc149400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:20.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.869+0000 7f87d2600640 1 -- 172.21.15.107:0/1855106966 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f87cc0adcf0 msgr2=0x7f87cc06ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:20.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.869+0000 7f87d2600640 1 --2- 172.21.15.107:0/1855106966 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f87cc0adcf0 0x7f87cc06ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:20.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.869+0000 7f87d2600640 1 -- 172.21.15.107:0/1855106966 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f87cc0abb00 msgr2=0x7f87cc149400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:20.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.869+0000 7f87d2600640 1 --2- 172.21.15.107:0/1855106966 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f87cc0abb00 0x7f87cc149400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:20.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.869+0000 7f87d2600640 1 -- 172.21.15.107:0/1855106966 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b8009450 con 0x7f87cc156c50 2024-08-17T02:25:20.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.869+0000 7f87d1200640 1 --2- 172.21.15.107:0/1855106966 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f87cc0adcf0 0x7f87cc06ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:20.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.869+0000 7f87d1c00640 1 --2- 172.21.15.107:0/1855106966 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f87cc0abb00 0x7f87cc149400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:20.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.869+0000 7f87d2600640 1 --2- 172.21.15.107:0/1855106966 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87cc156c50 0x7f87cc154ec0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f87c400a380 tx=0x7f87c4007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:20.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.870+0000 7f87c8c00640 1 -- 172.21.15.107:0/1855106966 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c400d650 con 0x7f87cc156c50 2024-08-17T02:25:20.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.870+0000 7f87c8c00640 1 -- 172.21.15.107:0/1855106966 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c400d7b0 con 0x7f87cc156c50 2024-08-17T02:25:20.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.870+0000 7f87c8c00640 1 -- 172.21.15.107:0/1855106966 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c400db70 con 0x7f87cc156c50 2024-08-17T02:25:20.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.870+0000 7f87d4600640 1 -- 172.21.15.107:0/1855106966 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87cc1573a0 con 0x7f87cc156c50 2024-08-17T02:25:20.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.870+0000 7f87d4600640 1 -- 172.21.15.107:0/1855106966 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87cc149940 con 0x7f87cc156c50 2024-08-17T02:25:20.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.871+0000 7f87d4600640 1 -- 172.21.15.107:0/1855106966 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87cc0caa50 con 0x7f87cc156c50 2024-08-17T02:25:20.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.871+0000 7f87c8c00640 1 -- 172.21.15.107:0/1855106966 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f87c401e3b0 con 0x7f87cc156c50 2024-08-17T02:25:20.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.872+0000 7f87c8c00640 1 --2- 172.21.15.107:0/1855106966 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f87ac065150 0x7f87ac067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:20.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.872+0000 7f87c8c00640 1 -- 172.21.15.107:0/1855106966 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f87c4082fa0 con 0x7f87cc156c50 2024-08-17T02:25:20.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.873+0000 7f87d1c00640 1 --2- 172.21.15.107:0/1855106966 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f87ac065150 0x7f87ac067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:20.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.873+0000 7f87d1c00640 1 --2- 172.21.15.107:0/1855106966 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f87ac065150 0x7f87ac067600 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f87cc0c7bb0 tx=0x7f87c0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:20.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:20.876+0000 7f87c8c00640 1 -- 172.21.15.107:0/1855106966 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f87cc0caa50 con 0x7f87cc156c50 2024-08-17T02:25:21.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.084+0000 7f87d4600640 1 -- 172.21.15.107:0/1855106966 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f87cc0caa50 con 0x7f87cc156c50 2024-08-17T02:25:21.692 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.692+0000 7f87c8c00640 1 -- 172.21.15.107:0/1855106966 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f87cc0caa50 con 0x7f87cc156c50 2024-08-17T02:25:21.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.695+0000 7f87d4600640 1 -- 172.21.15.107:0/1855106966 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f87ac065150 msgr2=0x7f87ac067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:21.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.695+0000 7f87d4600640 1 --2- 172.21.15.107:0/1855106966 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f87ac065150 0x7f87ac067600 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f87cc0c7bb0 tx=0x7f87c0009040 comp rx=0 tx=0).stop 2024-08-17T02:25:21.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.695+0000 7f87d4600640 1 -- 172.21.15.107:0/1855106966 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87cc156c50 msgr2=0x7f87cc154ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:21.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.695+0000 7f87d4600640 1 --2- 172.21.15.107:0/1855106966 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87cc156c50 0x7f87cc154ec0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f87c400a380 tx=0x7f87c4007900 comp rx=0 tx=0).stop 2024-08-17T02:25:21.696 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.695+0000 7f87d4600640 1 -- 172.21.15.107:0/1855106966 shutdown_connections 2024-08-17T02:25:21.696 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.695+0000 7f87d4600640 1 --2- 172.21.15.107:0/1855106966 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f87ac065150 0x7f87ac067600 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:21.696 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.695+0000 7f87d4600640 1 --2- 172.21.15.107:0/1855106966 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87cc156c50 0x7f87cc154ec0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:21.696 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.695+0000 7f87d4600640 1 --2- 172.21.15.107:0/1855106966 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f87cc0adcf0 0x7f87cc06ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:21.696 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.695+0000 7f87d4600640 1 --2- 172.21.15.107:0/1855106966 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f87cc0abb00 0x7f87cc149400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:21.696 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.695+0000 7f87d4600640 1 -- 172.21.15.107:0/1855106966 >> 172.21.15.107:0/1855106966 conn(0x7f87cc067750 msgr2=0x7f87cc068820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:21.696 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.695+0000 7f87d4600640 1 -- 172.21.15.107:0/1855106966 shutdown_connections 2024-08-17T02:25:21.696 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.695+0000 7f87d4600640 1 -- 172.21.15.107:0/1855106966 wait complete. 2024-08-17T02:25:21.713 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:25:21.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.864+0000 7f909e000640 1 Processor -- start 2024-08-17T02:25:21.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.865+0000 7f909e000640 1 -- start start 2024-08-17T02:25:21.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.866+0000 7f909e000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9098155900 0x7f9098155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:21.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.866+0000 7f909e000640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f90980b0270 0x7f9098156210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:21.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.866+0000 7f909e000640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9098157690 con 0x7f9098157b20 2024-08-17T02:25:21.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.866+0000 7f909e000640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9098156a80 con 0x7f90980b0270 2024-08-17T02:25:21.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.866+0000 7f909e000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9098156d60 con 0x7f9098155900 2024-08-17T02:25:21.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.867+0000 7f909cc00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9098155900 0x7f9098155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:21.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.867+0000 7f909cc00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9098155900 0x7f9098155cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:34526/0 (socket says 172.21.15.107:34526) 2024-08-17T02:25:21.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.867+0000 7f909cc00640 1 -- 172.21.15.107:0/3131665265 learned_addr learned my addr 172.21.15.107:0/3131665265 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:21.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.867+0000 7f9097e00640 1 --2- 172.21.15.107:0/3131665265 >> v2:172.21.15.157:3300/0 conn(0x7f90980b0270 0x7f9098156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:21.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.867+0000 7f909cc00640 1 -- 172.21.15.107:0/3131665265 >> v2:172.21.15.157:3300/0 conn(0x7f90980b0270 msgr2=0x7f9098156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:21.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.867+0000 7f909cc00640 1 --2- 172.21.15.107:0/3131665265 >> v2:172.21.15.157:3300/0 conn(0x7f90980b0270 0x7f9098156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:21.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.867+0000 7f909cc00640 1 -- 172.21.15.107:0/3131665265 >> v1:172.21.15.157:6789/0 conn(0x7f9098157b20 legacy=0x7f9098157fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:21.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.867+0000 7f909cc00640 1 -- 172.21.15.107:0/3131665265 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9098157040 con 0x7f9098155900 2024-08-17T02:25:21.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.868+0000 7f909cc00640 1 --2- 172.21.15.107:0/3131665265 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9098155900 0x7f9098155cd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9088009910 tx=0x7f90880091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=804e504ba9bc277a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:21.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.868+0000 7f9097400640 1 -- 172.21.15.107:0/3131665265 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908802add0 con 0x7f9098155900 2024-08-17T02:25:21.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.869+0000 7f9097400640 1 -- 172.21.15.107:0/3131665265 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9088032440 con 0x7f9098155900 2024-08-17T02:25:21.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.869+0000 7f9097400640 1 -- 172.21.15.107:0/3131665265 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9088032820 con 0x7f9098155900 2024-08-17T02:25:21.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.869+0000 7f909e000640 1 -- 172.21.15.107:0/3131665265 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9098155900 msgr2=0x7f9098155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:21.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.869+0000 7f909e000640 1 --2- 172.21.15.107:0/3131665265 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9098155900 0x7f9098155cd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9088009910 tx=0x7f90880091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:21.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.869+0000 7f909e000640 1 -- 172.21.15.107:0/3131665265 shutdown_connections 2024-08-17T02:25:21.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.869+0000 7f909e000640 1 --2- 172.21.15.107:0/3131665265 >> v2:172.21.15.157:3300/0 conn(0x7f90980b0270 0x7f9098156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:21.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.869+0000 7f909e000640 1 --2- 172.21.15.107:0/3131665265 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9098155900 0x7f9098155cd0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:21.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.869+0000 7f909e000640 1 -- 172.21.15.107:0/3131665265 >> 172.21.15.107:0/3131665265 conn(0x7f9098067750 msgr2=0x7f90980cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:21.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.869+0000 7f909e000640 1 -- 172.21.15.107:0/3131665265 shutdown_connections 2024-08-17T02:25:21.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.869+0000 7f909e000640 1 -- 172.21.15.107:0/3131665265 wait complete. 2024-08-17T02:25:21.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.870+0000 7f909e000640 1 Processor -- start 2024-08-17T02:25:21.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.871+0000 7f909e000640 1 -- start start 2024-08-17T02:25:21.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.871+0000 7f909e000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90980b0270 0x7f9098143910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:21.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.872+0000 7f909e000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9098155900 0x7f9098146f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:21.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.872+0000 7f909e000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9098157b20 0x7f90980a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:21.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.872+0000 7f909e000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90981434f0 con 0x7f9098155900 2024-08-17T02:25:21.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.872+0000 7f909e000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9098142820 con 0x7f90980b0270 2024-08-17T02:25:21.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.872+0000 7f909e000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9098142e50 con 0x7f9098157b20 2024-08-17T02:25:21.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.872+0000 7f9097e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9098155900 0x7f9098146f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:21.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.872+0000 7f9097e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9098155900 0x7f9098146f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57988/0 (socket says 172.21.15.107:57988) 2024-08-17T02:25:21.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.872+0000 7f9097e00640 1 -- 172.21.15.107:0/4271011263 learned_addr learned my addr 172.21.15.107:0/4271011263 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:21.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.872+0000 7f909cc00640 1 --2- 172.21.15.107:0/4271011263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90980b0270 0x7f9098143910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:21.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.872+0000 7f909d600640 1 --2- 172.21.15.107:0/4271011263 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9098157b20 0x7f90980a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:21.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.872+0000 7f9097e00640 1 -- 172.21.15.107:0/4271011263 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9098157b20 msgr2=0x7f90980a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:21.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.872+0000 7f9097e00640 1 --2- 172.21.15.107:0/4271011263 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9098157b20 0x7f90980a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:21.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.872+0000 7f9097e00640 1 -- 172.21.15.107:0/4271011263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90980b0270 msgr2=0x7f9098143910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:21.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.872+0000 7f9097e00640 1 --2- 172.21.15.107:0/4271011263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90980b0270 0x7f9098143910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:21.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.872+0000 7f9097e00640 1 -- 172.21.15.107:0/4271011263 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9088009450 con 0x7f9098155900 2024-08-17T02:25:21.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.873+0000 7f9097e00640 1 --2- 172.21.15.107:0/4271011263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9098155900 0x7f9098146f80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f908400ea20 tx=0x7f90840090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:21.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.873+0000 7f908fe00640 1 -- 172.21.15.107:0/4271011263 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908400ca10 con 0x7f9098155900 2024-08-17T02:25:21.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.873+0000 7f908fe00640 1 -- 172.21.15.107:0/4271011263 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908400cb70 con 0x7f9098155900 2024-08-17T02:25:21.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.873+0000 7f909e000640 1 -- 172.21.15.107:0/4271011263 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90980aa520 con 0x7f9098155900 2024-08-17T02:25:21.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.873+0000 7f908fe00640 1 -- 172.21.15.107:0/4271011263 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9084013470 con 0x7f9098155900 2024-08-17T02:25:21.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.873+0000 7f909e000640 1 -- 172.21.15.107:0/4271011263 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9098143e50 con 0x7f9098155900 2024-08-17T02:25:21.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.874+0000 7f909e000640 1 -- 172.21.15.107:0/4271011263 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9098071050 con 0x7f9098155900 2024-08-17T02:25:21.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.875+0000 7f908fe00640 1 -- 172.21.15.107:0/4271011263 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9084013860 con 0x7f9098155900 2024-08-17T02:25:21.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.876+0000 7f908fe00640 1 --2- 172.21.15.107:0/4271011263 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f9078065150 0x7f9078067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:21.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.876+0000 7f908fe00640 1 -- 172.21.15.107:0/4271011263 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f90840827d0 con 0x7f9098155900 2024-08-17T02:25:21.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.876+0000 7f909cc00640 1 --2- 172.21.15.107:0/4271011263 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f9078065150 0x7f9078067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:21.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.877+0000 7f909cc00640 1 --2- 172.21.15.107:0/4271011263 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f9078065150 0x7f9078067600 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9088034000 tx=0x7f9088032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:21.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:21.880+0000 7f908fe00640 1 -- 172.21.15.107:0/4271011263 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f90840508a0 con 0x7f9098155900 2024-08-17T02:25:22.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.087+0000 7f909e000640 1 -- 172.21.15.107:0/4271011263 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f909806f480 con 0x7f9098155900 2024-08-17T02:25:22.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.087+0000 7f908fe00640 1 -- 172.21.15.107:0/4271011263 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f9084053ec0 con 0x7f9098155900 2024-08-17T02:25:22.088 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:25:22.088 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4682,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/855770365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":855770365},{"type":"v1","addr":"172.21.15.107:6836","nonce":855770365}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4688,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6834/1749905502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1749905502},{"type":"v1","addr":"172.21.15.157:6834","nonce":1749905502}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4914,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/809431952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":809431952},{"type":"v1","addr":"172.21.15.107:6837","nonce":809431952}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:18.071301+0000","modified":"2024-08-17T02:25:21.685727+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4920":{"gid":4920,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6835/1725535660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6833","nonce":1725535660},{"type":"v1","addr":"172.21.15.157:6835","nonce":1725535660}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-08-17T02:25:22.088 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 17 2024-08-17T02:25:22.090 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.090+0000 7f909e000640 1 -- 172.21.15.107:0/4271011263 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f9078065150 msgr2=0x7f9078067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:22.090 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.090+0000 7f909e000640 1 --2- 172.21.15.107:0/4271011263 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f9078065150 0x7f9078067600 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9088034000 tx=0x7f9088032000 comp rx=0 tx=0).stop 2024-08-17T02:25:22.090 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.090+0000 7f909e000640 1 -- 172.21.15.107:0/4271011263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9098155900 msgr2=0x7f9098146f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:22.090 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.090+0000 7f909e000640 1 --2- 172.21.15.107:0/4271011263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9098155900 0x7f9098146f80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f908400ea20 tx=0x7f90840090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.090 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.090+0000 7f909e000640 1 -- 172.21.15.107:0/4271011263 shutdown_connections 2024-08-17T02:25:22.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.090+0000 7f909e000640 1 --2- 172.21.15.107:0/4271011263 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f9078065150 0x7f9078067600 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.090+0000 7f909e000640 1 --2- 172.21.15.107:0/4271011263 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9098157b20 0x7f90980a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.090+0000 7f909e000640 1 --2- 172.21.15.107:0/4271011263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9098155900 0x7f9098146f80 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.090+0000 7f909e000640 1 --2- 172.21.15.107:0/4271011263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90980b0270 0x7f9098143910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.090+0000 7f909e000640 1 -- 172.21.15.107:0/4271011263 >> 172.21.15.107:0/4271011263 conn(0x7f9098067750 msgr2=0x7f90980abf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:22.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.090+0000 7f909e000640 1 -- 172.21.15.107:0/4271011263 shutdown_connections 2024-08-17T02:25:22.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.090+0000 7f909e000640 1 -- 172.21.15.107:0/4271011263 wait complete. 2024-08-17T02:25:22.105 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:22.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.253+0000 7fe7d1200640 1 Processor -- start 2024-08-17T02:25:22.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.253+0000 7fe7d1200640 1 -- start start 2024-08-17T02:25:22.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.255+0000 7fe7d1200640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe7cc155df0 0x7fe7cc0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:22.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.255+0000 7fe7d1200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7cc156670 con 0x7fe7cc06df00 2024-08-17T02:25:22.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.255+0000 7fe7d1200640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7cc06e5e0 con 0x7fe7cc155a20 2024-08-17T02:25:22.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.255+0000 7fe7d1200640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7cc0b0350 con 0x7fe7cc155df0 2024-08-17T02:25:22.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.255+0000 7fe7c1400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fe7cc06df00 0x7fe7cc156b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:47724/0 (socket says 172.21.15.107:47724) 2024-08-17T02:25:22.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.255+0000 7fe7c1400640 1 -- 172.21.15.107:0/214591065 learned_addr learned my addr 172.21.15.107:0/214591065 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:25:22.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.255+0000 7fe7c9400640 1 -- 172.21.15.107:0/214591065 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2381237619 0 0) 0x7fe7cc156670 con 0x7fe7cc06df00 2024-08-17T02:25:22.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.255+0000 7fe7c9400640 1 -- 172.21.15.107:0/214591065 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7b00034e0 con 0x7fe7cc06df00 2024-08-17T02:25:22.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.255+0000 7fe7ca800640 1 --2- 172.21.15.107:0/214591065 >> v2:172.21.15.157:3300/0 conn(0x7fe7cc155df0 0x7fe7cc0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:22.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.256+0000 7fe7c9400640 1 -- 172.21.15.107:0/214591065 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3398520984 0 0) 0x7fe7b00034e0 con 0x7fe7cc06df00 2024-08-17T02:25:22.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.256+0000 7fe7c9400640 1 -- 172.21.15.107:0/214591065 >> v2:172.21.15.157:3300/0 conn(0x7fe7cc155df0 msgr2=0x7fe7cc0adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:22.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.256+0000 7fe7c9400640 1 --2- 172.21.15.107:0/214591065 >> v2:172.21.15.157:3300/0 conn(0x7fe7cc155df0 0x7fe7cc0adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.256+0000 7fe7c9400640 1 -- 172.21.15.107:0/214591065 >> v1:172.21.15.157:6789/0 conn(0x7fe7cc155a20 legacy=0x7fe7cc06d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:22.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.256+0000 7fe7c9400640 1 -- 172.21.15.107:0/214591065 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7cc06e8c0 con 0x7fe7cc06df00 2024-08-17T02:25:22.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.256+0000 7fe7c9400640 1 -- 172.21.15.107:0/214591065 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 537989081 0 0) 0x7fe7b4001470 con 0x7fe7cc06df00 2024-08-17T02:25:22.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.256+0000 7fe7c9400640 1 -- 172.21.15.107:0/214591065 >> v1:172.21.15.107:6789/0 conn(0x7fe7cc06df00 legacy=0x7fe7cc156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:22.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.256+0000 7fe7c9400640 1 --2- 172.21.15.107:0/214591065 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7b00039d0 0x7fe7b0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:22.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.256+0000 7fe7c9400640 1 --2- 172.21.15.107:0/214591065 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7b0004780 0x7fe7b0004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:22.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.256+0000 7fe7c9400640 1 --2- 172.21.15.107:0/214591065 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7b0005250 0x7fe7b000dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:22.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.256+0000 7fe7c9400640 1 -- 172.21.15.107:0/214591065 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b000e380 con 0x7fe7b0004780 2024-08-17T02:25:22.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.256+0000 7fe7c9400640 1 -- 172.21.15.107:0/214591065 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b000e4f0 con 0x7fe7b00039d0 2024-08-17T02:25:22.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.256+0000 7fe7c9400640 1 -- 172.21.15.107:0/214591065 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b000e6b0 con 0x7fe7b0005250 2024-08-17T02:25:22.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.256+0000 7fe7ca800640 1 --2- 172.21.15.107:0/214591065 >> v2:172.21.15.157:3300/0 conn(0x7fe7cc155df0 0x7fe7cc0adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:22.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.256+0000 7fe7c1400640 1 --2- 172.21.15.107:0/214591065 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7b0004780 0x7fe7b0004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:22.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.256+0000 7fe7c9e00640 1 --2- 172.21.15.107:0/214591065 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7b00039d0 0x7fe7b0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:22.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.256+0000 7fe7ca800640 1 --2- 172.21.15.107:0/214591065 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7b0005250 0x7fe7b000dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:22.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.256+0000 7fe7c1400640 1 -- 172.21.15.107:0/214591065 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7b0005250 msgr2=0x7fe7b000dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:22.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.256+0000 7fe7c1400640 1 --2- 172.21.15.107:0/214591065 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7b0005250 0x7fe7b000dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.256+0000 7fe7c1400640 1 -- 172.21.15.107:0/214591065 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7b00039d0 msgr2=0x7fe7b0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:22.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.256+0000 7fe7c1400640 1 --2- 172.21.15.107:0/214591065 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7b00039d0 0x7fe7b0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.256+0000 7fe7c1400640 1 -- 172.21.15.107:0/214591065 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b00034e0 con 0x7fe7b0004780 2024-08-17T02:25:22.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.256+0000 7fe7ca800640 1 -- 172.21.15.107:0/214591065 reap_dead start 2024-08-17T02:25:22.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.257+0000 7fe7c1400640 1 --2- 172.21.15.107:0/214591065 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7b0004780 0x7fe7b0004bf0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe7b400c2a0 tx=0x7fe7b4001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1892bc2a30e84bb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:22.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.258+0000 7fe7c9400640 1 -- 172.21.15.107:0/214591065 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b4005890 con 0x7fe7b0004780 2024-08-17T02:25:22.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.258+0000 7fe7c9400640 1 -- 172.21.15.107:0/214591065 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b4005a10 con 0x7fe7b0004780 2024-08-17T02:25:22.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.258+0000 7fe7c9400640 1 -- 172.21.15.107:0/214591065 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b4005dd0 con 0x7fe7b0004780 2024-08-17T02:25:22.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.258+0000 7fe7d1200640 1 -- 172.21.15.107:0/214591065 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7b0004780 msgr2=0x7fe7b0004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:22.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.258+0000 7fe7d1200640 1 --2- 172.21.15.107:0/214591065 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7b0004780 0x7fe7b0004bf0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe7b400c2a0 tx=0x7fe7b4001e50 comp rx=0 tx=0).stop 2024-08-17T02:25:22.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.258+0000 7fe7d1200640 1 -- 172.21.15.107:0/214591065 shutdown_connections 2024-08-17T02:25:22.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.258+0000 7fe7d1200640 1 --2- 172.21.15.107:0/214591065 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7b0004780 0x7fe7b0004bf0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.258+0000 7fe7d1200640 1 -- 172.21.15.107:0/214591065 >> 172.21.15.107:0/214591065 conn(0x7fe7cc0cb9b0 msgr2=0x7fe7cc0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:22.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.258+0000 7fe7d1200640 1 -- 172.21.15.107:0/214591065 shutdown_connections 2024-08-17T02:25:22.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.258+0000 7fe7d1200640 1 -- 172.21.15.107:0/214591065 wait complete. 2024-08-17T02:25:22.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.260+0000 7fe7d1200640 1 Processor -- start 2024-08-17T02:25:22.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.260+0000 7fe7d1200640 1 -- start start 2024-08-17T02:25:22.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.261+0000 7fe7d1200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7b0004780 0x7fe7cc1442f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:22.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.261+0000 7fe7d1200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7cc0ac910 0x7fe7cc0acd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:22.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.261+0000 7fe7d1200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7cc068ea0 0x7fe7cc069310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:22.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.261+0000 7fe7d1200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7cc157bc0 con 0x7fe7cc068ea0 2024-08-17T02:25:22.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.261+0000 7fe7d1200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7cc068a10 con 0x7fe7cc0ac910 2024-08-17T02:25:22.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.261+0000 7fe7d1200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7cc0ad660 con 0x7fe7b0004780 2024-08-17T02:25:22.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.261+0000 7fe7ca800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7cc068ea0 0x7fe7cc069310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:22.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.261+0000 7fe7ca800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7cc068ea0 0x7fe7cc069310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58010/0 (socket says 172.21.15.107:58010) 2024-08-17T02:25:22.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.261+0000 7fe7ca800640 1 -- 172.21.15.107:0/2263222271 learned_addr learned my addr 172.21.15.107:0/2263222271 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:22.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.261+0000 7fe7c1400640 1 --2- 172.21.15.107:0/2263222271 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7cc0ac910 0x7fe7cc0acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:22.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.261+0000 7fe7c9e00640 1 --2- 172.21.15.107:0/2263222271 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7b0004780 0x7fe7cc1442f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:22.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.261+0000 7fe7ca800640 1 -- 172.21.15.107:0/2263222271 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7b0004780 msgr2=0x7fe7cc1442f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:22.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.261+0000 7fe7ca800640 1 --2- 172.21.15.107:0/2263222271 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7b0004780 0x7fe7cc1442f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.261+0000 7fe7ca800640 1 -- 172.21.15.107:0/2263222271 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7cc0ac910 msgr2=0x7fe7cc0acd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:22.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.261+0000 7fe7ca800640 1 --2- 172.21.15.107:0/2263222271 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7cc0ac910 0x7fe7cc0acd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.261+0000 7fe7ca800640 1 -- 172.21.15.107:0/2263222271 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7cc0ad940 con 0x7fe7cc068ea0 2024-08-17T02:25:22.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.261+0000 7fe7c1400640 1 --2- 172.21.15.107:0/2263222271 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7cc0ac910 0x7fe7cc0acd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:22.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.262+0000 7fe7ca800640 1 --2- 172.21.15.107:0/2263222271 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7cc068ea0 0x7fe7cc069310 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc06aa10 tx=0x7fe7c40098f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:22.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.262+0000 7fe7c2000640 1 -- 172.21.15.107:0/2263222271 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c40025c0 con 0x7fe7cc068ea0 2024-08-17T02:25:22.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.262+0000 7fe7c2000640 1 -- 172.21.15.107:0/2263222271 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c400f050 con 0x7fe7cc068ea0 2024-08-17T02:25:22.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.262+0000 7fe7c2000640 1 -- 172.21.15.107:0/2263222271 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c4002930 con 0x7fe7cc068ea0 2024-08-17T02:25:22.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.262+0000 7fe7d1200640 1 -- 172.21.15.107:0/2263222271 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7cc0adc20 con 0x7fe7cc068ea0 2024-08-17T02:25:22.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.262+0000 7fe7d1200640 1 -- 172.21.15.107:0/2263222271 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7cc0ad2c0 con 0x7fe7cc068ea0 2024-08-17T02:25:22.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.263+0000 7fe7d1200640 1 -- 172.21.15.107:0/2263222271 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7cc068b80 con 0x7fe7cc068ea0 2024-08-17T02:25:22.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.264+0000 7fe7c2000640 1 -- 172.21.15.107:0/2263222271 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe7c4003040 con 0x7fe7cc068ea0 2024-08-17T02:25:22.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.265+0000 7fe7c2000640 1 --2- 172.21.15.107:0/2263222271 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe7a8065180 0x7fe7a8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:22.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.265+0000 7fe7c2000640 1 -- 172.21.15.107:0/2263222271 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe7c40820e0 con 0x7fe7cc068ea0 2024-08-17T02:25:22.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.265+0000 7fe7c9e00640 1 --2- 172.21.15.107:0/2263222271 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe7a8065180 0x7fe7a8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:22.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.266+0000 7fe7c9e00640 1 --2- 172.21.15.107:0/2263222271 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe7a8065180 0x7fe7a8067630 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc158a30 tx=0x7fe7bc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:22.268 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.269+0000 7fe7c2000640 1 -- 172.21.15.107:0/2263222271 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe7c4053b90 con 0x7fe7cc068ea0 2024-08-17T02:25:22.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.443+0000 7fe7d1200640 1 -- 172.21.15.107:0/2263222271 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7cc064db0 con 0x7fe7cc068ea0 2024-08-17T02:25:22.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.444+0000 7fe7c2000640 1 -- 172.21.15.107:0/2263222271 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fe7c4053720 con 0x7fe7cc068ea0 2024-08-17T02:25:22.444 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:25:22.445 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":32,"fsid":"f207b4c0-329d-46b8-b83f-aaf30bdb6ce3","created":"2024-08-17T02:24:11.038049+0000","modified":"2024-08-17T02:25:19.673728+0000","last_up_change":"2024-08-17T02:24:22.047790+0000","last_in_change":"2024-08-17T02:24:13.892720+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:23.456166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:16.086009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:17.060399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"376363f3-b8bf-4f1e-b691-51cdd39171ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37302},{"type":"v1","addr":"172.21.15.107:6801","nonce":37302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37302},{"type":"v1","addr":"172.21.15.107:6803","nonce":37302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37302},{"type":"v1","addr":"172.21.15.107:6807","nonce":37302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37302},{"type":"v1","addr":"172.21.15.107:6805","nonce":37302}]},"public_addr":"172.21.15.107:6801/37302","cluster_addr":"172.21.15.107:6803/37302","heartbeat_back_addr":"172.21.15.107:6807/37302","heartbeat_front_addr":"172.21.15.107:6805/37302","state":["exists","up"]},{"osd":1,"uuid":"cc6624e3-2ad4-4db4-b377-05dfe57424e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37305},{"type":"v1","addr":"172.21.15.107:6824","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37305},{"type":"v1","addr":"172.21.15.107:6827","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37305},{"type":"v1","addr":"172.21.15.107:6831","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37305},{"type":"v1","addr":"172.21.15.107:6829","nonce":37305}]},"public_addr":"172.21.15.107:6824/37305","cluster_addr":"172.21.15.107:6827/37305","heartbeat_back_addr":"172.21.15.107:6831/37305","heartbeat_front_addr":"172.21.15.107:6829/37305","state":["exists","up"]},{"osd":2,"uuid":"25229542-29b5-4281-bcb0-798ae0930aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37307},{"type":"v1","addr":"172.21.15.107:6817","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37307},{"type":"v1","addr":"172.21.15.107:6819","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6823","nonce":37307},{"type":"v1","addr":"172.21.15.107:6825","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37307},{"type":"v1","addr":"172.21.15.107:6821","nonce":37307}]},"public_addr":"172.21.15.107:6817/37307","cluster_addr":"172.21.15.107:6819/37307","heartbeat_back_addr":"172.21.15.107:6825/37307","heartbeat_front_addr":"172.21.15.107:6821/37307","state":["exists","up"]},{"osd":3,"uuid":"5f16aee8-8950-4268-a61a-5cf6ebd670e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37306},{"type":"v1","addr":"172.21.15.107:6809","nonce":37306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37306},{"type":"v1","addr":"172.21.15.107:6811","nonce":37306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37306},{"type":"v1","addr":"172.21.15.107:6815","nonce":37306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37306},{"type":"v1","addr":"172.21.15.107:6813","nonce":37306}]},"public_addr":"172.21.15.107:6809/37306","cluster_addr":"172.21.15.107:6811/37306","heartbeat_back_addr":"172.21.15.107:6815/37306","heartbeat_front_addr":"172.21.15.107:6813/37306","state":["exists","up"]},{"osd":4,"uuid":"23232e28-e23b-4b4e-a531-4939246dbbde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":37329},{"type":"v1","addr":"172.21.15.157:6817","nonce":37329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":37329},{"type":"v1","addr":"172.21.15.157:6819","nonce":37329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":37329},{"type":"v1","addr":"172.21.15.157:6823","nonce":37329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":37329},{"type":"v1","addr":"172.21.15.157:6821","nonce":37329}]},"public_addr":"172.21.15.157:6817/37329","cluster_addr":"172.21.15.157:6819/37329","heartbeat_back_addr":"172.21.15.157:6823/37329","heartbeat_front_addr":"172.21.15.157:6821/37329","state":["exists","up"]},{"osd":5,"uuid":"f87ec331-3e59-4886-a317-6f7e26ec8e21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":37328},{"type":"v1","addr":"172.21.15.157:6804","nonce":37328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":37328},{"type":"v1","addr":"172.21.15.157:6808","nonce":37328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":37328},{"type":"v1","addr":"172.21.15.157:6815","nonce":37328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":37328},{"type":"v1","addr":"172.21.15.157:6812","nonce":37328}]},"public_addr":"172.21.15.157:6804/37328","cluster_addr":"172.21.15.157:6808/37328","heartbeat_back_addr":"172.21.15.157:6815/37328","heartbeat_front_addr":"172.21.15.157:6812/37328","state":["exists","up"]},{"osd":6,"uuid":"92852235-ce49-4d96-a940-6f18d97b13ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":37330},{"type":"v1","addr":"172.21.15.157:6801","nonce":37330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6803","nonce":37330},{"type":"v1","addr":"172.21.15.157:6805","nonce":37330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":37330},{"type":"v1","addr":"172.21.15.157:6813","nonce":37330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":37330},{"type":"v1","addr":"172.21.15.157:6809","nonce":37330}]},"public_addr":"172.21.15.157:6801/37330","cluster_addr":"172.21.15.157:6805/37330","heartbeat_back_addr":"172.21.15.157:6813/37330","heartbeat_front_addr":"172.21.15.157:6809/37330","state":["exists","up"]},{"osd":7,"uuid":"7484a061-723d-4663-b28f-b01766d62f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":37373},{"type":"v1","addr":"172.21.15.157:6825","nonce":37373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":37373},{"type":"v1","addr":"172.21.15.157:6827","nonce":37373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":37373},{"type":"v1","addr":"172.21.15.157:6831","nonce":37373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":37373},{"type":"v1","addr":"172.21.15.157:6829","nonce":37373}]},"public_addr":"172.21.15.157:6825/37373","cluster_addr":"172.21.15.157:6827/37373","heartbeat_back_addr":"172.21.15.157:6831/37373","heartbeat_front_addr":"172.21.15.157:6829/37373","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.110188+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.280265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.252119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.267996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.284582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.144420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.174764+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.308002+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:22.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.446+0000 7fe7d1200640 1 -- 172.21.15.107:0/2263222271 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe7a8065180 msgr2=0x7fe7a8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:22.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.446+0000 7fe7d1200640 1 --2- 172.21.15.107:0/2263222271 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe7a8065180 0x7fe7a8067630 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc158a30 tx=0x7fe7bc009040 comp rx=0 tx=0).stop 2024-08-17T02:25:22.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.446+0000 7fe7d1200640 1 -- 172.21.15.107:0/2263222271 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7cc068ea0 msgr2=0x7fe7cc069310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:22.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.446+0000 7fe7d1200640 1 --2- 172.21.15.107:0/2263222271 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7cc068ea0 0x7fe7cc069310 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc06aa10 tx=0x7fe7c40098f0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.446+0000 7fe7d1200640 1 -- 172.21.15.107:0/2263222271 shutdown_connections 2024-08-17T02:25:22.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.446+0000 7fe7d1200640 1 --2- 172.21.15.107:0/2263222271 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe7a8065180 0x7fe7a8067630 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.446+0000 7fe7d1200640 1 --2- 172.21.15.107:0/2263222271 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7cc068ea0 0x7fe7cc069310 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.446+0000 7fe7d1200640 1 --2- 172.21.15.107:0/2263222271 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7cc0ac910 0x7fe7cc0acd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.446+0000 7fe7d1200640 1 --2- 172.21.15.107:0/2263222271 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7b0004780 0x7fe7cc1442f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.446+0000 7fe7d1200640 1 -- 172.21.15.107:0/2263222271 >> 172.21.15.107:0/2263222271 conn(0x7fe7cc0cb9b0 msgr2=0x7fe7cc154990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:22.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.446+0000 7fe7d1200640 1 -- 172.21.15.107:0/2263222271 shutdown_connections 2024-08-17T02:25:22.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.447+0000 7fe7d1200640 1 -- 172.21.15.107:0/2263222271 wait complete. 2024-08-17T02:25:22.463 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-08-17T02:25:22.463 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:25:22.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.609+0000 7f9913400640 1 Processor -- start 2024-08-17T02:25:22.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.609+0000 7f9913400640 1 -- start start 2024-08-17T02:25:22.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.610+0000 7f9913400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f990c155df0 0x7f990c0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:22.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.610+0000 7f9913400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f990c156670 con 0x7f990c155a20 2024-08-17T02:25:22.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.610+0000 7f9913400640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f990c06e5e0 con 0x7f990c06df00 2024-08-17T02:25:22.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.610+0000 7f9913400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f990c0b0350 con 0x7f990c155df0 2024-08-17T02:25:22.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.611+0000 7f9910a00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f990c155a20 0x7f990c06d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:47734/0 (socket says 172.21.15.107:47734) 2024-08-17T02:25:22.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.611+0000 7f9910a00640 1 -- 172.21.15.107:0/2423025019 learned_addr learned my addr 172.21.15.107:0/2423025019 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:25:22.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.611+0000 7f9911400640 1 --2- 172.21.15.107:0/2423025019 >> v2:172.21.15.107:3300/0 conn(0x7f990c155df0 0x7f990c0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:22.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.611+0000 7f9911400640 1 -- 172.21.15.107:0/2423025019 >> v1:172.21.15.157:6789/0 conn(0x7f990c06df00 legacy=0x7f990c156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:22.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.611+0000 7f9911400640 1 -- 172.21.15.107:0/2423025019 >> v1:172.21.15.107:6789/0 conn(0x7f990c155a20 legacy=0x7f990c06d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:22.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.611+0000 7f9911400640 1 -- 172.21.15.107:0/2423025019 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f990c06e8c0 con 0x7f990c155df0 2024-08-17T02:25:22.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.612+0000 7f9911400640 1 --2- 172.21.15.107:0/2423025019 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f990c155df0 0x7f990c0adf10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9904009e60 tx=0x7f9904009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=506261c9947bb9cc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:22.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.612+0000 7f990b400640 1 -- 172.21.15.107:0/2423025019 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9904007550 con 0x7f990c155df0 2024-08-17T02:25:22.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.612+0000 7f990b400640 1 -- 172.21.15.107:0/2423025019 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990402d050 con 0x7f990c155df0 2024-08-17T02:25:22.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.612+0000 7f990b400640 1 -- 172.21.15.107:0/2423025019 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9904007920 con 0x7f990c155df0 2024-08-17T02:25:22.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.613+0000 7f9913400640 1 -- 172.21.15.107:0/2423025019 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f990c155df0 msgr2=0x7f990c0adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:22.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.613+0000 7f9913400640 1 --2- 172.21.15.107:0/2423025019 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f990c155df0 0x7f990c0adf10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9904009e60 tx=0x7f9904009780 comp rx=0 tx=0).stop 2024-08-17T02:25:22.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.613+0000 7f9913400640 1 -- 172.21.15.107:0/2423025019 shutdown_connections 2024-08-17T02:25:22.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.613+0000 7f9913400640 1 --2- 172.21.15.107:0/2423025019 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f990c155df0 0x7f990c0adf10 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.613+0000 7f9913400640 1 -- 172.21.15.107:0/2423025019 >> 172.21.15.107:0/2423025019 conn(0x7f990c0cb9b0 msgr2=0x7f990c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:22.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.613+0000 7f9913400640 1 -- 172.21.15.107:0/2423025019 shutdown_connections 2024-08-17T02:25:22.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.613+0000 7f9913400640 1 -- 172.21.15.107:0/2423025019 wait complete. 2024-08-17T02:25:22.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.615+0000 7f9913400640 1 Processor -- start 2024-08-17T02:25:22.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.615+0000 7f9913400640 1 -- start start 2024-08-17T02:25:22.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.616+0000 7f9913400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f990c06df00 0x7f990c0ad550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:22.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.616+0000 7f9913400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f990c155a20 0x7f990c150c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:22.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.616+0000 7f9913400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f990c155df0 0x7f990c166d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:22.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.616+0000 7f9913400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990c0aa620 con 0x7f990c06df00 2024-08-17T02:25:22.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.616+0000 7f9913400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990c0cb680 con 0x7f990c155a20 2024-08-17T02:25:22.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.616+0000 7f9913400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f990c0a9a10 con 0x7f990c155df0 2024-08-17T02:25:22.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.616+0000 7f9910a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f990c06df00 0x7f990c0ad550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:22.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.616+0000 7f9910a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f990c06df00 0x7f990c0ad550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58038/0 (socket says 172.21.15.107:58038) 2024-08-17T02:25:22.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.616+0000 7f9910a00640 1 -- 172.21.15.107:0/3938574515 learned_addr learned my addr 172.21.15.107:0/3938574515 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:22.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.616+0000 7f990be00640 1 --2- 172.21.15.107:0/3938574515 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f990c155a20 0x7f990c150c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:22.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.616+0000 7f9911400640 1 --2- 172.21.15.107:0/3938574515 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f990c155df0 0x7f990c166d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:22.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.616+0000 7f9910a00640 1 -- 172.21.15.107:0/3938574515 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f990c155df0 msgr2=0x7f990c166d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:22.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.616+0000 7f9910a00640 1 --2- 172.21.15.107:0/3938574515 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f990c155df0 0x7f990c166d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.616+0000 7f9910a00640 1 -- 172.21.15.107:0/3938574515 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f990c155a20 msgr2=0x7f990c150c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:22.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.616+0000 7f9910a00640 1 --2- 172.21.15.107:0/3938574515 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f990c155a20 0x7f990c150c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.616+0000 7f9910a00640 1 -- 172.21.15.107:0/3938574515 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9904009a20 con 0x7f990c06df00 2024-08-17T02:25:22.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.616+0000 7f9911400640 1 --2- 172.21.15.107:0/3938574515 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f990c155df0 0x7f990c166d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:22.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.617+0000 7f9910a00640 1 --2- 172.21.15.107:0/3938574515 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f990c06df00 0x7f990c0ad550 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f98fc00c590 tx=0x7f98fc007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:22.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.617+0000 7f9903e00640 1 -- 172.21.15.107:0/3938574515 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98fc005aa0 con 0x7f990c06df00 2024-08-17T02:25:22.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.617+0000 7f9903e00640 1 -- 172.21.15.107:0/3938574515 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98fc005c20 con 0x7f990c06df00 2024-08-17T02:25:22.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.617+0000 7f9903e00640 1 -- 172.21.15.107:0/3938574515 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98fc0070f0 con 0x7f990c06df00 2024-08-17T02:25:22.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.617+0000 7f9913400640 1 -- 172.21.15.107:0/3938574515 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f990c0a9cf0 con 0x7f990c06df00 2024-08-17T02:25:22.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.617+0000 7f9913400640 1 -- 172.21.15.107:0/3938574515 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f990c0aa2b0 con 0x7f990c06df00 2024-08-17T02:25:22.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.618+0000 7f9913400640 1 -- 172.21.15.107:0/3938574515 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f990c064db0 con 0x7f990c06df00 2024-08-17T02:25:22.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.619+0000 7f9903e00640 1 -- 172.21.15.107:0/3938574515 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f98fc007540 con 0x7f990c06df00 2024-08-17T02:25:22.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.620+0000 7f9903e00640 1 --2- 172.21.15.107:0/3938574515 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f98ec065150 0x7f98ec067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:22.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.620+0000 7f9903e00640 1 -- 172.21.15.107:0/3938574515 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f98fc0814e0 con 0x7f990c06df00 2024-08-17T02:25:22.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.620+0000 7f990be00640 1 --2- 172.21.15.107:0/3938574515 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f98ec065150 0x7f98ec067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:22.621 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.620+0000 7f990be00640 1 --2- 172.21.15.107:0/3938574515 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f98ec065150 0x7f98ec067600 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f990c155390 tx=0x7f98f8007e10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:22.623 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.623+0000 7f9903e00640 1 -- 172.21.15.107:0/3938574515 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f98fc04f630 con 0x7f990c06df00 2024-08-17T02:25:22.644 INFO:tasks.ceph.mds.d.smithi157.stderr:2024-08-17T02:25:22.644+0000 7f6c70000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:25:22.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.794+0000 7f9913400640 1 -- 172.21.15.107:0/3938574515 --> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f990c0aa760 con 0x7f98ec065150 2024-08-17T02:25:22.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.801+0000 7f9903e00640 1 -- 172.21.15.107:0/3938574515 <== mgr.4110 v2:172.21.15.107:6832/37039 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+253865 (secure 0 0 0) 0x7f98f800f810 con 0x7f98ec065150 2024-08-17T02:25:22.804 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:25:22.805 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-08-17T02:25:22.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.804+0000 7f9913400640 1 -- 172.21.15.107:0/3938574515 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f98ec065150 msgr2=0x7f98ec067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:22.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.804+0000 7f9913400640 1 --2- 172.21.15.107:0/3938574515 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f98ec065150 0x7f98ec067600 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f990c155390 tx=0x7f98f8007e10 comp rx=0 tx=0).stop 2024-08-17T02:25:22.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.804+0000 7f9913400640 1 -- 172.21.15.107:0/3938574515 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f990c06df00 msgr2=0x7f990c0ad550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:22.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.804+0000 7f9913400640 1 --2- 172.21.15.107:0/3938574515 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f990c06df00 0x7f990c0ad550 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f98fc00c590 tx=0x7f98fc007ee0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.805+0000 7f9913400640 1 -- 172.21.15.107:0/3938574515 shutdown_connections 2024-08-17T02:25:22.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.805+0000 7f9913400640 1 --2- 172.21.15.107:0/3938574515 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f98ec065150 0x7f98ec067600 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.805+0000 7f9913400640 1 --2- 172.21.15.107:0/3938574515 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f990c155df0 0x7f990c166d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.805+0000 7f9913400640 1 --2- 172.21.15.107:0/3938574515 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f990c155a20 0x7f990c150c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.805+0000 7f9913400640 1 --2- 172.21.15.107:0/3938574515 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f990c06df00 0x7f990c0ad550 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.805+0000 7f9913400640 1 -- 172.21.15.107:0/3938574515 >> 172.21.15.107:0/3938574515 conn(0x7f990c0cb9b0 msgr2=0x7f990c153b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:22.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.805+0000 7f9913400640 1 -- 172.21.15.107:0/3938574515 shutdown_connections 2024-08-17T02:25:22.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:22.805+0000 7f9913400640 1 -- 172.21.15.107:0/3938574515 wait complete. 2024-08-17T02:25:22.821 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-08-17T02:25:21.415547+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2399172,"kb_used_data":3676,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752575548,"statfs":{"total":773094113280,"available":770637361152,"internally_reserved":0,"allocated":3764224,"data_stored":2127467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.759750"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.662092+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:41:06.837768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.660368+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:54:09.951612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.662967+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:10.657983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.656602+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:43:30.643309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.657172+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:58:54.659759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.656634+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:24:08.290061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.662005+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:08:42.813501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.656460+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:18:43.616735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.663748+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:14:21.868403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.659878+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:41:06.837768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.659849+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:34:39.313004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.662181+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:03:47.853752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.656547+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:43:30.643309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.660094+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:54:09.951612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.661496+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:48:25.682657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.664617+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:22.234303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.661985+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:10.657983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.656613+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:21:56.218636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.656603+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:24:33.895108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.656475+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:25.788507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.659644+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:50.528508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.660941+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:08:36.844257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.657077+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:54:53.867430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.659640+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:14:21.868403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.661507+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:08:42.813501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.658849+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:08:36.844257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.659830+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:41:06.837768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.658693+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:18:32.501730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.659565+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:50.528508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.656390+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:40:36.208597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.664120+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:57:03.088315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.661601+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:50.528508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-08-17T02:25:11.702044+0000","last_change":"2024-08-17T02:24:25.092772+0000","last_active":"2024-08-17T02:25:11.702044+0000","last_peered":"2024-08-17T02:25:11.702044+0000","last_clean":"2024-08-17T02:25:11.702044+0000","last_became_active":"2024-08-17T02:24:25.091788+0000","last_became_peered":"2024-08-17T02:24:25.091788+0000","last_unstale":"2024-08-17T02:25:11.702044+0000","last_undegraded":"2024-08-17T02:25:11.702044+0000","last_fullsized":"2024-08-17T02:25:11.702044+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:24.051996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:24.051996+0000","last_clean_scrub_stamp":"2024-08-17T02:24:24.051996+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:31:45.454480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302412,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069428,"statfs":{"total":96636764160,"available":96327094272,"internally_reserved":0,"allocated":917504,"data_stored":709435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]}]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301828,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070012,"statfs":{"total":96636764160,"available":96327692288,"internally_reserved":0,"allocated":311296,"data_stored":113262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301832,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070008,"statfs":{"total":96636764160,"available":96327688192,"internally_reserved":0,"allocated":323584,"data_stored":119067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301832,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070008,"statfs":{"total":96636764160,"available":96327688192,"internally_reserved":0,"allocated":323584,"data_stored":119067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297672,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074168,"statfs":{"total":96636764160,"available":96331948032,"internally_reserved":0,"allocated":323584,"data_stored":119067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297672,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074168,"statfs":{"total":96636764160,"available":96331948032,"internally_reserved":0,"allocated":323584,"data_stored":119067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297672,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074168,"statfs":{"total":96636764160,"available":96331948032,"internally_reserved":0,"allocated":323584,"data_stored":119067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298252,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073588,"statfs":{"total":96636764160,"available":96331354112,"internally_reserved":0,"allocated":917504,"data_stored":709435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:25:22.826 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:25:23.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.008+0000 7f8429400640 1 Processor -- start 2024-08-17T02:25:23.009 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.008+0000 7f8429400640 1 -- start start 2024-08-17T02:25:23.011 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.009+0000 7f8429400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f842406df00 0x7f84240adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.009+0000 7f8429400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8424156670 con 0x7f8424155a20 2024-08-17T02:25:23.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.009+0000 7f8429400640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f842406e5e0 con 0x7f8424155df0 2024-08-17T02:25:23.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.009+0000 7f8429400640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84240b0350 con 0x7f842406df00 2024-08-17T02:25:23.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.010+0000 7f8422800640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f8424155a20 0x7f842406d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:47750/0 (socket says 172.21.15.107:47750) 2024-08-17T02:25:23.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.010+0000 7f8422800640 1 -- 172.21.15.107:0/4074421421 learned_addr learned my addr 172.21.15.107:0/4074421421 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:25:23.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.010+0000 7f8421400640 1 -- 172.21.15.107:0/4074421421 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1940827743 0 0) 0x7f8424156670 con 0x7f8424155a20 2024-08-17T02:25:23.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.010+0000 7f8421400640 1 -- 172.21.15.107:0/4074421421 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84080034e0 con 0x7f8424155a20 2024-08-17T02:25:23.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.010+0000 7f8421e00640 1 --2- 172.21.15.107:0/4074421421 >> v2:172.21.15.157:3300/0 conn(0x7f842406df00 0x7f84240adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:23.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.010+0000 7f8421400640 1 -- 172.21.15.107:0/4074421421 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3954981389 0 0) 0x7f84080034e0 con 0x7f8424155a20 2024-08-17T02:25:23.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.010+0000 7f8421400640 1 -- 172.21.15.107:0/4074421421 >> v2:172.21.15.157:3300/0 conn(0x7f842406df00 msgr2=0x7f84240adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:23.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.010+0000 7f8421400640 1 --2- 172.21.15.107:0/4074421421 >> v2:172.21.15.157:3300/0 conn(0x7f842406df00 0x7f84240adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.010+0000 7f8421400640 1 -- 172.21.15.107:0/4074421421 >> v1:172.21.15.157:6789/0 conn(0x7f8424155df0 legacy=0x7f8424156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:23.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.010+0000 7f8421400640 1 -- 172.21.15.107:0/4074421421 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f842406e8c0 con 0x7f8424155a20 2024-08-17T02:25:23.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.010+0000 7f8421400640 1 -- 172.21.15.107:0/4074421421 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 537989081 0 0) 0x7f8414001470 con 0x7f8424155a20 2024-08-17T02:25:23.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.010+0000 7f8421e00640 1 --2- 172.21.15.107:0/4074421421 >> v2:172.21.15.157:3300/0 conn(0x7f842406df00 0x7f84240adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:23.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.010+0000 7f8421400640 1 -- 172.21.15.107:0/4074421421 >> v1:172.21.15.107:6789/0 conn(0x7f8424155a20 legacy=0x7f842406d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:23.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.011+0000 7f8421400640 1 --2- 172.21.15.107:0/4074421421 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8408003a20 0x7f8408003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.011+0000 7f8421400640 1 --2- 172.21.15.107:0/4074421421 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8408004780 0x7f8408004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.011+0000 7f8421400640 1 --2- 172.21.15.107:0/4074421421 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8408005250 0x7f840800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.011+0000 7f8421400640 1 -- 172.21.15.107:0/4074421421 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840800c1a0 con 0x7f8408004780 2024-08-17T02:25:23.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.011+0000 7f8421400640 1 -- 172.21.15.107:0/4074421421 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840800c310 con 0x7f8408005250 2024-08-17T02:25:23.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.011+0000 7f8421400640 1 -- 172.21.15.107:0/4074421421 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f840800c4d0 con 0x7f8408003a20 2024-08-17T02:25:23.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.011+0000 7f8421e00640 1 --2- 172.21.15.107:0/4074421421 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8408004780 0x7f8408004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:23.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.011+0000 7f8422800640 1 --2- 172.21.15.107:0/4074421421 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8408003a20 0x7f8408003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:23.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.011+0000 7f8423200640 1 --2- 172.21.15.107:0/4074421421 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8408005250 0x7f840800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:23.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.011+0000 7f8421e00640 1 -- 172.21.15.107:0/4074421421 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8408003a20 msgr2=0x7f8408003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:23.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.011+0000 7f8421e00640 1 --2- 172.21.15.107:0/4074421421 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8408003a20 0x7f8408003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.011+0000 7f8421e00640 1 -- 172.21.15.107:0/4074421421 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8408005250 msgr2=0x7f840800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:23.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.011+0000 7f8421e00640 1 --2- 172.21.15.107:0/4074421421 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8408005250 0x7f840800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.011+0000 7f8421e00640 1 -- 172.21.15.107:0/4074421421 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84080034e0 con 0x7f8408004780 2024-08-17T02:25:23.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.011+0000 7f8423200640 1 -- 172.21.15.107:0/4074421421 reap_dead start 2024-08-17T02:25:23.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.012+0000 7f8421e00640 1 --2- 172.21.15.107:0/4074421421 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8408004780 0x7f8408004bf0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f841000bb80 tx=0x7f8410008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=456159b9df0f29e2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:23.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.012+0000 7f8421400640 1 -- 172.21.15.107:0/4074421421 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841002ac60 con 0x7f8408004780 2024-08-17T02:25:23.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.012+0000 7f8421400640 1 -- 172.21.15.107:0/4074421421 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f841002e070 con 0x7f8408004780 2024-08-17T02:25:23.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.013+0000 7f8421400640 1 -- 172.21.15.107:0/4074421421 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8410034610 con 0x7f8408004780 2024-08-17T02:25:23.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.013+0000 7f8429400640 1 -- 172.21.15.107:0/4074421421 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8408004780 msgr2=0x7f8408004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:23.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.013+0000 7f8429400640 1 --2- 172.21.15.107:0/4074421421 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8408004780 0x7f8408004bf0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f841000bb80 tx=0x7f8410008040 comp rx=0 tx=0).stop 2024-08-17T02:25:23.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.013+0000 7f8429400640 1 -- 172.21.15.107:0/4074421421 shutdown_connections 2024-08-17T02:25:23.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.013+0000 7f8429400640 1 --2- 172.21.15.107:0/4074421421 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8408004780 0x7f8408004bf0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.013+0000 7f8429400640 1 -- 172.21.15.107:0/4074421421 >> 172.21.15.107:0/4074421421 conn(0x7f84240cb9b0 msgr2=0x7f84240cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:23.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.013+0000 7f8429400640 1 -- 172.21.15.107:0/4074421421 shutdown_connections 2024-08-17T02:25:23.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.013+0000 7f8429400640 1 -- 172.21.15.107:0/4074421421 wait complete. 2024-08-17T02:25:23.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.015+0000 7f8429400640 1 Processor -- start 2024-08-17T02:25:23.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.015+0000 7f8429400640 1 -- start start 2024-08-17T02:25:23.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.016+0000 7f8429400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8408004780 0x7f842416bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.016+0000 7f8429400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8424145eb0 0x7f84240ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.016+0000 7f8429400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84240c1360 0x7f84240c2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.016+0000 7f8429400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84240aa0c0 con 0x7f84240c1360 2024-08-17T02:25:23.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.016+0000 7f8429400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842416c110 con 0x7f8424145eb0 2024-08-17T02:25:23.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.016+0000 7f8429400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84240c1920 con 0x7f8408004780 2024-08-17T02:25:23.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.016+0000 7f8423200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84240c1360 0x7f84240c2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:23.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.016+0000 7f8422800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8408004780 0x7f842416bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:23.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.016+0000 7f8423200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84240c1360 0x7f84240c2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58054/0 (socket says 172.21.15.107:58054) 2024-08-17T02:25:23.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.016+0000 7f8423200640 1 -- 172.21.15.107:0/1134317071 learned_addr learned my addr 172.21.15.107:0/1134317071 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:23.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.016+0000 7f8421e00640 1 --2- 172.21.15.107:0/1134317071 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8424145eb0 0x7f84240ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:23.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.016+0000 7f8423200640 1 -- 172.21.15.107:0/1134317071 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8408004780 msgr2=0x7f842416bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:23.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.016+0000 7f8423200640 1 --2- 172.21.15.107:0/1134317071 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8408004780 0x7f842416bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.016+0000 7f8423200640 1 -- 172.21.15.107:0/1134317071 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8424145eb0 msgr2=0x7f84240ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:23.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.016+0000 7f8423200640 1 --2- 172.21.15.107:0/1134317071 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8424145eb0 0x7f84240ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.016+0000 7f8423200640 1 -- 172.21.15.107:0/1134317071 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84240c1c00 con 0x7f84240c1360 2024-08-17T02:25:23.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.017+0000 7f8423200640 1 --2- 172.21.15.107:0/1134317071 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84240c1360 0x7f84240c2160 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f842406aa10 tx=0x7f841c007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:23.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.017+0000 7f841a000640 1 -- 172.21.15.107:0/1134317071 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841c006b10 con 0x7f84240c1360 2024-08-17T02:25:23.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.017+0000 7f841a000640 1 -- 172.21.15.107:0/1134317071 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f841c006c70 con 0x7f84240c1360 2024-08-17T02:25:23.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.017+0000 7f841a000640 1 -- 172.21.15.107:0/1134317071 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841c014480 con 0x7f84240c1360 2024-08-17T02:25:23.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.017+0000 7f8429400640 1 -- 172.21.15.107:0/1134317071 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84240a9a70 con 0x7f84240c1360 2024-08-17T02:25:23.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.017+0000 7f8429400640 1 -- 172.21.15.107:0/1134317071 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84240ad600 con 0x7f84240c1360 2024-08-17T02:25:23.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.018+0000 7f8429400640 1 -- 172.21.15.107:0/1134317071 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84240aa230 con 0x7f84240c1360 2024-08-17T02:25:23.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.019+0000 7f841a000640 1 -- 172.21.15.107:0/1134317071 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f841c007030 con 0x7f84240c1360 2024-08-17T02:25:23.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.020+0000 7f841a000640 1 --2- 172.21.15.107:0/1134317071 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f8404065180 0x7f8404067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.020+0000 7f841a000640 1 -- 172.21.15.107:0/1134317071 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f841c0814f0 con 0x7f84240c1360 2024-08-17T02:25:23.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.020+0000 7f8422800640 1 --2- 172.21.15.107:0/1134317071 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f8404065180 0x7f8404067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:23.023 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.021+0000 7f8422800640 1 --2- 172.21.15.107:0/1134317071 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f8404065180 0x7f8404067630 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8414001c10 tx=0x7f8414001d80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:23.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.024+0000 7f841a000640 1 -- 172.21.15.107:0/1134317071 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f841c04f5c0 con 0x7f84240c1360 2024-08-17T02:25:23.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.192+0000 7f8429400640 1 -- 172.21.15.107:0/1134317071 --> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8424064db0 con 0x7f8404065180 2024-08-17T02:25:23.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.198+0000 7f841a000640 1 -- 172.21.15.107:0/1134317071 <== mgr.4110 v2:172.21.15.107:6832/37039 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+253865 (secure 0 0 0) 0x7f8424064db0 con 0x7f8404065180 2024-08-17T02:25:23.203 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:25:23.204 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-08-17T02:25:23.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.202+0000 7f8429400640 1 -- 172.21.15.107:0/1134317071 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f8404065180 msgr2=0x7f8404067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:23.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.202+0000 7f8429400640 1 --2- 172.21.15.107:0/1134317071 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f8404065180 0x7f8404067630 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8414001c10 tx=0x7f8414001d80 comp rx=0 tx=0).stop 2024-08-17T02:25:23.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.202+0000 7f8429400640 1 -- 172.21.15.107:0/1134317071 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84240c1360 msgr2=0x7f84240c2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:23.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.202+0000 7f8429400640 1 --2- 172.21.15.107:0/1134317071 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84240c1360 0x7f84240c2160 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f842406aa10 tx=0x7f841c007f90 comp rx=0 tx=0).stop 2024-08-17T02:25:23.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.202+0000 7f8429400640 1 -- 172.21.15.107:0/1134317071 shutdown_connections 2024-08-17T02:25:23.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.202+0000 7f8429400640 1 --2- 172.21.15.107:0/1134317071 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f8404065180 0x7f8404067630 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.202+0000 7f8429400640 1 --2- 172.21.15.107:0/1134317071 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84240c1360 0x7f84240c2160 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.202+0000 7f8429400640 1 --2- 172.21.15.107:0/1134317071 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8424145eb0 0x7f84240ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.202+0000 7f8429400640 1 --2- 172.21.15.107:0/1134317071 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8408004780 0x7f842416bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.202+0000 7f8429400640 1 -- 172.21.15.107:0/1134317071 >> 172.21.15.107:0/1134317071 conn(0x7f84240cb9b0 msgr2=0x7f84241503b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:23.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.203+0000 7f8429400640 1 -- 172.21.15.107:0/1134317071 shutdown_connections 2024-08-17T02:25:23.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.203+0000 7f8429400640 1 -- 172.21.15.107:0/1134317071 wait complete. 2024-08-17T02:25:23.219 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-08-17T02:25:21.415547+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2399172,"kb_used_data":3676,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752575548,"statfs":{"total":773094113280,"available":770637361152,"internally_reserved":0,"allocated":3764224,"data_stored":2127467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.759750"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.662092+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:41:06.837768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.660368+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:54:09.951612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.662967+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:10.657983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.656602+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:43:30.643309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.657172+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:58:54.659759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.656634+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:24:08.290061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.662005+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:08:42.813501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.656460+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:18:43.616735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.663748+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:14:21.868403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.659878+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:41:06.837768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.659849+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:34:39.313004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.662181+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:03:47.853752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.656547+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:43:30.643309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.660094+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:54:09.951612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.661496+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:48:25.682657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.664617+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:22.234303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.661985+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:10.657983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.656613+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:21:56.218636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.656603+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:24:33.895108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.656475+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:25.788507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.659644+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:50.528508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.660941+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:08:36.844257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.657077+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:54:53.867430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.659640+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:14:21.868403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.661507+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:08:42.813501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.658849+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:08:36.844257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.659830+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:41:06.837768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.658693+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:18:32.501730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.659565+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:50.528508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.656390+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:40:36.208597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.664120+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:57:03.088315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:17.653714+0000","last_change":"2024-08-17T02:25:17.653714+0000","last_active":"2024-08-17T02:25:17.653714+0000","last_peered":"2024-08-17T02:25:17.653714+0000","last_clean":"2024-08-17T02:25:17.653714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:17.653714+0000","last_undegraded":"2024-08-17T02:25:17.653714+0000","last_fullsized":"2024-08-17T02:25:17.653714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:16.647077+0000","last_change":"2024-08-17T02:25:16.661601+0000","last_active":"2024-08-17T02:25:16.647077+0000","last_peered":"2024-08-17T02:25:16.647077+0000","last_clean":"2024-08-17T02:25:16.647077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:16.647077+0000","last_undegraded":"2024-08-17T02:25:16.647077+0000","last_fullsized":"2024-08-17T02:25:16.647077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:50.528508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-08-17T02:25:11.702044+0000","last_change":"2024-08-17T02:24:25.092772+0000","last_active":"2024-08-17T02:25:11.702044+0000","last_peered":"2024-08-17T02:25:11.702044+0000","last_clean":"2024-08-17T02:25:11.702044+0000","last_became_active":"2024-08-17T02:24:25.091788+0000","last_became_peered":"2024-08-17T02:24:25.091788+0000","last_unstale":"2024-08-17T02:25:11.702044+0000","last_undegraded":"2024-08-17T02:25:11.702044+0000","last_fullsized":"2024-08-17T02:25:11.702044+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:24.051996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:24.051996+0000","last_clean_scrub_stamp":"2024-08-17T02:24:24.051996+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:31:45.454480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302412,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069428,"statfs":{"total":96636764160,"available":96327094272,"internally_reserved":0,"allocated":917504,"data_stored":709435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]}]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301828,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070012,"statfs":{"total":96636764160,"available":96327692288,"internally_reserved":0,"allocated":311296,"data_stored":113262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301832,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070008,"statfs":{"total":96636764160,"available":96327688192,"internally_reserved":0,"allocated":323584,"data_stored":119067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301832,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070008,"statfs":{"total":96636764160,"available":96327688192,"internally_reserved":0,"allocated":323584,"data_stored":119067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297672,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074168,"statfs":{"total":96636764160,"available":96331948032,"internally_reserved":0,"allocated":323584,"data_stored":119067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297672,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074168,"statfs":{"total":96636764160,"available":96331948032,"internally_reserved":0,"allocated":323584,"data_stored":119067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297672,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074168,"statfs":{"total":96636764160,"available":96331948032,"internally_reserved":0,"allocated":323584,"data_stored":119067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298252,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073588,"statfs":{"total":96636764160,"available":96331354112,"internally_reserved":0,"allocated":917504,"data_stored":709435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:25:23.223 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:25:23.406 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.405+0000 7fbd0ba00640 1 Processor -- start 2024-08-17T02:25:23.406 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.405+0000 7fbd0ba00640 1 -- start start 2024-08-17T02:25:23.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.406+0000 7fbd0ba00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd04155a20 0x7fbd040adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.406+0000 7fbd0ba00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fbd04155df0 0x7fbd040ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.406+0000 7fbd0ba00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd04156670 con 0x7fbd0406d7f0 2024-08-17T02:25:23.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.406+0000 7fbd0ba00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd040b0350 con 0x7fbd04155df0 2024-08-17T02:25:23.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.406+0000 7fbd0ba00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0406e5e0 con 0x7fbd04155a20 2024-08-17T02:25:23.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.407+0000 7fbd09a00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fbd0406d7f0 0x7fbd040ac790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:47764/0 (socket says 172.21.15.107:47764) 2024-08-17T02:25:23.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.407+0000 7fbd09a00640 1 -- 172.21.15.107:0/2824390309 learned_addr learned my addr 172.21.15.107:0/2824390309 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:25:23.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.407+0000 7fbd09000640 1 --2- 172.21.15.107:0/2824390309 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd04155a20 0x7fbd040adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:23.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.407+0000 7fbd03e00640 1 --2- 172.21.15.107:0/2824390309 >> v2:172.21.15.157:3300/0 conn(0x7fbd04155df0 0x7fbd040ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:23.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.407+0000 7fbd03400640 1 -- 172.21.15.107:0/2824390309 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1213653069 0 0) 0x7fbd04156670 con 0x7fbd0406d7f0 2024-08-17T02:25:23.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.407+0000 7fbd03400640 1 -- 172.21.15.107:0/2824390309 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcec0034e0 con 0x7fbd0406d7f0 2024-08-17T02:25:23.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.407+0000 7fbd09000640 1 -- 172.21.15.107:0/2824390309 >> v2:172.21.15.157:3300/0 conn(0x7fbd04155df0 msgr2=0x7fbd040ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:23.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.407+0000 7fbd09000640 1 --2- 172.21.15.107:0/2824390309 >> v2:172.21.15.157:3300/0 conn(0x7fbd04155df0 0x7fbd040ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.407+0000 7fbd09000640 1 -- 172.21.15.107:0/2824390309 >> v1:172.21.15.107:6789/0 conn(0x7fbd0406d7f0 legacy=0x7fbd040ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:23.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.407+0000 7fbd09000640 1 -- 172.21.15.107:0/2824390309 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0406e8c0 con 0x7fbd04155a20 2024-08-17T02:25:23.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.409+0000 7fbd09000640 1 --2- 172.21.15.107:0/2824390309 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd04155a20 0x7fbd040adf10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8009850 tx=0x7fbcf80090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88fc65d3c11301b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:23.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.409+0000 7fbd03400640 1 -- 172.21.15.107:0/2824390309 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf802ad90 con 0x7fbd04155a20 2024-08-17T02:25:23.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.409+0000 7fbd03400640 1 -- 172.21.15.107:0/2824390309 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf8032440 con 0x7fbd04155a20 2024-08-17T02:25:23.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.409+0000 7fbd03400640 1 -- 172.21.15.107:0/2824390309 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf8032820 con 0x7fbd04155a20 2024-08-17T02:25:23.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.409+0000 7fbd0ba00640 1 -- 172.21.15.107:0/2824390309 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd04155a20 msgr2=0x7fbd040adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:23.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.409+0000 7fbd0ba00640 1 --2- 172.21.15.107:0/2824390309 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd04155a20 0x7fbd040adf10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8009850 tx=0x7fbcf80090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.409+0000 7fbd0ba00640 1 -- 172.21.15.107:0/2824390309 shutdown_connections 2024-08-17T02:25:23.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.409+0000 7fbd0ba00640 1 --2- 172.21.15.107:0/2824390309 >> v2:172.21.15.157:3300/0 conn(0x7fbd04155df0 0x7fbd040ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.409+0000 7fbd0ba00640 1 --2- 172.21.15.107:0/2824390309 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd04155a20 0x7fbd040adf10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.409+0000 7fbd0ba00640 1 -- 172.21.15.107:0/2824390309 >> 172.21.15.107:0/2824390309 conn(0x7fbd040cb9b0 msgr2=0x7fbd040cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:23.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.410+0000 7fbd0ba00640 1 -- 172.21.15.107:0/2824390309 shutdown_connections 2024-08-17T02:25:23.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.410+0000 7fbd0ba00640 1 -- 172.21.15.107:0/2824390309 wait complete. 2024-08-17T02:25:23.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.411+0000 7fbd0ba00640 1 Processor -- start 2024-08-17T02:25:23.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.411+0000 7fbd0ba00640 1 -- start start 2024-08-17T02:25:23.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.412+0000 7fbd0ba00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd0406d7f0 0x7fbd040ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.412+0000 7fbd0ba00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd04155a20 0x7fbd040a7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.412+0000 7fbd0ba00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd04155df0 0x7fbd040ab520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.412+0000 7fbd0ba00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd040a8fe0 con 0x7fbd0406d7f0 2024-08-17T02:25:23.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.412+0000 7fbd0ba00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd040a92c0 con 0x7fbd04155a20 2024-08-17T02:25:23.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.412+0000 7fbd0ba00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd040a95a0 con 0x7fbd04155df0 2024-08-17T02:25:23.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.412+0000 7fbd09000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd0406d7f0 0x7fbd040ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:23.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.412+0000 7fbd09000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd0406d7f0 0x7fbd040ca2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58066/0 (socket says 172.21.15.107:58066) 2024-08-17T02:25:23.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.412+0000 7fbd09000640 1 -- 172.21.15.107:0/219890785 learned_addr learned my addr 172.21.15.107:0/219890785 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:23.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.413+0000 7fbd09000640 1 -- 172.21.15.107:0/219890785 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd04155df0 msgr2=0x7fbd040ab520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:23.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.413+0000 7fbd09000640 1 --2- 172.21.15.107:0/219890785 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd04155df0 0x7fbd040ab520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.413+0000 7fbd09000640 1 -- 172.21.15.107:0/219890785 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd04155a20 msgr2=0x7fbd040a7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:23.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.413+0000 7fbd09000640 1 --2- 172.21.15.107:0/219890785 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd04155a20 0x7fbd040a7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.413+0000 7fbd09000640 1 -- 172.21.15.107:0/219890785 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf8009390 con 0x7fbd0406d7f0 2024-08-17T02:25:23.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.413+0000 7fbd09000640 1 --2- 172.21.15.107:0/219890785 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd0406d7f0 0x7fbd040ca2c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8009360 tx=0x7fbcf8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:23.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.413+0000 7fbcf7e00640 1 -- 172.21.15.107:0/219890785 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf8031c20 con 0x7fbd0406d7f0 2024-08-17T02:25:23.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.413+0000 7fbcf7e00640 1 -- 172.21.15.107:0/219890785 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf8031d80 con 0x7fbd0406d7f0 2024-08-17T02:25:23.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.413+0000 7fbd0ba00640 1 -- 172.21.15.107:0/219890785 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd040a9880 con 0x7fbd0406d7f0 2024-08-17T02:25:23.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.413+0000 7fbcf7e00640 1 -- 172.21.15.107:0/219890785 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf803d670 con 0x7fbd0406d7f0 2024-08-17T02:25:23.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.413+0000 7fbd0ba00640 1 -- 172.21.15.107:0/219890785 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd040ca800 con 0x7fbd0406d7f0 2024-08-17T02:25:23.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.414+0000 7fbd0ba00640 1 -- 172.21.15.107:0/219890785 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd04064db0 con 0x7fbd0406d7f0 2024-08-17T02:25:23.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.416+0000 7fbcf7e00640 1 -- 172.21.15.107:0/219890785 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbcf8039040 con 0x7fbd0406d7f0 2024-08-17T02:25:23.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.416+0000 7fbcf7e00640 1 --2- 172.21.15.107:0/219890785 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbce4065150 0x7fbce4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.416+0000 7fbcf7e00640 1 -- 172.21.15.107:0/219890785 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbcf80a2640 con 0x7fbd0406d7f0 2024-08-17T02:25:23.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.417+0000 7fbd03e00640 1 --2- 172.21.15.107:0/219890785 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbce4065150 0x7fbce4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:23.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.417+0000 7fbd03e00640 1 --2- 172.21.15.107:0/219890785 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbce4065150 0x7fbce4067600 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbd0416dbc0 tx=0x7fbcf00090f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:23.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.420+0000 7fbcf7e00640 1 -- 172.21.15.107:0/219890785 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbcf8070700 con 0x7fbd0406d7f0 2024-08-17T02:25:23.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.587+0000 7fbd0ba00640 1 -- 172.21.15.107:0/219890785 --> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbd040ae250 con 0x7fbce4065150 2024-08-17T02:25:23.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.595+0000 7fbcf7e00640 1 -- 172.21.15.107:0/219890785 <== mgr.4110 v2:172.21.15.107:6832/37039 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+273911 (secure 0 0 0) 0x7fbd040ae250 con 0x7fbce4065150 2024-08-17T02:25:23.599 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:25:23.601 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-08-17T02:25:23.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.599+0000 7fbd0ba00640 1 -- 172.21.15.107:0/219890785 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbce4065150 msgr2=0x7fbce4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:23.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.599+0000 7fbd0ba00640 1 --2- 172.21.15.107:0/219890785 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbce4065150 0x7fbce4067600 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbd0416dbc0 tx=0x7fbcf00090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.599+0000 7fbd0ba00640 1 -- 172.21.15.107:0/219890785 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd0406d7f0 msgr2=0x7fbd040ca2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:23.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.599+0000 7fbd0ba00640 1 --2- 172.21.15.107:0/219890785 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd0406d7f0 0x7fbd040ca2c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8009360 tx=0x7fbcf8032000 comp rx=0 tx=0).stop 2024-08-17T02:25:23.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.599+0000 7fbd0ba00640 1 -- 172.21.15.107:0/219890785 shutdown_connections 2024-08-17T02:25:23.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.599+0000 7fbd0ba00640 1 --2- 172.21.15.107:0/219890785 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fbce4065150 0x7fbce4067600 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.599+0000 7fbd0ba00640 1 --2- 172.21.15.107:0/219890785 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbd04155df0 0x7fbd040ab520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.599+0000 7fbd0ba00640 1 --2- 172.21.15.107:0/219890785 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd04155a20 0x7fbd040a7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.599+0000 7fbd0ba00640 1 --2- 172.21.15.107:0/219890785 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd0406d7f0 0x7fbd040ca2c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.599+0000 7fbd0ba00640 1 -- 172.21.15.107:0/219890785 >> 172.21.15.107:0/219890785 conn(0x7fbd040cb9b0 msgr2=0x7fbd041537c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:23.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.599+0000 7fbd0ba00640 1 -- 172.21.15.107:0/219890785 shutdown_connections 2024-08-17T02:25:23.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.599+0000 7fbd0ba00640 1 -- 172.21.15.107:0/219890785 wait complete. 2024-08-17T02:25:23.616 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-08-17T02:25:23.415949+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2399584,"kb_used_data":4040,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752575136,"statfs":{"total":773094113280,"available":770636939264,"internally_reserved":0,"allocated":4136960,"data_stored":2292396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001121"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.696078+0000","last_change":"2024-08-17T02:25:18.688115+0000","last_active":"2024-08-17T02:25:18.696078+0000","last_peered":"2024-08-17T02:25:18.696078+0000","last_clean":"2024-08-17T02:25:18.696078+0000","last_became_active":"2024-08-17T02:25:18.687875+0000","last_became_peered":"2024-08-17T02:25:18.687875+0000","last_unstale":"2024-08-17T02:25:18.696078+0000","last_undegraded":"2024-08-17T02:25:18.696078+0000","last_fullsized":"2024-08-17T02:25:18.696078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:21:54.496023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.697662+0000","last_change":"2024-08-17T02:25:18.686834+0000","last_active":"2024-08-17T02:25:18.697662+0000","last_peered":"2024-08-17T02:25:18.697662+0000","last_clean":"2024-08-17T02:25:18.697662+0000","last_became_active":"2024-08-17T02:25:18.686669+0000","last_became_peered":"2024-08-17T02:25:18.686669+0000","last_unstale":"2024-08-17T02:25:18.697662+0000","last_undegraded":"2024-08-17T02:25:18.697662+0000","last_fullsized":"2024-08-17T02:25:18.697662+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:12:11.199988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.691325+0000","last_change":"2024-08-17T02:25:18.689104+0000","last_active":"2024-08-17T02:25:18.691325+0000","last_peered":"2024-08-17T02:25:18.691325+0000","last_clean":"2024-08-17T02:25:18.691325+0000","last_became_active":"2024-08-17T02:25:18.688407+0000","last_became_peered":"2024-08-17T02:25:18.688407+0000","last_unstale":"2024-08-17T02:25:18.691325+0000","last_undegraded":"2024-08-17T02:25:18.691325+0000","last_fullsized":"2024-08-17T02:25:18.691325+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:12:11.199988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.681831+0000","last_change":"2024-08-17T02:25:18.677810+0000","last_active":"2024-08-17T02:25:18.681831+0000","last_peered":"2024-08-17T02:25:18.681831+0000","last_clean":"2024-08-17T02:25:18.681831+0000","last_became_active":"2024-08-17T02:25:18.677248+0000","last_became_peered":"2024-08-17T02:25:18.677248+0000","last_unstale":"2024-08-17T02:25:18.681831+0000","last_undegraded":"2024-08-17T02:25:18.681831+0000","last_fullsized":"2024-08-17T02:25:18.681831+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:15:54.854019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.681872+0000","last_change":"2024-08-17T02:25:18.675364+0000","last_active":"2024-08-17T02:25:18.681872+0000","last_peered":"2024-08-17T02:25:18.681872+0000","last_clean":"2024-08-17T02:25:18.681872+0000","last_became_active":"2024-08-17T02:25:18.674787+0000","last_became_peered":"2024-08-17T02:25:18.674787+0000","last_unstale":"2024-08-17T02:25:18.681872+0000","last_undegraded":"2024-08-17T02:25:18.681872+0000","last_fullsized":"2024-08-17T02:25:18.681872+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:03:48.860389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.700312+0000","last_change":"2024-08-17T02:25:18.691428+0000","last_active":"2024-08-17T02:25:18.700312+0000","last_peered":"2024-08-17T02:25:18.700312+0000","last_clean":"2024-08-17T02:25:18.700312+0000","last_became_active":"2024-08-17T02:25:18.691171+0000","last_became_peered":"2024-08-17T02:25:18.691171+0000","last_unstale":"2024-08-17T02:25:18.700312+0000","last_undegraded":"2024-08-17T02:25:18.700312+0000","last_fullsized":"2024-08-17T02:25:18.700312+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:25.271173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.697661+0000","last_change":"2024-08-17T02:25:18.695337+0000","last_active":"2024-08-17T02:25:18.697661+0000","last_peered":"2024-08-17T02:25:18.697661+0000","last_clean":"2024-08-17T02:25:18.697661+0000","last_became_active":"2024-08-17T02:25:18.695069+0000","last_became_peered":"2024-08-17T02:25:18.695069+0000","last_unstale":"2024-08-17T02:25:18.697661+0000","last_undegraded":"2024-08-17T02:25:18.697661+0000","last_fullsized":"2024-08-17T02:25:18.697661+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:59:36.606411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.699526+0000","last_change":"2024-08-17T02:25:18.691322+0000","last_active":"2024-08-17T02:25:18.699526+0000","last_peered":"2024-08-17T02:25:18.699526+0000","last_clean":"2024-08-17T02:25:18.699526+0000","last_became_active":"2024-08-17T02:25:18.690483+0000","last_became_peered":"2024-08-17T02:25:18.690483+0000","last_unstale":"2024-08-17T02:25:18.699526+0000","last_undegraded":"2024-08-17T02:25:18.699526+0000","last_fullsized":"2024-08-17T02:25:18.699526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:15:35.080503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.691074+0000","last_change":"2024-08-17T02:25:18.687183+0000","last_active":"2024-08-17T02:25:18.691074+0000","last_peered":"2024-08-17T02:25:18.691074+0000","last_clean":"2024-08-17T02:25:18.691074+0000","last_became_active":"2024-08-17T02:25:18.686911+0000","last_became_peered":"2024-08-17T02:25:18.686911+0000","last_unstale":"2024-08-17T02:25:18.691074+0000","last_undegraded":"2024-08-17T02:25:18.691074+0000","last_fullsized":"2024-08-17T02:25:18.691074+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:53.854442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.702694+0000","last_change":"2024-08-17T02:25:18.694136+0000","last_active":"2024-08-17T02:25:18.702694+0000","last_peered":"2024-08-17T02:25:18.702694+0000","last_clean":"2024-08-17T02:25:18.702694+0000","last_became_active":"2024-08-17T02:25:18.693929+0000","last_became_peered":"2024-08-17T02:25:18.693929+0000","last_unstale":"2024-08-17T02:25:18.702694+0000","last_undegraded":"2024-08-17T02:25:18.702694+0000","last_fullsized":"2024-08-17T02:25:18.702694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:51:04.058113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.699061+0000","last_change":"2024-08-17T02:25:18.693611+0000","last_active":"2024-08-17T02:25:18.699061+0000","last_peered":"2024-08-17T02:25:18.699061+0000","last_clean":"2024-08-17T02:25:18.699061+0000","last_became_active":"2024-08-17T02:25:18.693393+0000","last_became_peered":"2024-08-17T02:25:18.693393+0000","last_unstale":"2024-08-17T02:25:18.699061+0000","last_undegraded":"2024-08-17T02:25:18.699061+0000","last_fullsized":"2024-08-17T02:25:18.699061+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:25.271173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.701781+0000","last_change":"2024-08-17T02:25:18.697695+0000","last_active":"2024-08-17T02:25:18.701781+0000","last_peered":"2024-08-17T02:25:18.701781+0000","last_clean":"2024-08-17T02:25:18.701781+0000","last_became_active":"2024-08-17T02:25:18.697406+0000","last_became_peered":"2024-08-17T02:25:18.697406+0000","last_unstale":"2024-08-17T02:25:18.701781+0000","last_undegraded":"2024-08-17T02:25:18.701781+0000","last_fullsized":"2024-08-17T02:25:18.701781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:26:05.015031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.692359+0000","last_change":"2024-08-17T02:25:18.683134+0000","last_active":"2024-08-17T02:25:18.692359+0000","last_peered":"2024-08-17T02:25:18.692359+0000","last_clean":"2024-08-17T02:25:18.692359+0000","last_became_active":"2024-08-17T02:25:18.681298+0000","last_became_peered":"2024-08-17T02:25:18.681298+0000","last_unstale":"2024-08-17T02:25:18.692359+0000","last_undegraded":"2024-08-17T02:25:18.692359+0000","last_fullsized":"2024-08-17T02:25:18.692359+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:11.664621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.700228+0000","last_change":"2024-08-17T02:25:18.690055+0000","last_active":"2024-08-17T02:25:18.700228+0000","last_peered":"2024-08-17T02:25:18.700228+0000","last_clean":"2024-08-17T02:25:18.700228+0000","last_became_active":"2024-08-17T02:25:18.689829+0000","last_became_peered":"2024-08-17T02:25:18.689829+0000","last_unstale":"2024-08-17T02:25:18.700228+0000","last_undegraded":"2024-08-17T02:25:18.700228+0000","last_fullsized":"2024-08-17T02:25:18.700228+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:38.896462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.702511+0000","last_change":"2024-08-17T02:25:18.698182+0000","last_active":"2024-08-17T02:25:18.702511+0000","last_peered":"2024-08-17T02:25:18.702511+0000","last_clean":"2024-08-17T02:25:18.702511+0000","last_became_active":"2024-08-17T02:25:18.697917+0000","last_became_peered":"2024-08-17T02:25:18.697917+0000","last_unstale":"2024-08-17T02:25:18.702511+0000","last_undegraded":"2024-08-17T02:25:18.702511+0000","last_fullsized":"2024-08-17T02:25:18.702511+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:28:51.002809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.702567+0000","last_change":"2024-08-17T02:25:18.699338+0000","last_active":"2024-08-17T02:25:18.702567+0000","last_peered":"2024-08-17T02:25:18.702567+0000","last_clean":"2024-08-17T02:25:18.702567+0000","last_became_active":"2024-08-17T02:25:18.698937+0000","last_became_peered":"2024-08-17T02:25:18.698937+0000","last_unstale":"2024-08-17T02:25:18.702567+0000","last_undegraded":"2024-08-17T02:25:18.702567+0000","last_fullsized":"2024-08-17T02:25:18.702567+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:26:05.015031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.702952+0000","last_change":"2024-08-17T02:25:18.701349+0000","last_active":"2024-08-17T02:25:18.702952+0000","last_peered":"2024-08-17T02:25:18.702952+0000","last_clean":"2024-08-17T02:25:18.702952+0000","last_became_active":"2024-08-17T02:25:18.701109+0000","last_became_peered":"2024-08-17T02:25:18.701109+0000","last_unstale":"2024-08-17T02:25:18.702952+0000","last_undegraded":"2024-08-17T02:25:18.702952+0000","last_fullsized":"2024-08-17T02:25:18.702952+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:58:50.210579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.701372+0000","last_change":"2024-08-17T02:25:18.698189+0000","last_active":"2024-08-17T02:25:18.701372+0000","last_peered":"2024-08-17T02:25:18.701372+0000","last_clean":"2024-08-17T02:25:18.701372+0000","last_became_active":"2024-08-17T02:25:18.697968+0000","last_became_peered":"2024-08-17T02:25:18.697968+0000","last_unstale":"2024-08-17T02:25:18.701372+0000","last_undegraded":"2024-08-17T02:25:18.701372+0000","last_fullsized":"2024-08-17T02:25:18.701372+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:19:35.711198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.700380+0000","last_change":"2024-08-17T02:25:18.692100+0000","last_active":"2024-08-17T02:25:18.700380+0000","last_peered":"2024-08-17T02:25:18.700380+0000","last_clean":"2024-08-17T02:25:18.700380+0000","last_became_active":"2024-08-17T02:25:18.687629+0000","last_became_peered":"2024-08-17T02:25:18.687629+0000","last_unstale":"2024-08-17T02:25:18.700380+0000","last_undegraded":"2024-08-17T02:25:18.700380+0000","last_fullsized":"2024-08-17T02:25:18.700380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:37:41.942948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.696560+0000","last_change":"2024-08-17T02:25:18.688705+0000","last_active":"2024-08-17T02:25:18.696560+0000","last_peered":"2024-08-17T02:25:18.696560+0000","last_clean":"2024-08-17T02:25:18.696560+0000","last_became_active":"2024-08-17T02:25:18.686153+0000","last_became_peered":"2024-08-17T02:25:18.686153+0000","last_unstale":"2024-08-17T02:25:18.696560+0000","last_undegraded":"2024-08-17T02:25:18.696560+0000","last_fullsized":"2024-08-17T02:25:18.696560+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:48:26.689294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.687889+0000","last_change":"2024-08-17T02:25:18.680573+0000","last_active":"2024-08-17T02:25:18.687889+0000","last_peered":"2024-08-17T02:25:18.687889+0000","last_clean":"2024-08-17T02:25:18.687889+0000","last_became_active":"2024-08-17T02:25:18.680323+0000","last_became_peered":"2024-08-17T02:25:18.680323+0000","last_unstale":"2024-08-17T02:25:18.687889+0000","last_undegraded":"2024-08-17T02:25:18.687889+0000","last_fullsized":"2024-08-17T02:25:18.687889+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:21:54.496023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.689396+0000","last_change":"2024-08-17T02:25:18.686075+0000","last_active":"2024-08-17T02:25:18.689396+0000","last_peered":"2024-08-17T02:25:18.689396+0000","last_clean":"2024-08-17T02:25:18.689396+0000","last_became_active":"2024-08-17T02:25:18.685806+0000","last_became_peered":"2024-08-17T02:25:18.685806+0000","last_unstale":"2024-08-17T02:25:18.689396+0000","last_undegraded":"2024-08-17T02:25:18.689396+0000","last_fullsized":"2024-08-17T02:25:18.689396+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:58:50.210579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.688919+0000","last_change":"2024-08-17T02:25:18.685685+0000","last_active":"2024-08-17T02:25:18.688919+0000","last_peered":"2024-08-17T02:25:18.688919+0000","last_clean":"2024-08-17T02:25:18.688919+0000","last_became_active":"2024-08-17T02:25:18.683333+0000","last_became_peered":"2024-08-17T02:25:18.683333+0000","last_unstale":"2024-08-17T02:25:18.688919+0000","last_undegraded":"2024-08-17T02:25:18.688919+0000","last_fullsized":"2024-08-17T02:25:18.688919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:23.240941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.691179+0000","last_change":"2024-08-17T02:25:18.688254+0000","last_active":"2024-08-17T02:25:18.691179+0000","last_peered":"2024-08-17T02:25:18.691179+0000","last_clean":"2024-08-17T02:25:18.691179+0000","last_became_active":"2024-08-17T02:25:18.687954+0000","last_became_peered":"2024-08-17T02:25:18.687954+0000","last_unstale":"2024-08-17T02:25:18.691179+0000","last_undegraded":"2024-08-17T02:25:18.691179+0000","last_fullsized":"2024-08-17T02:25:18.691179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:22:19.225830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.689310+0000","last_change":"2024-08-17T02:25:18.684233+0000","last_active":"2024-08-17T02:25:18.689310+0000","last_peered":"2024-08-17T02:25:18.689310+0000","last_clean":"2024-08-17T02:25:18.689310+0000","last_became_active":"2024-08-17T02:25:18.684000+0000","last_became_peered":"2024-08-17T02:25:18.684000+0000","last_unstale":"2024-08-17T02:25:18.689310+0000","last_undegraded":"2024-08-17T02:25:18.689310+0000","last_fullsized":"2024-08-17T02:25:18.689310+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:22:19.225830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.692142+0000","last_change":"2024-08-17T02:25:18.685525+0000","last_active":"2024-08-17T02:25:18.692142+0000","last_peered":"2024-08-17T02:25:18.692142+0000","last_clean":"2024-08-17T02:25:18.692142+0000","last_became_active":"2024-08-17T02:25:18.685305+0000","last_became_peered":"2024-08-17T02:25:18.685305+0000","last_unstale":"2024-08-17T02:25:18.692142+0000","last_undegraded":"2024-08-17T02:25:18.692142+0000","last_fullsized":"2024-08-17T02:25:18.692142+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:25:47.932042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.689316+0000","last_change":"2024-08-17T02:25:18.679317+0000","last_active":"2024-08-17T02:25:18.689316+0000","last_peered":"2024-08-17T02:25:18.689316+0000","last_clean":"2024-08-17T02:25:18.689316+0000","last_became_active":"2024-08-17T02:25:18.677699+0000","last_became_peered":"2024-08-17T02:25:18.677699+0000","last_unstale":"2024-08-17T02:25:18.689316+0000","last_undegraded":"2024-08-17T02:25:18.689316+0000","last_fullsized":"2024-08-17T02:25:18.689316+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:55:29.782118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.695115+0000","last_change":"2024-08-17T02:25:18.688723+0000","last_active":"2024-08-17T02:25:18.695115+0000","last_peered":"2024-08-17T02:25:18.695115+0000","last_clean":"2024-08-17T02:25:18.695115+0000","last_became_active":"2024-08-17T02:25:18.688436+0000","last_became_peered":"2024-08-17T02:25:18.688436+0000","last_unstale":"2024-08-17T02:25:18.695115+0000","last_undegraded":"2024-08-17T02:25:18.695115+0000","last_fullsized":"2024-08-17T02:25:18.695115+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:57:45.497406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.687909+0000","last_change":"2024-08-17T02:25:18.683787+0000","last_active":"2024-08-17T02:25:18.687909+0000","last_peered":"2024-08-17T02:25:18.687909+0000","last_clean":"2024-08-17T02:25:18.687909+0000","last_became_active":"2024-08-17T02:25:18.678310+0000","last_became_peered":"2024-08-17T02:25:18.678310+0000","last_unstale":"2024-08-17T02:25:18.687909+0000","last_undegraded":"2024-08-17T02:25:18.687909+0000","last_fullsized":"2024-08-17T02:25:18.687909+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:59:36.606411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.697627+0000","last_change":"2024-08-17T02:25:18.695053+0000","last_active":"2024-08-17T02:25:18.697627+0000","last_peered":"2024-08-17T02:25:18.697627+0000","last_clean":"2024-08-17T02:25:18.697627+0000","last_became_active":"2024-08-17T02:25:18.694747+0000","last_became_peered":"2024-08-17T02:25:18.694747+0000","last_unstale":"2024-08-17T02:25:18.697627+0000","last_undegraded":"2024-08-17T02:25:18.697627+0000","last_fullsized":"2024-08-17T02:25:18.697627+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:28:51.002809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.700418+0000","last_change":"2024-08-17T02:25:18.689116+0000","last_active":"2024-08-17T02:25:18.700418+0000","last_peered":"2024-08-17T02:25:18.700418+0000","last_clean":"2024-08-17T02:25:18.700418+0000","last_became_active":"2024-08-17T02:25:18.688871+0000","last_became_peered":"2024-08-17T02:25:18.688871+0000","last_unstale":"2024-08-17T02:25:18.700418+0000","last_undegraded":"2024-08-17T02:25:18.700418+0000","last_fullsized":"2024-08-17T02:25:18.700418+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:57:04.094952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.702603+0000","last_change":"2024-08-17T02:25:18.699667+0000","last_active":"2024-08-17T02:25:18.702603+0000","last_peered":"2024-08-17T02:25:18.702603+0000","last_clean":"2024-08-17T02:25:18.702603+0000","last_became_active":"2024-08-17T02:25:18.699332+0000","last_became_peered":"2024-08-17T02:25:18.699332+0000","last_unstale":"2024-08-17T02:25:18.702603+0000","last_undegraded":"2024-08-17T02:25:18.702603+0000","last_fullsized":"2024-08-17T02:25:18.702603+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:38.896462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.686194+0000","last_change":"2024-08-17T02:25:18.680597+0000","last_active":"2024-08-17T02:25:18.686194+0000","last_peered":"2024-08-17T02:25:18.686194+0000","last_clean":"2024-08-17T02:25:18.686194+0000","last_became_active":"2024-08-17T02:25:18.680329+0000","last_became_peered":"2024-08-17T02:25:18.680329+0000","last_unstale":"2024-08-17T02:25:18.686194+0000","last_undegraded":"2024-08-17T02:25:18.686194+0000","last_fullsized":"2024-08-17T02:25:18.686194+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:59:36.606411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.695905+0000","last_change":"2024-08-17T02:25:17.681025+0000","last_active":"2024-08-17T02:25:18.695905+0000","last_peered":"2024-08-17T02:25:18.695905+0000","last_clean":"2024-08-17T02:25:18.695905+0000","last_became_active":"2024-08-17T02:25:17.680756+0000","last_became_peered":"2024-08-17T02:25:17.680756+0000","last_unstale":"2024-08-17T02:25:18.695905+0000","last_undegraded":"2024-08-17T02:25:18.695905+0000","last_fullsized":"2024-08-17T02:25:18.695905+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:08:42.813501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.696008+0000","last_change":"2024-08-17T02:25:18.686948+0000","last_active":"2024-08-17T02:25:18.696008+0000","last_peered":"2024-08-17T02:25:18.696008+0000","last_clean":"2024-08-17T02:25:18.696008+0000","last_became_active":"2024-08-17T02:25:18.686700+0000","last_became_peered":"2024-08-17T02:25:18.686700+0000","last_unstale":"2024-08-17T02:25:18.696008+0000","last_undegraded":"2024-08-17T02:25:18.696008+0000","last_fullsized":"2024-08-17T02:25:18.696008+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:59:36.606411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.686111+0000","last_change":"2024-08-17T02:25:17.682308+0000","last_active":"2024-08-17T02:25:18.686111+0000","last_peered":"2024-08-17T02:25:18.686111+0000","last_clean":"2024-08-17T02:25:18.686111+0000","last_became_active":"2024-08-17T02:25:17.682087+0000","last_became_peered":"2024-08-17T02:25:17.682087+0000","last_unstale":"2024-08-17T02:25:18.686111+0000","last_undegraded":"2024-08-17T02:25:18.686111+0000","last_fullsized":"2024-08-17T02:25:18.686111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:03:34.957853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.690825+0000","last_change":"2024-08-17T02:25:18.688198+0000","last_active":"2024-08-17T02:25:18.690825+0000","last_peered":"2024-08-17T02:25:18.690825+0000","last_clean":"2024-08-17T02:25:18.690825+0000","last_became_active":"2024-08-17T02:25:18.687994+0000","last_became_peered":"2024-08-17T02:25:18.687994+0000","last_unstale":"2024-08-17T02:25:18.690825+0000","last_undegraded":"2024-08-17T02:25:18.690825+0000","last_fullsized":"2024-08-17T02:25:18.690825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:23.240941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.702553+0000","last_change":"2024-08-17T02:25:17.689951+0000","last_active":"2024-08-17T02:25:18.702553+0000","last_peered":"2024-08-17T02:25:18.702553+0000","last_clean":"2024-08-17T02:25:18.702553+0000","last_became_active":"2024-08-17T02:25:17.689705+0000","last_became_peered":"2024-08-17T02:25:17.689705+0000","last_unstale":"2024-08-17T02:25:18.702553+0000","last_undegraded":"2024-08-17T02:25:18.702553+0000","last_fullsized":"2024-08-17T02:25:18.702553+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:29:57.578020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.689337+0000","last_change":"2024-08-17T02:25:18.679557+0000","last_active":"2024-08-17T02:25:18.689337+0000","last_peered":"2024-08-17T02:25:18.689337+0000","last_clean":"2024-08-17T02:25:18.689337+0000","last_became_active":"2024-08-17T02:25:18.679031+0000","last_became_peered":"2024-08-17T02:25:18.679031+0000","last_unstale":"2024-08-17T02:25:18.689337+0000","last_undegraded":"2024-08-17T02:25:18.689337+0000","last_fullsized":"2024-08-17T02:25:18.689337+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:46:17.633686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.692393+0000","last_change":"2024-08-17T02:25:17.686605+0000","last_active":"2024-08-17T02:25:18.692393+0000","last_peered":"2024-08-17T02:25:18.692393+0000","last_clean":"2024-08-17T02:25:18.692393+0000","last_became_active":"2024-08-17T02:25:17.686028+0000","last_became_peered":"2024-08-17T02:25:17.686028+0000","last_unstale":"2024-08-17T02:25:18.692393+0000","last_undegraded":"2024-08-17T02:25:18.692393+0000","last_fullsized":"2024-08-17T02:25:18.692393+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:21:56.218636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.697611+0000","last_change":"2024-08-17T02:25:18.692115+0000","last_active":"2024-08-17T02:25:18.697611+0000","last_peered":"2024-08-17T02:25:18.697611+0000","last_clean":"2024-08-17T02:25:18.697611+0000","last_became_active":"2024-08-17T02:25:18.691884+0000","last_became_peered":"2024-08-17T02:25:18.691884+0000","last_unstale":"2024-08-17T02:25:18.697611+0000","last_undegraded":"2024-08-17T02:25:18.697611+0000","last_fullsized":"2024-08-17T02:25:18.697611+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:51:04.058113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.702072+0000","last_change":"2024-08-17T02:25:17.681949+0000","last_active":"2024-08-17T02:25:18.702072+0000","last_peered":"2024-08-17T02:25:18.702072+0000","last_clean":"2024-08-17T02:25:18.702072+0000","last_became_active":"2024-08-17T02:25:17.681666+0000","last_became_peered":"2024-08-17T02:25:17.681666+0000","last_unstale":"2024-08-17T02:25:18.702072+0000","last_undegraded":"2024-08-17T02:25:18.702072+0000","last_fullsized":"2024-08-17T02:25:18.702072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:50.528508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.701618+0000","last_change":"2024-08-17T02:25:18.693575+0000","last_active":"2024-08-17T02:25:18.701618+0000","last_peered":"2024-08-17T02:25:18.701618+0000","last_clean":"2024-08-17T02:25:18.701618+0000","last_became_active":"2024-08-17T02:25:18.693247+0000","last_became_peered":"2024-08-17T02:25:18.693247+0000","last_unstale":"2024-08-17T02:25:18.701618+0000","last_undegraded":"2024-08-17T02:25:18.701618+0000","last_fullsized":"2024-08-17T02:25:18.701618+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:15:59.138809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.701126+0000","last_change":"2024-08-17T02:25:17.685024+0000","last_active":"2024-08-17T02:25:18.701126+0000","last_peered":"2024-08-17T02:25:18.701126+0000","last_clean":"2024-08-17T02:25:18.701126+0000","last_became_active":"2024-08-17T02:25:17.683666+0000","last_became_peered":"2024-08-17T02:25:17.683666+0000","last_unstale":"2024-08-17T02:25:18.701126+0000","last_undegraded":"2024-08-17T02:25:18.701126+0000","last_fullsized":"2024-08-17T02:25:18.701126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:41:06.837768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.696244+0000","last_change":"2024-08-17T02:25:18.691520+0000","last_active":"2024-08-17T02:25:18.696244+0000","last_peered":"2024-08-17T02:25:18.696244+0000","last_clean":"2024-08-17T02:25:18.696244+0000","last_became_active":"2024-08-17T02:25:18.691241+0000","last_became_peered":"2024-08-17T02:25:18.691241+0000","last_unstale":"2024-08-17T02:25:18.696244+0000","last_undegraded":"2024-08-17T02:25:18.696244+0000","last_fullsized":"2024-08-17T02:25:18.696244+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:57:04.094952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.676809+0000","last_change":"2024-08-17T02:25:17.679314+0000","last_active":"2024-08-17T02:25:18.676809+0000","last_peered":"2024-08-17T02:25:18.676809+0000","last_clean":"2024-08-17T02:25:18.676809+0000","last_became_active":"2024-08-17T02:25:17.679068+0000","last_became_peered":"2024-08-17T02:25:17.679068+0000","last_unstale":"2024-08-17T02:25:18.676809+0000","last_undegraded":"2024-08-17T02:25:18.676809+0000","last_fullsized":"2024-08-17T02:25:18.676809+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:44:16.038254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.689662+0000","last_change":"2024-08-17T02:25:18.682667+0000","last_active":"2024-08-17T02:25:18.689662+0000","last_peered":"2024-08-17T02:25:18.689662+0000","last_clean":"2024-08-17T02:25:18.689662+0000","last_became_active":"2024-08-17T02:25:18.682349+0000","last_became_peered":"2024-08-17T02:25:18.682349+0000","last_unstale":"2024-08-17T02:25:18.689662+0000","last_undegraded":"2024-08-17T02:25:18.689662+0000","last_fullsized":"2024-08-17T02:25:18.689662+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:29:07.794780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.666463+0000","last_change":"2024-08-17T02:25:17.673242+0000","last_active":"2024-08-17T02:25:18.666463+0000","last_peered":"2024-08-17T02:25:18.666463+0000","last_clean":"2024-08-17T02:25:18.666463+0000","last_became_active":"2024-08-17T02:25:17.672957+0000","last_became_peered":"2024-08-17T02:25:17.672957+0000","last_unstale":"2024-08-17T02:25:18.666463+0000","last_undegraded":"2024-08-17T02:25:18.666463+0000","last_fullsized":"2024-08-17T02:25:18.666463+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:38:08.511096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.701620+0000","last_change":"2024-08-17T02:25:18.694604+0000","last_active":"2024-08-17T02:25:18.701620+0000","last_peered":"2024-08-17T02:25:18.701620+0000","last_clean":"2024-08-17T02:25:18.701620+0000","last_became_active":"2024-08-17T02:25:18.694373+0000","last_became_peered":"2024-08-17T02:25:18.694373+0000","last_unstale":"2024-08-17T02:25:18.701620+0000","last_undegraded":"2024-08-17T02:25:18.701620+0000","last_fullsized":"2024-08-17T02:25:18.701620+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:15:35.080503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.675230+0000","last_change":"2024-08-17T02:25:17.681879+0000","last_active":"2024-08-17T02:25:18.675230+0000","last_peered":"2024-08-17T02:25:18.675230+0000","last_clean":"2024-08-17T02:25:18.675230+0000","last_became_active":"2024-08-17T02:25:17.681624+0000","last_became_peered":"2024-08-17T02:25:17.681624+0000","last_unstale":"2024-08-17T02:25:18.675230+0000","last_undegraded":"2024-08-17T02:25:18.675230+0000","last_fullsized":"2024-08-17T02:25:18.675230+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:21:53.489386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.700468+0000","last_change":"2024-08-17T02:25:18.694622+0000","last_active":"2024-08-17T02:25:18.700468+0000","last_peered":"2024-08-17T02:25:18.700468+0000","last_clean":"2024-08-17T02:25:18.700468+0000","last_became_active":"2024-08-17T02:25:18.694388+0000","last_became_peered":"2024-08-17T02:25:18.694388+0000","last_unstale":"2024-08-17T02:25:18.700468+0000","last_undegraded":"2024-08-17T02:25:18.700468+0000","last_fullsized":"2024-08-17T02:25:18.700468+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:14:51.437597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.664893+0000","last_change":"2024-08-17T02:25:17.676989+0000","last_active":"2024-08-17T02:25:18.664893+0000","last_peered":"2024-08-17T02:25:18.664893+0000","last_clean":"2024-08-17T02:25:18.664893+0000","last_became_active":"2024-08-17T02:25:17.676554+0000","last_became_peered":"2024-08-17T02:25:17.676554+0000","last_unstale":"2024-08-17T02:25:18.664893+0000","last_undegraded":"2024-08-17T02:25:18.664893+0000","last_fullsized":"2024-08-17T02:25:18.664893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:10.657983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.696437+0000","last_change":"2024-08-17T02:25:18.684310+0000","last_active":"2024-08-17T02:25:18.696437+0000","last_peered":"2024-08-17T02:25:18.696437+0000","last_clean":"2024-08-17T02:25:18.696437+0000","last_became_active":"2024-08-17T02:25:18.684066+0000","last_became_peered":"2024-08-17T02:25:18.684066+0000","last_unstale":"2024-08-17T02:25:18.696437+0000","last_undegraded":"2024-08-17T02:25:18.696437+0000","last_fullsized":"2024-08-17T02:25:18.696437+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:41:04.504523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.700827+0000","last_change":"2024-08-17T02:25:17.682039+0000","last_active":"2024-08-17T02:25:18.700827+0000","last_peered":"2024-08-17T02:25:18.700827+0000","last_clean":"2024-08-17T02:25:18.700827+0000","last_became_active":"2024-08-17T02:25:17.681753+0000","last_became_peered":"2024-08-17T02:25:17.681753+0000","last_unstale":"2024-08-17T02:25:18.700827+0000","last_undegraded":"2024-08-17T02:25:18.700827+0000","last_fullsized":"2024-08-17T02:25:18.700827+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:57:03.088315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.691347+0000","last_change":"2024-08-17T02:25:18.689244+0000","last_active":"2024-08-17T02:25:18.691347+0000","last_peered":"2024-08-17T02:25:18.691347+0000","last_clean":"2024-08-17T02:25:18.691347+0000","last_became_active":"2024-08-17T02:25:18.688773+0000","last_became_peered":"2024-08-17T02:25:18.688773+0000","last_unstale":"2024-08-17T02:25:18.691347+0000","last_undegraded":"2024-08-17T02:25:18.691347+0000","last_fullsized":"2024-08-17T02:25:18.691347+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:38.896462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.704817+0000","last_change":"2024-08-17T02:25:17.688038+0000","last_active":"2024-08-17T02:25:18.704817+0000","last_peered":"2024-08-17T02:25:18.704817+0000","last_clean":"2024-08-17T02:25:18.704817+0000","last_became_active":"2024-08-17T02:25:17.687784+0000","last_became_peered":"2024-08-17T02:25:17.687784+0000","last_unstale":"2024-08-17T02:25:18.704817+0000","last_undegraded":"2024-08-17T02:25:18.704817+0000","last_fullsized":"2024-08-17T02:25:18.704817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:03:34.957853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.698164+0000","last_change":"2024-08-17T02:25:18.688857+0000","last_active":"2024-08-17T02:25:18.698164+0000","last_peered":"2024-08-17T02:25:18.698164+0000","last_clean":"2024-08-17T02:25:18.698164+0000","last_became_active":"2024-08-17T02:25:18.687321+0000","last_became_peered":"2024-08-17T02:25:18.687321+0000","last_unstale":"2024-08-17T02:25:18.698164+0000","last_undegraded":"2024-08-17T02:25:18.698164+0000","last_fullsized":"2024-08-17T02:25:18.698164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:15:59.138809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.701718+0000","last_change":"2024-08-17T02:25:17.676792+0000","last_active":"2024-08-17T02:25:18.701718+0000","last_peered":"2024-08-17T02:25:18.701718+0000","last_clean":"2024-08-17T02:25:18.701718+0000","last_became_active":"2024-08-17T02:25:17.673989+0000","last_became_peered":"2024-08-17T02:25:17.673989+0000","last_unstale":"2024-08-17T02:25:18.701718+0000","last_undegraded":"2024-08-17T02:25:18.701718+0000","last_fullsized":"2024-08-17T02:25:18.701718+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:17.604015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.690106+0000","last_change":"2024-08-17T02:25:18.680024+0000","last_active":"2024-08-17T02:25:18.690106+0000","last_peered":"2024-08-17T02:25:18.690106+0000","last_clean":"2024-08-17T02:25:18.690106+0000","last_became_active":"2024-08-17T02:25:18.679782+0000","last_became_peered":"2024-08-17T02:25:18.679782+0000","last_unstale":"2024-08-17T02:25:18.690106+0000","last_undegraded":"2024-08-17T02:25:18.690106+0000","last_fullsized":"2024-08-17T02:25:18.690106+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:28:51.002809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.682478+0000","last_change":"2024-08-17T02:25:17.685576+0000","last_active":"2024-08-17T02:25:18.682478+0000","last_peered":"2024-08-17T02:25:18.682478+0000","last_clean":"2024-08-17T02:25:18.682478+0000","last_became_active":"2024-08-17T02:25:17.685314+0000","last_became_peered":"2024-08-17T02:25:17.685314+0000","last_unstale":"2024-08-17T02:25:18.682478+0000","last_undegraded":"2024-08-17T02:25:18.682478+0000","last_fullsized":"2024-08-17T02:25:18.682478+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:14:21.868403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.702586+0000","last_change":"2024-08-17T02:25:18.699544+0000","last_active":"2024-08-17T02:25:18.702586+0000","last_peered":"2024-08-17T02:25:18.702586+0000","last_clean":"2024-08-17T02:25:18.702586+0000","last_became_active":"2024-08-17T02:25:18.699066+0000","last_became_peered":"2024-08-17T02:25:18.699066+0000","last_unstale":"2024-08-17T02:25:18.702586+0000","last_undegraded":"2024-08-17T02:25:18.702586+0000","last_fullsized":"2024-08-17T02:25:18.702586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:12:11.199988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.676895+0000","last_change":"2024-08-17T02:25:17.687390+0000","last_active":"2024-08-17T02:25:18.676895+0000","last_peered":"2024-08-17T02:25:18.676895+0000","last_clean":"2024-08-17T02:25:18.676895+0000","last_became_active":"2024-08-17T02:25:17.687168+0000","last_became_peered":"2024-08-17T02:25:17.687168+0000","last_unstale":"2024-08-17T02:25:18.676895+0000","last_undegraded":"2024-08-17T02:25:18.676895+0000","last_fullsized":"2024-08-17T02:25:18.676895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:34:39.313004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.700437+0000","last_change":"2024-08-17T02:25:18.693643+0000","last_active":"2024-08-17T02:25:18.700437+0000","last_peered":"2024-08-17T02:25:18.700437+0000","last_clean":"2024-08-17T02:25:18.700437+0000","last_became_active":"2024-08-17T02:25:18.693204+0000","last_became_peered":"2024-08-17T02:25:18.693204+0000","last_unstale":"2024-08-17T02:25:18.700437+0000","last_undegraded":"2024-08-17T02:25:18.700437+0000","last_fullsized":"2024-08-17T02:25:18.700437+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:44:17.044891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.703683+0000","last_change":"2024-08-17T02:25:17.684571+0000","last_active":"2024-08-17T02:25:18.703683+0000","last_peered":"2024-08-17T02:25:18.703683+0000","last_clean":"2024-08-17T02:25:18.703683+0000","last_became_active":"2024-08-17T02:25:17.684008+0000","last_became_peered":"2024-08-17T02:25:17.684008+0000","last_unstale":"2024-08-17T02:25:18.703683+0000","last_undegraded":"2024-08-17T02:25:18.703683+0000","last_fullsized":"2024-08-17T02:25:18.703683+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:02.630816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.696209+0000","last_change":"2024-08-17T02:25:18.691629+0000","last_active":"2024-08-17T02:25:18.696209+0000","last_peered":"2024-08-17T02:25:18.696209+0000","last_clean":"2024-08-17T02:25:18.696209+0000","last_became_active":"2024-08-17T02:25:18.690619+0000","last_became_peered":"2024-08-17T02:25:18.690619+0000","last_unstale":"2024-08-17T02:25:18.696209+0000","last_undegraded":"2024-08-17T02:25:18.696209+0000","last_fullsized":"2024-08-17T02:25:18.696209+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:29:58.584657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.703518+0000","last_change":"2024-08-17T02:25:17.690425+0000","last_active":"2024-08-17T02:25:18.703518+0000","last_peered":"2024-08-17T02:25:18.703518+0000","last_clean":"2024-08-17T02:25:18.703518+0000","last_became_active":"2024-08-17T02:25:17.690138+0000","last_became_peered":"2024-08-17T02:25:17.690138+0000","last_unstale":"2024-08-17T02:25:18.703518+0000","last_undegraded":"2024-08-17T02:25:18.703518+0000","last_fullsized":"2024-08-17T02:25:18.703518+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:34:39.313004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.698332+0000","last_change":"2024-08-17T02:25:18.692029+0000","last_active":"2024-08-17T02:25:18.698332+0000","last_peered":"2024-08-17T02:25:18.698332+0000","last_clean":"2024-08-17T02:25:18.698332+0000","last_became_active":"2024-08-17T02:25:18.691758+0000","last_became_peered":"2024-08-17T02:25:18.691758+0000","last_unstale":"2024-08-17T02:25:18.698332+0000","last_undegraded":"2024-08-17T02:25:18.698332+0000","last_fullsized":"2024-08-17T02:25:18.698332+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:51:04.058113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.696791+0000","last_change":"2024-08-17T02:25:17.673862+0000","last_active":"2024-08-17T02:25:18.696791+0000","last_peered":"2024-08-17T02:25:18.696791+0000","last_clean":"2024-08-17T02:25:18.696791+0000","last_became_active":"2024-08-17T02:25:17.673608+0000","last_became_peered":"2024-08-17T02:25:17.673608+0000","last_unstale":"2024-08-17T02:25:18.696791+0000","last_undegraded":"2024-08-17T02:25:18.696791+0000","last_fullsized":"2024-08-17T02:25:18.696791+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:18:32.501730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.681849+0000","last_change":"2024-08-17T02:25:18.677970+0000","last_active":"2024-08-17T02:25:18.681849+0000","last_peered":"2024-08-17T02:25:18.681849+0000","last_clean":"2024-08-17T02:25:18.681849+0000","last_became_active":"2024-08-17T02:25:18.677588+0000","last_became_peered":"2024-08-17T02:25:18.677588+0000","last_unstale":"2024-08-17T02:25:18.681849+0000","last_undegraded":"2024-08-17T02:25:18.681849+0000","last_fullsized":"2024-08-17T02:25:18.681849+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:57:45.497406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.696113+0000","last_change":"2024-08-17T02:25:17.677042+0000","last_active":"2024-08-17T02:25:18.696113+0000","last_peered":"2024-08-17T02:25:18.696113+0000","last_clean":"2024-08-17T02:25:18.696113+0000","last_became_active":"2024-08-17T02:25:17.676166+0000","last_became_peered":"2024-08-17T02:25:17.676166+0000","last_unstale":"2024-08-17T02:25:18.696113+0000","last_undegraded":"2024-08-17T02:25:18.696113+0000","last_fullsized":"2024-08-17T02:25:18.696113+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:43:30.288480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.692251+0000","last_change":"2024-08-17T02:25:18.683115+0000","last_active":"2024-08-17T02:25:18.692251+0000","last_peered":"2024-08-17T02:25:18.692251+0000","last_clean":"2024-08-17T02:25:18.692251+0000","last_became_active":"2024-08-17T02:25:18.682850+0000","last_became_peered":"2024-08-17T02:25:18.682850+0000","last_unstale":"2024-08-17T02:25:18.692251+0000","last_undegraded":"2024-08-17T02:25:18.692251+0000","last_fullsized":"2024-08-17T02:25:18.692251+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:03:35.964491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.669358+0000","last_change":"2024-08-17T02:25:17.680896+0000","last_active":"2024-08-17T02:25:18.669358+0000","last_peered":"2024-08-17T02:25:18.669358+0000","last_clean":"2024-08-17T02:25:18.669358+0000","last_became_active":"2024-08-17T02:25:17.680609+0000","last_became_peered":"2024-08-17T02:25:17.680609+0000","last_unstale":"2024-08-17T02:25:18.669358+0000","last_undegraded":"2024-08-17T02:25:18.669358+0000","last_fullsized":"2024-08-17T02:25:18.669358+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:08:36.844257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.685384+0000","last_change":"2024-08-17T02:25:18.680147+0000","last_active":"2024-08-17T02:25:18.685384+0000","last_peered":"2024-08-17T02:25:18.685384+0000","last_clean":"2024-08-17T02:25:18.685384+0000","last_became_active":"2024-08-17T02:25:18.679880+0000","last_became_peered":"2024-08-17T02:25:18.679880+0000","last_unstale":"2024-08-17T02:25:18.685384+0000","last_undegraded":"2024-08-17T02:25:18.685384+0000","last_fullsized":"2024-08-17T02:25:18.685384+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:51.535145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.690413+0000","last_change":"2024-08-17T02:25:17.687610+0000","last_active":"2024-08-17T02:25:18.690413+0000","last_peered":"2024-08-17T02:25:18.690413+0000","last_clean":"2024-08-17T02:25:18.690413+0000","last_became_active":"2024-08-17T02:25:17.687268+0000","last_became_peered":"2024-08-17T02:25:17.687268+0000","last_unstale":"2024-08-17T02:25:18.690413+0000","last_undegraded":"2024-08-17T02:25:18.690413+0000","last_fullsized":"2024-08-17T02:25:18.690413+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:03:47.853752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.682985+0000","last_change":"2024-08-17T02:25:18.675577+0000","last_active":"2024-08-17T02:25:18.682985+0000","last_peered":"2024-08-17T02:25:18.682985+0000","last_clean":"2024-08-17T02:25:18.682985+0000","last_became_active":"2024-08-17T02:25:18.675124+0000","last_became_peered":"2024-08-17T02:25:18.675124+0000","last_unstale":"2024-08-17T02:25:18.682985+0000","last_undegraded":"2024-08-17T02:25:18.682985+0000","last_fullsized":"2024-08-17T02:25:18.682985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:54:10.958249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.680385+0000","last_change":"2024-08-17T02:25:17.692433+0000","last_active":"2024-08-17T02:25:18.680385+0000","last_peered":"2024-08-17T02:25:18.680385+0000","last_clean":"2024-08-17T02:25:18.680385+0000","last_became_active":"2024-08-17T02:25:17.692172+0000","last_became_peered":"2024-08-17T02:25:17.692172+0000","last_unstale":"2024-08-17T02:25:18.680385+0000","last_undegraded":"2024-08-17T02:25:18.680385+0000","last_fullsized":"2024-08-17T02:25:18.680385+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:48:25.682657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.683983+0000","last_change":"2024-08-17T02:25:18.678202+0000","last_active":"2024-08-17T02:25:18.683983+0000","last_peered":"2024-08-17T02:25:18.683983+0000","last_clean":"2024-08-17T02:25:18.683983+0000","last_became_active":"2024-08-17T02:25:18.675448+0000","last_became_peered":"2024-08-17T02:25:18.675448+0000","last_unstale":"2024-08-17T02:25:18.683983+0000","last_undegraded":"2024-08-17T02:25:18.683983+0000","last_fullsized":"2024-08-17T02:25:18.683983+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:08:37.850894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.667123+0000","last_change":"2024-08-17T02:25:17.686038+0000","last_active":"2024-08-17T02:25:18.667123+0000","last_peered":"2024-08-17T02:25:18.667123+0000","last_clean":"2024-08-17T02:25:18.667123+0000","last_became_active":"2024-08-17T02:25:17.685788+0000","last_became_peered":"2024-08-17T02:25:17.685788+0000","last_unstale":"2024-08-17T02:25:18.667123+0000","last_undegraded":"2024-08-17T02:25:18.667123+0000","last_fullsized":"2024-08-17T02:25:18.667123+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:00:25.851171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.699193+0000","last_change":"2024-08-17T02:25:18.697276+0000","last_active":"2024-08-17T02:25:18.699193+0000","last_peered":"2024-08-17T02:25:18.699193+0000","last_clean":"2024-08-17T02:25:18.699193+0000","last_became_active":"2024-08-17T02:25:18.694659+0000","last_became_peered":"2024-08-17T02:25:18.694659+0000","last_unstale":"2024-08-17T02:25:18.699193+0000","last_undegraded":"2024-08-17T02:25:18.699193+0000","last_fullsized":"2024-08-17T02:25:18.699193+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:03.637453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.676552+0000","last_change":"2024-08-17T02:25:17.688649+0000","last_active":"2024-08-17T02:25:18.676552+0000","last_peered":"2024-08-17T02:25:18.676552+0000","last_clean":"2024-08-17T02:25:18.676552+0000","last_became_active":"2024-08-17T02:25:17.688290+0000","last_became_peered":"2024-08-17T02:25:17.688290+0000","last_unstale":"2024-08-17T02:25:18.676552+0000","last_undegraded":"2024-08-17T02:25:18.676552+0000","last_fullsized":"2024-08-17T02:25:18.676552+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:29:57.578020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.693587+0000","last_change":"2024-08-17T02:25:18.686927+0000","last_active":"2024-08-17T02:25:18.693587+0000","last_peered":"2024-08-17T02:25:18.693587+0000","last_clean":"2024-08-17T02:25:18.693587+0000","last_became_active":"2024-08-17T02:25:18.686700+0000","last_became_peered":"2024-08-17T02:25:18.686700+0000","last_unstale":"2024-08-17T02:25:18.693587+0000","last_undegraded":"2024-08-17T02:25:18.693587+0000","last_fullsized":"2024-08-17T02:25:18.693587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:08:43.820138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.702978+0000","last_change":"2024-08-17T02:25:17.685745+0000","last_active":"2024-08-17T02:25:18.702978+0000","last_peered":"2024-08-17T02:25:18.702978+0000","last_clean":"2024-08-17T02:25:18.702978+0000","last_became_active":"2024-08-17T02:25:17.685437+0000","last_became_peered":"2024-08-17T02:25:17.685437+0000","last_unstale":"2024-08-17T02:25:18.702978+0000","last_undegraded":"2024-08-17T02:25:18.702978+0000","last_fullsized":"2024-08-17T02:25:18.702978+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:03:34.957853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.701773+0000","last_change":"2024-08-17T02:25:18.695593+0000","last_active":"2024-08-17T02:25:18.701773+0000","last_peered":"2024-08-17T02:25:18.701773+0000","last_clean":"2024-08-17T02:25:18.701773+0000","last_became_active":"2024-08-17T02:25:18.695345+0000","last_became_peered":"2024-08-17T02:25:18.695345+0000","last_unstale":"2024-08-17T02:25:18.701773+0000","last_undegraded":"2024-08-17T02:25:18.701773+0000","last_fullsized":"2024-08-17T02:25:18.701773+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:25.271173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:25:19.761705+0000","last_change":"2024-08-17T02:25:17.688551+0000","last_active":"2024-08-17T02:25:19.761705+0000","last_peered":"2024-08-17T02:25:19.761705+0000","last_clean":"2024-08-17T02:25:19.761705+0000","last_became_active":"2024-08-17T02:25:17.688287+0000","last_became_peered":"2024-08-17T02:25:17.688287+0000","last_unstale":"2024-08-17T02:25:19.761705+0000","last_undegraded":"2024-08-17T02:25:19.761705+0000","last_fullsized":"2024-08-17T02:25:19.761705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:08:42.813501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.692846+0000","last_change":"2024-08-17T02:25:18.688535+0000","last_active":"2024-08-17T02:25:18.692846+0000","last_peered":"2024-08-17T02:25:18.692846+0000","last_clean":"2024-08-17T02:25:18.692846+0000","last_became_active":"2024-08-17T02:25:18.685407+0000","last_became_peered":"2024-08-17T02:25:18.685407+0000","last_unstale":"2024-08-17T02:25:18.692846+0000","last_undegraded":"2024-08-17T02:25:18.692846+0000","last_fullsized":"2024-08-17T02:25:18.692846+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:03.637453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.683554+0000","last_change":"2024-08-17T02:25:17.688006+0000","last_active":"2024-08-17T02:25:18.683554+0000","last_peered":"2024-08-17T02:25:18.683554+0000","last_clean":"2024-08-17T02:25:18.683554+0000","last_became_active":"2024-08-17T02:25:17.687617+0000","last_became_peered":"2024-08-17T02:25:17.687617+0000","last_unstale":"2024-08-17T02:25:18.683554+0000","last_undegraded":"2024-08-17T02:25:18.683554+0000","last_fullsized":"2024-08-17T02:25:18.683554+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:03:47.853752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.700074+0000","last_change":"2024-08-17T02:25:18.693366+0000","last_active":"2024-08-17T02:25:18.700074+0000","last_peered":"2024-08-17T02:25:18.700074+0000","last_clean":"2024-08-17T02:25:18.700074+0000","last_became_active":"2024-08-17T02:25:18.693093+0000","last_became_peered":"2024-08-17T02:25:18.693093+0000","last_unstale":"2024-08-17T02:25:18.700074+0000","last_undegraded":"2024-08-17T02:25:18.700074+0000","last_fullsized":"2024-08-17T02:25:18.700074+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:23.240941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.664605+0000","last_change":"2024-08-17T02:25:17.668970+0000","last_active":"2024-08-17T02:25:18.664605+0000","last_peered":"2024-08-17T02:25:18.664605+0000","last_clean":"2024-08-17T02:25:18.664605+0000","last_became_active":"2024-08-17T02:25:17.668716+0000","last_became_peered":"2024-08-17T02:25:17.668716+0000","last_unstale":"2024-08-17T02:25:18.664605+0000","last_undegraded":"2024-08-17T02:25:18.664605+0000","last_fullsized":"2024-08-17T02:25:18.664605+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:48:25.682657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.689579+0000","last_change":"2024-08-17T02:25:18.686951+0000","last_active":"2024-08-17T02:25:18.689579+0000","last_peered":"2024-08-17T02:25:18.689579+0000","last_clean":"2024-08-17T02:25:18.689579+0000","last_became_active":"2024-08-17T02:25:18.686679+0000","last_became_peered":"2024-08-17T02:25:18.686679+0000","last_unstale":"2024-08-17T02:25:18.689579+0000","last_undegraded":"2024-08-17T02:25:18.689579+0000","last_fullsized":"2024-08-17T02:25:18.689579+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:21:54.496023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.682615+0000","last_change":"2024-08-17T02:25:17.683540+0000","last_active":"2024-08-17T02:25:18.682615+0000","last_peered":"2024-08-17T02:25:18.682615+0000","last_clean":"2024-08-17T02:25:18.682615+0000","last_became_active":"2024-08-17T02:25:17.683254+0000","last_became_peered":"2024-08-17T02:25:17.683254+0000","last_unstale":"2024-08-17T02:25:18.682615+0000","last_undegraded":"2024-08-17T02:25:18.682615+0000","last_fullsized":"2024-08-17T02:25:18.682615+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:48:25.682657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.696954+0000","last_change":"2024-08-17T02:25:18.686296+0000","last_active":"2024-08-17T02:25:18.696954+0000","last_peered":"2024-08-17T02:25:18.696954+0000","last_clean":"2024-08-17T02:25:18.696954+0000","last_became_active":"2024-08-17T02:25:18.686010+0000","last_became_peered":"2024-08-17T02:25:18.686010+0000","last_unstale":"2024-08-17T02:25:18.696954+0000","last_undegraded":"2024-08-17T02:25:18.696954+0000","last_fullsized":"2024-08-17T02:25:18.696954+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:51:04.058113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.667223+0000","last_change":"2024-08-17T02:25:17.678168+0000","last_active":"2024-08-17T02:25:18.667223+0000","last_peered":"2024-08-17T02:25:18.667223+0000","last_clean":"2024-08-17T02:25:18.667223+0000","last_became_active":"2024-08-17T02:25:17.677901+0000","last_became_peered":"2024-08-17T02:25:17.677901+0000","last_unstale":"2024-08-17T02:25:18.667223+0000","last_undegraded":"2024-08-17T02:25:18.667223+0000","last_fullsized":"2024-08-17T02:25:18.667223+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:18:28.078127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.696309+0000","last_change":"2024-08-17T02:25:18.692788+0000","last_active":"2024-08-17T02:25:18.696309+0000","last_peered":"2024-08-17T02:25:18.696309+0000","last_clean":"2024-08-17T02:25:18.696309+0000","last_became_active":"2024-08-17T02:25:18.692523+0000","last_became_peered":"2024-08-17T02:25:18.692523+0000","last_unstale":"2024-08-17T02:25:18.696309+0000","last_undegraded":"2024-08-17T02:25:18.696309+0000","last_fullsized":"2024-08-17T02:25:18.696309+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:03.637453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.670714+0000","last_change":"2024-08-17T02:25:17.688335+0000","last_active":"2024-08-17T02:25:18.670714+0000","last_peered":"2024-08-17T02:25:18.670714+0000","last_clean":"2024-08-17T02:25:18.670714+0000","last_became_active":"2024-08-17T02:25:17.688083+0000","last_became_peered":"2024-08-17T02:25:17.688083+0000","last_unstale":"2024-08-17T02:25:18.670714+0000","last_undegraded":"2024-08-17T02:25:18.670714+0000","last_fullsized":"2024-08-17T02:25:18.670714+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:59:35.599774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.687527+0000","last_change":"2024-08-17T02:25:18.684557+0000","last_active":"2024-08-17T02:25:18.687527+0000","last_peered":"2024-08-17T02:25:18.687527+0000","last_clean":"2024-08-17T02:25:18.687527+0000","last_became_active":"2024-08-17T02:25:18.684031+0000","last_became_peered":"2024-08-17T02:25:18.684031+0000","last_unstale":"2024-08-17T02:25:18.687527+0000","last_undegraded":"2024-08-17T02:25:18.687527+0000","last_fullsized":"2024-08-17T02:25:18.687527+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:22:19.225830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.680651+0000","last_change":"2024-08-17T02:25:17.684468+0000","last_active":"2024-08-17T02:25:18.680651+0000","last_peered":"2024-08-17T02:25:18.680651+0000","last_clean":"2024-08-17T02:25:18.680651+0000","last_became_active":"2024-08-17T02:25:17.684195+0000","last_became_peered":"2024-08-17T02:25:17.684195+0000","last_unstale":"2024-08-17T02:25:18.680651+0000","last_undegraded":"2024-08-17T02:25:18.680651+0000","last_fullsized":"2024-08-17T02:25:18.680651+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:54:09.951612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":172,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.677542+0000","last_change":"2024-08-17T02:24:25.092772+0000","last_active":"2024-08-17T02:25:18.677542+0000","last_peered":"2024-08-17T02:25:18.677542+0000","last_clean":"2024-08-17T02:25:18.677542+0000","last_became_active":"2024-08-17T02:24:25.091788+0000","last_became_peered":"2024-08-17T02:24:25.091788+0000","last_unstale":"2024-08-17T02:25:18.677542+0000","last_undegraded":"2024-08-17T02:25:18.677542+0000","last_fullsized":"2024-08-17T02:25:18.677542+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:24.051996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:24.051996+0000","last_clean_scrub_stamp":"2024-08-17T02:24:24.051996+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:31:45.454480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302456,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069384,"statfs":{"total":96636764160,"available":96327049216,"internally_reserved":0,"allocated":958464,"data_stored":728831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.68100000000000005}]},{"osd":1,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.82799999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.63500000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.75800000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.60499999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.85499999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.88},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.55100000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301884,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069956,"statfs":{"total":96636764160,"available":96327634944,"internally_reserved":0,"allocated":368640,"data_stored":138977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301884,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069956,"statfs":{"total":96636764160,"available":96327634944,"internally_reserved":0,"allocated":368640,"data_stored":139033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":3.1440000000000001,"5min":3.1440000000000001,"15min":3.1440000000000001},"last":0.57299999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.69199999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":3.2559999999999998,"5min":3.2559999999999998,"15min":3.2559999999999998},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.64300000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":3.2229999999999999,"5min":3.2229999999999999,"15min":3.2229999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":3.1859999999999999,"5min":3.1859999999999999,"15min":3.1859999999999999},"last":0.72699999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.66300000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.62},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.49199999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.75900000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301884,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069956,"statfs":{"total":96636764160,"available":96327634944,"internally_reserved":0,"allocated":368640,"data_stored":138477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":376832,"data_stored":139947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.375},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.33500000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.48199999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.41799999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.81899999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.80100000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.83399999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.85999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":364544,"data_stored":138443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":376832,"data_stored":139947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298292,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073548,"statfs":{"total":96636764160,"available":96331313152,"internally_reserved":0,"allocated":954368,"data_stored":728741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:25:23.626 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-17T02:25:23.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.804+0000 7f6f98800640 1 Processor -- start 2024-08-17T02:25:23.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.805+0000 7f6f98800640 1 -- start start 2024-08-17T02:25:23.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.806+0000 7f6f98800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6f90155a20 0x7f6f900adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.806+0000 7f6f98800640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6f90155df0 0x7f6f900ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.806+0000 7f6f98800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f90156670 con 0x7f6f9006d7f0 2024-08-17T02:25:23.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.806+0000 7f6f98800640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f900b0350 con 0x7f6f90155df0 2024-08-17T02:25:23.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.806+0000 7f6f98800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9006e5e0 con 0x7f6f90155a20 2024-08-17T02:25:23.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.806+0000 7f6f96800640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f6f9006d7f0 0x7f6f900ac790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:47766/0 (socket says 172.21.15.107:47766) 2024-08-17T02:25:23.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.806+0000 7f6f96800640 1 -- 172.21.15.107:0/61604001 learned_addr learned my addr 172.21.15.107:0/61604001 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:25:23.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.806+0000 7f6f95400640 1 --2- 172.21.15.107:0/61604001 >> v2:172.21.15.157:3300/0 conn(0x7f6f90155df0 0x7f6f900ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:23.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.806+0000 7f6f95e00640 1 --2- 172.21.15.107:0/61604001 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6f90155a20 0x7f6f900adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:23.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.806+0000 7f6f94a00640 1 -- 172.21.15.107:0/61604001 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1618332982 0 0) 0x7f6f90156670 con 0x7f6f9006d7f0 2024-08-17T02:25:23.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.807+0000 7f6f94a00640 1 -- 172.21.15.107:0/61604001 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f780034e0 con 0x7f6f9006d7f0 2024-08-17T02:25:23.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.807+0000 7f6f95400640 1 -- 172.21.15.107:0/61604001 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6f90155a20 msgr2=0x7f6f900adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:23.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.807+0000 7f6f95400640 1 --2- 172.21.15.107:0/61604001 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6f90155a20 0x7f6f900adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.807+0000 7f6f95400640 1 -- 172.21.15.107:0/61604001 >> v1:172.21.15.107:6789/0 conn(0x7f6f9006d7f0 legacy=0x7f6f900ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:23.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.807+0000 7f6f95400640 1 -- 172.21.15.107:0/61604001 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f9006e8c0 con 0x7f6f90155df0 2024-08-17T02:25:23.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.807+0000 7f6f95e00640 1 --2- 172.21.15.107:0/61604001 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6f90155a20 0x7f6f900adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:23.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.808+0000 7f6f95400640 1 --2- 172.21.15.107:0/61604001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f90155df0 0x7f6f900ad9b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6f80009850 tx=0x7f6f800090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f4cfdb7f217e78a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:23.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.808+0000 7f6f94a00640 1 -- 172.21.15.107:0/61604001 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8002ad90 con 0x7f6f90155df0 2024-08-17T02:25:23.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.808+0000 7f6f94a00640 1 -- 172.21.15.107:0/61604001 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f80032440 con 0x7f6f90155df0 2024-08-17T02:25:23.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.808+0000 7f6f94a00640 1 -- 172.21.15.107:0/61604001 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f80032820 con 0x7f6f90155df0 2024-08-17T02:25:23.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.809+0000 7f6f98800640 1 -- 172.21.15.107:0/61604001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f90155df0 msgr2=0x7f6f900ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:23.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.809+0000 7f6f98800640 1 --2- 172.21.15.107:0/61604001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f90155df0 0x7f6f900ad9b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6f80009850 tx=0x7f6f800090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.809+0000 7f6f98800640 1 -- 172.21.15.107:0/61604001 shutdown_connections 2024-08-17T02:25:23.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.809+0000 7f6f98800640 1 --2- 172.21.15.107:0/61604001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f90155df0 0x7f6f900ad9b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.809+0000 7f6f98800640 1 --2- 172.21.15.107:0/61604001 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6f90155a20 0x7f6f900adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.809+0000 7f6f98800640 1 -- 172.21.15.107:0/61604001 >> 172.21.15.107:0/61604001 conn(0x7f6f900cb9b0 msgr2=0x7f6f900cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:23.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.809+0000 7f6f98800640 1 -- 172.21.15.107:0/61604001 shutdown_connections 2024-08-17T02:25:23.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.809+0000 7f6f98800640 1 -- 172.21.15.107:0/61604001 wait complete. 2024-08-17T02:25:23.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.810+0000 7f6f98800640 1 Processor -- start 2024-08-17T02:25:23.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.810+0000 7f6f98800640 1 -- start start 2024-08-17T02:25:23.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.811+0000 7f6f98800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f9006d7f0 0x7f6f900ac3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.811+0000 7f6f98800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6f90155a20 0x7f6f9016cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.811+0000 7f6f98800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6f90155df0 0x7f6f90168bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.811+0000 7f6f98800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9016d160 con 0x7f6f90155df0 2024-08-17T02:25:23.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.811+0000 7f6f98800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f900aa3b0 con 0x7f6f9006d7f0 2024-08-17T02:25:23.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.811+0000 7f6f98800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f900a9a80 con 0x7f6f90155a20 2024-08-17T02:25:23.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.811+0000 7f6f96800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6f90155df0 0x7f6f90168bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:23.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.811+0000 7f6f96800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6f90155df0 0x7f6f90168bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58068/0 (socket says 172.21.15.107:58068) 2024-08-17T02:25:23.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.811+0000 7f6f96800640 1 -- 172.21.15.107:0/956990965 learned_addr learned my addr 172.21.15.107:0/956990965 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:23.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.812+0000 7f6f95400640 1 --2- 172.21.15.107:0/956990965 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6f90155a20 0x7f6f9016cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:23.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.812+0000 7f6f95e00640 1 --2- 172.21.15.107:0/956990965 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f9006d7f0 0x7f6f900ac3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:23.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.812+0000 7f6f96800640 1 -- 172.21.15.107:0/956990965 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6f90155a20 msgr2=0x7f6f9016cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:23.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.812+0000 7f6f96800640 1 --2- 172.21.15.107:0/956990965 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6f90155a20 0x7f6f9016cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.812+0000 7f6f96800640 1 -- 172.21.15.107:0/956990965 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f9006d7f0 msgr2=0x7f6f900ac3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:23.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.812+0000 7f6f96800640 1 --2- 172.21.15.107:0/956990965 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f9006d7f0 0x7f6f900ac3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.812+0000 7f6f96800640 1 -- 172.21.15.107:0/956990965 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f84009390 con 0x7f6f90155df0 2024-08-17T02:25:23.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.812+0000 7f6f96800640 1 --2- 172.21.15.107:0/956990965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6f90155df0 0x7f6f90168bb0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c001460 tx=0x7f6f8c001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:23.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.812+0000 7f6f89600640 1 -- 172.21.15.107:0/956990965 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c00ce90 con 0x7f6f90155df0 2024-08-17T02:25:23.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.812+0000 7f6f89600640 1 -- 172.21.15.107:0/956990965 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8c00a850 con 0x7f6f90155df0 2024-08-17T02:25:23.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.812+0000 7f6f89600640 1 -- 172.21.15.107:0/956990965 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c00ac50 con 0x7f6f90155df0 2024-08-17T02:25:23.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.812+0000 7f6f98800640 1 -- 172.21.15.107:0/956990965 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f80009390 con 0x7f6f90155df0 2024-08-17T02:25:23.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.812+0000 7f6f98800640 1 -- 172.21.15.107:0/956990965 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f900aa040 con 0x7f6f90155df0 2024-08-17T02:25:23.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.813+0000 7f6f98800640 1 -- 172.21.15.107:0/956990965 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f900aa540 con 0x7f6f90155df0 2024-08-17T02:25:23.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.814+0000 7f6f89600640 1 -- 172.21.15.107:0/956990965 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6f8c007300 con 0x7f6f90155df0 2024-08-17T02:25:23.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.815+0000 7f6f89600640 1 --2- 172.21.15.107:0/956990965 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6f74065150 0x7f6f74067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.815+0000 7f6f89600640 1 -- 172.21.15.107:0/956990965 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6f8c0826f0 con 0x7f6f90155df0 2024-08-17T02:25:23.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.816+0000 7f6f95e00640 1 --2- 172.21.15.107:0/956990965 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6f74065150 0x7f6f74067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:23.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.816+0000 7f6f95e00640 1 --2- 172.21.15.107:0/956990965 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6f74065150 0x7f6f74067600 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6f84009360 tx=0x7f6f84008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:23.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:23.819+0000 7f6f89600640 1 -- 172.21.15.107:0/956990965 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6f8c050700 con 0x7f6f90155df0 2024-08-17T02:25:24.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.056+0000 7f6f98800640 1 -- 172.21.15.107:0/956990965 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f6f90064db0 con 0x7f6f90155df0 2024-08-17T02:25:24.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.057+0000 7f6f89600640 1 -- 172.21.15.107:0/956990965 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1562 (secure 0 0 0) 0x7f6f8c053d20 con 0x7f6f90155df0 2024-08-17T02:25:24.058 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:25:24.058 INFO:teuthology.orchestra.run.smithi107.stdout:{"fsid":"f207b4c0-329d-46b8-b83f-aaf30bdb6ce3","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":73,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":32,"num_osds":8,"num_up_osds":8,"osd_up_since":1723861462,"num_in_osds":8,"osd_in_since":1723861453,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592706,"bytes_used":2457174016,"bytes_avail":770636939264,"bytes_total":773094113280,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"d","status":"up:active","gid":4920}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-08-17T02:25:23.416215+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-08-17T02:25:24.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.058+0000 7f6f98800640 1 -- 172.21.15.107:0/956990965 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6f74065150 msgr2=0x7f6f74067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:24.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.058+0000 7f6f98800640 1 --2- 172.21.15.107:0/956990965 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6f74065150 0x7f6f74067600 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6f84009360 tx=0x7f6f84008040 comp rx=0 tx=0).stop 2024-08-17T02:25:24.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.058+0000 7f6f98800640 1 -- 172.21.15.107:0/956990965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6f90155df0 msgr2=0x7f6f90168bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:24.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.058+0000 7f6f98800640 1 --2- 172.21.15.107:0/956990965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6f90155df0 0x7f6f90168bb0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c001460 tx=0x7f6f8c001ae0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.059+0000 7f6f98800640 1 -- 172.21.15.107:0/956990965 shutdown_connections 2024-08-17T02:25:24.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.059+0000 7f6f98800640 1 --2- 172.21.15.107:0/956990965 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6f74065150 0x7f6f74067600 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.059+0000 7f6f98800640 1 --2- 172.21.15.107:0/956990965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6f90155df0 0x7f6f90168bb0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.059+0000 7f6f98800640 1 --2- 172.21.15.107:0/956990965 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6f90155a20 0x7f6f9016cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.059+0000 7f6f98800640 1 --2- 172.21.15.107:0/956990965 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f9006d7f0 0x7f6f900ac3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.059+0000 7f6f98800640 1 -- 172.21.15.107:0/956990965 >> 172.21.15.107:0/956990965 conn(0x7f6f900cb9b0 msgr2=0x7f6f90153590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:24.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.059+0000 7f6f98800640 1 -- 172.21.15.107:0/956990965 shutdown_connections 2024-08-17T02:25:24.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.059+0000 7f6f98800640 1 -- 172.21.15.107:0/956990965 wait complete. 2024-08-17T02:25:24.074 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-08-17T02:25:24.075 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:25:24.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.221+0000 7f67ee000640 1 Processor -- start 2024-08-17T02:25:24.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.221+0000 7f67ee000640 1 -- start start 2024-08-17T02:25:24.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.223+0000 7f67ee000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f67e81401b0 0x7f67e80caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.223+0000 7f67ee000640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f67e80b1440 0x7f67e80c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.223+0000 7f67ee000640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67e80caa80 con 0x7f67e8140580 2024-08-17T02:25:24.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.223+0000 7f67ee000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67e80cb450 con 0x7f67e81401b0 2024-08-17T02:25:24.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.223+0000 7f67ee000640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67e80c9e70 con 0x7f67e80b1440 2024-08-17T02:25:24.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.223+0000 7f67e7400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f67e81401b0 0x7f67e80caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.223+0000 7f67e7400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f67e81401b0 0x7f67e80caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58078/0 (socket says 172.21.15.107:58078) 2024-08-17T02:25:24.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.223+0000 7f67e7400640 1 -- 172.21.15.107:0/3932563686 learned_addr learned my addr 172.21.15.107:0/3932563686 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:24.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.223+0000 7f67e7e00640 1 --2- 172.21.15.107:0/3932563686 >> v2:172.21.15.157:3300/0 conn(0x7f67e80b1440 0x7f67e80c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.223+0000 7f67e7400640 1 -- 172.21.15.107:0/3932563686 >> v2:172.21.15.157:3300/0 conn(0x7f67e80b1440 msgr2=0x7f67e80c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:24.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.223+0000 7f67e7400640 1 --2- 172.21.15.107:0/3932563686 >> v2:172.21.15.157:3300/0 conn(0x7f67e80b1440 0x7f67e80c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.223+0000 7f67e7400640 1 -- 172.21.15.107:0/3932563686 >> v1:172.21.15.157:6789/0 conn(0x7f67e8140580 legacy=0x7f67e80b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:24.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.223+0000 7f67e7400640 1 -- 172.21.15.107:0/3932563686 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e80ca150 con 0x7f67e81401b0 2024-08-17T02:25:24.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.223+0000 7f67e7e00640 1 --2- 172.21.15.107:0/3932563686 >> v2:172.21.15.157:3300/0 conn(0x7f67e80b1440 0x7f67e80c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:24.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.224+0000 7f67e7400640 1 --2- 172.21.15.107:0/3932563686 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67e81401b0 0x7f67e80caf10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f67e80ca9f0 tx=0x7f67d80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d911366e8de02d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:24.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.225+0000 7f67e6000640 1 -- 172.21.15.107:0/3932563686 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d802ad40 con 0x7f67e81401b0 2024-08-17T02:25:24.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.225+0000 7f67e6000640 1 -- 172.21.15.107:0/3932563686 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d8032440 con 0x7f67e81401b0 2024-08-17T02:25:24.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.225+0000 7f67e6000640 1 -- 172.21.15.107:0/3932563686 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d802aea0 con 0x7f67e81401b0 2024-08-17T02:25:24.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.225+0000 7f67ee000640 1 -- 172.21.15.107:0/3932563686 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67e81401b0 msgr2=0x7f67e80caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:24.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.225+0000 7f67ee000640 1 --2- 172.21.15.107:0/3932563686 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67e81401b0 0x7f67e80caf10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f67e80ca9f0 tx=0x7f67d80091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.225+0000 7f67ee000640 1 -- 172.21.15.107:0/3932563686 shutdown_connections 2024-08-17T02:25:24.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.225+0000 7f67ee000640 1 --2- 172.21.15.107:0/3932563686 >> v2:172.21.15.157:3300/0 conn(0x7f67e80b1440 0x7f67e80c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.225+0000 7f67ee000640 1 --2- 172.21.15.107:0/3932563686 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67e81401b0 0x7f67e80caf10 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.225+0000 7f67ee000640 1 -- 172.21.15.107:0/3932563686 >> 172.21.15.107:0/3932563686 conn(0x7f67e80cb9b0 msgr2=0x7f67e80cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:24.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.225+0000 7f67ee000640 1 -- 172.21.15.107:0/3932563686 shutdown_connections 2024-08-17T02:25:24.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.225+0000 7f67ee000640 1 -- 172.21.15.107:0/3932563686 wait complete. 2024-08-17T02:25:24.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.227+0000 7f67ee000640 1 Processor -- start 2024-08-17T02:25:24.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.227+0000 7f67ee000640 1 -- start start 2024-08-17T02:25:24.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.228+0000 7f67ee000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67e80b1440 0x7f67e813f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.228+0000 7f67ee000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67e81401b0 0x7f67e8166e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.228+0000 7f67ee000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67e8140580 0x7f67e80a9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.228+0000 7f67ee000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e80aa180 con 0x7f67e81401b0 2024-08-17T02:25:24.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.228+0000 7f67ee000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e80a6b90 con 0x7f67e8140580 2024-08-17T02:25:24.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.228+0000 7f67ee000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67e813f8f0 con 0x7f67e80b1440 2024-08-17T02:25:24.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.228+0000 7f67e6a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67e81401b0 0x7f67e8166e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.228+0000 7f67e6a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67e81401b0 0x7f67e8166e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58086/0 (socket says 172.21.15.107:58086) 2024-08-17T02:25:24.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.228+0000 7f67e6a00640 1 -- 172.21.15.107:0/1732092334 learned_addr learned my addr 172.21.15.107:0/1732092334 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:24.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.228+0000 7f67e7400640 1 --2- 172.21.15.107:0/1732092334 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67e80b1440 0x7f67e813f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.228+0000 7f67e7e00640 1 --2- 172.21.15.107:0/1732092334 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67e8140580 0x7f67e80a9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.228+0000 7f67e6a00640 1 -- 172.21.15.107:0/1732092334 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67e80b1440 msgr2=0x7f67e813f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:24.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.228+0000 7f67e6a00640 1 --2- 172.21.15.107:0/1732092334 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67e80b1440 0x7f67e813f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.228+0000 7f67e6a00640 1 -- 172.21.15.107:0/1732092334 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67e8140580 msgr2=0x7f67e80a9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:24.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.228+0000 7f67e6a00640 1 --2- 172.21.15.107:0/1732092334 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67e8140580 0x7f67e80a9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.228+0000 7f67e6a00640 1 -- 172.21.15.107:0/1732092334 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d8009450 con 0x7f67e81401b0 2024-08-17T02:25:24.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.228+0000 7f67e7e00640 1 --2- 172.21.15.107:0/1732092334 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67e8140580 0x7f67e80a9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:24.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.229+0000 7f67e6a00640 1 --2- 172.21.15.107:0/1732092334 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67e81401b0 0x7f67e8166e10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f67d400c5e0 tx=0x7f67d4007ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:24.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.229+0000 7f67dea00640 1 -- 172.21.15.107:0/1732092334 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d4012630 con 0x7f67e81401b0 2024-08-17T02:25:24.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.229+0000 7f67dea00640 1 -- 172.21.15.107:0/1732092334 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d4012790 con 0x7f67e81401b0 2024-08-17T02:25:24.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.229+0000 7f67dea00640 1 -- 172.21.15.107:0/1732092334 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d4012bd0 con 0x7f67e81401b0 2024-08-17T02:25:24.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.229+0000 7f67ee000640 1 -- 172.21.15.107:0/1732092334 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67e80a61f0 con 0x7f67e81401b0 2024-08-17T02:25:24.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.229+0000 7f67ee000640 1 -- 172.21.15.107:0/1732092334 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67e80a67b0 con 0x7f67e81401b0 2024-08-17T02:25:24.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.230+0000 7f67ee000640 1 -- 172.21.15.107:0/1732092334 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67e80a6cd0 con 0x7f67e81401b0 2024-08-17T02:25:24.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.231+0000 7f67dea00640 1 -- 172.21.15.107:0/1732092334 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f67d401b400 con 0x7f67e81401b0 2024-08-17T02:25:24.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.232+0000 7f67dea00640 1 --2- 172.21.15.107:0/1732092334 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f67c8065180 0x7f67c8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.232+0000 7f67dea00640 1 -- 172.21.15.107:0/1732092334 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f67d4082560 con 0x7f67e81401b0 2024-08-17T02:25:24.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.232+0000 7f67e7400640 1 --2- 172.21.15.107:0/1732092334 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f67c8065180 0x7f67c8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.232+0000 7f67e7400640 1 --2- 172.21.15.107:0/1732092334 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f67c8065180 0x7f67c8067630 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f67d8034000 tx=0x7f67d8032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:24.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.235+0000 7f67dea00640 1 -- 172.21.15.107:0/1732092334 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f67e80a6cd0 con 0x7f67e81401b0 2024-08-17T02:25:24.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.403+0000 7f67ee000640 1 -- 172.21.15.107:0/1732092334 --> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f67e80a6cd0 con 0x7f67c8065180 2024-08-17T02:25:24.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.410+0000 7f67dea00640 1 -- 172.21.15.107:0/1732092334 <== mgr.4110 v2:172.21.15.107:6832/37039 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+273911 (secure 0 0 0) 0x7f67e80a6cd0 con 0x7f67c8065180 2024-08-17T02:25:24.414 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:25:24.416 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-08-17T02:25:24.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.414+0000 7f67ee000640 1 -- 172.21.15.107:0/1732092334 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f67c8065180 msgr2=0x7f67c8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:24.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.414+0000 7f67ee000640 1 --2- 172.21.15.107:0/1732092334 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f67c8065180 0x7f67c8067630 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f67d8034000 tx=0x7f67d8032000 comp rx=0 tx=0).stop 2024-08-17T02:25:24.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.414+0000 7f67ee000640 1 -- 172.21.15.107:0/1732092334 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67e81401b0 msgr2=0x7f67e8166e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:24.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.414+0000 7f67ee000640 1 --2- 172.21.15.107:0/1732092334 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67e81401b0 0x7f67e8166e10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f67d400c5e0 tx=0x7f67d4007ed0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.414+0000 7f67ee000640 1 -- 172.21.15.107:0/1732092334 shutdown_connections 2024-08-17T02:25:24.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.414+0000 7f67ee000640 1 --2- 172.21.15.107:0/1732092334 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f67c8065180 0x7f67c8067630 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.414+0000 7f67ee000640 1 --2- 172.21.15.107:0/1732092334 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67e8140580 0x7f67e80a9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.414+0000 7f67ee000640 1 --2- 172.21.15.107:0/1732092334 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67e81401b0 0x7f67e8166e10 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.414+0000 7f67ee000640 1 --2- 172.21.15.107:0/1732092334 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67e80b1440 0x7f67e813f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.414+0000 7f67ee000640 1 -- 172.21.15.107:0/1732092334 >> 172.21.15.107:0/1732092334 conn(0x7f67e80cb9b0 msgr2=0x7f67e8069dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:24.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.414+0000 7f67ee000640 1 -- 172.21.15.107:0/1732092334 shutdown_connections 2024-08-17T02:25:24.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:24.414+0000 7f67ee000640 1 -- 172.21.15.107:0/1732092334 wait complete. 2024-08-17T02:25:24.431 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-08-17T02:25:23.415949+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2399584,"kb_used_data":4040,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752575136,"statfs":{"total":773094113280,"available":770636939264,"internally_reserved":0,"allocated":4136960,"data_stored":2292396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001121"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.696078+0000","last_change":"2024-08-17T02:25:18.688115+0000","last_active":"2024-08-17T02:25:18.696078+0000","last_peered":"2024-08-17T02:25:18.696078+0000","last_clean":"2024-08-17T02:25:18.696078+0000","last_became_active":"2024-08-17T02:25:18.687875+0000","last_became_peered":"2024-08-17T02:25:18.687875+0000","last_unstale":"2024-08-17T02:25:18.696078+0000","last_undegraded":"2024-08-17T02:25:18.696078+0000","last_fullsized":"2024-08-17T02:25:18.696078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:21:54.496023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.697662+0000","last_change":"2024-08-17T02:25:18.686834+0000","last_active":"2024-08-17T02:25:18.697662+0000","last_peered":"2024-08-17T02:25:18.697662+0000","last_clean":"2024-08-17T02:25:18.697662+0000","last_became_active":"2024-08-17T02:25:18.686669+0000","last_became_peered":"2024-08-17T02:25:18.686669+0000","last_unstale":"2024-08-17T02:25:18.697662+0000","last_undegraded":"2024-08-17T02:25:18.697662+0000","last_fullsized":"2024-08-17T02:25:18.697662+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:12:11.199988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.691325+0000","last_change":"2024-08-17T02:25:18.689104+0000","last_active":"2024-08-17T02:25:18.691325+0000","last_peered":"2024-08-17T02:25:18.691325+0000","last_clean":"2024-08-17T02:25:18.691325+0000","last_became_active":"2024-08-17T02:25:18.688407+0000","last_became_peered":"2024-08-17T02:25:18.688407+0000","last_unstale":"2024-08-17T02:25:18.691325+0000","last_undegraded":"2024-08-17T02:25:18.691325+0000","last_fullsized":"2024-08-17T02:25:18.691325+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:12:11.199988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.681831+0000","last_change":"2024-08-17T02:25:18.677810+0000","last_active":"2024-08-17T02:25:18.681831+0000","last_peered":"2024-08-17T02:25:18.681831+0000","last_clean":"2024-08-17T02:25:18.681831+0000","last_became_active":"2024-08-17T02:25:18.677248+0000","last_became_peered":"2024-08-17T02:25:18.677248+0000","last_unstale":"2024-08-17T02:25:18.681831+0000","last_undegraded":"2024-08-17T02:25:18.681831+0000","last_fullsized":"2024-08-17T02:25:18.681831+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:15:54.854019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.681872+0000","last_change":"2024-08-17T02:25:18.675364+0000","last_active":"2024-08-17T02:25:18.681872+0000","last_peered":"2024-08-17T02:25:18.681872+0000","last_clean":"2024-08-17T02:25:18.681872+0000","last_became_active":"2024-08-17T02:25:18.674787+0000","last_became_peered":"2024-08-17T02:25:18.674787+0000","last_unstale":"2024-08-17T02:25:18.681872+0000","last_undegraded":"2024-08-17T02:25:18.681872+0000","last_fullsized":"2024-08-17T02:25:18.681872+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:03:48.860389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.700312+0000","last_change":"2024-08-17T02:25:18.691428+0000","last_active":"2024-08-17T02:25:18.700312+0000","last_peered":"2024-08-17T02:25:18.700312+0000","last_clean":"2024-08-17T02:25:18.700312+0000","last_became_active":"2024-08-17T02:25:18.691171+0000","last_became_peered":"2024-08-17T02:25:18.691171+0000","last_unstale":"2024-08-17T02:25:18.700312+0000","last_undegraded":"2024-08-17T02:25:18.700312+0000","last_fullsized":"2024-08-17T02:25:18.700312+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:25.271173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.697661+0000","last_change":"2024-08-17T02:25:18.695337+0000","last_active":"2024-08-17T02:25:18.697661+0000","last_peered":"2024-08-17T02:25:18.697661+0000","last_clean":"2024-08-17T02:25:18.697661+0000","last_became_active":"2024-08-17T02:25:18.695069+0000","last_became_peered":"2024-08-17T02:25:18.695069+0000","last_unstale":"2024-08-17T02:25:18.697661+0000","last_undegraded":"2024-08-17T02:25:18.697661+0000","last_fullsized":"2024-08-17T02:25:18.697661+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:59:36.606411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.699526+0000","last_change":"2024-08-17T02:25:18.691322+0000","last_active":"2024-08-17T02:25:18.699526+0000","last_peered":"2024-08-17T02:25:18.699526+0000","last_clean":"2024-08-17T02:25:18.699526+0000","last_became_active":"2024-08-17T02:25:18.690483+0000","last_became_peered":"2024-08-17T02:25:18.690483+0000","last_unstale":"2024-08-17T02:25:18.699526+0000","last_undegraded":"2024-08-17T02:25:18.699526+0000","last_fullsized":"2024-08-17T02:25:18.699526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:15:35.080503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.691074+0000","last_change":"2024-08-17T02:25:18.687183+0000","last_active":"2024-08-17T02:25:18.691074+0000","last_peered":"2024-08-17T02:25:18.691074+0000","last_clean":"2024-08-17T02:25:18.691074+0000","last_became_active":"2024-08-17T02:25:18.686911+0000","last_became_peered":"2024-08-17T02:25:18.686911+0000","last_unstale":"2024-08-17T02:25:18.691074+0000","last_undegraded":"2024-08-17T02:25:18.691074+0000","last_fullsized":"2024-08-17T02:25:18.691074+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:53.854442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.702694+0000","last_change":"2024-08-17T02:25:18.694136+0000","last_active":"2024-08-17T02:25:18.702694+0000","last_peered":"2024-08-17T02:25:18.702694+0000","last_clean":"2024-08-17T02:25:18.702694+0000","last_became_active":"2024-08-17T02:25:18.693929+0000","last_became_peered":"2024-08-17T02:25:18.693929+0000","last_unstale":"2024-08-17T02:25:18.702694+0000","last_undegraded":"2024-08-17T02:25:18.702694+0000","last_fullsized":"2024-08-17T02:25:18.702694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:51:04.058113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.699061+0000","last_change":"2024-08-17T02:25:18.693611+0000","last_active":"2024-08-17T02:25:18.699061+0000","last_peered":"2024-08-17T02:25:18.699061+0000","last_clean":"2024-08-17T02:25:18.699061+0000","last_became_active":"2024-08-17T02:25:18.693393+0000","last_became_peered":"2024-08-17T02:25:18.693393+0000","last_unstale":"2024-08-17T02:25:18.699061+0000","last_undegraded":"2024-08-17T02:25:18.699061+0000","last_fullsized":"2024-08-17T02:25:18.699061+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:25.271173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.701781+0000","last_change":"2024-08-17T02:25:18.697695+0000","last_active":"2024-08-17T02:25:18.701781+0000","last_peered":"2024-08-17T02:25:18.701781+0000","last_clean":"2024-08-17T02:25:18.701781+0000","last_became_active":"2024-08-17T02:25:18.697406+0000","last_became_peered":"2024-08-17T02:25:18.697406+0000","last_unstale":"2024-08-17T02:25:18.701781+0000","last_undegraded":"2024-08-17T02:25:18.701781+0000","last_fullsized":"2024-08-17T02:25:18.701781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:26:05.015031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.692359+0000","last_change":"2024-08-17T02:25:18.683134+0000","last_active":"2024-08-17T02:25:18.692359+0000","last_peered":"2024-08-17T02:25:18.692359+0000","last_clean":"2024-08-17T02:25:18.692359+0000","last_became_active":"2024-08-17T02:25:18.681298+0000","last_became_peered":"2024-08-17T02:25:18.681298+0000","last_unstale":"2024-08-17T02:25:18.692359+0000","last_undegraded":"2024-08-17T02:25:18.692359+0000","last_fullsized":"2024-08-17T02:25:18.692359+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:11.664621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.700228+0000","last_change":"2024-08-17T02:25:18.690055+0000","last_active":"2024-08-17T02:25:18.700228+0000","last_peered":"2024-08-17T02:25:18.700228+0000","last_clean":"2024-08-17T02:25:18.700228+0000","last_became_active":"2024-08-17T02:25:18.689829+0000","last_became_peered":"2024-08-17T02:25:18.689829+0000","last_unstale":"2024-08-17T02:25:18.700228+0000","last_undegraded":"2024-08-17T02:25:18.700228+0000","last_fullsized":"2024-08-17T02:25:18.700228+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:38.896462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.702511+0000","last_change":"2024-08-17T02:25:18.698182+0000","last_active":"2024-08-17T02:25:18.702511+0000","last_peered":"2024-08-17T02:25:18.702511+0000","last_clean":"2024-08-17T02:25:18.702511+0000","last_became_active":"2024-08-17T02:25:18.697917+0000","last_became_peered":"2024-08-17T02:25:18.697917+0000","last_unstale":"2024-08-17T02:25:18.702511+0000","last_undegraded":"2024-08-17T02:25:18.702511+0000","last_fullsized":"2024-08-17T02:25:18.702511+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:28:51.002809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.702567+0000","last_change":"2024-08-17T02:25:18.699338+0000","last_active":"2024-08-17T02:25:18.702567+0000","last_peered":"2024-08-17T02:25:18.702567+0000","last_clean":"2024-08-17T02:25:18.702567+0000","last_became_active":"2024-08-17T02:25:18.698937+0000","last_became_peered":"2024-08-17T02:25:18.698937+0000","last_unstale":"2024-08-17T02:25:18.702567+0000","last_undegraded":"2024-08-17T02:25:18.702567+0000","last_fullsized":"2024-08-17T02:25:18.702567+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:26:05.015031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.702952+0000","last_change":"2024-08-17T02:25:18.701349+0000","last_active":"2024-08-17T02:25:18.702952+0000","last_peered":"2024-08-17T02:25:18.702952+0000","last_clean":"2024-08-17T02:25:18.702952+0000","last_became_active":"2024-08-17T02:25:18.701109+0000","last_became_peered":"2024-08-17T02:25:18.701109+0000","last_unstale":"2024-08-17T02:25:18.702952+0000","last_undegraded":"2024-08-17T02:25:18.702952+0000","last_fullsized":"2024-08-17T02:25:18.702952+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:58:50.210579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.701372+0000","last_change":"2024-08-17T02:25:18.698189+0000","last_active":"2024-08-17T02:25:18.701372+0000","last_peered":"2024-08-17T02:25:18.701372+0000","last_clean":"2024-08-17T02:25:18.701372+0000","last_became_active":"2024-08-17T02:25:18.697968+0000","last_became_peered":"2024-08-17T02:25:18.697968+0000","last_unstale":"2024-08-17T02:25:18.701372+0000","last_undegraded":"2024-08-17T02:25:18.701372+0000","last_fullsized":"2024-08-17T02:25:18.701372+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:19:35.711198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.700380+0000","last_change":"2024-08-17T02:25:18.692100+0000","last_active":"2024-08-17T02:25:18.700380+0000","last_peered":"2024-08-17T02:25:18.700380+0000","last_clean":"2024-08-17T02:25:18.700380+0000","last_became_active":"2024-08-17T02:25:18.687629+0000","last_became_peered":"2024-08-17T02:25:18.687629+0000","last_unstale":"2024-08-17T02:25:18.700380+0000","last_undegraded":"2024-08-17T02:25:18.700380+0000","last_fullsized":"2024-08-17T02:25:18.700380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:37:41.942948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.696560+0000","last_change":"2024-08-17T02:25:18.688705+0000","last_active":"2024-08-17T02:25:18.696560+0000","last_peered":"2024-08-17T02:25:18.696560+0000","last_clean":"2024-08-17T02:25:18.696560+0000","last_became_active":"2024-08-17T02:25:18.686153+0000","last_became_peered":"2024-08-17T02:25:18.686153+0000","last_unstale":"2024-08-17T02:25:18.696560+0000","last_undegraded":"2024-08-17T02:25:18.696560+0000","last_fullsized":"2024-08-17T02:25:18.696560+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:48:26.689294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.687889+0000","last_change":"2024-08-17T02:25:18.680573+0000","last_active":"2024-08-17T02:25:18.687889+0000","last_peered":"2024-08-17T02:25:18.687889+0000","last_clean":"2024-08-17T02:25:18.687889+0000","last_became_active":"2024-08-17T02:25:18.680323+0000","last_became_peered":"2024-08-17T02:25:18.680323+0000","last_unstale":"2024-08-17T02:25:18.687889+0000","last_undegraded":"2024-08-17T02:25:18.687889+0000","last_fullsized":"2024-08-17T02:25:18.687889+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:21:54.496023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.689396+0000","last_change":"2024-08-17T02:25:18.686075+0000","last_active":"2024-08-17T02:25:18.689396+0000","last_peered":"2024-08-17T02:25:18.689396+0000","last_clean":"2024-08-17T02:25:18.689396+0000","last_became_active":"2024-08-17T02:25:18.685806+0000","last_became_peered":"2024-08-17T02:25:18.685806+0000","last_unstale":"2024-08-17T02:25:18.689396+0000","last_undegraded":"2024-08-17T02:25:18.689396+0000","last_fullsized":"2024-08-17T02:25:18.689396+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:58:50.210579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.688919+0000","last_change":"2024-08-17T02:25:18.685685+0000","last_active":"2024-08-17T02:25:18.688919+0000","last_peered":"2024-08-17T02:25:18.688919+0000","last_clean":"2024-08-17T02:25:18.688919+0000","last_became_active":"2024-08-17T02:25:18.683333+0000","last_became_peered":"2024-08-17T02:25:18.683333+0000","last_unstale":"2024-08-17T02:25:18.688919+0000","last_undegraded":"2024-08-17T02:25:18.688919+0000","last_fullsized":"2024-08-17T02:25:18.688919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:23.240941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.691179+0000","last_change":"2024-08-17T02:25:18.688254+0000","last_active":"2024-08-17T02:25:18.691179+0000","last_peered":"2024-08-17T02:25:18.691179+0000","last_clean":"2024-08-17T02:25:18.691179+0000","last_became_active":"2024-08-17T02:25:18.687954+0000","last_became_peered":"2024-08-17T02:25:18.687954+0000","last_unstale":"2024-08-17T02:25:18.691179+0000","last_undegraded":"2024-08-17T02:25:18.691179+0000","last_fullsized":"2024-08-17T02:25:18.691179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:22:19.225830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.689310+0000","last_change":"2024-08-17T02:25:18.684233+0000","last_active":"2024-08-17T02:25:18.689310+0000","last_peered":"2024-08-17T02:25:18.689310+0000","last_clean":"2024-08-17T02:25:18.689310+0000","last_became_active":"2024-08-17T02:25:18.684000+0000","last_became_peered":"2024-08-17T02:25:18.684000+0000","last_unstale":"2024-08-17T02:25:18.689310+0000","last_undegraded":"2024-08-17T02:25:18.689310+0000","last_fullsized":"2024-08-17T02:25:18.689310+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:22:19.225830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.692142+0000","last_change":"2024-08-17T02:25:18.685525+0000","last_active":"2024-08-17T02:25:18.692142+0000","last_peered":"2024-08-17T02:25:18.692142+0000","last_clean":"2024-08-17T02:25:18.692142+0000","last_became_active":"2024-08-17T02:25:18.685305+0000","last_became_peered":"2024-08-17T02:25:18.685305+0000","last_unstale":"2024-08-17T02:25:18.692142+0000","last_undegraded":"2024-08-17T02:25:18.692142+0000","last_fullsized":"2024-08-17T02:25:18.692142+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:25:47.932042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.689316+0000","last_change":"2024-08-17T02:25:18.679317+0000","last_active":"2024-08-17T02:25:18.689316+0000","last_peered":"2024-08-17T02:25:18.689316+0000","last_clean":"2024-08-17T02:25:18.689316+0000","last_became_active":"2024-08-17T02:25:18.677699+0000","last_became_peered":"2024-08-17T02:25:18.677699+0000","last_unstale":"2024-08-17T02:25:18.689316+0000","last_undegraded":"2024-08-17T02:25:18.689316+0000","last_fullsized":"2024-08-17T02:25:18.689316+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:55:29.782118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.695115+0000","last_change":"2024-08-17T02:25:18.688723+0000","last_active":"2024-08-17T02:25:18.695115+0000","last_peered":"2024-08-17T02:25:18.695115+0000","last_clean":"2024-08-17T02:25:18.695115+0000","last_became_active":"2024-08-17T02:25:18.688436+0000","last_became_peered":"2024-08-17T02:25:18.688436+0000","last_unstale":"2024-08-17T02:25:18.695115+0000","last_undegraded":"2024-08-17T02:25:18.695115+0000","last_fullsized":"2024-08-17T02:25:18.695115+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:57:45.497406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.687909+0000","last_change":"2024-08-17T02:25:18.683787+0000","last_active":"2024-08-17T02:25:18.687909+0000","last_peered":"2024-08-17T02:25:18.687909+0000","last_clean":"2024-08-17T02:25:18.687909+0000","last_became_active":"2024-08-17T02:25:18.678310+0000","last_became_peered":"2024-08-17T02:25:18.678310+0000","last_unstale":"2024-08-17T02:25:18.687909+0000","last_undegraded":"2024-08-17T02:25:18.687909+0000","last_fullsized":"2024-08-17T02:25:18.687909+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:59:36.606411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.697627+0000","last_change":"2024-08-17T02:25:18.695053+0000","last_active":"2024-08-17T02:25:18.697627+0000","last_peered":"2024-08-17T02:25:18.697627+0000","last_clean":"2024-08-17T02:25:18.697627+0000","last_became_active":"2024-08-17T02:25:18.694747+0000","last_became_peered":"2024-08-17T02:25:18.694747+0000","last_unstale":"2024-08-17T02:25:18.697627+0000","last_undegraded":"2024-08-17T02:25:18.697627+0000","last_fullsized":"2024-08-17T02:25:18.697627+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:28:51.002809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.700418+0000","last_change":"2024-08-17T02:25:18.689116+0000","last_active":"2024-08-17T02:25:18.700418+0000","last_peered":"2024-08-17T02:25:18.700418+0000","last_clean":"2024-08-17T02:25:18.700418+0000","last_became_active":"2024-08-17T02:25:18.688871+0000","last_became_peered":"2024-08-17T02:25:18.688871+0000","last_unstale":"2024-08-17T02:25:18.700418+0000","last_undegraded":"2024-08-17T02:25:18.700418+0000","last_fullsized":"2024-08-17T02:25:18.700418+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:57:04.094952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.702603+0000","last_change":"2024-08-17T02:25:18.699667+0000","last_active":"2024-08-17T02:25:18.702603+0000","last_peered":"2024-08-17T02:25:18.702603+0000","last_clean":"2024-08-17T02:25:18.702603+0000","last_became_active":"2024-08-17T02:25:18.699332+0000","last_became_peered":"2024-08-17T02:25:18.699332+0000","last_unstale":"2024-08-17T02:25:18.702603+0000","last_undegraded":"2024-08-17T02:25:18.702603+0000","last_fullsized":"2024-08-17T02:25:18.702603+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:38.896462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.686194+0000","last_change":"2024-08-17T02:25:18.680597+0000","last_active":"2024-08-17T02:25:18.686194+0000","last_peered":"2024-08-17T02:25:18.686194+0000","last_clean":"2024-08-17T02:25:18.686194+0000","last_became_active":"2024-08-17T02:25:18.680329+0000","last_became_peered":"2024-08-17T02:25:18.680329+0000","last_unstale":"2024-08-17T02:25:18.686194+0000","last_undegraded":"2024-08-17T02:25:18.686194+0000","last_fullsized":"2024-08-17T02:25:18.686194+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:59:36.606411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.695905+0000","last_change":"2024-08-17T02:25:17.681025+0000","last_active":"2024-08-17T02:25:18.695905+0000","last_peered":"2024-08-17T02:25:18.695905+0000","last_clean":"2024-08-17T02:25:18.695905+0000","last_became_active":"2024-08-17T02:25:17.680756+0000","last_became_peered":"2024-08-17T02:25:17.680756+0000","last_unstale":"2024-08-17T02:25:18.695905+0000","last_undegraded":"2024-08-17T02:25:18.695905+0000","last_fullsized":"2024-08-17T02:25:18.695905+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:08:42.813501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.696008+0000","last_change":"2024-08-17T02:25:18.686948+0000","last_active":"2024-08-17T02:25:18.696008+0000","last_peered":"2024-08-17T02:25:18.696008+0000","last_clean":"2024-08-17T02:25:18.696008+0000","last_became_active":"2024-08-17T02:25:18.686700+0000","last_became_peered":"2024-08-17T02:25:18.686700+0000","last_unstale":"2024-08-17T02:25:18.696008+0000","last_undegraded":"2024-08-17T02:25:18.696008+0000","last_fullsized":"2024-08-17T02:25:18.696008+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:59:36.606411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.686111+0000","last_change":"2024-08-17T02:25:17.682308+0000","last_active":"2024-08-17T02:25:18.686111+0000","last_peered":"2024-08-17T02:25:18.686111+0000","last_clean":"2024-08-17T02:25:18.686111+0000","last_became_active":"2024-08-17T02:25:17.682087+0000","last_became_peered":"2024-08-17T02:25:17.682087+0000","last_unstale":"2024-08-17T02:25:18.686111+0000","last_undegraded":"2024-08-17T02:25:18.686111+0000","last_fullsized":"2024-08-17T02:25:18.686111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:03:34.957853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.690825+0000","last_change":"2024-08-17T02:25:18.688198+0000","last_active":"2024-08-17T02:25:18.690825+0000","last_peered":"2024-08-17T02:25:18.690825+0000","last_clean":"2024-08-17T02:25:18.690825+0000","last_became_active":"2024-08-17T02:25:18.687994+0000","last_became_peered":"2024-08-17T02:25:18.687994+0000","last_unstale":"2024-08-17T02:25:18.690825+0000","last_undegraded":"2024-08-17T02:25:18.690825+0000","last_fullsized":"2024-08-17T02:25:18.690825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:23.240941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.702553+0000","last_change":"2024-08-17T02:25:17.689951+0000","last_active":"2024-08-17T02:25:18.702553+0000","last_peered":"2024-08-17T02:25:18.702553+0000","last_clean":"2024-08-17T02:25:18.702553+0000","last_became_active":"2024-08-17T02:25:17.689705+0000","last_became_peered":"2024-08-17T02:25:17.689705+0000","last_unstale":"2024-08-17T02:25:18.702553+0000","last_undegraded":"2024-08-17T02:25:18.702553+0000","last_fullsized":"2024-08-17T02:25:18.702553+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:29:57.578020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.689337+0000","last_change":"2024-08-17T02:25:18.679557+0000","last_active":"2024-08-17T02:25:18.689337+0000","last_peered":"2024-08-17T02:25:18.689337+0000","last_clean":"2024-08-17T02:25:18.689337+0000","last_became_active":"2024-08-17T02:25:18.679031+0000","last_became_peered":"2024-08-17T02:25:18.679031+0000","last_unstale":"2024-08-17T02:25:18.689337+0000","last_undegraded":"2024-08-17T02:25:18.689337+0000","last_fullsized":"2024-08-17T02:25:18.689337+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:46:17.633686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.692393+0000","last_change":"2024-08-17T02:25:17.686605+0000","last_active":"2024-08-17T02:25:18.692393+0000","last_peered":"2024-08-17T02:25:18.692393+0000","last_clean":"2024-08-17T02:25:18.692393+0000","last_became_active":"2024-08-17T02:25:17.686028+0000","last_became_peered":"2024-08-17T02:25:17.686028+0000","last_unstale":"2024-08-17T02:25:18.692393+0000","last_undegraded":"2024-08-17T02:25:18.692393+0000","last_fullsized":"2024-08-17T02:25:18.692393+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:21:56.218636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.697611+0000","last_change":"2024-08-17T02:25:18.692115+0000","last_active":"2024-08-17T02:25:18.697611+0000","last_peered":"2024-08-17T02:25:18.697611+0000","last_clean":"2024-08-17T02:25:18.697611+0000","last_became_active":"2024-08-17T02:25:18.691884+0000","last_became_peered":"2024-08-17T02:25:18.691884+0000","last_unstale":"2024-08-17T02:25:18.697611+0000","last_undegraded":"2024-08-17T02:25:18.697611+0000","last_fullsized":"2024-08-17T02:25:18.697611+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:51:04.058113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.702072+0000","last_change":"2024-08-17T02:25:17.681949+0000","last_active":"2024-08-17T02:25:18.702072+0000","last_peered":"2024-08-17T02:25:18.702072+0000","last_clean":"2024-08-17T02:25:18.702072+0000","last_became_active":"2024-08-17T02:25:17.681666+0000","last_became_peered":"2024-08-17T02:25:17.681666+0000","last_unstale":"2024-08-17T02:25:18.702072+0000","last_undegraded":"2024-08-17T02:25:18.702072+0000","last_fullsized":"2024-08-17T02:25:18.702072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:50.528508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.701618+0000","last_change":"2024-08-17T02:25:18.693575+0000","last_active":"2024-08-17T02:25:18.701618+0000","last_peered":"2024-08-17T02:25:18.701618+0000","last_clean":"2024-08-17T02:25:18.701618+0000","last_became_active":"2024-08-17T02:25:18.693247+0000","last_became_peered":"2024-08-17T02:25:18.693247+0000","last_unstale":"2024-08-17T02:25:18.701618+0000","last_undegraded":"2024-08-17T02:25:18.701618+0000","last_fullsized":"2024-08-17T02:25:18.701618+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:15:59.138809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.701126+0000","last_change":"2024-08-17T02:25:17.685024+0000","last_active":"2024-08-17T02:25:18.701126+0000","last_peered":"2024-08-17T02:25:18.701126+0000","last_clean":"2024-08-17T02:25:18.701126+0000","last_became_active":"2024-08-17T02:25:17.683666+0000","last_became_peered":"2024-08-17T02:25:17.683666+0000","last_unstale":"2024-08-17T02:25:18.701126+0000","last_undegraded":"2024-08-17T02:25:18.701126+0000","last_fullsized":"2024-08-17T02:25:18.701126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:41:06.837768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.696244+0000","last_change":"2024-08-17T02:25:18.691520+0000","last_active":"2024-08-17T02:25:18.696244+0000","last_peered":"2024-08-17T02:25:18.696244+0000","last_clean":"2024-08-17T02:25:18.696244+0000","last_became_active":"2024-08-17T02:25:18.691241+0000","last_became_peered":"2024-08-17T02:25:18.691241+0000","last_unstale":"2024-08-17T02:25:18.696244+0000","last_undegraded":"2024-08-17T02:25:18.696244+0000","last_fullsized":"2024-08-17T02:25:18.696244+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:57:04.094952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.676809+0000","last_change":"2024-08-17T02:25:17.679314+0000","last_active":"2024-08-17T02:25:18.676809+0000","last_peered":"2024-08-17T02:25:18.676809+0000","last_clean":"2024-08-17T02:25:18.676809+0000","last_became_active":"2024-08-17T02:25:17.679068+0000","last_became_peered":"2024-08-17T02:25:17.679068+0000","last_unstale":"2024-08-17T02:25:18.676809+0000","last_undegraded":"2024-08-17T02:25:18.676809+0000","last_fullsized":"2024-08-17T02:25:18.676809+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:44:16.038254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.689662+0000","last_change":"2024-08-17T02:25:18.682667+0000","last_active":"2024-08-17T02:25:18.689662+0000","last_peered":"2024-08-17T02:25:18.689662+0000","last_clean":"2024-08-17T02:25:18.689662+0000","last_became_active":"2024-08-17T02:25:18.682349+0000","last_became_peered":"2024-08-17T02:25:18.682349+0000","last_unstale":"2024-08-17T02:25:18.689662+0000","last_undegraded":"2024-08-17T02:25:18.689662+0000","last_fullsized":"2024-08-17T02:25:18.689662+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:29:07.794780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.666463+0000","last_change":"2024-08-17T02:25:17.673242+0000","last_active":"2024-08-17T02:25:18.666463+0000","last_peered":"2024-08-17T02:25:18.666463+0000","last_clean":"2024-08-17T02:25:18.666463+0000","last_became_active":"2024-08-17T02:25:17.672957+0000","last_became_peered":"2024-08-17T02:25:17.672957+0000","last_unstale":"2024-08-17T02:25:18.666463+0000","last_undegraded":"2024-08-17T02:25:18.666463+0000","last_fullsized":"2024-08-17T02:25:18.666463+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:38:08.511096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.701620+0000","last_change":"2024-08-17T02:25:18.694604+0000","last_active":"2024-08-17T02:25:18.701620+0000","last_peered":"2024-08-17T02:25:18.701620+0000","last_clean":"2024-08-17T02:25:18.701620+0000","last_became_active":"2024-08-17T02:25:18.694373+0000","last_became_peered":"2024-08-17T02:25:18.694373+0000","last_unstale":"2024-08-17T02:25:18.701620+0000","last_undegraded":"2024-08-17T02:25:18.701620+0000","last_fullsized":"2024-08-17T02:25:18.701620+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:15:35.080503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.675230+0000","last_change":"2024-08-17T02:25:17.681879+0000","last_active":"2024-08-17T02:25:18.675230+0000","last_peered":"2024-08-17T02:25:18.675230+0000","last_clean":"2024-08-17T02:25:18.675230+0000","last_became_active":"2024-08-17T02:25:17.681624+0000","last_became_peered":"2024-08-17T02:25:17.681624+0000","last_unstale":"2024-08-17T02:25:18.675230+0000","last_undegraded":"2024-08-17T02:25:18.675230+0000","last_fullsized":"2024-08-17T02:25:18.675230+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:21:53.489386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.700468+0000","last_change":"2024-08-17T02:25:18.694622+0000","last_active":"2024-08-17T02:25:18.700468+0000","last_peered":"2024-08-17T02:25:18.700468+0000","last_clean":"2024-08-17T02:25:18.700468+0000","last_became_active":"2024-08-17T02:25:18.694388+0000","last_became_peered":"2024-08-17T02:25:18.694388+0000","last_unstale":"2024-08-17T02:25:18.700468+0000","last_undegraded":"2024-08-17T02:25:18.700468+0000","last_fullsized":"2024-08-17T02:25:18.700468+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:14:51.437597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.664893+0000","last_change":"2024-08-17T02:25:17.676989+0000","last_active":"2024-08-17T02:25:18.664893+0000","last_peered":"2024-08-17T02:25:18.664893+0000","last_clean":"2024-08-17T02:25:18.664893+0000","last_became_active":"2024-08-17T02:25:17.676554+0000","last_became_peered":"2024-08-17T02:25:17.676554+0000","last_unstale":"2024-08-17T02:25:18.664893+0000","last_undegraded":"2024-08-17T02:25:18.664893+0000","last_fullsized":"2024-08-17T02:25:18.664893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:10.657983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.696437+0000","last_change":"2024-08-17T02:25:18.684310+0000","last_active":"2024-08-17T02:25:18.696437+0000","last_peered":"2024-08-17T02:25:18.696437+0000","last_clean":"2024-08-17T02:25:18.696437+0000","last_became_active":"2024-08-17T02:25:18.684066+0000","last_became_peered":"2024-08-17T02:25:18.684066+0000","last_unstale":"2024-08-17T02:25:18.696437+0000","last_undegraded":"2024-08-17T02:25:18.696437+0000","last_fullsized":"2024-08-17T02:25:18.696437+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:41:04.504523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.700827+0000","last_change":"2024-08-17T02:25:17.682039+0000","last_active":"2024-08-17T02:25:18.700827+0000","last_peered":"2024-08-17T02:25:18.700827+0000","last_clean":"2024-08-17T02:25:18.700827+0000","last_became_active":"2024-08-17T02:25:17.681753+0000","last_became_peered":"2024-08-17T02:25:17.681753+0000","last_unstale":"2024-08-17T02:25:18.700827+0000","last_undegraded":"2024-08-17T02:25:18.700827+0000","last_fullsized":"2024-08-17T02:25:18.700827+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:57:03.088315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.691347+0000","last_change":"2024-08-17T02:25:18.689244+0000","last_active":"2024-08-17T02:25:18.691347+0000","last_peered":"2024-08-17T02:25:18.691347+0000","last_clean":"2024-08-17T02:25:18.691347+0000","last_became_active":"2024-08-17T02:25:18.688773+0000","last_became_peered":"2024-08-17T02:25:18.688773+0000","last_unstale":"2024-08-17T02:25:18.691347+0000","last_undegraded":"2024-08-17T02:25:18.691347+0000","last_fullsized":"2024-08-17T02:25:18.691347+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:38.896462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.704817+0000","last_change":"2024-08-17T02:25:17.688038+0000","last_active":"2024-08-17T02:25:18.704817+0000","last_peered":"2024-08-17T02:25:18.704817+0000","last_clean":"2024-08-17T02:25:18.704817+0000","last_became_active":"2024-08-17T02:25:17.687784+0000","last_became_peered":"2024-08-17T02:25:17.687784+0000","last_unstale":"2024-08-17T02:25:18.704817+0000","last_undegraded":"2024-08-17T02:25:18.704817+0000","last_fullsized":"2024-08-17T02:25:18.704817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:03:34.957853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.698164+0000","last_change":"2024-08-17T02:25:18.688857+0000","last_active":"2024-08-17T02:25:18.698164+0000","last_peered":"2024-08-17T02:25:18.698164+0000","last_clean":"2024-08-17T02:25:18.698164+0000","last_became_active":"2024-08-17T02:25:18.687321+0000","last_became_peered":"2024-08-17T02:25:18.687321+0000","last_unstale":"2024-08-17T02:25:18.698164+0000","last_undegraded":"2024-08-17T02:25:18.698164+0000","last_fullsized":"2024-08-17T02:25:18.698164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:15:59.138809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.701718+0000","last_change":"2024-08-17T02:25:17.676792+0000","last_active":"2024-08-17T02:25:18.701718+0000","last_peered":"2024-08-17T02:25:18.701718+0000","last_clean":"2024-08-17T02:25:18.701718+0000","last_became_active":"2024-08-17T02:25:17.673989+0000","last_became_peered":"2024-08-17T02:25:17.673989+0000","last_unstale":"2024-08-17T02:25:18.701718+0000","last_undegraded":"2024-08-17T02:25:18.701718+0000","last_fullsized":"2024-08-17T02:25:18.701718+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:17.604015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.690106+0000","last_change":"2024-08-17T02:25:18.680024+0000","last_active":"2024-08-17T02:25:18.690106+0000","last_peered":"2024-08-17T02:25:18.690106+0000","last_clean":"2024-08-17T02:25:18.690106+0000","last_became_active":"2024-08-17T02:25:18.679782+0000","last_became_peered":"2024-08-17T02:25:18.679782+0000","last_unstale":"2024-08-17T02:25:18.690106+0000","last_undegraded":"2024-08-17T02:25:18.690106+0000","last_fullsized":"2024-08-17T02:25:18.690106+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:28:51.002809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.682478+0000","last_change":"2024-08-17T02:25:17.685576+0000","last_active":"2024-08-17T02:25:18.682478+0000","last_peered":"2024-08-17T02:25:18.682478+0000","last_clean":"2024-08-17T02:25:18.682478+0000","last_became_active":"2024-08-17T02:25:17.685314+0000","last_became_peered":"2024-08-17T02:25:17.685314+0000","last_unstale":"2024-08-17T02:25:18.682478+0000","last_undegraded":"2024-08-17T02:25:18.682478+0000","last_fullsized":"2024-08-17T02:25:18.682478+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:14:21.868403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.702586+0000","last_change":"2024-08-17T02:25:18.699544+0000","last_active":"2024-08-17T02:25:18.702586+0000","last_peered":"2024-08-17T02:25:18.702586+0000","last_clean":"2024-08-17T02:25:18.702586+0000","last_became_active":"2024-08-17T02:25:18.699066+0000","last_became_peered":"2024-08-17T02:25:18.699066+0000","last_unstale":"2024-08-17T02:25:18.702586+0000","last_undegraded":"2024-08-17T02:25:18.702586+0000","last_fullsized":"2024-08-17T02:25:18.702586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:12:11.199988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.676895+0000","last_change":"2024-08-17T02:25:17.687390+0000","last_active":"2024-08-17T02:25:18.676895+0000","last_peered":"2024-08-17T02:25:18.676895+0000","last_clean":"2024-08-17T02:25:18.676895+0000","last_became_active":"2024-08-17T02:25:17.687168+0000","last_became_peered":"2024-08-17T02:25:17.687168+0000","last_unstale":"2024-08-17T02:25:18.676895+0000","last_undegraded":"2024-08-17T02:25:18.676895+0000","last_fullsized":"2024-08-17T02:25:18.676895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:34:39.313004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.700437+0000","last_change":"2024-08-17T02:25:18.693643+0000","last_active":"2024-08-17T02:25:18.700437+0000","last_peered":"2024-08-17T02:25:18.700437+0000","last_clean":"2024-08-17T02:25:18.700437+0000","last_became_active":"2024-08-17T02:25:18.693204+0000","last_became_peered":"2024-08-17T02:25:18.693204+0000","last_unstale":"2024-08-17T02:25:18.700437+0000","last_undegraded":"2024-08-17T02:25:18.700437+0000","last_fullsized":"2024-08-17T02:25:18.700437+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:44:17.044891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.703683+0000","last_change":"2024-08-17T02:25:17.684571+0000","last_active":"2024-08-17T02:25:18.703683+0000","last_peered":"2024-08-17T02:25:18.703683+0000","last_clean":"2024-08-17T02:25:18.703683+0000","last_became_active":"2024-08-17T02:25:17.684008+0000","last_became_peered":"2024-08-17T02:25:17.684008+0000","last_unstale":"2024-08-17T02:25:18.703683+0000","last_undegraded":"2024-08-17T02:25:18.703683+0000","last_fullsized":"2024-08-17T02:25:18.703683+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:02.630816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.696209+0000","last_change":"2024-08-17T02:25:18.691629+0000","last_active":"2024-08-17T02:25:18.696209+0000","last_peered":"2024-08-17T02:25:18.696209+0000","last_clean":"2024-08-17T02:25:18.696209+0000","last_became_active":"2024-08-17T02:25:18.690619+0000","last_became_peered":"2024-08-17T02:25:18.690619+0000","last_unstale":"2024-08-17T02:25:18.696209+0000","last_undegraded":"2024-08-17T02:25:18.696209+0000","last_fullsized":"2024-08-17T02:25:18.696209+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:29:58.584657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.703518+0000","last_change":"2024-08-17T02:25:17.690425+0000","last_active":"2024-08-17T02:25:18.703518+0000","last_peered":"2024-08-17T02:25:18.703518+0000","last_clean":"2024-08-17T02:25:18.703518+0000","last_became_active":"2024-08-17T02:25:17.690138+0000","last_became_peered":"2024-08-17T02:25:17.690138+0000","last_unstale":"2024-08-17T02:25:18.703518+0000","last_undegraded":"2024-08-17T02:25:18.703518+0000","last_fullsized":"2024-08-17T02:25:18.703518+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:34:39.313004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.698332+0000","last_change":"2024-08-17T02:25:18.692029+0000","last_active":"2024-08-17T02:25:18.698332+0000","last_peered":"2024-08-17T02:25:18.698332+0000","last_clean":"2024-08-17T02:25:18.698332+0000","last_became_active":"2024-08-17T02:25:18.691758+0000","last_became_peered":"2024-08-17T02:25:18.691758+0000","last_unstale":"2024-08-17T02:25:18.698332+0000","last_undegraded":"2024-08-17T02:25:18.698332+0000","last_fullsized":"2024-08-17T02:25:18.698332+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:51:04.058113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.696791+0000","last_change":"2024-08-17T02:25:17.673862+0000","last_active":"2024-08-17T02:25:18.696791+0000","last_peered":"2024-08-17T02:25:18.696791+0000","last_clean":"2024-08-17T02:25:18.696791+0000","last_became_active":"2024-08-17T02:25:17.673608+0000","last_became_peered":"2024-08-17T02:25:17.673608+0000","last_unstale":"2024-08-17T02:25:18.696791+0000","last_undegraded":"2024-08-17T02:25:18.696791+0000","last_fullsized":"2024-08-17T02:25:18.696791+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:18:32.501730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.681849+0000","last_change":"2024-08-17T02:25:18.677970+0000","last_active":"2024-08-17T02:25:18.681849+0000","last_peered":"2024-08-17T02:25:18.681849+0000","last_clean":"2024-08-17T02:25:18.681849+0000","last_became_active":"2024-08-17T02:25:18.677588+0000","last_became_peered":"2024-08-17T02:25:18.677588+0000","last_unstale":"2024-08-17T02:25:18.681849+0000","last_undegraded":"2024-08-17T02:25:18.681849+0000","last_fullsized":"2024-08-17T02:25:18.681849+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:57:45.497406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.696113+0000","last_change":"2024-08-17T02:25:17.677042+0000","last_active":"2024-08-17T02:25:18.696113+0000","last_peered":"2024-08-17T02:25:18.696113+0000","last_clean":"2024-08-17T02:25:18.696113+0000","last_became_active":"2024-08-17T02:25:17.676166+0000","last_became_peered":"2024-08-17T02:25:17.676166+0000","last_unstale":"2024-08-17T02:25:18.696113+0000","last_undegraded":"2024-08-17T02:25:18.696113+0000","last_fullsized":"2024-08-17T02:25:18.696113+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:43:30.288480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.692251+0000","last_change":"2024-08-17T02:25:18.683115+0000","last_active":"2024-08-17T02:25:18.692251+0000","last_peered":"2024-08-17T02:25:18.692251+0000","last_clean":"2024-08-17T02:25:18.692251+0000","last_became_active":"2024-08-17T02:25:18.682850+0000","last_became_peered":"2024-08-17T02:25:18.682850+0000","last_unstale":"2024-08-17T02:25:18.692251+0000","last_undegraded":"2024-08-17T02:25:18.692251+0000","last_fullsized":"2024-08-17T02:25:18.692251+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:03:35.964491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.669358+0000","last_change":"2024-08-17T02:25:17.680896+0000","last_active":"2024-08-17T02:25:18.669358+0000","last_peered":"2024-08-17T02:25:18.669358+0000","last_clean":"2024-08-17T02:25:18.669358+0000","last_became_active":"2024-08-17T02:25:17.680609+0000","last_became_peered":"2024-08-17T02:25:17.680609+0000","last_unstale":"2024-08-17T02:25:18.669358+0000","last_undegraded":"2024-08-17T02:25:18.669358+0000","last_fullsized":"2024-08-17T02:25:18.669358+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:08:36.844257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.685384+0000","last_change":"2024-08-17T02:25:18.680147+0000","last_active":"2024-08-17T02:25:18.685384+0000","last_peered":"2024-08-17T02:25:18.685384+0000","last_clean":"2024-08-17T02:25:18.685384+0000","last_became_active":"2024-08-17T02:25:18.679880+0000","last_became_peered":"2024-08-17T02:25:18.679880+0000","last_unstale":"2024-08-17T02:25:18.685384+0000","last_undegraded":"2024-08-17T02:25:18.685384+0000","last_fullsized":"2024-08-17T02:25:18.685384+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:51.535145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.690413+0000","last_change":"2024-08-17T02:25:17.687610+0000","last_active":"2024-08-17T02:25:18.690413+0000","last_peered":"2024-08-17T02:25:18.690413+0000","last_clean":"2024-08-17T02:25:18.690413+0000","last_became_active":"2024-08-17T02:25:17.687268+0000","last_became_peered":"2024-08-17T02:25:17.687268+0000","last_unstale":"2024-08-17T02:25:18.690413+0000","last_undegraded":"2024-08-17T02:25:18.690413+0000","last_fullsized":"2024-08-17T02:25:18.690413+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:03:47.853752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.682985+0000","last_change":"2024-08-17T02:25:18.675577+0000","last_active":"2024-08-17T02:25:18.682985+0000","last_peered":"2024-08-17T02:25:18.682985+0000","last_clean":"2024-08-17T02:25:18.682985+0000","last_became_active":"2024-08-17T02:25:18.675124+0000","last_became_peered":"2024-08-17T02:25:18.675124+0000","last_unstale":"2024-08-17T02:25:18.682985+0000","last_undegraded":"2024-08-17T02:25:18.682985+0000","last_fullsized":"2024-08-17T02:25:18.682985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:54:10.958249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.680385+0000","last_change":"2024-08-17T02:25:17.692433+0000","last_active":"2024-08-17T02:25:18.680385+0000","last_peered":"2024-08-17T02:25:18.680385+0000","last_clean":"2024-08-17T02:25:18.680385+0000","last_became_active":"2024-08-17T02:25:17.692172+0000","last_became_peered":"2024-08-17T02:25:17.692172+0000","last_unstale":"2024-08-17T02:25:18.680385+0000","last_undegraded":"2024-08-17T02:25:18.680385+0000","last_fullsized":"2024-08-17T02:25:18.680385+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:48:25.682657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.683983+0000","last_change":"2024-08-17T02:25:18.678202+0000","last_active":"2024-08-17T02:25:18.683983+0000","last_peered":"2024-08-17T02:25:18.683983+0000","last_clean":"2024-08-17T02:25:18.683983+0000","last_became_active":"2024-08-17T02:25:18.675448+0000","last_became_peered":"2024-08-17T02:25:18.675448+0000","last_unstale":"2024-08-17T02:25:18.683983+0000","last_undegraded":"2024-08-17T02:25:18.683983+0000","last_fullsized":"2024-08-17T02:25:18.683983+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:08:37.850894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.667123+0000","last_change":"2024-08-17T02:25:17.686038+0000","last_active":"2024-08-17T02:25:18.667123+0000","last_peered":"2024-08-17T02:25:18.667123+0000","last_clean":"2024-08-17T02:25:18.667123+0000","last_became_active":"2024-08-17T02:25:17.685788+0000","last_became_peered":"2024-08-17T02:25:17.685788+0000","last_unstale":"2024-08-17T02:25:18.667123+0000","last_undegraded":"2024-08-17T02:25:18.667123+0000","last_fullsized":"2024-08-17T02:25:18.667123+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:00:25.851171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.699193+0000","last_change":"2024-08-17T02:25:18.697276+0000","last_active":"2024-08-17T02:25:18.699193+0000","last_peered":"2024-08-17T02:25:18.699193+0000","last_clean":"2024-08-17T02:25:18.699193+0000","last_became_active":"2024-08-17T02:25:18.694659+0000","last_became_peered":"2024-08-17T02:25:18.694659+0000","last_unstale":"2024-08-17T02:25:18.699193+0000","last_undegraded":"2024-08-17T02:25:18.699193+0000","last_fullsized":"2024-08-17T02:25:18.699193+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:03.637453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.676552+0000","last_change":"2024-08-17T02:25:17.688649+0000","last_active":"2024-08-17T02:25:18.676552+0000","last_peered":"2024-08-17T02:25:18.676552+0000","last_clean":"2024-08-17T02:25:18.676552+0000","last_became_active":"2024-08-17T02:25:17.688290+0000","last_became_peered":"2024-08-17T02:25:17.688290+0000","last_unstale":"2024-08-17T02:25:18.676552+0000","last_undegraded":"2024-08-17T02:25:18.676552+0000","last_fullsized":"2024-08-17T02:25:18.676552+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:29:57.578020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.693587+0000","last_change":"2024-08-17T02:25:18.686927+0000","last_active":"2024-08-17T02:25:18.693587+0000","last_peered":"2024-08-17T02:25:18.693587+0000","last_clean":"2024-08-17T02:25:18.693587+0000","last_became_active":"2024-08-17T02:25:18.686700+0000","last_became_peered":"2024-08-17T02:25:18.686700+0000","last_unstale":"2024-08-17T02:25:18.693587+0000","last_undegraded":"2024-08-17T02:25:18.693587+0000","last_fullsized":"2024-08-17T02:25:18.693587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:08:43.820138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.702978+0000","last_change":"2024-08-17T02:25:17.685745+0000","last_active":"2024-08-17T02:25:18.702978+0000","last_peered":"2024-08-17T02:25:18.702978+0000","last_clean":"2024-08-17T02:25:18.702978+0000","last_became_active":"2024-08-17T02:25:17.685437+0000","last_became_peered":"2024-08-17T02:25:17.685437+0000","last_unstale":"2024-08-17T02:25:18.702978+0000","last_undegraded":"2024-08-17T02:25:18.702978+0000","last_fullsized":"2024-08-17T02:25:18.702978+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:03:34.957853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.701773+0000","last_change":"2024-08-17T02:25:18.695593+0000","last_active":"2024-08-17T02:25:18.701773+0000","last_peered":"2024-08-17T02:25:18.701773+0000","last_clean":"2024-08-17T02:25:18.701773+0000","last_became_active":"2024-08-17T02:25:18.695345+0000","last_became_peered":"2024-08-17T02:25:18.695345+0000","last_unstale":"2024-08-17T02:25:18.701773+0000","last_undegraded":"2024-08-17T02:25:18.701773+0000","last_fullsized":"2024-08-17T02:25:18.701773+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:25.271173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:25:19.761705+0000","last_change":"2024-08-17T02:25:17.688551+0000","last_active":"2024-08-17T02:25:19.761705+0000","last_peered":"2024-08-17T02:25:19.761705+0000","last_clean":"2024-08-17T02:25:19.761705+0000","last_became_active":"2024-08-17T02:25:17.688287+0000","last_became_peered":"2024-08-17T02:25:17.688287+0000","last_unstale":"2024-08-17T02:25:19.761705+0000","last_undegraded":"2024-08-17T02:25:19.761705+0000","last_fullsized":"2024-08-17T02:25:19.761705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:08:42.813501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.692846+0000","last_change":"2024-08-17T02:25:18.688535+0000","last_active":"2024-08-17T02:25:18.692846+0000","last_peered":"2024-08-17T02:25:18.692846+0000","last_clean":"2024-08-17T02:25:18.692846+0000","last_became_active":"2024-08-17T02:25:18.685407+0000","last_became_peered":"2024-08-17T02:25:18.685407+0000","last_unstale":"2024-08-17T02:25:18.692846+0000","last_undegraded":"2024-08-17T02:25:18.692846+0000","last_fullsized":"2024-08-17T02:25:18.692846+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:03.637453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.683554+0000","last_change":"2024-08-17T02:25:17.688006+0000","last_active":"2024-08-17T02:25:18.683554+0000","last_peered":"2024-08-17T02:25:18.683554+0000","last_clean":"2024-08-17T02:25:18.683554+0000","last_became_active":"2024-08-17T02:25:17.687617+0000","last_became_peered":"2024-08-17T02:25:17.687617+0000","last_unstale":"2024-08-17T02:25:18.683554+0000","last_undegraded":"2024-08-17T02:25:18.683554+0000","last_fullsized":"2024-08-17T02:25:18.683554+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:03:47.853752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.700074+0000","last_change":"2024-08-17T02:25:18.693366+0000","last_active":"2024-08-17T02:25:18.700074+0000","last_peered":"2024-08-17T02:25:18.700074+0000","last_clean":"2024-08-17T02:25:18.700074+0000","last_became_active":"2024-08-17T02:25:18.693093+0000","last_became_peered":"2024-08-17T02:25:18.693093+0000","last_unstale":"2024-08-17T02:25:18.700074+0000","last_undegraded":"2024-08-17T02:25:18.700074+0000","last_fullsized":"2024-08-17T02:25:18.700074+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:23.240941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.664605+0000","last_change":"2024-08-17T02:25:17.668970+0000","last_active":"2024-08-17T02:25:18.664605+0000","last_peered":"2024-08-17T02:25:18.664605+0000","last_clean":"2024-08-17T02:25:18.664605+0000","last_became_active":"2024-08-17T02:25:17.668716+0000","last_became_peered":"2024-08-17T02:25:17.668716+0000","last_unstale":"2024-08-17T02:25:18.664605+0000","last_undegraded":"2024-08-17T02:25:18.664605+0000","last_fullsized":"2024-08-17T02:25:18.664605+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:48:25.682657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.689579+0000","last_change":"2024-08-17T02:25:18.686951+0000","last_active":"2024-08-17T02:25:18.689579+0000","last_peered":"2024-08-17T02:25:18.689579+0000","last_clean":"2024-08-17T02:25:18.689579+0000","last_became_active":"2024-08-17T02:25:18.686679+0000","last_became_peered":"2024-08-17T02:25:18.686679+0000","last_unstale":"2024-08-17T02:25:18.689579+0000","last_undegraded":"2024-08-17T02:25:18.689579+0000","last_fullsized":"2024-08-17T02:25:18.689579+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:21:54.496023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.682615+0000","last_change":"2024-08-17T02:25:17.683540+0000","last_active":"2024-08-17T02:25:18.682615+0000","last_peered":"2024-08-17T02:25:18.682615+0000","last_clean":"2024-08-17T02:25:18.682615+0000","last_became_active":"2024-08-17T02:25:17.683254+0000","last_became_peered":"2024-08-17T02:25:17.683254+0000","last_unstale":"2024-08-17T02:25:18.682615+0000","last_undegraded":"2024-08-17T02:25:18.682615+0000","last_fullsized":"2024-08-17T02:25:18.682615+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:48:25.682657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.696954+0000","last_change":"2024-08-17T02:25:18.686296+0000","last_active":"2024-08-17T02:25:18.696954+0000","last_peered":"2024-08-17T02:25:18.696954+0000","last_clean":"2024-08-17T02:25:18.696954+0000","last_became_active":"2024-08-17T02:25:18.686010+0000","last_became_peered":"2024-08-17T02:25:18.686010+0000","last_unstale":"2024-08-17T02:25:18.696954+0000","last_undegraded":"2024-08-17T02:25:18.696954+0000","last_fullsized":"2024-08-17T02:25:18.696954+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:51:04.058113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.667223+0000","last_change":"2024-08-17T02:25:17.678168+0000","last_active":"2024-08-17T02:25:18.667223+0000","last_peered":"2024-08-17T02:25:18.667223+0000","last_clean":"2024-08-17T02:25:18.667223+0000","last_became_active":"2024-08-17T02:25:17.677901+0000","last_became_peered":"2024-08-17T02:25:17.677901+0000","last_unstale":"2024-08-17T02:25:18.667223+0000","last_undegraded":"2024-08-17T02:25:18.667223+0000","last_fullsized":"2024-08-17T02:25:18.667223+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:18:28.078127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.696309+0000","last_change":"2024-08-17T02:25:18.692788+0000","last_active":"2024-08-17T02:25:18.696309+0000","last_peered":"2024-08-17T02:25:18.696309+0000","last_clean":"2024-08-17T02:25:18.696309+0000","last_became_active":"2024-08-17T02:25:18.692523+0000","last_became_peered":"2024-08-17T02:25:18.692523+0000","last_unstale":"2024-08-17T02:25:18.696309+0000","last_undegraded":"2024-08-17T02:25:18.696309+0000","last_fullsized":"2024-08-17T02:25:18.696309+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:03.637453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.670714+0000","last_change":"2024-08-17T02:25:17.688335+0000","last_active":"2024-08-17T02:25:18.670714+0000","last_peered":"2024-08-17T02:25:18.670714+0000","last_clean":"2024-08-17T02:25:18.670714+0000","last_became_active":"2024-08-17T02:25:17.688083+0000","last_became_peered":"2024-08-17T02:25:17.688083+0000","last_unstale":"2024-08-17T02:25:18.670714+0000","last_undegraded":"2024-08-17T02:25:18.670714+0000","last_fullsized":"2024-08-17T02:25:18.670714+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:59:35.599774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.687527+0000","last_change":"2024-08-17T02:25:18.684557+0000","last_active":"2024-08-17T02:25:18.687527+0000","last_peered":"2024-08-17T02:25:18.687527+0000","last_clean":"2024-08-17T02:25:18.687527+0000","last_became_active":"2024-08-17T02:25:18.684031+0000","last_became_peered":"2024-08-17T02:25:18.684031+0000","last_unstale":"2024-08-17T02:25:18.687527+0000","last_undegraded":"2024-08-17T02:25:18.687527+0000","last_fullsized":"2024-08-17T02:25:18.687527+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:22:19.225830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.680651+0000","last_change":"2024-08-17T02:25:17.684468+0000","last_active":"2024-08-17T02:25:18.680651+0000","last_peered":"2024-08-17T02:25:18.680651+0000","last_clean":"2024-08-17T02:25:18.680651+0000","last_became_active":"2024-08-17T02:25:17.684195+0000","last_became_peered":"2024-08-17T02:25:17.684195+0000","last_unstale":"2024-08-17T02:25:18.680651+0000","last_undegraded":"2024-08-17T02:25:18.680651+0000","last_fullsized":"2024-08-17T02:25:18.680651+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:54:09.951612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":172,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.677542+0000","last_change":"2024-08-17T02:24:25.092772+0000","last_active":"2024-08-17T02:25:18.677542+0000","last_peered":"2024-08-17T02:25:18.677542+0000","last_clean":"2024-08-17T02:25:18.677542+0000","last_became_active":"2024-08-17T02:24:25.091788+0000","last_became_peered":"2024-08-17T02:24:25.091788+0000","last_unstale":"2024-08-17T02:25:18.677542+0000","last_undegraded":"2024-08-17T02:25:18.677542+0000","last_fullsized":"2024-08-17T02:25:18.677542+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:24.051996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:24.051996+0000","last_clean_scrub_stamp":"2024-08-17T02:24:24.051996+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:31:45.454480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302456,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069384,"statfs":{"total":96636764160,"available":96327049216,"internally_reserved":0,"allocated":958464,"data_stored":728831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.68100000000000005}]},{"osd":1,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.82799999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.63500000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.75800000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.60499999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.85499999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.88},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.55100000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301884,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069956,"statfs":{"total":96636764160,"available":96327634944,"internally_reserved":0,"allocated":368640,"data_stored":138977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301884,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069956,"statfs":{"total":96636764160,"available":96327634944,"internally_reserved":0,"allocated":368640,"data_stored":139033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":3.1440000000000001,"5min":3.1440000000000001,"15min":3.1440000000000001},"last":0.57299999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.69199999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":3.2559999999999998,"5min":3.2559999999999998,"15min":3.2559999999999998},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.64300000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":3.2229999999999999,"5min":3.2229999999999999,"15min":3.2229999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":3.1859999999999999,"5min":3.1859999999999999,"15min":3.1859999999999999},"last":0.72699999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.66300000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.62},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.49199999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.75900000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301884,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069956,"statfs":{"total":96636764160,"available":96327634944,"internally_reserved":0,"allocated":368640,"data_stored":138477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":376832,"data_stored":139947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.375},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.33500000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.48199999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.41799999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.81899999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.80100000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.83399999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.85999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":364544,"data_stored":138443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":376832,"data_stored":139947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298292,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073548,"statfs":{"total":96636764160,"available":96331313152,"internally_reserved":0,"allocated":954368,"data_stored":728741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:25:27.439 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:25:27.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.593+0000 7f8772e00640 1 Processor -- start 2024-08-17T02:25:27.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.593+0000 7f8772e00640 1 -- start start 2024-08-17T02:25:27.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.595+0000 7f8772e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f876c1401b0 0x7f876c0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:27.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.595+0000 7f8772e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f876c0b1440 0x7f876c0c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:27.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.595+0000 7f8772e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f876c0caa80 con 0x7f876c140580 2024-08-17T02:25:27.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.595+0000 7f8772e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f876c0cb450 con 0x7f876c0b1440 2024-08-17T02:25:27.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.595+0000 7f8772e00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f876c0c9e70 con 0x7f876c1401b0 2024-08-17T02:25:27.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.595+0000 7f8770e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f876c0b1440 0x7f876c0c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:27.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.595+0000 7f8763400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f876c140580 0x7f876c0b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:59894/0 (socket says 172.21.15.107:59894) 2024-08-17T02:25:27.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.595+0000 7f8763400640 1 -- 172.21.15.107:0/1778171608 learned_addr learned my addr 172.21.15.107:0/1778171608 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:25:27.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.595+0000 7f876be00640 1 --2- 172.21.15.107:0/1778171608 >> v2:172.21.15.157:3300/0 conn(0x7f876c1401b0 0x7f876c0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:27.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.595+0000 7f8770e00640 1 -- 172.21.15.107:0/1778171608 >> v2:172.21.15.157:3300/0 conn(0x7f876c1401b0 msgr2=0x7f876c0caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:27.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.595+0000 7f8770e00640 1 --2- 172.21.15.107:0/1778171608 >> v2:172.21.15.157:3300/0 conn(0x7f876c1401b0 0x7f876c0caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.595+0000 7f8770e00640 1 -- 172.21.15.107:0/1778171608 >> v1:172.21.15.107:6789/0 conn(0x7f876c140580 legacy=0x7f876c0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.595+0000 7f8770e00640 1 -- 172.21.15.107:0/1778171608 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f876c0ca150 con 0x7f876c0b1440 2024-08-17T02:25:27.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.596+0000 7f8770e00640 1 --2- 172.21.15.107:0/1778171608 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f876c0b1440 0x7f876c0c9040 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f876c068650 tx=0x7f8764009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b02cfdc3f55c68 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:27.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.597+0000 7f876b400640 1 -- 172.21.15.107:0/1778171608 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8764007550 con 0x7f876c0b1440 2024-08-17T02:25:27.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.597+0000 7f876b400640 1 -- 172.21.15.107:0/1778171608 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f876402d050 con 0x7f876c0b1440 2024-08-17T02:25:27.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.597+0000 7f876b400640 1 -- 172.21.15.107:0/1778171608 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8764007920 con 0x7f876c0b1440 2024-08-17T02:25:27.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.597+0000 7f8772e00640 1 -- 172.21.15.107:0/1778171608 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f876c0b1440 msgr2=0x7f876c0c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.597+0000 7f8772e00640 1 --2- 172.21.15.107:0/1778171608 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f876c0b1440 0x7f876c0c9040 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f876c068650 tx=0x7f8764009780 comp rx=0 tx=0).stop 2024-08-17T02:25:27.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.597+0000 7f8772e00640 1 -- 172.21.15.107:0/1778171608 shutdown_connections 2024-08-17T02:25:27.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.597+0000 7f8772e00640 1 --2- 172.21.15.107:0/1778171608 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f876c0b1440 0x7f876c0c9040 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.597+0000 7f8772e00640 1 --2- 172.21.15.107:0/1778171608 >> v2:172.21.15.157:3300/0 conn(0x7f876c1401b0 0x7f876c0caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.597+0000 7f8772e00640 1 -- 172.21.15.107:0/1778171608 >> 172.21.15.107:0/1778171608 conn(0x7f876c0cb9b0 msgr2=0x7f876c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:27.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.597+0000 7f8772e00640 1 -- 172.21.15.107:0/1778171608 shutdown_connections 2024-08-17T02:25:27.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.597+0000 7f8772e00640 1 -- 172.21.15.107:0/1778171608 wait complete. 2024-08-17T02:25:27.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.599+0000 7f8772e00640 1 Processor -- start 2024-08-17T02:25:27.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.599+0000 7f8772e00640 1 -- start start 2024-08-17T02:25:27.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.600+0000 7f8772e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f876c0b1440 0x7f876c157460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:27.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.600+0000 7f8772e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f876c1401b0 0x7f876c1598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:27.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.600+0000 7f8772e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f876c140580 0x7f876c156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:27.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.600+0000 7f8772e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876c168d90 con 0x7f876c1401b0 2024-08-17T02:25:27.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.600+0000 7f8772e00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876c16bfa0 con 0x7f876c0b1440 2024-08-17T02:25:27.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.600+0000 7f8772e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f876c159e20 con 0x7f876c140580 2024-08-17T02:25:27.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.600+0000 7f8763400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f876c1401b0 0x7f876c1598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:27.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.600+0000 7f8763400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f876c1401b0 0x7f876c1598e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60402/0 (socket says 172.21.15.107:60402) 2024-08-17T02:25:27.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.600+0000 7f8763400640 1 -- 172.21.15.107:0/1055838413 learned_addr learned my addr 172.21.15.107:0/1055838413 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:27.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.600+0000 7f876be00640 1 --2- 172.21.15.107:0/1055838413 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f876c0b1440 0x7f876c157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:27.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.600+0000 7f8770e00640 1 --2- 172.21.15.107:0/1055838413 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f876c140580 0x7f876c156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:27.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.600+0000 7f8763400640 1 -- 172.21.15.107:0/1055838413 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f876c140580 msgr2=0x7f876c156400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.601+0000 7f8763400640 1 --2- 172.21.15.107:0/1055838413 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f876c140580 0x7f876c156400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.601+0000 7f8763400640 1 -- 172.21.15.107:0/1055838413 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f876c0b1440 msgr2=0x7f876c157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.601+0000 7f8763400640 1 --2- 172.21.15.107:0/1055838413 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f876c0b1440 0x7f876c157460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.601+0000 7f8763400640 1 -- 172.21.15.107:0/1055838413 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8764009a20 con 0x7f876c1401b0 2024-08-17T02:25:27.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.601+0000 7f876be00640 1 --2- 172.21.15.107:0/1055838413 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f876c0b1440 0x7f876c157460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:27.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.601+0000 7f8770e00640 1 --2- 172.21.15.107:0/1055838413 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f876c140580 0x7f876c156400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:27.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.601+0000 7f8763400640 1 --2- 172.21.15.107:0/1055838413 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f876c1401b0 0x7f876c1598e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f875400c5c0 tx=0x7f8754007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:27.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.601+0000 7f8763e00640 1 -- 172.21.15.107:0/1055838413 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8754005aa0 con 0x7f876c1401b0 2024-08-17T02:25:27.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.601+0000 7f8763e00640 1 -- 172.21.15.107:0/1055838413 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8754005c20 con 0x7f876c1401b0 2024-08-17T02:25:27.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.601+0000 7f8772e00640 1 -- 172.21.15.107:0/1055838413 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f876c15a050 con 0x7f876c1401b0 2024-08-17T02:25:27.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.601+0000 7f8763e00640 1 -- 172.21.15.107:0/1055838413 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87540070f0 con 0x7f876c1401b0 2024-08-17T02:25:27.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.601+0000 7f8772e00640 1 -- 172.21.15.107:0/1055838413 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f876c15a3e0 con 0x7f876c1401b0 2024-08-17T02:25:27.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.602+0000 7f8772e00640 1 -- 172.21.15.107:0/1055838413 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f876c168f00 con 0x7f876c1401b0 2024-08-17T02:25:27.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.603+0000 7f8763e00640 1 -- 172.21.15.107:0/1055838413 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8754007520 con 0x7f876c1401b0 2024-08-17T02:25:27.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.604+0000 7f8763e00640 1 --2- 172.21.15.107:0/1055838413 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f8748065150 0x7f8748067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:27.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.604+0000 7f8763e00640 1 -- 172.21.15.107:0/1055838413 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8754081780 con 0x7f876c1401b0 2024-08-17T02:25:27.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.604+0000 7f876be00640 1 --2- 172.21.15.107:0/1055838413 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f8748065150 0x7f8748067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:27.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.605+0000 7f876be00640 1 --2- 172.21.15.107:0/1055838413 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f8748065150 0x7f8748067600 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f876c06e2b0 tx=0x7f875c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:27.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.608+0000 7f8763e00640 1 -- 172.21.15.107:0/1055838413 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f876c168f00 con 0x7f876c1401b0 2024-08-17T02:25:27.784 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.783+0000 7f8772e00640 1 -- 172.21.15.107:0/1055838413 --> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f876c168b90 con 0x7f8748065150 2024-08-17T02:25:27.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.789+0000 7f8763e00640 1 -- 172.21.15.107:0/1055838413 <== mgr.4110 v2:172.21.15.107:6832/37039 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+273911 (secure 0 0 0) 0x7f876c168b90 con 0x7f8748065150 2024-08-17T02:25:27.793 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:25:27.795 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-08-17T02:25:27.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.793+0000 7f8772e00640 1 -- 172.21.15.107:0/1055838413 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f8748065150 msgr2=0x7f8748067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.793+0000 7f8772e00640 1 --2- 172.21.15.107:0/1055838413 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f8748065150 0x7f8748067600 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f876c06e2b0 tx=0x7f875c008040 comp rx=0 tx=0).stop 2024-08-17T02:25:27.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.793+0000 7f8772e00640 1 -- 172.21.15.107:0/1055838413 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f876c1401b0 msgr2=0x7f876c1598e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.793+0000 7f8772e00640 1 --2- 172.21.15.107:0/1055838413 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f876c1401b0 0x7f876c1598e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f875400c5c0 tx=0x7f8754007ee0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.793+0000 7f8772e00640 1 -- 172.21.15.107:0/1055838413 shutdown_connections 2024-08-17T02:25:27.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.793+0000 7f8772e00640 1 --2- 172.21.15.107:0/1055838413 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f8748065150 0x7f8748067600 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.793+0000 7f8772e00640 1 --2- 172.21.15.107:0/1055838413 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f876c140580 0x7f876c156400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.793+0000 7f8772e00640 1 --2- 172.21.15.107:0/1055838413 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f876c1401b0 0x7f876c1598e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.793+0000 7f8772e00640 1 --2- 172.21.15.107:0/1055838413 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f876c0b1440 0x7f876c157460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.793+0000 7f8772e00640 1 -- 172.21.15.107:0/1055838413 >> 172.21.15.107:0/1055838413 conn(0x7f876c0cb9b0 msgr2=0x7f876c0aeb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:27.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.793+0000 7f8772e00640 1 -- 172.21.15.107:0/1055838413 shutdown_connections 2024-08-17T02:25:27.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:27.793+0000 7f8772e00640 1 -- 172.21.15.107:0/1055838413 wait complete. 2024-08-17T02:25:27.809 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2024-08-17T02:25:27.416954+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2399584,"kb_used_data":4040,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752575136,"statfs":{"total":773094113280,"available":770636939264,"internally_reserved":0,"allocated":4136960,"data_stored":2292396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.755071"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.696078+0000","last_change":"2024-08-17T02:25:18.688115+0000","last_active":"2024-08-17T02:25:18.696078+0000","last_peered":"2024-08-17T02:25:18.696078+0000","last_clean":"2024-08-17T02:25:18.696078+0000","last_became_active":"2024-08-17T02:25:18.687875+0000","last_became_peered":"2024-08-17T02:25:18.687875+0000","last_unstale":"2024-08-17T02:25:18.696078+0000","last_undegraded":"2024-08-17T02:25:18.696078+0000","last_fullsized":"2024-08-17T02:25:18.696078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:21:54.496023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.697662+0000","last_change":"2024-08-17T02:25:18.686834+0000","last_active":"2024-08-17T02:25:18.697662+0000","last_peered":"2024-08-17T02:25:18.697662+0000","last_clean":"2024-08-17T02:25:18.697662+0000","last_became_active":"2024-08-17T02:25:18.686669+0000","last_became_peered":"2024-08-17T02:25:18.686669+0000","last_unstale":"2024-08-17T02:25:18.697662+0000","last_undegraded":"2024-08-17T02:25:18.697662+0000","last_fullsized":"2024-08-17T02:25:18.697662+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:12:11.199988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.691325+0000","last_change":"2024-08-17T02:25:18.689104+0000","last_active":"2024-08-17T02:25:18.691325+0000","last_peered":"2024-08-17T02:25:18.691325+0000","last_clean":"2024-08-17T02:25:18.691325+0000","last_became_active":"2024-08-17T02:25:18.688407+0000","last_became_peered":"2024-08-17T02:25:18.688407+0000","last_unstale":"2024-08-17T02:25:18.691325+0000","last_undegraded":"2024-08-17T02:25:18.691325+0000","last_fullsized":"2024-08-17T02:25:18.691325+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:12:11.199988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.681831+0000","last_change":"2024-08-17T02:25:18.677810+0000","last_active":"2024-08-17T02:25:18.681831+0000","last_peered":"2024-08-17T02:25:18.681831+0000","last_clean":"2024-08-17T02:25:18.681831+0000","last_became_active":"2024-08-17T02:25:18.677248+0000","last_became_peered":"2024-08-17T02:25:18.677248+0000","last_unstale":"2024-08-17T02:25:18.681831+0000","last_undegraded":"2024-08-17T02:25:18.681831+0000","last_fullsized":"2024-08-17T02:25:18.681831+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:15:54.854019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.681872+0000","last_change":"2024-08-17T02:25:18.675364+0000","last_active":"2024-08-17T02:25:18.681872+0000","last_peered":"2024-08-17T02:25:18.681872+0000","last_clean":"2024-08-17T02:25:18.681872+0000","last_became_active":"2024-08-17T02:25:18.674787+0000","last_became_peered":"2024-08-17T02:25:18.674787+0000","last_unstale":"2024-08-17T02:25:18.681872+0000","last_undegraded":"2024-08-17T02:25:18.681872+0000","last_fullsized":"2024-08-17T02:25:18.681872+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:03:48.860389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.700312+0000","last_change":"2024-08-17T02:25:18.691428+0000","last_active":"2024-08-17T02:25:18.700312+0000","last_peered":"2024-08-17T02:25:18.700312+0000","last_clean":"2024-08-17T02:25:18.700312+0000","last_became_active":"2024-08-17T02:25:18.691171+0000","last_became_peered":"2024-08-17T02:25:18.691171+0000","last_unstale":"2024-08-17T02:25:18.700312+0000","last_undegraded":"2024-08-17T02:25:18.700312+0000","last_fullsized":"2024-08-17T02:25:18.700312+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:25.271173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.697661+0000","last_change":"2024-08-17T02:25:18.695337+0000","last_active":"2024-08-17T02:25:18.697661+0000","last_peered":"2024-08-17T02:25:18.697661+0000","last_clean":"2024-08-17T02:25:18.697661+0000","last_became_active":"2024-08-17T02:25:18.695069+0000","last_became_peered":"2024-08-17T02:25:18.695069+0000","last_unstale":"2024-08-17T02:25:18.697661+0000","last_undegraded":"2024-08-17T02:25:18.697661+0000","last_fullsized":"2024-08-17T02:25:18.697661+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:59:36.606411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.699526+0000","last_change":"2024-08-17T02:25:18.691322+0000","last_active":"2024-08-17T02:25:18.699526+0000","last_peered":"2024-08-17T02:25:18.699526+0000","last_clean":"2024-08-17T02:25:18.699526+0000","last_became_active":"2024-08-17T02:25:18.690483+0000","last_became_peered":"2024-08-17T02:25:18.690483+0000","last_unstale":"2024-08-17T02:25:18.699526+0000","last_undegraded":"2024-08-17T02:25:18.699526+0000","last_fullsized":"2024-08-17T02:25:18.699526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:15:35.080503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.691074+0000","last_change":"2024-08-17T02:25:18.687183+0000","last_active":"2024-08-17T02:25:18.691074+0000","last_peered":"2024-08-17T02:25:18.691074+0000","last_clean":"2024-08-17T02:25:18.691074+0000","last_became_active":"2024-08-17T02:25:18.686911+0000","last_became_peered":"2024-08-17T02:25:18.686911+0000","last_unstale":"2024-08-17T02:25:18.691074+0000","last_undegraded":"2024-08-17T02:25:18.691074+0000","last_fullsized":"2024-08-17T02:25:18.691074+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:53.854442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.702694+0000","last_change":"2024-08-17T02:25:18.694136+0000","last_active":"2024-08-17T02:25:18.702694+0000","last_peered":"2024-08-17T02:25:18.702694+0000","last_clean":"2024-08-17T02:25:18.702694+0000","last_became_active":"2024-08-17T02:25:18.693929+0000","last_became_peered":"2024-08-17T02:25:18.693929+0000","last_unstale":"2024-08-17T02:25:18.702694+0000","last_undegraded":"2024-08-17T02:25:18.702694+0000","last_fullsized":"2024-08-17T02:25:18.702694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:51:04.058113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.699061+0000","last_change":"2024-08-17T02:25:18.693611+0000","last_active":"2024-08-17T02:25:18.699061+0000","last_peered":"2024-08-17T02:25:18.699061+0000","last_clean":"2024-08-17T02:25:18.699061+0000","last_became_active":"2024-08-17T02:25:18.693393+0000","last_became_peered":"2024-08-17T02:25:18.693393+0000","last_unstale":"2024-08-17T02:25:18.699061+0000","last_undegraded":"2024-08-17T02:25:18.699061+0000","last_fullsized":"2024-08-17T02:25:18.699061+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:25.271173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.701781+0000","last_change":"2024-08-17T02:25:18.697695+0000","last_active":"2024-08-17T02:25:18.701781+0000","last_peered":"2024-08-17T02:25:18.701781+0000","last_clean":"2024-08-17T02:25:18.701781+0000","last_became_active":"2024-08-17T02:25:18.697406+0000","last_became_peered":"2024-08-17T02:25:18.697406+0000","last_unstale":"2024-08-17T02:25:18.701781+0000","last_undegraded":"2024-08-17T02:25:18.701781+0000","last_fullsized":"2024-08-17T02:25:18.701781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:26:05.015031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.692359+0000","last_change":"2024-08-17T02:25:18.683134+0000","last_active":"2024-08-17T02:25:18.692359+0000","last_peered":"2024-08-17T02:25:18.692359+0000","last_clean":"2024-08-17T02:25:18.692359+0000","last_became_active":"2024-08-17T02:25:18.681298+0000","last_became_peered":"2024-08-17T02:25:18.681298+0000","last_unstale":"2024-08-17T02:25:18.692359+0000","last_undegraded":"2024-08-17T02:25:18.692359+0000","last_fullsized":"2024-08-17T02:25:18.692359+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:11.664621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.700228+0000","last_change":"2024-08-17T02:25:18.690055+0000","last_active":"2024-08-17T02:25:18.700228+0000","last_peered":"2024-08-17T02:25:18.700228+0000","last_clean":"2024-08-17T02:25:18.700228+0000","last_became_active":"2024-08-17T02:25:18.689829+0000","last_became_peered":"2024-08-17T02:25:18.689829+0000","last_unstale":"2024-08-17T02:25:18.700228+0000","last_undegraded":"2024-08-17T02:25:18.700228+0000","last_fullsized":"2024-08-17T02:25:18.700228+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:38.896462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.702511+0000","last_change":"2024-08-17T02:25:18.698182+0000","last_active":"2024-08-17T02:25:18.702511+0000","last_peered":"2024-08-17T02:25:18.702511+0000","last_clean":"2024-08-17T02:25:18.702511+0000","last_became_active":"2024-08-17T02:25:18.697917+0000","last_became_peered":"2024-08-17T02:25:18.697917+0000","last_unstale":"2024-08-17T02:25:18.702511+0000","last_undegraded":"2024-08-17T02:25:18.702511+0000","last_fullsized":"2024-08-17T02:25:18.702511+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:28:51.002809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.702567+0000","last_change":"2024-08-17T02:25:18.699338+0000","last_active":"2024-08-17T02:25:18.702567+0000","last_peered":"2024-08-17T02:25:18.702567+0000","last_clean":"2024-08-17T02:25:18.702567+0000","last_became_active":"2024-08-17T02:25:18.698937+0000","last_became_peered":"2024-08-17T02:25:18.698937+0000","last_unstale":"2024-08-17T02:25:18.702567+0000","last_undegraded":"2024-08-17T02:25:18.702567+0000","last_fullsized":"2024-08-17T02:25:18.702567+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:26:05.015031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.702952+0000","last_change":"2024-08-17T02:25:18.701349+0000","last_active":"2024-08-17T02:25:18.702952+0000","last_peered":"2024-08-17T02:25:18.702952+0000","last_clean":"2024-08-17T02:25:18.702952+0000","last_became_active":"2024-08-17T02:25:18.701109+0000","last_became_peered":"2024-08-17T02:25:18.701109+0000","last_unstale":"2024-08-17T02:25:18.702952+0000","last_undegraded":"2024-08-17T02:25:18.702952+0000","last_fullsized":"2024-08-17T02:25:18.702952+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:58:50.210579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.701372+0000","last_change":"2024-08-17T02:25:18.698189+0000","last_active":"2024-08-17T02:25:18.701372+0000","last_peered":"2024-08-17T02:25:18.701372+0000","last_clean":"2024-08-17T02:25:18.701372+0000","last_became_active":"2024-08-17T02:25:18.697968+0000","last_became_peered":"2024-08-17T02:25:18.697968+0000","last_unstale":"2024-08-17T02:25:18.701372+0000","last_undegraded":"2024-08-17T02:25:18.701372+0000","last_fullsized":"2024-08-17T02:25:18.701372+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:19:35.711198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.700380+0000","last_change":"2024-08-17T02:25:18.692100+0000","last_active":"2024-08-17T02:25:18.700380+0000","last_peered":"2024-08-17T02:25:18.700380+0000","last_clean":"2024-08-17T02:25:18.700380+0000","last_became_active":"2024-08-17T02:25:18.687629+0000","last_became_peered":"2024-08-17T02:25:18.687629+0000","last_unstale":"2024-08-17T02:25:18.700380+0000","last_undegraded":"2024-08-17T02:25:18.700380+0000","last_fullsized":"2024-08-17T02:25:18.700380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:37:41.942948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.696560+0000","last_change":"2024-08-17T02:25:18.688705+0000","last_active":"2024-08-17T02:25:18.696560+0000","last_peered":"2024-08-17T02:25:18.696560+0000","last_clean":"2024-08-17T02:25:18.696560+0000","last_became_active":"2024-08-17T02:25:18.686153+0000","last_became_peered":"2024-08-17T02:25:18.686153+0000","last_unstale":"2024-08-17T02:25:18.696560+0000","last_undegraded":"2024-08-17T02:25:18.696560+0000","last_fullsized":"2024-08-17T02:25:18.696560+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:48:26.689294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.687889+0000","last_change":"2024-08-17T02:25:18.680573+0000","last_active":"2024-08-17T02:25:18.687889+0000","last_peered":"2024-08-17T02:25:18.687889+0000","last_clean":"2024-08-17T02:25:18.687889+0000","last_became_active":"2024-08-17T02:25:18.680323+0000","last_became_peered":"2024-08-17T02:25:18.680323+0000","last_unstale":"2024-08-17T02:25:18.687889+0000","last_undegraded":"2024-08-17T02:25:18.687889+0000","last_fullsized":"2024-08-17T02:25:18.687889+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:21:54.496023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.689396+0000","last_change":"2024-08-17T02:25:18.686075+0000","last_active":"2024-08-17T02:25:18.689396+0000","last_peered":"2024-08-17T02:25:18.689396+0000","last_clean":"2024-08-17T02:25:18.689396+0000","last_became_active":"2024-08-17T02:25:18.685806+0000","last_became_peered":"2024-08-17T02:25:18.685806+0000","last_unstale":"2024-08-17T02:25:18.689396+0000","last_undegraded":"2024-08-17T02:25:18.689396+0000","last_fullsized":"2024-08-17T02:25:18.689396+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:58:50.210579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.688919+0000","last_change":"2024-08-17T02:25:18.685685+0000","last_active":"2024-08-17T02:25:18.688919+0000","last_peered":"2024-08-17T02:25:18.688919+0000","last_clean":"2024-08-17T02:25:18.688919+0000","last_became_active":"2024-08-17T02:25:18.683333+0000","last_became_peered":"2024-08-17T02:25:18.683333+0000","last_unstale":"2024-08-17T02:25:18.688919+0000","last_undegraded":"2024-08-17T02:25:18.688919+0000","last_fullsized":"2024-08-17T02:25:18.688919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:23.240941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.691179+0000","last_change":"2024-08-17T02:25:18.688254+0000","last_active":"2024-08-17T02:25:18.691179+0000","last_peered":"2024-08-17T02:25:18.691179+0000","last_clean":"2024-08-17T02:25:18.691179+0000","last_became_active":"2024-08-17T02:25:18.687954+0000","last_became_peered":"2024-08-17T02:25:18.687954+0000","last_unstale":"2024-08-17T02:25:18.691179+0000","last_undegraded":"2024-08-17T02:25:18.691179+0000","last_fullsized":"2024-08-17T02:25:18.691179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:22:19.225830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.689310+0000","last_change":"2024-08-17T02:25:18.684233+0000","last_active":"2024-08-17T02:25:18.689310+0000","last_peered":"2024-08-17T02:25:18.689310+0000","last_clean":"2024-08-17T02:25:18.689310+0000","last_became_active":"2024-08-17T02:25:18.684000+0000","last_became_peered":"2024-08-17T02:25:18.684000+0000","last_unstale":"2024-08-17T02:25:18.689310+0000","last_undegraded":"2024-08-17T02:25:18.689310+0000","last_fullsized":"2024-08-17T02:25:18.689310+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:22:19.225830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.692142+0000","last_change":"2024-08-17T02:25:18.685525+0000","last_active":"2024-08-17T02:25:18.692142+0000","last_peered":"2024-08-17T02:25:18.692142+0000","last_clean":"2024-08-17T02:25:18.692142+0000","last_became_active":"2024-08-17T02:25:18.685305+0000","last_became_peered":"2024-08-17T02:25:18.685305+0000","last_unstale":"2024-08-17T02:25:18.692142+0000","last_undegraded":"2024-08-17T02:25:18.692142+0000","last_fullsized":"2024-08-17T02:25:18.692142+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:25:47.932042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.689316+0000","last_change":"2024-08-17T02:25:18.679317+0000","last_active":"2024-08-17T02:25:18.689316+0000","last_peered":"2024-08-17T02:25:18.689316+0000","last_clean":"2024-08-17T02:25:18.689316+0000","last_became_active":"2024-08-17T02:25:18.677699+0000","last_became_peered":"2024-08-17T02:25:18.677699+0000","last_unstale":"2024-08-17T02:25:18.689316+0000","last_undegraded":"2024-08-17T02:25:18.689316+0000","last_fullsized":"2024-08-17T02:25:18.689316+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:55:29.782118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.695115+0000","last_change":"2024-08-17T02:25:18.688723+0000","last_active":"2024-08-17T02:25:18.695115+0000","last_peered":"2024-08-17T02:25:18.695115+0000","last_clean":"2024-08-17T02:25:18.695115+0000","last_became_active":"2024-08-17T02:25:18.688436+0000","last_became_peered":"2024-08-17T02:25:18.688436+0000","last_unstale":"2024-08-17T02:25:18.695115+0000","last_undegraded":"2024-08-17T02:25:18.695115+0000","last_fullsized":"2024-08-17T02:25:18.695115+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:57:45.497406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.687909+0000","last_change":"2024-08-17T02:25:18.683787+0000","last_active":"2024-08-17T02:25:18.687909+0000","last_peered":"2024-08-17T02:25:18.687909+0000","last_clean":"2024-08-17T02:25:18.687909+0000","last_became_active":"2024-08-17T02:25:18.678310+0000","last_became_peered":"2024-08-17T02:25:18.678310+0000","last_unstale":"2024-08-17T02:25:18.687909+0000","last_undegraded":"2024-08-17T02:25:18.687909+0000","last_fullsized":"2024-08-17T02:25:18.687909+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:59:36.606411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.697627+0000","last_change":"2024-08-17T02:25:18.695053+0000","last_active":"2024-08-17T02:25:18.697627+0000","last_peered":"2024-08-17T02:25:18.697627+0000","last_clean":"2024-08-17T02:25:18.697627+0000","last_became_active":"2024-08-17T02:25:18.694747+0000","last_became_peered":"2024-08-17T02:25:18.694747+0000","last_unstale":"2024-08-17T02:25:18.697627+0000","last_undegraded":"2024-08-17T02:25:18.697627+0000","last_fullsized":"2024-08-17T02:25:18.697627+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:28:51.002809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.700418+0000","last_change":"2024-08-17T02:25:18.689116+0000","last_active":"2024-08-17T02:25:18.700418+0000","last_peered":"2024-08-17T02:25:18.700418+0000","last_clean":"2024-08-17T02:25:18.700418+0000","last_became_active":"2024-08-17T02:25:18.688871+0000","last_became_peered":"2024-08-17T02:25:18.688871+0000","last_unstale":"2024-08-17T02:25:18.700418+0000","last_undegraded":"2024-08-17T02:25:18.700418+0000","last_fullsized":"2024-08-17T02:25:18.700418+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:57:04.094952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.702603+0000","last_change":"2024-08-17T02:25:18.699667+0000","last_active":"2024-08-17T02:25:18.702603+0000","last_peered":"2024-08-17T02:25:18.702603+0000","last_clean":"2024-08-17T02:25:18.702603+0000","last_became_active":"2024-08-17T02:25:18.699332+0000","last_became_peered":"2024-08-17T02:25:18.699332+0000","last_unstale":"2024-08-17T02:25:18.702603+0000","last_undegraded":"2024-08-17T02:25:18.702603+0000","last_fullsized":"2024-08-17T02:25:18.702603+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:38.896462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.686194+0000","last_change":"2024-08-17T02:25:18.680597+0000","last_active":"2024-08-17T02:25:18.686194+0000","last_peered":"2024-08-17T02:25:18.686194+0000","last_clean":"2024-08-17T02:25:18.686194+0000","last_became_active":"2024-08-17T02:25:18.680329+0000","last_became_peered":"2024-08-17T02:25:18.680329+0000","last_unstale":"2024-08-17T02:25:18.686194+0000","last_undegraded":"2024-08-17T02:25:18.686194+0000","last_fullsized":"2024-08-17T02:25:18.686194+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:59:36.606411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.695905+0000","last_change":"2024-08-17T02:25:17.681025+0000","last_active":"2024-08-17T02:25:18.695905+0000","last_peered":"2024-08-17T02:25:18.695905+0000","last_clean":"2024-08-17T02:25:18.695905+0000","last_became_active":"2024-08-17T02:25:17.680756+0000","last_became_peered":"2024-08-17T02:25:17.680756+0000","last_unstale":"2024-08-17T02:25:18.695905+0000","last_undegraded":"2024-08-17T02:25:18.695905+0000","last_fullsized":"2024-08-17T02:25:18.695905+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:08:42.813501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.696008+0000","last_change":"2024-08-17T02:25:18.686948+0000","last_active":"2024-08-17T02:25:18.696008+0000","last_peered":"2024-08-17T02:25:18.696008+0000","last_clean":"2024-08-17T02:25:18.696008+0000","last_became_active":"2024-08-17T02:25:18.686700+0000","last_became_peered":"2024-08-17T02:25:18.686700+0000","last_unstale":"2024-08-17T02:25:18.696008+0000","last_undegraded":"2024-08-17T02:25:18.696008+0000","last_fullsized":"2024-08-17T02:25:18.696008+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:59:36.606411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.686111+0000","last_change":"2024-08-17T02:25:17.682308+0000","last_active":"2024-08-17T02:25:18.686111+0000","last_peered":"2024-08-17T02:25:18.686111+0000","last_clean":"2024-08-17T02:25:18.686111+0000","last_became_active":"2024-08-17T02:25:17.682087+0000","last_became_peered":"2024-08-17T02:25:17.682087+0000","last_unstale":"2024-08-17T02:25:18.686111+0000","last_undegraded":"2024-08-17T02:25:18.686111+0000","last_fullsized":"2024-08-17T02:25:18.686111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:03:34.957853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.690825+0000","last_change":"2024-08-17T02:25:18.688198+0000","last_active":"2024-08-17T02:25:18.690825+0000","last_peered":"2024-08-17T02:25:18.690825+0000","last_clean":"2024-08-17T02:25:18.690825+0000","last_became_active":"2024-08-17T02:25:18.687994+0000","last_became_peered":"2024-08-17T02:25:18.687994+0000","last_unstale":"2024-08-17T02:25:18.690825+0000","last_undegraded":"2024-08-17T02:25:18.690825+0000","last_fullsized":"2024-08-17T02:25:18.690825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:23.240941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.702553+0000","last_change":"2024-08-17T02:25:17.689951+0000","last_active":"2024-08-17T02:25:18.702553+0000","last_peered":"2024-08-17T02:25:18.702553+0000","last_clean":"2024-08-17T02:25:18.702553+0000","last_became_active":"2024-08-17T02:25:17.689705+0000","last_became_peered":"2024-08-17T02:25:17.689705+0000","last_unstale":"2024-08-17T02:25:18.702553+0000","last_undegraded":"2024-08-17T02:25:18.702553+0000","last_fullsized":"2024-08-17T02:25:18.702553+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:29:57.578020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.689337+0000","last_change":"2024-08-17T02:25:18.679557+0000","last_active":"2024-08-17T02:25:18.689337+0000","last_peered":"2024-08-17T02:25:18.689337+0000","last_clean":"2024-08-17T02:25:18.689337+0000","last_became_active":"2024-08-17T02:25:18.679031+0000","last_became_peered":"2024-08-17T02:25:18.679031+0000","last_unstale":"2024-08-17T02:25:18.689337+0000","last_undegraded":"2024-08-17T02:25:18.689337+0000","last_fullsized":"2024-08-17T02:25:18.689337+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:46:17.633686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.692393+0000","last_change":"2024-08-17T02:25:17.686605+0000","last_active":"2024-08-17T02:25:18.692393+0000","last_peered":"2024-08-17T02:25:18.692393+0000","last_clean":"2024-08-17T02:25:18.692393+0000","last_became_active":"2024-08-17T02:25:17.686028+0000","last_became_peered":"2024-08-17T02:25:17.686028+0000","last_unstale":"2024-08-17T02:25:18.692393+0000","last_undegraded":"2024-08-17T02:25:18.692393+0000","last_fullsized":"2024-08-17T02:25:18.692393+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:21:56.218636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.697611+0000","last_change":"2024-08-17T02:25:18.692115+0000","last_active":"2024-08-17T02:25:18.697611+0000","last_peered":"2024-08-17T02:25:18.697611+0000","last_clean":"2024-08-17T02:25:18.697611+0000","last_became_active":"2024-08-17T02:25:18.691884+0000","last_became_peered":"2024-08-17T02:25:18.691884+0000","last_unstale":"2024-08-17T02:25:18.697611+0000","last_undegraded":"2024-08-17T02:25:18.697611+0000","last_fullsized":"2024-08-17T02:25:18.697611+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:51:04.058113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.702072+0000","last_change":"2024-08-17T02:25:17.681949+0000","last_active":"2024-08-17T02:25:18.702072+0000","last_peered":"2024-08-17T02:25:18.702072+0000","last_clean":"2024-08-17T02:25:18.702072+0000","last_became_active":"2024-08-17T02:25:17.681666+0000","last_became_peered":"2024-08-17T02:25:17.681666+0000","last_unstale":"2024-08-17T02:25:18.702072+0000","last_undegraded":"2024-08-17T02:25:18.702072+0000","last_fullsized":"2024-08-17T02:25:18.702072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:50.528508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.701618+0000","last_change":"2024-08-17T02:25:18.693575+0000","last_active":"2024-08-17T02:25:18.701618+0000","last_peered":"2024-08-17T02:25:18.701618+0000","last_clean":"2024-08-17T02:25:18.701618+0000","last_became_active":"2024-08-17T02:25:18.693247+0000","last_became_peered":"2024-08-17T02:25:18.693247+0000","last_unstale":"2024-08-17T02:25:18.701618+0000","last_undegraded":"2024-08-17T02:25:18.701618+0000","last_fullsized":"2024-08-17T02:25:18.701618+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:15:59.138809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.701126+0000","last_change":"2024-08-17T02:25:17.685024+0000","last_active":"2024-08-17T02:25:18.701126+0000","last_peered":"2024-08-17T02:25:18.701126+0000","last_clean":"2024-08-17T02:25:18.701126+0000","last_became_active":"2024-08-17T02:25:17.683666+0000","last_became_peered":"2024-08-17T02:25:17.683666+0000","last_unstale":"2024-08-17T02:25:18.701126+0000","last_undegraded":"2024-08-17T02:25:18.701126+0000","last_fullsized":"2024-08-17T02:25:18.701126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:41:06.837768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.696244+0000","last_change":"2024-08-17T02:25:18.691520+0000","last_active":"2024-08-17T02:25:18.696244+0000","last_peered":"2024-08-17T02:25:18.696244+0000","last_clean":"2024-08-17T02:25:18.696244+0000","last_became_active":"2024-08-17T02:25:18.691241+0000","last_became_peered":"2024-08-17T02:25:18.691241+0000","last_unstale":"2024-08-17T02:25:18.696244+0000","last_undegraded":"2024-08-17T02:25:18.696244+0000","last_fullsized":"2024-08-17T02:25:18.696244+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:57:04.094952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.676809+0000","last_change":"2024-08-17T02:25:17.679314+0000","last_active":"2024-08-17T02:25:18.676809+0000","last_peered":"2024-08-17T02:25:18.676809+0000","last_clean":"2024-08-17T02:25:18.676809+0000","last_became_active":"2024-08-17T02:25:17.679068+0000","last_became_peered":"2024-08-17T02:25:17.679068+0000","last_unstale":"2024-08-17T02:25:18.676809+0000","last_undegraded":"2024-08-17T02:25:18.676809+0000","last_fullsized":"2024-08-17T02:25:18.676809+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:44:16.038254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.689662+0000","last_change":"2024-08-17T02:25:18.682667+0000","last_active":"2024-08-17T02:25:18.689662+0000","last_peered":"2024-08-17T02:25:18.689662+0000","last_clean":"2024-08-17T02:25:18.689662+0000","last_became_active":"2024-08-17T02:25:18.682349+0000","last_became_peered":"2024-08-17T02:25:18.682349+0000","last_unstale":"2024-08-17T02:25:18.689662+0000","last_undegraded":"2024-08-17T02:25:18.689662+0000","last_fullsized":"2024-08-17T02:25:18.689662+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:29:07.794780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.666463+0000","last_change":"2024-08-17T02:25:17.673242+0000","last_active":"2024-08-17T02:25:18.666463+0000","last_peered":"2024-08-17T02:25:18.666463+0000","last_clean":"2024-08-17T02:25:18.666463+0000","last_became_active":"2024-08-17T02:25:17.672957+0000","last_became_peered":"2024-08-17T02:25:17.672957+0000","last_unstale":"2024-08-17T02:25:18.666463+0000","last_undegraded":"2024-08-17T02:25:18.666463+0000","last_fullsized":"2024-08-17T02:25:18.666463+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:38:08.511096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.701620+0000","last_change":"2024-08-17T02:25:18.694604+0000","last_active":"2024-08-17T02:25:18.701620+0000","last_peered":"2024-08-17T02:25:18.701620+0000","last_clean":"2024-08-17T02:25:18.701620+0000","last_became_active":"2024-08-17T02:25:18.694373+0000","last_became_peered":"2024-08-17T02:25:18.694373+0000","last_unstale":"2024-08-17T02:25:18.701620+0000","last_undegraded":"2024-08-17T02:25:18.701620+0000","last_fullsized":"2024-08-17T02:25:18.701620+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:15:35.080503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.675230+0000","last_change":"2024-08-17T02:25:17.681879+0000","last_active":"2024-08-17T02:25:18.675230+0000","last_peered":"2024-08-17T02:25:18.675230+0000","last_clean":"2024-08-17T02:25:18.675230+0000","last_became_active":"2024-08-17T02:25:17.681624+0000","last_became_peered":"2024-08-17T02:25:17.681624+0000","last_unstale":"2024-08-17T02:25:18.675230+0000","last_undegraded":"2024-08-17T02:25:18.675230+0000","last_fullsized":"2024-08-17T02:25:18.675230+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:21:53.489386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.700468+0000","last_change":"2024-08-17T02:25:18.694622+0000","last_active":"2024-08-17T02:25:18.700468+0000","last_peered":"2024-08-17T02:25:18.700468+0000","last_clean":"2024-08-17T02:25:18.700468+0000","last_became_active":"2024-08-17T02:25:18.694388+0000","last_became_peered":"2024-08-17T02:25:18.694388+0000","last_unstale":"2024-08-17T02:25:18.700468+0000","last_undegraded":"2024-08-17T02:25:18.700468+0000","last_fullsized":"2024-08-17T02:25:18.700468+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:14:51.437597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.664893+0000","last_change":"2024-08-17T02:25:17.676989+0000","last_active":"2024-08-17T02:25:18.664893+0000","last_peered":"2024-08-17T02:25:18.664893+0000","last_clean":"2024-08-17T02:25:18.664893+0000","last_became_active":"2024-08-17T02:25:17.676554+0000","last_became_peered":"2024-08-17T02:25:17.676554+0000","last_unstale":"2024-08-17T02:25:18.664893+0000","last_undegraded":"2024-08-17T02:25:18.664893+0000","last_fullsized":"2024-08-17T02:25:18.664893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:10.657983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.696437+0000","last_change":"2024-08-17T02:25:18.684310+0000","last_active":"2024-08-17T02:25:18.696437+0000","last_peered":"2024-08-17T02:25:18.696437+0000","last_clean":"2024-08-17T02:25:18.696437+0000","last_became_active":"2024-08-17T02:25:18.684066+0000","last_became_peered":"2024-08-17T02:25:18.684066+0000","last_unstale":"2024-08-17T02:25:18.696437+0000","last_undegraded":"2024-08-17T02:25:18.696437+0000","last_fullsized":"2024-08-17T02:25:18.696437+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:41:04.504523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.700827+0000","last_change":"2024-08-17T02:25:17.682039+0000","last_active":"2024-08-17T02:25:18.700827+0000","last_peered":"2024-08-17T02:25:18.700827+0000","last_clean":"2024-08-17T02:25:18.700827+0000","last_became_active":"2024-08-17T02:25:17.681753+0000","last_became_peered":"2024-08-17T02:25:17.681753+0000","last_unstale":"2024-08-17T02:25:18.700827+0000","last_undegraded":"2024-08-17T02:25:18.700827+0000","last_fullsized":"2024-08-17T02:25:18.700827+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:57:03.088315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.691347+0000","last_change":"2024-08-17T02:25:18.689244+0000","last_active":"2024-08-17T02:25:18.691347+0000","last_peered":"2024-08-17T02:25:18.691347+0000","last_clean":"2024-08-17T02:25:18.691347+0000","last_became_active":"2024-08-17T02:25:18.688773+0000","last_became_peered":"2024-08-17T02:25:18.688773+0000","last_unstale":"2024-08-17T02:25:18.691347+0000","last_undegraded":"2024-08-17T02:25:18.691347+0000","last_fullsized":"2024-08-17T02:25:18.691347+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:38.896462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.704817+0000","last_change":"2024-08-17T02:25:17.688038+0000","last_active":"2024-08-17T02:25:18.704817+0000","last_peered":"2024-08-17T02:25:18.704817+0000","last_clean":"2024-08-17T02:25:18.704817+0000","last_became_active":"2024-08-17T02:25:17.687784+0000","last_became_peered":"2024-08-17T02:25:17.687784+0000","last_unstale":"2024-08-17T02:25:18.704817+0000","last_undegraded":"2024-08-17T02:25:18.704817+0000","last_fullsized":"2024-08-17T02:25:18.704817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:03:34.957853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.698164+0000","last_change":"2024-08-17T02:25:18.688857+0000","last_active":"2024-08-17T02:25:18.698164+0000","last_peered":"2024-08-17T02:25:18.698164+0000","last_clean":"2024-08-17T02:25:18.698164+0000","last_became_active":"2024-08-17T02:25:18.687321+0000","last_became_peered":"2024-08-17T02:25:18.687321+0000","last_unstale":"2024-08-17T02:25:18.698164+0000","last_undegraded":"2024-08-17T02:25:18.698164+0000","last_fullsized":"2024-08-17T02:25:18.698164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:15:59.138809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.701718+0000","last_change":"2024-08-17T02:25:17.676792+0000","last_active":"2024-08-17T02:25:18.701718+0000","last_peered":"2024-08-17T02:25:18.701718+0000","last_clean":"2024-08-17T02:25:18.701718+0000","last_became_active":"2024-08-17T02:25:17.673989+0000","last_became_peered":"2024-08-17T02:25:17.673989+0000","last_unstale":"2024-08-17T02:25:18.701718+0000","last_undegraded":"2024-08-17T02:25:18.701718+0000","last_fullsized":"2024-08-17T02:25:18.701718+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:17.604015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.690106+0000","last_change":"2024-08-17T02:25:18.680024+0000","last_active":"2024-08-17T02:25:18.690106+0000","last_peered":"2024-08-17T02:25:18.690106+0000","last_clean":"2024-08-17T02:25:18.690106+0000","last_became_active":"2024-08-17T02:25:18.679782+0000","last_became_peered":"2024-08-17T02:25:18.679782+0000","last_unstale":"2024-08-17T02:25:18.690106+0000","last_undegraded":"2024-08-17T02:25:18.690106+0000","last_fullsized":"2024-08-17T02:25:18.690106+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:28:51.002809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.682478+0000","last_change":"2024-08-17T02:25:17.685576+0000","last_active":"2024-08-17T02:25:18.682478+0000","last_peered":"2024-08-17T02:25:18.682478+0000","last_clean":"2024-08-17T02:25:18.682478+0000","last_became_active":"2024-08-17T02:25:17.685314+0000","last_became_peered":"2024-08-17T02:25:17.685314+0000","last_unstale":"2024-08-17T02:25:18.682478+0000","last_undegraded":"2024-08-17T02:25:18.682478+0000","last_fullsized":"2024-08-17T02:25:18.682478+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:14:21.868403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.702586+0000","last_change":"2024-08-17T02:25:18.699544+0000","last_active":"2024-08-17T02:25:18.702586+0000","last_peered":"2024-08-17T02:25:18.702586+0000","last_clean":"2024-08-17T02:25:18.702586+0000","last_became_active":"2024-08-17T02:25:18.699066+0000","last_became_peered":"2024-08-17T02:25:18.699066+0000","last_unstale":"2024-08-17T02:25:18.702586+0000","last_undegraded":"2024-08-17T02:25:18.702586+0000","last_fullsized":"2024-08-17T02:25:18.702586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:12:11.199988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.676895+0000","last_change":"2024-08-17T02:25:17.687390+0000","last_active":"2024-08-17T02:25:18.676895+0000","last_peered":"2024-08-17T02:25:18.676895+0000","last_clean":"2024-08-17T02:25:18.676895+0000","last_became_active":"2024-08-17T02:25:17.687168+0000","last_became_peered":"2024-08-17T02:25:17.687168+0000","last_unstale":"2024-08-17T02:25:18.676895+0000","last_undegraded":"2024-08-17T02:25:18.676895+0000","last_fullsized":"2024-08-17T02:25:18.676895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:34:39.313004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.700437+0000","last_change":"2024-08-17T02:25:18.693643+0000","last_active":"2024-08-17T02:25:18.700437+0000","last_peered":"2024-08-17T02:25:18.700437+0000","last_clean":"2024-08-17T02:25:18.700437+0000","last_became_active":"2024-08-17T02:25:18.693204+0000","last_became_peered":"2024-08-17T02:25:18.693204+0000","last_unstale":"2024-08-17T02:25:18.700437+0000","last_undegraded":"2024-08-17T02:25:18.700437+0000","last_fullsized":"2024-08-17T02:25:18.700437+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:44:17.044891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.703683+0000","last_change":"2024-08-17T02:25:17.684571+0000","last_active":"2024-08-17T02:25:18.703683+0000","last_peered":"2024-08-17T02:25:18.703683+0000","last_clean":"2024-08-17T02:25:18.703683+0000","last_became_active":"2024-08-17T02:25:17.684008+0000","last_became_peered":"2024-08-17T02:25:17.684008+0000","last_unstale":"2024-08-17T02:25:18.703683+0000","last_undegraded":"2024-08-17T02:25:18.703683+0000","last_fullsized":"2024-08-17T02:25:18.703683+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:02.630816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.696209+0000","last_change":"2024-08-17T02:25:18.691629+0000","last_active":"2024-08-17T02:25:18.696209+0000","last_peered":"2024-08-17T02:25:18.696209+0000","last_clean":"2024-08-17T02:25:18.696209+0000","last_became_active":"2024-08-17T02:25:18.690619+0000","last_became_peered":"2024-08-17T02:25:18.690619+0000","last_unstale":"2024-08-17T02:25:18.696209+0000","last_undegraded":"2024-08-17T02:25:18.696209+0000","last_fullsized":"2024-08-17T02:25:18.696209+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:29:58.584657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.703518+0000","last_change":"2024-08-17T02:25:17.690425+0000","last_active":"2024-08-17T02:25:18.703518+0000","last_peered":"2024-08-17T02:25:18.703518+0000","last_clean":"2024-08-17T02:25:18.703518+0000","last_became_active":"2024-08-17T02:25:17.690138+0000","last_became_peered":"2024-08-17T02:25:17.690138+0000","last_unstale":"2024-08-17T02:25:18.703518+0000","last_undegraded":"2024-08-17T02:25:18.703518+0000","last_fullsized":"2024-08-17T02:25:18.703518+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:34:39.313004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.698332+0000","last_change":"2024-08-17T02:25:18.692029+0000","last_active":"2024-08-17T02:25:18.698332+0000","last_peered":"2024-08-17T02:25:18.698332+0000","last_clean":"2024-08-17T02:25:18.698332+0000","last_became_active":"2024-08-17T02:25:18.691758+0000","last_became_peered":"2024-08-17T02:25:18.691758+0000","last_unstale":"2024-08-17T02:25:18.698332+0000","last_undegraded":"2024-08-17T02:25:18.698332+0000","last_fullsized":"2024-08-17T02:25:18.698332+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:51:04.058113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.696791+0000","last_change":"2024-08-17T02:25:17.673862+0000","last_active":"2024-08-17T02:25:18.696791+0000","last_peered":"2024-08-17T02:25:18.696791+0000","last_clean":"2024-08-17T02:25:18.696791+0000","last_became_active":"2024-08-17T02:25:17.673608+0000","last_became_peered":"2024-08-17T02:25:17.673608+0000","last_unstale":"2024-08-17T02:25:18.696791+0000","last_undegraded":"2024-08-17T02:25:18.696791+0000","last_fullsized":"2024-08-17T02:25:18.696791+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:18:32.501730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.681849+0000","last_change":"2024-08-17T02:25:18.677970+0000","last_active":"2024-08-17T02:25:18.681849+0000","last_peered":"2024-08-17T02:25:18.681849+0000","last_clean":"2024-08-17T02:25:18.681849+0000","last_became_active":"2024-08-17T02:25:18.677588+0000","last_became_peered":"2024-08-17T02:25:18.677588+0000","last_unstale":"2024-08-17T02:25:18.681849+0000","last_undegraded":"2024-08-17T02:25:18.681849+0000","last_fullsized":"2024-08-17T02:25:18.681849+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:57:45.497406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.696113+0000","last_change":"2024-08-17T02:25:17.677042+0000","last_active":"2024-08-17T02:25:18.696113+0000","last_peered":"2024-08-17T02:25:18.696113+0000","last_clean":"2024-08-17T02:25:18.696113+0000","last_became_active":"2024-08-17T02:25:17.676166+0000","last_became_peered":"2024-08-17T02:25:17.676166+0000","last_unstale":"2024-08-17T02:25:18.696113+0000","last_undegraded":"2024-08-17T02:25:18.696113+0000","last_fullsized":"2024-08-17T02:25:18.696113+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:43:30.288480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.692251+0000","last_change":"2024-08-17T02:25:18.683115+0000","last_active":"2024-08-17T02:25:18.692251+0000","last_peered":"2024-08-17T02:25:18.692251+0000","last_clean":"2024-08-17T02:25:18.692251+0000","last_became_active":"2024-08-17T02:25:18.682850+0000","last_became_peered":"2024-08-17T02:25:18.682850+0000","last_unstale":"2024-08-17T02:25:18.692251+0000","last_undegraded":"2024-08-17T02:25:18.692251+0000","last_fullsized":"2024-08-17T02:25:18.692251+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:03:35.964491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.669358+0000","last_change":"2024-08-17T02:25:17.680896+0000","last_active":"2024-08-17T02:25:18.669358+0000","last_peered":"2024-08-17T02:25:18.669358+0000","last_clean":"2024-08-17T02:25:18.669358+0000","last_became_active":"2024-08-17T02:25:17.680609+0000","last_became_peered":"2024-08-17T02:25:17.680609+0000","last_unstale":"2024-08-17T02:25:18.669358+0000","last_undegraded":"2024-08-17T02:25:18.669358+0000","last_fullsized":"2024-08-17T02:25:18.669358+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:08:36.844257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.685384+0000","last_change":"2024-08-17T02:25:18.680147+0000","last_active":"2024-08-17T02:25:18.685384+0000","last_peered":"2024-08-17T02:25:18.685384+0000","last_clean":"2024-08-17T02:25:18.685384+0000","last_became_active":"2024-08-17T02:25:18.679880+0000","last_became_peered":"2024-08-17T02:25:18.679880+0000","last_unstale":"2024-08-17T02:25:18.685384+0000","last_undegraded":"2024-08-17T02:25:18.685384+0000","last_fullsized":"2024-08-17T02:25:18.685384+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:51.535145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.690413+0000","last_change":"2024-08-17T02:25:17.687610+0000","last_active":"2024-08-17T02:25:18.690413+0000","last_peered":"2024-08-17T02:25:18.690413+0000","last_clean":"2024-08-17T02:25:18.690413+0000","last_became_active":"2024-08-17T02:25:17.687268+0000","last_became_peered":"2024-08-17T02:25:17.687268+0000","last_unstale":"2024-08-17T02:25:18.690413+0000","last_undegraded":"2024-08-17T02:25:18.690413+0000","last_fullsized":"2024-08-17T02:25:18.690413+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:03:47.853752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.682985+0000","last_change":"2024-08-17T02:25:18.675577+0000","last_active":"2024-08-17T02:25:18.682985+0000","last_peered":"2024-08-17T02:25:18.682985+0000","last_clean":"2024-08-17T02:25:18.682985+0000","last_became_active":"2024-08-17T02:25:18.675124+0000","last_became_peered":"2024-08-17T02:25:18.675124+0000","last_unstale":"2024-08-17T02:25:18.682985+0000","last_undegraded":"2024-08-17T02:25:18.682985+0000","last_fullsized":"2024-08-17T02:25:18.682985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:54:10.958249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.680385+0000","last_change":"2024-08-17T02:25:17.692433+0000","last_active":"2024-08-17T02:25:18.680385+0000","last_peered":"2024-08-17T02:25:18.680385+0000","last_clean":"2024-08-17T02:25:18.680385+0000","last_became_active":"2024-08-17T02:25:17.692172+0000","last_became_peered":"2024-08-17T02:25:17.692172+0000","last_unstale":"2024-08-17T02:25:18.680385+0000","last_undegraded":"2024-08-17T02:25:18.680385+0000","last_fullsized":"2024-08-17T02:25:18.680385+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:48:25.682657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.683983+0000","last_change":"2024-08-17T02:25:18.678202+0000","last_active":"2024-08-17T02:25:18.683983+0000","last_peered":"2024-08-17T02:25:18.683983+0000","last_clean":"2024-08-17T02:25:18.683983+0000","last_became_active":"2024-08-17T02:25:18.675448+0000","last_became_peered":"2024-08-17T02:25:18.675448+0000","last_unstale":"2024-08-17T02:25:18.683983+0000","last_undegraded":"2024-08-17T02:25:18.683983+0000","last_fullsized":"2024-08-17T02:25:18.683983+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:08:37.850894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.667123+0000","last_change":"2024-08-17T02:25:17.686038+0000","last_active":"2024-08-17T02:25:18.667123+0000","last_peered":"2024-08-17T02:25:18.667123+0000","last_clean":"2024-08-17T02:25:18.667123+0000","last_became_active":"2024-08-17T02:25:17.685788+0000","last_became_peered":"2024-08-17T02:25:17.685788+0000","last_unstale":"2024-08-17T02:25:18.667123+0000","last_undegraded":"2024-08-17T02:25:18.667123+0000","last_fullsized":"2024-08-17T02:25:18.667123+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:00:25.851171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.699193+0000","last_change":"2024-08-17T02:25:18.697276+0000","last_active":"2024-08-17T02:25:18.699193+0000","last_peered":"2024-08-17T02:25:18.699193+0000","last_clean":"2024-08-17T02:25:18.699193+0000","last_became_active":"2024-08-17T02:25:18.694659+0000","last_became_peered":"2024-08-17T02:25:18.694659+0000","last_unstale":"2024-08-17T02:25:18.699193+0000","last_undegraded":"2024-08-17T02:25:18.699193+0000","last_fullsized":"2024-08-17T02:25:18.699193+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:03.637453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.676552+0000","last_change":"2024-08-17T02:25:17.688649+0000","last_active":"2024-08-17T02:25:18.676552+0000","last_peered":"2024-08-17T02:25:18.676552+0000","last_clean":"2024-08-17T02:25:18.676552+0000","last_became_active":"2024-08-17T02:25:17.688290+0000","last_became_peered":"2024-08-17T02:25:17.688290+0000","last_unstale":"2024-08-17T02:25:18.676552+0000","last_undegraded":"2024-08-17T02:25:18.676552+0000","last_fullsized":"2024-08-17T02:25:18.676552+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:29:57.578020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.693587+0000","last_change":"2024-08-17T02:25:18.686927+0000","last_active":"2024-08-17T02:25:18.693587+0000","last_peered":"2024-08-17T02:25:18.693587+0000","last_clean":"2024-08-17T02:25:18.693587+0000","last_became_active":"2024-08-17T02:25:18.686700+0000","last_became_peered":"2024-08-17T02:25:18.686700+0000","last_unstale":"2024-08-17T02:25:18.693587+0000","last_undegraded":"2024-08-17T02:25:18.693587+0000","last_fullsized":"2024-08-17T02:25:18.693587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:08:43.820138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.702978+0000","last_change":"2024-08-17T02:25:17.685745+0000","last_active":"2024-08-17T02:25:18.702978+0000","last_peered":"2024-08-17T02:25:18.702978+0000","last_clean":"2024-08-17T02:25:18.702978+0000","last_became_active":"2024-08-17T02:25:17.685437+0000","last_became_peered":"2024-08-17T02:25:17.685437+0000","last_unstale":"2024-08-17T02:25:18.702978+0000","last_undegraded":"2024-08-17T02:25:18.702978+0000","last_fullsized":"2024-08-17T02:25:18.702978+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:03:34.957853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.701773+0000","last_change":"2024-08-17T02:25:18.695593+0000","last_active":"2024-08-17T02:25:18.701773+0000","last_peered":"2024-08-17T02:25:18.701773+0000","last_clean":"2024-08-17T02:25:18.701773+0000","last_became_active":"2024-08-17T02:25:18.695345+0000","last_became_peered":"2024-08-17T02:25:18.695345+0000","last_unstale":"2024-08-17T02:25:18.701773+0000","last_undegraded":"2024-08-17T02:25:18.701773+0000","last_fullsized":"2024-08-17T02:25:18.701773+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:25.271173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:25:19.761705+0000","last_change":"2024-08-17T02:25:17.688551+0000","last_active":"2024-08-17T02:25:19.761705+0000","last_peered":"2024-08-17T02:25:19.761705+0000","last_clean":"2024-08-17T02:25:19.761705+0000","last_became_active":"2024-08-17T02:25:17.688287+0000","last_became_peered":"2024-08-17T02:25:17.688287+0000","last_unstale":"2024-08-17T02:25:19.761705+0000","last_undegraded":"2024-08-17T02:25:19.761705+0000","last_fullsized":"2024-08-17T02:25:19.761705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:08:42.813501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.692846+0000","last_change":"2024-08-17T02:25:18.688535+0000","last_active":"2024-08-17T02:25:18.692846+0000","last_peered":"2024-08-17T02:25:18.692846+0000","last_clean":"2024-08-17T02:25:18.692846+0000","last_became_active":"2024-08-17T02:25:18.685407+0000","last_became_peered":"2024-08-17T02:25:18.685407+0000","last_unstale":"2024-08-17T02:25:18.692846+0000","last_undegraded":"2024-08-17T02:25:18.692846+0000","last_fullsized":"2024-08-17T02:25:18.692846+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:03.637453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.683554+0000","last_change":"2024-08-17T02:25:17.688006+0000","last_active":"2024-08-17T02:25:18.683554+0000","last_peered":"2024-08-17T02:25:18.683554+0000","last_clean":"2024-08-17T02:25:18.683554+0000","last_became_active":"2024-08-17T02:25:17.687617+0000","last_became_peered":"2024-08-17T02:25:17.687617+0000","last_unstale":"2024-08-17T02:25:18.683554+0000","last_undegraded":"2024-08-17T02:25:18.683554+0000","last_fullsized":"2024-08-17T02:25:18.683554+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:03:47.853752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.700074+0000","last_change":"2024-08-17T02:25:18.693366+0000","last_active":"2024-08-17T02:25:18.700074+0000","last_peered":"2024-08-17T02:25:18.700074+0000","last_clean":"2024-08-17T02:25:18.700074+0000","last_became_active":"2024-08-17T02:25:18.693093+0000","last_became_peered":"2024-08-17T02:25:18.693093+0000","last_unstale":"2024-08-17T02:25:18.700074+0000","last_undegraded":"2024-08-17T02:25:18.700074+0000","last_fullsized":"2024-08-17T02:25:18.700074+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:23.240941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.664605+0000","last_change":"2024-08-17T02:25:17.668970+0000","last_active":"2024-08-17T02:25:18.664605+0000","last_peered":"2024-08-17T02:25:18.664605+0000","last_clean":"2024-08-17T02:25:18.664605+0000","last_became_active":"2024-08-17T02:25:17.668716+0000","last_became_peered":"2024-08-17T02:25:17.668716+0000","last_unstale":"2024-08-17T02:25:18.664605+0000","last_undegraded":"2024-08-17T02:25:18.664605+0000","last_fullsized":"2024-08-17T02:25:18.664605+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:48:25.682657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.689579+0000","last_change":"2024-08-17T02:25:18.686951+0000","last_active":"2024-08-17T02:25:18.689579+0000","last_peered":"2024-08-17T02:25:18.689579+0000","last_clean":"2024-08-17T02:25:18.689579+0000","last_became_active":"2024-08-17T02:25:18.686679+0000","last_became_peered":"2024-08-17T02:25:18.686679+0000","last_unstale":"2024-08-17T02:25:18.689579+0000","last_undegraded":"2024-08-17T02:25:18.689579+0000","last_fullsized":"2024-08-17T02:25:18.689579+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:21:54.496023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.682615+0000","last_change":"2024-08-17T02:25:17.683540+0000","last_active":"2024-08-17T02:25:18.682615+0000","last_peered":"2024-08-17T02:25:18.682615+0000","last_clean":"2024-08-17T02:25:18.682615+0000","last_became_active":"2024-08-17T02:25:17.683254+0000","last_became_peered":"2024-08-17T02:25:17.683254+0000","last_unstale":"2024-08-17T02:25:18.682615+0000","last_undegraded":"2024-08-17T02:25:18.682615+0000","last_fullsized":"2024-08-17T02:25:18.682615+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:48:25.682657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.696954+0000","last_change":"2024-08-17T02:25:18.686296+0000","last_active":"2024-08-17T02:25:18.696954+0000","last_peered":"2024-08-17T02:25:18.696954+0000","last_clean":"2024-08-17T02:25:18.696954+0000","last_became_active":"2024-08-17T02:25:18.686010+0000","last_became_peered":"2024-08-17T02:25:18.686010+0000","last_unstale":"2024-08-17T02:25:18.696954+0000","last_undegraded":"2024-08-17T02:25:18.696954+0000","last_fullsized":"2024-08-17T02:25:18.696954+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:51:04.058113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.667223+0000","last_change":"2024-08-17T02:25:17.678168+0000","last_active":"2024-08-17T02:25:18.667223+0000","last_peered":"2024-08-17T02:25:18.667223+0000","last_clean":"2024-08-17T02:25:18.667223+0000","last_became_active":"2024-08-17T02:25:17.677901+0000","last_became_peered":"2024-08-17T02:25:17.677901+0000","last_unstale":"2024-08-17T02:25:18.667223+0000","last_undegraded":"2024-08-17T02:25:18.667223+0000","last_fullsized":"2024-08-17T02:25:18.667223+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:18:28.078127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.696309+0000","last_change":"2024-08-17T02:25:18.692788+0000","last_active":"2024-08-17T02:25:18.696309+0000","last_peered":"2024-08-17T02:25:18.696309+0000","last_clean":"2024-08-17T02:25:18.696309+0000","last_became_active":"2024-08-17T02:25:18.692523+0000","last_became_peered":"2024-08-17T02:25:18.692523+0000","last_unstale":"2024-08-17T02:25:18.696309+0000","last_undegraded":"2024-08-17T02:25:18.696309+0000","last_fullsized":"2024-08-17T02:25:18.696309+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:03.637453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.670714+0000","last_change":"2024-08-17T02:25:17.688335+0000","last_active":"2024-08-17T02:25:18.670714+0000","last_peered":"2024-08-17T02:25:18.670714+0000","last_clean":"2024-08-17T02:25:18.670714+0000","last_became_active":"2024-08-17T02:25:17.688083+0000","last_became_peered":"2024-08-17T02:25:17.688083+0000","last_unstale":"2024-08-17T02:25:18.670714+0000","last_undegraded":"2024-08-17T02:25:18.670714+0000","last_fullsized":"2024-08-17T02:25:18.670714+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:59:35.599774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.687527+0000","last_change":"2024-08-17T02:25:18.684557+0000","last_active":"2024-08-17T02:25:18.687527+0000","last_peered":"2024-08-17T02:25:18.687527+0000","last_clean":"2024-08-17T02:25:18.687527+0000","last_became_active":"2024-08-17T02:25:18.684031+0000","last_became_peered":"2024-08-17T02:25:18.684031+0000","last_unstale":"2024-08-17T02:25:18.687527+0000","last_undegraded":"2024-08-17T02:25:18.687527+0000","last_fullsized":"2024-08-17T02:25:18.687527+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:17.653714+0000","last_clean_scrub_stamp":"2024-08-17T02:25:17.653714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:22:19.225830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.680651+0000","last_change":"2024-08-17T02:25:17.684468+0000","last_active":"2024-08-17T02:25:18.680651+0000","last_peered":"2024-08-17T02:25:18.680651+0000","last_clean":"2024-08-17T02:25:18.680651+0000","last_became_active":"2024-08-17T02:25:17.684195+0000","last_became_peered":"2024-08-17T02:25:17.684195+0000","last_unstale":"2024-08-17T02:25:18.680651+0000","last_undegraded":"2024-08-17T02:25:18.680651+0000","last_fullsized":"2024-08-17T02:25:18.680651+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:16.647077+0000","last_clean_scrub_stamp":"2024-08-17T02:25:16.647077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:54:09.951612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":172,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:25:18.677542+0000","last_change":"2024-08-17T02:24:25.092772+0000","last_active":"2024-08-17T02:25:18.677542+0000","last_peered":"2024-08-17T02:25:18.677542+0000","last_clean":"2024-08-17T02:25:18.677542+0000","last_became_active":"2024-08-17T02:24:25.091788+0000","last_became_peered":"2024-08-17T02:24:25.091788+0000","last_unstale":"2024-08-17T02:25:18.677542+0000","last_undegraded":"2024-08-17T02:25:18.677542+0000","last_fullsized":"2024-08-17T02:25:18.677542+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:24.051996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:24.051996+0000","last_clean_scrub_stamp":"2024-08-17T02:24:24.051996+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:31:45.454480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302456,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069384,"statfs":{"total":96636764160,"available":96327049216,"internally_reserved":0,"allocated":958464,"data_stored":728831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.68100000000000005}]},{"osd":1,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.82799999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.63500000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.75800000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.60499999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.85499999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.88},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.55100000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301884,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069956,"statfs":{"total":96636764160,"available":96327634944,"internally_reserved":0,"allocated":368640,"data_stored":138977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301884,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069956,"statfs":{"total":96636764160,"available":96327634944,"internally_reserved":0,"allocated":368640,"data_stored":139033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":3.1440000000000001,"5min":3.1440000000000001,"15min":3.1440000000000001},"last":0.57299999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.69199999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":3.2559999999999998,"5min":3.2559999999999998,"15min":3.2559999999999998},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.64300000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":3.2229999999999999,"5min":3.2229999999999999,"15min":3.2229999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":3.1859999999999999,"5min":3.1859999999999999,"15min":3.1859999999999999},"last":0.72699999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.66300000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.62},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.49199999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.75900000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301884,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069956,"statfs":{"total":96636764160,"available":96327634944,"internally_reserved":0,"allocated":368640,"data_stored":138477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":376832,"data_stored":139947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.375},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.33500000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.48199999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.41799999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.81899999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.80100000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.83399999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.85999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":364544,"data_stored":138443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":376832,"data_stored":139947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298292,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073548,"statfs":{"total":96636764160,"available":96331313152,"internally_reserved":0,"allocated":954368,"data_stored":728741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:25:27.814 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-08-17T02:25:27.814 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-08-17T02:25:28.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.004+0000 7f57dd600640 1 Processor -- start 2024-08-17T02:25:28.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.005+0000 7f57dd600640 1 -- start start 2024-08-17T02:25:28.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.006+0000 7f57dd600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f57d806e5f0 0x7f57d80c8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.006+0000 7f57dd600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57d80ae9b0 con 0x7f57d8156c60 2024-08-17T02:25:28.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.006+0000 7f57dd600640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57d80ab320 con 0x7f57d8156890 2024-08-17T02:25:28.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.006+0000 7f57dd600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57d80aa730 con 0x7f57d806e5f0 2024-08-17T02:25:28.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.006+0000 7f57ce000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f57d806e5f0 0x7f57d80c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.006+0000 7f57ce000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f57d806e5f0 0x7f57d80c8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60418/0 (socket says 172.21.15.107:60418) 2024-08-17T02:25:28.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.006+0000 7f57ce000640 1 -- 172.21.15.107:0/956825951 learned_addr learned my addr 172.21.15.107:0/956825951 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:28.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.006+0000 7f57d7400640 1 --1- 172.21.15.107:0/956825951 >> v1:172.21.15.107:6789/0 conn(0x7f57d8156c60 0x7f57d80ca3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:59896/0 (socket says 172.21.15.107:59896) 2024-08-17T02:25:28.009 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.007+0000 7f57ce000640 1 -- 172.21.15.107:0/956825951 >> v1:172.21.15.157:6789/0 conn(0x7f57d8156890 legacy=0x7f57d806dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.009 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.007+0000 7f57ce000640 1 -- 172.21.15.107:0/956825951 >> v1:172.21.15.107:6789/0 conn(0x7f57d8156c60 legacy=0x7f57d80ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.009 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.007+0000 7f57ce000640 1 -- 172.21.15.107:0/956825951 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d80aa9f0 con 0x7f57d806e5f0 2024-08-17T02:25:28.009 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.007+0000 7f57d6000640 1 -- 172.21.15.107:0/956825951 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2638759453 0 0) 0x7f57d80ae9b0 con 0x7f57d8156c60 2024-08-17T02:25:28.009 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.008+0000 7f57ce000640 1 --2- 172.21.15.107:0/956825951 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57d806e5f0 0x7f57d80c8130 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f57c0009910 tx=0x7f57c00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7a0d097df3de414 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:28.009 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.008+0000 7f57d6000640 1 -- 172.21.15.107:0/956825951 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c002ae60 con 0x7f57d806e5f0 2024-08-17T02:25:28.009 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.008+0000 7f57d6000640 1 -- 172.21.15.107:0/956825951 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c0032440 con 0x7f57d806e5f0 2024-08-17T02:25:28.009 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.008+0000 7f57d6000640 1 -- 172.21.15.107:0/956825951 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c00327e0 con 0x7f57d806e5f0 2024-08-17T02:25:28.010 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.008+0000 7f57dd600640 1 -- 172.21.15.107:0/956825951 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57d806e5f0 msgr2=0x7f57d80c8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.010 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.008+0000 7f57dd600640 1 --2- 172.21.15.107:0/956825951 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57d806e5f0 0x7f57d80c8130 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f57c0009910 tx=0x7f57c00091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.010 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.009+0000 7f57dd600640 1 -- 172.21.15.107:0/956825951 shutdown_connections 2024-08-17T02:25:28.010 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.009+0000 7f57dd600640 1 --2- 172.21.15.107:0/956825951 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57d806e5f0 0x7f57d80c8130 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.010 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.009+0000 7f57dd600640 1 -- 172.21.15.107:0/956825951 >> 172.21.15.107:0/956825951 conn(0x7f57d8067750 msgr2=0x7f57d806c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:28.011 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.009+0000 7f57dd600640 1 -- 172.21.15.107:0/956825951 shutdown_connections 2024-08-17T02:25:28.011 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.009+0000 7f57dd600640 1 -- 172.21.15.107:0/956825951 wait complete. 2024-08-17T02:25:28.011 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.010+0000 7f57dd600640 1 Processor -- start 2024-08-17T02:25:28.011 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.010+0000 7f57dd600640 1 -- start start 2024-08-17T02:25:28.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.011+0000 7f57dd600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57d806e5f0 0x7f57d8148bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.011+0000 7f57dd600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f57d8156890 0x7f57d8148240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.011+0000 7f57dd600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f57d8156c60 0x7f57d816a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.011+0000 7f57dd600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d814d7c0 con 0x7f57d806e5f0 2024-08-17T02:25:28.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.011+0000 7f57dd600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d816b430 con 0x7f57d8156890 2024-08-17T02:25:28.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.011+0000 7f57dd600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d816b710 con 0x7f57d8156c60 2024-08-17T02:25:28.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.011+0000 7f57d6a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57d806e5f0 0x7f57d8148bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.011+0000 7f57d6a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57d806e5f0 0x7f57d8148bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60430/0 (socket says 172.21.15.107:60430) 2024-08-17T02:25:28.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.011+0000 7f57d6a00640 1 -- 172.21.15.107:0/503195704 learned_addr learned my addr 172.21.15.107:0/503195704 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:28.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.012+0000 7f57ce000640 1 --2- 172.21.15.107:0/503195704 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f57d8156890 0x7f57d8148240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.012+0000 7f57d7400640 1 --2- 172.21.15.107:0/503195704 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f57d8156c60 0x7f57d816a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.012+0000 7f57d6a00640 1 -- 172.21.15.107:0/503195704 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f57d8156c60 msgr2=0x7f57d816a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.012+0000 7f57d6a00640 1 --2- 172.21.15.107:0/503195704 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f57d8156c60 0x7f57d816a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.012+0000 7f57d6a00640 1 -- 172.21.15.107:0/503195704 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f57d8156890 msgr2=0x7f57d8148240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.012+0000 7f57d6a00640 1 --2- 172.21.15.107:0/503195704 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f57d8156890 0x7f57d8148240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.012+0000 7f57d6a00640 1 -- 172.21.15.107:0/503195704 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c0009450 con 0x7f57d806e5f0 2024-08-17T02:25:28.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.012+0000 7f57d6a00640 1 --2- 172.21.15.107:0/503195704 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57d806e5f0 0x7f57d8148bd0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f57c800c560 tx=0x7f57c8007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:28.015 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.012+0000 7f57cea00640 1 -- 172.21.15.107:0/503195704 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c8011590 con 0x7f57d806e5f0 2024-08-17T02:25:28.015 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.012+0000 7f57cea00640 1 -- 172.21.15.107:0/503195704 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c8011710 con 0x7f57d806e5f0 2024-08-17T02:25:28.015 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.012+0000 7f57cea00640 1 -- 172.21.15.107:0/503195704 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c8011ad0 con 0x7f57d806e5f0 2024-08-17T02:25:28.015 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.012+0000 7f57dd600640 1 -- 172.21.15.107:0/503195704 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57d814d450 con 0x7f57d806e5f0 2024-08-17T02:25:28.015 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.012+0000 7f57dd600640 1 -- 172.21.15.107:0/503195704 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57d814d100 con 0x7f57d806e5f0 2024-08-17T02:25:28.015 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.013+0000 7f57dd600640 1 -- 172.21.15.107:0/503195704 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57d80710c0 con 0x7f57d806e5f0 2024-08-17T02:25:28.015 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.014+0000 7f57cea00640 1 -- 172.21.15.107:0/503195704 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f57c801b3b0 con 0x7f57d806e5f0 2024-08-17T02:25:28.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.015+0000 7f57cea00640 1 --2- 172.21.15.107:0/503195704 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f57b4065150 0x7f57b4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.015+0000 7f57cea00640 1 -- 172.21.15.107:0/503195704 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f57c8081a90 con 0x7f57d806e5f0 2024-08-17T02:25:28.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.015+0000 7f57ce000640 1 --2- 172.21.15.107:0/503195704 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f57b4065150 0x7f57b4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.016+0000 7f57ce000640 1 --2- 172.21.15.107:0/503195704 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f57b4065150 0x7f57b4067600 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f57c0034000 tx=0x7f57c0032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:28.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.019+0000 7f57cea00640 1 -- 172.21.15.107:0/503195704 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f57c804fab0 con 0x7f57d806e5f0 2024-08-17T02:25:28.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.255+0000 7f57dd600640 1 -- 172.21.15.107:0/503195704 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f57d8069420 con 0x7f57d806e5f0 2024-08-17T02:25:28.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.259+0000 7f57cea00640 1 -- 172.21.15.107:0/503195704 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f57c8017070 con 0x7f57d806e5f0 2024-08-17T02:25:28.260 INFO:teuthology.orchestra.run.smithi107.stderr:updated caps for client.0 2024-08-17T02:25:28.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.261+0000 7f57dd600640 1 -- 172.21.15.107:0/503195704 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f57b4065150 msgr2=0x7f57b4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.261+0000 7f57dd600640 1 --2- 172.21.15.107:0/503195704 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f57b4065150 0x7f57b4067600 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f57c0034000 tx=0x7f57c0032000 comp rx=0 tx=0).stop 2024-08-17T02:25:28.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.261+0000 7f57dd600640 1 -- 172.21.15.107:0/503195704 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57d806e5f0 msgr2=0x7f57d8148bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.261+0000 7f57dd600640 1 --2- 172.21.15.107:0/503195704 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57d806e5f0 0x7f57d8148bd0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f57c800c560 tx=0x7f57c8007ef0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.261+0000 7f57dd600640 1 -- 172.21.15.107:0/503195704 shutdown_connections 2024-08-17T02:25:28.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.261+0000 7f57dd600640 1 --2- 172.21.15.107:0/503195704 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f57b4065150 0x7f57b4067600 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.261+0000 7f57dd600640 1 --2- 172.21.15.107:0/503195704 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f57d8156c60 0x7f57d816a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.261+0000 7f57dd600640 1 --2- 172.21.15.107:0/503195704 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f57d8156890 0x7f57d8148240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.261+0000 7f57dd600640 1 --2- 172.21.15.107:0/503195704 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57d806e5f0 0x7f57d8148bd0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.261+0000 7f57dd600640 1 -- 172.21.15.107:0/503195704 >> 172.21.15.107:0/503195704 conn(0x7f57d8067750 msgr2=0x7f57d806dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:28.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.261+0000 7f57dd600640 1 -- 172.21.15.107:0/503195704 shutdown_connections 2024-08-17T02:25:28.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.261+0000 7f57dd600640 1 -- 172.21.15.107:0/503195704 wait complete. 2024-08-17T02:25:28.277 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:25:28.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.423+0000 7f8784e00640 1 Processor -- start 2024-08-17T02:25:28.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.423+0000 7f8784e00640 1 -- start start 2024-08-17T02:25:28.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.424+0000 7f8784e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f87800ccca0 0x7f8780163870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.424+0000 7f8784e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87800cadc0 con 0x7f8780159ca0 2024-08-17T02:25:28.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.424+0000 7f8784e00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87800cb060 con 0x7f87800ceb40 2024-08-17T02:25:28.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.424+0000 7f8784e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87800cd6e0 con 0x7f87800ccca0 2024-08-17T02:25:28.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.424+0000 7f877f400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f8780159ca0 0x7f87800ca360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:59898/0 (socket says 172.21.15.107:59898) 2024-08-17T02:25:28.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.424+0000 7f877f400640 1 -- 172.21.15.107:0/4200612307 learned_addr learned my addr 172.21.15.107:0/4200612307 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:25:28.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.425+0000 7f877fe00640 1 --2- 172.21.15.107:0/4200612307 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f87800ccca0 0x7f8780163870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.425+0000 7f877ea00640 1 -- 172.21.15.107:0/4200612307 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4218497202 0 0) 0x7f87800cadc0 con 0x7f8780159ca0 2024-08-17T02:25:28.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.425+0000 7f877ea00640 1 -- 172.21.15.107:0/4200612307 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87640034e0 con 0x7f8780159ca0 2024-08-17T02:25:28.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.425+0000 7f877ea00640 1 -- 172.21.15.107:0/4200612307 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3325532643 0 0) 0x7f87800cb060 con 0x7f87800ceb40 2024-08-17T02:25:28.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.425+0000 7f877ea00640 1 -- 172.21.15.107:0/4200612307 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87800cadc0 con 0x7f87800ceb40 2024-08-17T02:25:28.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.425+0000 7f877fe00640 1 -- 172.21.15.107:0/4200612307 >> v1:172.21.15.157:6789/0 conn(0x7f87800ceb40 legacy=0x7f87800cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.425+0000 7f877fe00640 1 -- 172.21.15.107:0/4200612307 >> v1:172.21.15.107:6789/0 conn(0x7f8780159ca0 legacy=0x7f87800ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.425+0000 7f877ea00640 1 -- 172.21.15.107:0/4200612307 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1301729766 0 0) 0x7f87640034e0 con 0x7f8780159ca0 2024-08-17T02:25:28.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.425+0000 7f877fe00640 1 -- 172.21.15.107:0/4200612307 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87800cb300 con 0x7f87800ccca0 2024-08-17T02:25:28.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.426+0000 7f877fe00640 1 --2- 172.21.15.107:0/4200612307 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f87800ccca0 0x7f8780163870 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8778009e90 tx=0x7f8778009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76daee26e3288e6f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:28.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.426+0000 7f877ea00640 1 -- 172.21.15.107:0/4200612307 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8778007550 con 0x7f87800ccca0 2024-08-17T02:25:28.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.427+0000 7f877ea00640 1 -- 172.21.15.107:0/4200612307 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877802d050 con 0x7f87800ccca0 2024-08-17T02:25:28.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.427+0000 7f877ea00640 1 -- 172.21.15.107:0/4200612307 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87780078c0 con 0x7f87800ccca0 2024-08-17T02:25:28.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.427+0000 7f8784e00640 1 -- 172.21.15.107:0/4200612307 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f87800ccca0 msgr2=0x7f8780163870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.427+0000 7f8784e00640 1 --2- 172.21.15.107:0/4200612307 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f87800ccca0 0x7f8780163870 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8778009e90 tx=0x7f8778009780 comp rx=0 tx=0).stop 2024-08-17T02:25:28.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.427+0000 7f8784e00640 1 -- 172.21.15.107:0/4200612307 shutdown_connections 2024-08-17T02:25:28.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.427+0000 7f8784e00640 1 --2- 172.21.15.107:0/4200612307 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f87800ccca0 0x7f8780163870 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.427+0000 7f8784e00640 1 -- 172.21.15.107:0/4200612307 >> 172.21.15.107:0/4200612307 conn(0x7f8780098e00 msgr2=0x7f878006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:28.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.427+0000 7f8784e00640 1 -- 172.21.15.107:0/4200612307 shutdown_connections 2024-08-17T02:25:28.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.427+0000 7f8784e00640 1 -- 172.21.15.107:0/4200612307 wait complete. 2024-08-17T02:25:28.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.429+0000 7f8784e00640 1 Processor -- start 2024-08-17T02:25:28.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.429+0000 7f8784e00640 1 -- start start 2024-08-17T02:25:28.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.430+0000 7f8784e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87800ccca0 0x7f878009b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.430+0000 7f8784e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f87800ceb40 0x7f8780067550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.430+0000 7f8784e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8780159ca0 0x7f8780099a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.430+0000 7f8784e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878009cd70 con 0x7f87800ccca0 2024-08-17T02:25:28.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.430+0000 7f8784e00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878009c160 con 0x7f8780159ca0 2024-08-17T02:25:28.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.430+0000 7f8784e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878009c440 con 0x7f87800ceb40 2024-08-17T02:25:28.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.430+0000 7f877f400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87800ccca0 0x7f878009b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.430+0000 7f877f400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87800ccca0 0x7f878009b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60434/0 (socket says 172.21.15.107:60434) 2024-08-17T02:25:28.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.430+0000 7f877f400640 1 -- 172.21.15.107:0/2964259438 learned_addr learned my addr 172.21.15.107:0/2964259438 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:28.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.430+0000 7f877fe00640 1 --2- 172.21.15.107:0/2964259438 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8780159ca0 0x7f8780099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.430+0000 7f8777e00640 1 --2- 172.21.15.107:0/2964259438 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f87800ceb40 0x7f8780067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.430+0000 7f877f400640 1 -- 172.21.15.107:0/2964259438 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f87800ceb40 msgr2=0x7f8780067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.430+0000 7f877f400640 1 --2- 172.21.15.107:0/2964259438 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f87800ceb40 0x7f8780067550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.430+0000 7f877f400640 1 -- 172.21.15.107:0/2964259438 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8780159ca0 msgr2=0x7f8780099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.430+0000 7f877f400640 1 --2- 172.21.15.107:0/2964259438 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8780159ca0 0x7f8780099a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.430+0000 7f877f400640 1 -- 172.21.15.107:0/2964259438 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8778009a20 con 0x7f87800ccca0 2024-08-17T02:25:28.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.431+0000 7f877f400640 1 --2- 172.21.15.107:0/2964259438 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87800ccca0 0x7f878009b810 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f877000c510 tx=0x7f8770007ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:28.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.431+0000 7f8776a00640 1 -- 172.21.15.107:0/2964259438 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8770007360 con 0x7f87800ccca0 2024-08-17T02:25:28.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.431+0000 7f8776a00640 1 -- 172.21.15.107:0/2964259438 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87700074c0 con 0x7f87800ccca0 2024-08-17T02:25:28.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.431+0000 7f8776a00640 1 -- 172.21.15.107:0/2964259438 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87700049f0 con 0x7f87800ccca0 2024-08-17T02:25:28.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.431+0000 7f8784e00640 1 -- 172.21.15.107:0/2964259438 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f878009c720 con 0x7f87800ccca0 2024-08-17T02:25:28.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.431+0000 7f8784e00640 1 -- 172.21.15.107:0/2964259438 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f878009bd50 con 0x7f87800ccca0 2024-08-17T02:25:28.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.432+0000 7f8784e00640 1 -- 172.21.15.107:0/2964259438 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8780071050 con 0x7f87800ccca0 2024-08-17T02:25:28.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.433+0000 7f8776a00640 1 -- 172.21.15.107:0/2964259438 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8770014420 con 0x7f87800ccca0 2024-08-17T02:25:28.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.433+0000 7f8776a00640 1 --2- 172.21.15.107:0/2964259438 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f875c065150 0x7f875c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.434+0000 7f8776a00640 1 -- 172.21.15.107:0/2964259438 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f87700821c0 con 0x7f87800ccca0 2024-08-17T02:25:28.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.434+0000 7f8777e00640 1 --2- 172.21.15.107:0/2964259438 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f875c065150 0x7f875c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.434+0000 7f8777e00640 1 --2- 172.21.15.107:0/2964259438 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f875c065150 0x7f875c067600 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f87800cd260 tx=0x7f8768009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:28.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.437+0000 7f8776a00640 1 -- 172.21.15.107:0/2964259438 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8770050320 con 0x7f87800ccca0 2024-08-17T02:25:28.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.645+0000 7f8784e00640 1 -- 172.21.15.107:0/2964259438 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8780062f50 con 0x7f87800ccca0 2024-08-17T02:25:28.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.645+0000 7f8776a00640 1 -- 172.21.15.107:0/2964259438 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f8770007630 con 0x7f87800ccca0 2024-08-17T02:25:28.647 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:25:28.647 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4682,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/855770365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":855770365},{"type":"v1","addr":"172.21.15.107:6836","nonce":855770365}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4688,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6834/1749905502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1749905502},{"type":"v1","addr":"172.21.15.157:6834","nonce":1749905502}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4914,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/809431952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":809431952},{"type":"v1","addr":"172.21.15.107:6837","nonce":809431952}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:18.071301+0000","modified":"2024-08-17T02:25:21.685727+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4920":{"gid":4920,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6835/1725535660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6833","nonce":1725535660},{"type":"v1","addr":"172.21.15.157:6835","nonce":1725535660}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-08-17T02:25:28.647 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 17 2024-08-17T02:25:28.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.647+0000 7f8784e00640 1 -- 172.21.15.107:0/2964259438 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f875c065150 msgr2=0x7f875c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.647+0000 7f8784e00640 1 --2- 172.21.15.107:0/2964259438 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f875c065150 0x7f875c067600 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f87800cd260 tx=0x7f8768009040 comp rx=0 tx=0).stop 2024-08-17T02:25:28.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.647+0000 7f8784e00640 1 -- 172.21.15.107:0/2964259438 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87800ccca0 msgr2=0x7f878009b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.647+0000 7f8784e00640 1 --2- 172.21.15.107:0/2964259438 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87800ccca0 0x7f878009b810 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f877000c510 tx=0x7f8770007ce0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.647+0000 7f8784e00640 1 -- 172.21.15.107:0/2964259438 shutdown_connections 2024-08-17T02:25:28.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.647+0000 7f8784e00640 1 --2- 172.21.15.107:0/2964259438 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f875c065150 0x7f875c067600 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.647+0000 7f8784e00640 1 --2- 172.21.15.107:0/2964259438 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8780159ca0 0x7f8780099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.647+0000 7f8784e00640 1 --2- 172.21.15.107:0/2964259438 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f87800ceb40 0x7f8780067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.647+0000 7f8784e00640 1 --2- 172.21.15.107:0/2964259438 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87800ccca0 0x7f878009b810 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.647+0000 7f8784e00640 1 -- 172.21.15.107:0/2964259438 >> 172.21.15.107:0/2964259438 conn(0x7f8780098e00 msgr2=0x7f8780155de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:28.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.648+0000 7f8784e00640 1 -- 172.21.15.107:0/2964259438 shutdown_connections 2024-08-17T02:25:28.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:28.648+0000 7f8784e00640 1 -- 172.21.15.107:0/2964259438 wait complete. 2024-08-17T02:25:29.066 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-17T02:25:18.071301+0000', 'modified': '2024-08-17T02:25:21.685727+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4920}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4920': {'gid': 4920, 'name': 'd', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.157:6835/1725535660', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6833', 'nonce': 1725535660}, {'type': 'v1', 'addr': '172.21.15.157:6835', 'nonce': 1725535660}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-08-17T02:25:29.067 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-17T02:25:29.067 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-08-17T02:25:29.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.216+0000 7f90d0400640 1 Processor -- start 2024-08-17T02:25:29.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.216+0000 7f90d0400640 1 -- start start 2024-08-17T02:25:29.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.217+0000 7f90d0400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90c8155a20 0x7f90c80adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:29.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.217+0000 7f90d0400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f90c8155df0 0x7f90c80ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:29.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.217+0000 7f90d0400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90c8156670 con 0x7f90c806d7f0 2024-08-17T02:25:29.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.217+0000 7f90d0400640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90c80b0350 con 0x7f90c8155df0 2024-08-17T02:25:29.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.217+0000 7f90d0400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c806e5e0 con 0x7f90c8155a20 2024-08-17T02:25:29.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.217+0000 7f90ce400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f90c806d7f0 0x7f90c80ac790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:59910/0 (socket says 172.21.15.107:59910) 2024-08-17T02:25:29.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.217+0000 7f90ce400640 1 -- 172.21.15.107:0/291547561 learned_addr learned my addr 172.21.15.107:0/291547561 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:25:29.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.218+0000 7f90cda00640 1 --2- 172.21.15.107:0/291547561 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90c8155a20 0x7f90c80adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:29.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.218+0000 7f90cd000640 1 --2- 172.21.15.107:0/291547561 >> v2:172.21.15.157:3300/0 conn(0x7f90c8155df0 0x7f90c80ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:29.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.218+0000 7f90c7e00640 1 -- 172.21.15.107:0/291547561 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4196131045 0 0) 0x7f90c8156670 con 0x7f90c806d7f0 2024-08-17T02:25:29.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.218+0000 7f90c7e00640 1 -- 172.21.15.107:0/291547561 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90b00034e0 con 0x7f90c806d7f0 2024-08-17T02:25:29.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.218+0000 7f90c7e00640 1 -- 172.21.15.107:0/291547561 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3715511972 0 0) 0x7f90b00034e0 con 0x7f90c806d7f0 2024-08-17T02:25:29.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.218+0000 7f90c7e00640 1 -- 172.21.15.107:0/291547561 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90c8155a20 msgr2=0x7f90c80adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:29.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.218+0000 7f90c7e00640 1 --2- 172.21.15.107:0/291547561 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90c8155a20 0x7f90c80adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.218+0000 7f90c7e00640 1 -- 172.21.15.107:0/291547561 >> v2:172.21.15.157:3300/0 conn(0x7f90c8155df0 msgr2=0x7f90c80ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:29.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.218+0000 7f90c7e00640 1 --2- 172.21.15.107:0/291547561 >> v2:172.21.15.157:3300/0 conn(0x7f90c8155df0 0x7f90c80ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.218+0000 7f90c7e00640 1 -- 172.21.15.107:0/291547561 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c806e8c0 con 0x7f90c806d7f0 2024-08-17T02:25:29.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.218+0000 7f90c7e00640 1 -- 172.21.15.107:0/291547561 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 537989081 0 0) 0x7f90c00017f0 con 0x7f90c806d7f0 2024-08-17T02:25:29.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.218+0000 7f90c7e00640 1 -- 172.21.15.107:0/291547561 >> v1:172.21.15.107:6789/0 conn(0x7f90c806d7f0 legacy=0x7f90c80ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:29.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.218+0000 7f90c7e00640 1 --2- 172.21.15.107:0/291547561 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90b00039d0 0x7f90b0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:29.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.218+0000 7f90c7e00640 1 --2- 172.21.15.107:0/291547561 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90b0004780 0x7f90b0004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:29.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.218+0000 7f90c7e00640 1 --2- 172.21.15.107:0/291547561 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90c8155a20 0x7f90b0005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:29.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.218+0000 7f90c7e00640 1 -- 172.21.15.107:0/291547561 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c806e5e0 con 0x7f90b00039d0 2024-08-17T02:25:29.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.218+0000 7f90c7e00640 1 -- 172.21.15.107:0/291547561 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b000dbe0 con 0x7f90b0004780 2024-08-17T02:25:29.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.218+0000 7f90c7e00640 1 -- 172.21.15.107:0/291547561 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90b000dd20 con 0x7f90c8155a20 2024-08-17T02:25:29.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.219+0000 7f90cda00640 1 --2- 172.21.15.107:0/291547561 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90b00039d0 0x7f90b0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:29.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.219+0000 7f90cd000640 1 --2- 172.21.15.107:0/291547561 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90b0004780 0x7f90b0004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:29.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.219+0000 7f90ce400640 1 --2- 172.21.15.107:0/291547561 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90c8155a20 0x7f90b0005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:29.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.219+0000 7f90cda00640 1 -- 172.21.15.107:0/291547561 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90c8155a20 msgr2=0x7f90b0005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:29.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.219+0000 7f90cda00640 1 --2- 172.21.15.107:0/291547561 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90c8155a20 0x7f90b0005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.219+0000 7f90cda00640 1 -- 172.21.15.107:0/291547561 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90b0004780 msgr2=0x7f90b0004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:29.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.219+0000 7f90cda00640 1 --2- 172.21.15.107:0/291547561 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90b0004780 0x7f90b0004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.219+0000 7f90cda00640 1 -- 172.21.15.107:0/291547561 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b00034e0 con 0x7f90b00039d0 2024-08-17T02:25:29.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.219+0000 7f90cd000640 1 --2- 172.21.15.107:0/291547561 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90b0004780 0x7f90b0004bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:29.226 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.220+0000 7f90cda00640 1 --2- 172.21.15.107:0/291547561 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90b00039d0 0x7f90b0003de0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f90bc009ba0 tx=0x7f90bc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcfd72a9d2f2f230 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:29.226 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.220+0000 7f90c7e00640 1 -- 172.21.15.107:0/291547561 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc031400 con 0x7f90b00039d0 2024-08-17T02:25:29.226 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.220+0000 7f90c7e00640 1 -- 172.21.15.107:0/291547561 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90bc02d050 con 0x7f90b00039d0 2024-08-17T02:25:29.226 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.220+0000 7f90c7e00640 1 -- 172.21.15.107:0/291547561 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc031790 con 0x7f90b00039d0 2024-08-17T02:25:29.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.221+0000 7f90d0400640 1 -- 172.21.15.107:0/291547561 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90b00039d0 msgr2=0x7f90b0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:29.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.221+0000 7f90d0400640 1 --2- 172.21.15.107:0/291547561 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90b00039d0 0x7f90b0003de0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f90bc009ba0 tx=0x7f90bc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.221+0000 7f90ce400640 1 -- 172.21.15.107:0/291547561 reap_dead start 2024-08-17T02:25:29.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.221+0000 7f90d0400640 1 -- 172.21.15.107:0/291547561 shutdown_connections 2024-08-17T02:25:29.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.221+0000 7f90d0400640 1 -- 172.21.15.107:0/291547561 >> 172.21.15.107:0/291547561 conn(0x7f90c80cb9b0 msgr2=0x7f90c80cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:29.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.221+0000 7f90d0400640 1 -- 172.21.15.107:0/291547561 shutdown_connections 2024-08-17T02:25:29.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.221+0000 7f90d0400640 1 -- 172.21.15.107:0/291547561 wait complete. 2024-08-17T02:25:29.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.222+0000 7f90d0400640 1 Processor -- start 2024-08-17T02:25:29.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.222+0000 7f90d0400640 1 -- start start 2024-08-17T02:25:29.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.223+0000 7f90d0400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90b00039d0 0x7f90c80acaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:29.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.223+0000 7f90d0400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90c80ad030 0x7f90c8145270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:29.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.223+0000 7f90d0400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90c81457b0 0x7f90c80c0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:29.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.223+0000 7f90d0400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c8145c30 con 0x7f90b00039d0 2024-08-17T02:25:29.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.223+0000 7f90d0400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c80c31b0 con 0x7f90c81457b0 2024-08-17T02:25:29.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.223+0000 7f90d0400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c8145eb0 con 0x7f90c80ad030 2024-08-17T02:25:29.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.223+0000 7f90cda00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90b00039d0 0x7f90c80acaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:29.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.223+0000 7f90cda00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90b00039d0 0x7f90c80acaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60456/0 (socket says 172.21.15.107:60456) 2024-08-17T02:25:29.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.223+0000 7f90cda00640 1 -- 172.21.15.107:0/544108920 learned_addr learned my addr 172.21.15.107:0/544108920 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:29.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.224+0000 7f90ce400640 1 --2- 172.21.15.107:0/544108920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90c81457b0 0x7f90c80c0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:29.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.224+0000 7f90cd000640 1 --2- 172.21.15.107:0/544108920 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90c80ad030 0x7f90c8145270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:29.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.224+0000 7f90cda00640 1 -- 172.21.15.107:0/544108920 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90c80ad030 msgr2=0x7f90c8145270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:29.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.224+0000 7f90cda00640 1 --2- 172.21.15.107:0/544108920 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90c80ad030 0x7f90c8145270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.224+0000 7f90cda00640 1 -- 172.21.15.107:0/544108920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90c81457b0 msgr2=0x7f90c80c0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:29.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.224+0000 7f90cda00640 1 --2- 172.21.15.107:0/544108920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90c81457b0 0x7f90c80c0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.224+0000 7f90cda00640 1 -- 172.21.15.107:0/544108920 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c80c1860 con 0x7f90b00039d0 2024-08-17T02:25:29.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.224+0000 7f90cd000640 1 --2- 172.21.15.107:0/544108920 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90c80ad030 0x7f90c8145270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:29.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.224+0000 7f90ce400640 1 --2- 172.21.15.107:0/544108920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90c81457b0 0x7f90c80c0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:29.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.224+0000 7f90cda00640 1 --2- 172.21.15.107:0/544108920 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90b00039d0 0x7f90c80acaf0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f90bc02ab10 tx=0x7f90bc035000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:29.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.224+0000 7f90c4c00640 1 -- 172.21.15.107:0/544108920 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc03c700 con 0x7f90b00039d0 2024-08-17T02:25:29.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.224+0000 7f90c4c00640 1 -- 172.21.15.107:0/544108920 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90bc03c860 con 0x7f90b00039d0 2024-08-17T02:25:29.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.224+0000 7f90c4c00640 1 -- 172.21.15.107:0/544108920 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc03cc20 con 0x7f90b00039d0 2024-08-17T02:25:29.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.224+0000 7f90d0400640 1 -- 172.21.15.107:0/544108920 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90c80c2880 con 0x7f90b00039d0 2024-08-17T02:25:29.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.225+0000 7f90d0400640 1 -- 172.21.15.107:0/544108920 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90c80c2e40 con 0x7f90b00039d0 2024-08-17T02:25:29.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.226+0000 7f90c4c00640 1 -- 172.21.15.107:0/544108920 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f90bc045460 con 0x7f90b00039d0 2024-08-17T02:25:29.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.227+0000 7f90c4c00640 1 --2- 172.21.15.107:0/544108920 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f90a8065180 0x7f90a8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:29.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.227+0000 7f90c4c00640 1 -- 172.21.15.107:0/544108920 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f90bc0a3900 con 0x7f90b00039d0 2024-08-17T02:25:29.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.227+0000 7f90cd000640 1 --2- 172.21.15.107:0/544108920 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f90a8065180 0x7f90a8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:29.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.228+0000 7f90d2a31740 1 Processor -- start 2024-08-17T02:25:29.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.228+0000 7f90cd000640 1 --2- 172.21.15.107:0/544108920 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f90a8065180 0x7f90a8067630 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f90b4006cf0 tx=0x7f90b4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:29.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.228+0000 7f90d2a31740 1 -- start start 2024-08-17T02:25:29.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.229+0000 7f90d2a31740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5644bf551a30 0x5644bf551e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:29.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.229+0000 7f90d2a31740 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5644bf52d0a0 0x5644bf56f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:29.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.229+0000 7f90d2a31740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644bf56fb10 0x5644bf526900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:29.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.229+0000 7f90d2a31740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644bf4e7380 con 0x5644bf56fb10 2024-08-17T02:25:29.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.229+0000 7f90d2a31740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644bf4909e0 con 0x5644bf551a30 2024-08-17T02:25:29.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.229+0000 7f90d2a31740 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x5644bf48e170 con 0x5644bf52d0a0 2024-08-17T02:25:29.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.229+0000 7f90ce400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644bf56fb10 0x5644bf526900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:29.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.229+0000 7f90ce400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644bf56fb10 0x5644bf526900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60458/0 (socket says 172.21.15.107:60458) 2024-08-17T02:25:29.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.229+0000 7f90ce400640 1 -- 172.21.15.107:0/1752057070 learned_addr learned my addr 172.21.15.107:0/1752057070 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:29.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.229+0000 7f90cda00640 1 --2- 172.21.15.107:0/1752057070 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5644bf551a30 0x5644bf551e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:29.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.229+0000 7f90cd000640 1 --2- 172.21.15.107:0/1752057070 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5644bf52d0a0 0x5644bf56f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:29.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.229+0000 7f90ce400640 1 -- 172.21.15.107:0/1752057070 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5644bf52d0a0 msgr2=0x5644bf56f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:29.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.229+0000 7f90ce400640 1 --2- 172.21.15.107:0/1752057070 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5644bf52d0a0 0x5644bf56f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.229+0000 7f90ce400640 1 -- 172.21.15.107:0/1752057070 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5644bf551a30 msgr2=0x5644bf551e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:29.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.229+0000 7f90ce400640 1 --2- 172.21.15.107:0/1752057070 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5644bf551a30 0x5644bf551e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.229+0000 7f90ce400640 1 -- 172.21.15.107:0/1752057070 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5644bf43d820 con 0x5644bf56fb10 2024-08-17T02:25:29.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.229+0000 7f90cd000640 1 --2- 172.21.15.107:0/1752057070 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5644bf52d0a0 0x5644bf56f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:29.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.230+0000 7f90ce400640 1 --2- 172.21.15.107:0/1752057070 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644bf56fb10 0x5644bf526900 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f90c806bc30 tx=0x7f90c0006040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc12698909570ed4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:29.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.230+0000 7f90b9600640 1 -- 172.21.15.107:0/1752057070 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c0019070 con 0x5644bf56fb10 2024-08-17T02:25:29.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.230+0000 7f90b9600640 1 -- 172.21.15.107:0/1752057070 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c0004ee0 con 0x5644bf56fb10 2024-08-17T02:25:29.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.230+0000 7f90b9600640 1 -- 172.21.15.107:0/1752057070 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c00052a0 con 0x5644bf56fb10 2024-08-17T02:25:29.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.230+0000 7f90d2a31740 1 -- 172.21.15.107:0/1752057070 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644bf56fb10 msgr2=0x5644bf526900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:29.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.230+0000 7f90d2a31740 1 --2- 172.21.15.107:0/1752057070 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644bf56fb10 0x5644bf526900 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f90c806bc30 tx=0x7f90c0006040 comp rx=0 tx=0).stop 2024-08-17T02:25:29.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.231+0000 7f90d2a31740 1 -- 172.21.15.107:0/1752057070 shutdown_connections 2024-08-17T02:25:29.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.231+0000 7f90d2a31740 1 --2- 172.21.15.107:0/1752057070 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644bf56fb10 0x5644bf526900 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.231+0000 7f90d2a31740 1 --2- 172.21.15.107:0/1752057070 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5644bf52d0a0 0x5644bf56f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.231+0000 7f90d2a31740 1 --2- 172.21.15.107:0/1752057070 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5644bf551a30 0x5644bf551e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.231+0000 7f90d2a31740 1 -- 172.21.15.107:0/1752057070 >> 172.21.15.107:0/1752057070 conn(0x5644bf4c5030 msgr2=0x5644bf573c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:29.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.231+0000 7f90d2a31740 1 -- 172.21.15.107:0/1752057070 shutdown_connections 2024-08-17T02:25:29.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.231+0000 7f90d2a31740 1 -- 172.21.15.107:0/1752057070 wait complete. 2024-08-17T02:25:29.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.231+0000 7f90d2a31740 1 -- start start 2024-08-17T02:25:29.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.231+0000 7f90d2a31740 1 Processor -- start 2024-08-17T02:25:29.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.232+0000 7f90d2a31740 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5644bf52d0a0 0x5644bf554de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:29.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.232+0000 7f90d2a31740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644bf551a30 0x5644bf558fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:29.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.232+0000 7f90d2a31740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5644bf56fb10 0x5644bf559500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:29.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.232+0000 7f90d2a31740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644bf489f60 con 0x5644bf551a30 2024-08-17T02:25:29.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.232+0000 7f90d2a31740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644bf432690 con 0x5644bf56fb10 2024-08-17T02:25:29.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.232+0000 7f90d2a31740 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x5644bf432330 con 0x5644bf52d0a0 2024-08-17T02:25:29.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.232+0000 7f90d2a31740 10 client.0 _ll_register_callbacks cb 0x5644bf42c2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:25:29.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.233+0000 7f90cd000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644bf551a30 0x5644bf558fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:29.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.233+0000 7f90cd000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644bf551a30 0x5644bf558fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60472/0 (socket says 172.21.15.107:60472) 2024-08-17T02:25:29.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.233+0000 7f90cd000640 1 -- 172.21.15.107:0/2090749058 learned_addr learned my addr 172.21.15.107:0/2090749058 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:29.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.233+0000 7f90cda00640 1 --2- 172.21.15.107:0/2090749058 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5644bf52d0a0 0x5644bf554de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:29.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.233+0000 7f90ce400640 1 --2- 172.21.15.107:0/2090749058 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5644bf56fb10 0x5644bf559500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:29.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.233+0000 7f90cd000640 1 -- 172.21.15.107:0/2090749058 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5644bf52d0a0 msgr2=0x5644bf554de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:29.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.233+0000 7f90cd000640 1 --2- 172.21.15.107:0/2090749058 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5644bf52d0a0 0x5644bf554de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.233+0000 7f90cd000640 1 -- 172.21.15.107:0/2090749058 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5644bf56fb10 msgr2=0x5644bf559500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:29.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.233+0000 7f90cd000640 1 --2- 172.21.15.107:0/2090749058 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5644bf56fb10 0x5644bf559500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.233+0000 7f90cd000640 1 -- 172.21.15.107:0/2090749058 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90c000f040 con 0x5644bf551a30 2024-08-17T02:25:29.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.233+0000 7f90cda00640 1 --2- 172.21.15.107:0/2090749058 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5644bf52d0a0 0x5644bf554de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:29.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.233+0000 7f90ce400640 1 --2- 172.21.15.107:0/2090749058 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5644bf56fb10 0x5644bf559500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:29.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.233+0000 7f90cd000640 1 --2- 172.21.15.107:0/2090749058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644bf551a30 0x5644bf558fc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f90b4015c80 tx=0x7f90b4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30b3bde50e21c873 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:29.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.234+0000 7f90ae000640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-08-17T02:25:29.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.234+0000 7f90ae000640 1 -- 172.21.15.107:0/2090749058 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b4015cb0 con 0x5644bf551a30 2024-08-17T02:25:29.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.234+0000 7f90d2a31740 1 -- 172.21.15.107:0/2090749058 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5644bf4bdd20 con 0x5644bf551a30 2024-08-17T02:25:29.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.234+0000 7f90ae000640 1 -- 172.21.15.107:0/2090749058 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f90b4015e10 con 0x5644bf551a30 2024-08-17T02:25:29.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.234+0000 7f90ae000640 1 -- 172.21.15.107:0/2090749058 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90b4023630 con 0x5644bf551a30 2024-08-17T02:25:29.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.234+0000 7f90d2a31740 10 client.5133 fetch_fsmap learned FSMap version 17 2024-08-17T02:25:29.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.234+0000 7f90d2a31740 1 -- 172.21.15.107:0/2090749058 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5644bf453ab0 con 0x5644bf551a30 2024-08-17T02:25:29.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.234+0000 7f90ae000640 1 -- 172.21.15.107:0/2090749058 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5644bf4bdd20 con 0x5644bf551a30 2024-08-17T02:25:29.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.234+0000 7f90ae000640 1 -- 172.21.15.107:0/2090749058 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f90b4023790 con 0x5644bf551a30 2024-08-17T02:25:29.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.234+0000 7f90d2a31740 10 client.5133 fetch_fsmap finished waiting for FSMap version 17 2024-08-17T02:25:29.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.234+0000 7f90d2a31740 10 client.5133 resolve_mds: resolved name 'd' to daemon mds.d 2024-08-17T02:25:29.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.234+0000 7f90d2a31740 20 client.5133 populate_metadata read hostname 'smithi107' 2024-08-17T02:25:29.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.234+0000 7f90d2a31740 1 --2- 172.21.15.107:0/2090749058 >> [v2:172.21.15.157:6833/1725535660,v1:172.21.15.157:6835/1725535660] conn(0x5644bf557bc0 0x5644bf557f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:29.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.234+0000 7f90d2a31740 4 client.5133 mds_command: new command op to 4920 tid=0[{"prefix": "get_command_descriptions"}] 2024-08-17T02:25:29.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.234+0000 7f90d2a31740 1 -- 172.21.15.107:0/2090749058 --> [v2:172.21.15.157:6833/1725535660,v1:172.21.15.157:6835/1725535660] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5644bf1913c0 con 0x5644bf557bc0 2024-08-17T02:25:29.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.235+0000 7f90cda00640 1 --2- 172.21.15.107:0/2090749058 >> [v2:172.21.15.157:6833/1725535660,v1:172.21.15.157:6835/1725535660] conn(0x5644bf557bc0 0x5644bf557f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:29.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.235+0000 7f90cda00640 1 --2- 172.21.15.107:0/2090749058 >> [v2:172.21.15.157:6833/1725535660,v1:172.21.15.157:6835/1725535660] conn(0x5644bf557bc0 0x5644bf557f90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6401ca1152eccabd server_cookie=e92f6b45ab9d53ea in_seq=0 out_seq=0 2024-08-17T02:25:29.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.235+0000 7f90ae000640 10 client.5133 ms_handle_connect on v2:172.21.15.157:6833/1725535660 2024-08-17T02:25:29.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.236+0000 7f90ae000640 1 -- 172.21.15.107:0/2090749058 <== mds.0 v2:172.21.15.157:6833/1725535660 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (crc 0 0 0) 0x5644bf1913c0 con 0x5644bf557bc0 2024-08-17T02:25:29.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.236+0000 7f90ae000640 10 client.5133 handle_command_reply: tid=0 2024-08-17T02:25:29.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.237+0000 7f90d2a31740 1 client.5133 shutdown 2024-08-17T02:25:29.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.237+0000 7f90d2a31740 1 -- 172.21.15.107:0/2090749058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644bf551a30 msgr2=0x5644bf558fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:29.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.237+0000 7f90d2a31740 1 --2- 172.21.15.107:0/2090749058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644bf551a30 0x5644bf558fc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f90b4015c80 tx=0x7f90b4019000 comp rx=0 tx=0).stop 2024-08-17T02:25:29.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.237+0000 7f90d2a31740 1 -- 172.21.15.107:0/2090749058 shutdown_connections 2024-08-17T02:25:29.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.237+0000 7f90d2a31740 1 --2- 172.21.15.107:0/2090749058 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5644bf56fb10 0x5644bf559500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.237+0000 7f90d2a31740 1 --2- 172.21.15.107:0/2090749058 >> [v2:172.21.15.157:6833/1725535660,v1:172.21.15.157:6835/1725535660] conn(0x5644bf557bc0 0x5644bf557f90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.237+0000 7f90d2a31740 1 --2- 172.21.15.107:0/2090749058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644bf551a30 0x5644bf558fc0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.237+0000 7f90d2a31740 1 --2- 172.21.15.107:0/2090749058 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5644bf52d0a0 0x5644bf554de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.237+0000 7f90ae000640 0 client.5133 ms_handle_reset on v2:172.21.15.157:6833/1725535660 2024-08-17T02:25:29.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.237+0000 7f90d2a31740 1 -- 172.21.15.107:0/2090749058 >> 172.21.15.107:0/2090749058 conn(0x5644bf4c5030 msgr2=0x5644bf573750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:29.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.237+0000 7f90d2a31740 1 -- 172.21.15.107:0/2090749058 shutdown_connections 2024-08-17T02:25:29.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.237+0000 7f90d2a31740 1 -- 172.21.15.107:0/2090749058 wait complete. 2024-08-17T02:25:29.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.237+0000 7f90d2a31740 20 client.5133 trim_cache size 0 max 16384 2024-08-17T02:25:29.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.252+0000 7f90d2a31740 1 Processor -- start 2024-08-17T02:25:29.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.253+0000 7f90d2a31740 1 -- start start 2024-08-17T02:25:29.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.253+0000 7f90d2a31740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644bf52d0a0 0x5644bf5587f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:29.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.253+0000 7f90d2a31740 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5644bf551a30 0x5644bf558dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:29.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.253+0000 7f90d2a31740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5644bf56fb10 0x5644bf559310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:29.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.253+0000 7f90d2a31740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644bf204f20 con 0x5644bf52d0a0 2024-08-17T02:25:29.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.253+0000 7f90d2a31740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644bf58a070 con 0x5644bf56fb10 2024-08-17T02:25:29.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.253+0000 7f90d2a31740 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x5644bf559a50 con 0x5644bf551a30 2024-08-17T02:25:29.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.254+0000 7f90cda00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644bf52d0a0 0x5644bf5587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:29.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.254+0000 7f90cda00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644bf52d0a0 0x5644bf5587f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60482/0 (socket says 172.21.15.107:60482) 2024-08-17T02:25:29.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.254+0000 7f90cda00640 1 -- 172.21.15.107:0/2716507510 learned_addr learned my addr 172.21.15.107:0/2716507510 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:29.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.254+0000 7f90cda00640 1 -- 172.21.15.107:0/2716507510 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5644bf551a30 msgr2=0x5644bf558dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:29.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.254+0000 7f90cda00640 1 --2- 172.21.15.107:0/2716507510 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5644bf551a30 0x5644bf558dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.254+0000 7f90cda00640 1 -- 172.21.15.107:0/2716507510 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5644bf56fb10 msgr2=0x5644bf559310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:29.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.254+0000 7f90ce400640 1 --2- 172.21.15.107:0/2716507510 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5644bf56fb10 0x5644bf559310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:29.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.254+0000 7f90cda00640 1 --2- 172.21.15.107:0/2716507510 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5644bf56fb10 0x5644bf559310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.254+0000 7f90cda00640 1 -- 172.21.15.107:0/2716507510 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5644bf457490 con 0x5644bf52d0a0 2024-08-17T02:25:29.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.254+0000 7f90ce400640 1 --2- 172.21.15.107:0/2716507510 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5644bf56fb10 0x5644bf559310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:29.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.254+0000 7f90cda00640 1 --2- 172.21.15.107:0/2716507510 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644bf52d0a0 0x5644bf5587f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f90bc02abe0 tx=0x7f90bc02c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be29e55de87e376c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:29.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.254+0000 7f90ba000640 1 -- 172.21.15.107:0/2716507510 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc0737d0 con 0x5644bf52d0a0 2024-08-17T02:25:29.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.255+0000 7f90ba000640 1 -- 172.21.15.107:0/2716507510 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90bc0a1e90 con 0x5644bf52d0a0 2024-08-17T02:25:29.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.255+0000 7f90ba000640 1 -- 172.21.15.107:0/2716507510 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc073a30 con 0x5644bf52d0a0 2024-08-17T02:25:29.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.255+0000 7f90d2a31740 1 -- 172.21.15.107:0/2716507510 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644bf52d0a0 msgr2=0x5644bf5587f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:29.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.255+0000 7f90d2a31740 1 --2- 172.21.15.107:0/2716507510 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644bf52d0a0 0x5644bf5587f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f90bc02abe0 tx=0x7f90bc02c040 comp rx=0 tx=0).stop 2024-08-17T02:25:29.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.255+0000 7f90d2a31740 1 -- 172.21.15.107:0/2716507510 shutdown_connections 2024-08-17T02:25:29.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.255+0000 7f90d2a31740 1 --2- 172.21.15.107:0/2716507510 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5644bf56fb10 0x5644bf559310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.255+0000 7f90d2a31740 1 --2- 172.21.15.107:0/2716507510 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5644bf551a30 0x5644bf558dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.255+0000 7f90d2a31740 1 --2- 172.21.15.107:0/2716507510 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644bf52d0a0 0x5644bf5587f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.255+0000 7f90d2a31740 1 -- 172.21.15.107:0/2716507510 >> 172.21.15.107:0/2716507510 conn(0x5644bf4c5030 msgr2=0x5644bf5216b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:29.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.255+0000 7f90d2a31740 1 -- 172.21.15.107:0/2716507510 shutdown_connections 2024-08-17T02:25:29.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.255+0000 7f90d2a31740 1 -- 172.21.15.107:0/2716507510 wait complete. 2024-08-17T02:25:29.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.256+0000 7f90d2a31740 1 -- start start 2024-08-17T02:25:29.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.256+0000 7f90d2a31740 1 Processor -- start 2024-08-17T02:25:29.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.257+0000 7f90d2a31740 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5644bf52d0a0 0x5644bf5d64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:29.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.257+0000 7f90d2a31740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5644bf551a30 0x5644bf56e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:29.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.257+0000 7f90d2a31740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644bf56fb10 0x5644bf56e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:29.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.257+0000 7f90d2a31740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644bf5e1600 con 0x5644bf56fb10 2024-08-17T02:25:29.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.257+0000 7f90d2a31740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644bf551610 con 0x5644bf551a30 2024-08-17T02:25:29.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.257+0000 7f90d2a31740 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x5644bf5597e0 con 0x5644bf52d0a0 2024-08-17T02:25:29.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.257+0000 7f90d2a31740 10 client.0 _ll_register_callbacks cb 0x7f90b4009980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:25:29.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.257+0000 7f90ce400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644bf56fb10 0x5644bf56e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:29.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.257+0000 7f90ce400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644bf56fb10 0x5644bf56e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60490/0 (socket says 172.21.15.107:60490) 2024-08-17T02:25:29.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.257+0000 7f90ce400640 1 -- 172.21.15.107:0/583070983 learned_addr learned my addr 172.21.15.107:0/583070983 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:29.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.257+0000 7f90cd000640 1 --2- 172.21.15.107:0/583070983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5644bf551a30 0x5644bf56e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:29.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.257+0000 7f90cda00640 1 --2- 172.21.15.107:0/583070983 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5644bf52d0a0 0x5644bf5d64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:29.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.258+0000 7f90ce400640 1 -- 172.21.15.107:0/583070983 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5644bf52d0a0 msgr2=0x5644bf5d64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:29.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.258+0000 7f90ce400640 1 --2- 172.21.15.107:0/583070983 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5644bf52d0a0 0x5644bf5d64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.258+0000 7f90ce400640 1 -- 172.21.15.107:0/583070983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5644bf551a30 msgr2=0x5644bf56e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:29.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.258+0000 7f90ce400640 1 --2- 172.21.15.107:0/583070983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5644bf551a30 0x5644bf56e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.258+0000 7f90ce400640 1 -- 172.21.15.107:0/583070983 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90c80c2e40 con 0x5644bf56fb10 2024-08-17T02:25:29.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.258+0000 7f90ce400640 1 --2- 172.21.15.107:0/583070983 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644bf56fb10 0x5644bf56e8d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f90c00013a0 tx=0x7f90c0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc9330af147b1f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:29.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.258+0000 7f90ae000640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-08-17T02:25:29.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.258+0000 7f90ae000640 1 -- 172.21.15.107:0/583070983 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c0019070 con 0x5644bf56fb10 2024-08-17T02:25:29.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.258+0000 7f90ae000640 1 -- 172.21.15.107:0/583070983 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f90c0020460 con 0x5644bf56fb10 2024-08-17T02:25:29.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.258+0000 7f90d2a31740 1 -- 172.21.15.107:0/583070983 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f90c0004ee0 con 0x5644bf56fb10 2024-08-17T02:25:29.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.258+0000 7f90ae000640 1 -- 172.21.15.107:0/583070983 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90c0020830 con 0x5644bf56fb10 2024-08-17T02:25:29.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.258+0000 7f90d2a31740 10 client.5139 fetch_fsmap learned FSMap version 17 2024-08-17T02:25:29.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.258+0000 7f90d2a31740 1 -- 172.21.15.107:0/583070983 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5644bf4571e0 con 0x5644bf56fb10 2024-08-17T02:25:29.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.259+0000 7f90ae000640 1 -- 172.21.15.107:0/583070983 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c0004ee0 con 0x5644bf56fb10 2024-08-17T02:25:29.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.259+0000 7f90ae000640 1 -- 172.21.15.107:0/583070983 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f90c0020990 con 0x5644bf56fb10 2024-08-17T02:25:29.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.259+0000 7f90d2a31740 10 client.5139 fetch_fsmap finished waiting for FSMap version 17 2024-08-17T02:25:29.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.259+0000 7f90d2a31740 10 client.5139 resolve_mds: resolved name 'd' to daemon mds.d 2024-08-17T02:25:29.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.259+0000 7f90d2a31740 20 client.5139 populate_metadata read hostname 'smithi107' 2024-08-17T02:25:29.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.259+0000 7f90d2a31740 1 --2- 172.21.15.107:0/583070983 >> [v2:172.21.15.157:6833/1725535660,v1:172.21.15.157:6835/1725535660] conn(0x5644bf5e3870 0x5644bf5e3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:29.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.259+0000 7f90d2a31740 4 client.5139 mds_command: new command op to 4920 tid=0[{"prefix": "status"}] 2024-08-17T02:25:29.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.259+0000 7f90d2a31740 1 -- 172.21.15.107:0/583070983 --> [v2:172.21.15.157:6833/1725535660,v1:172.21.15.157:6835/1725535660] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5644bf1a26c0 con 0x5644bf5e3870 2024-08-17T02:25:29.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.259+0000 7f90cda00640 1 --2- 172.21.15.107:0/583070983 >> [v2:172.21.15.157:6833/1725535660,v1:172.21.15.157:6835/1725535660] conn(0x5644bf5e3870 0x5644bf5e3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:29.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.260+0000 7f90cda00640 1 --2- 172.21.15.107:0/583070983 >> [v2:172.21.15.157:6833/1725535660,v1:172.21.15.157:6835/1725535660] conn(0x5644bf5e3870 0x5644bf5e3c40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9951a8469ab96256 server_cookie=81783badf34cd5c in_seq=0 out_seq=0 2024-08-17T02:25:29.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.260+0000 7f90ae000640 10 client.5139 ms_handle_connect on v2:172.21.15.157:6833/1725535660 2024-08-17T02:25:29.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.260+0000 7f90ae000640 1 -- 172.21.15.107:0/583070983 <== mds.0 v2:172.21.15.157:6833/1725535660 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5644bf1a26c0 con 0x5644bf5e3870 2024-08-17T02:25:29.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.260+0000 7f90ae000640 10 client.5139 handle_command_reply: tid=0 2024-08-17T02:25:29.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.260+0000 7f90d2a31740 1 client.5139 shutdown 2024-08-17T02:25:29.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.260+0000 7f90d2a31740 1 -- 172.21.15.107:0/583070983 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644bf56fb10 msgr2=0x5644bf56e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:29.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.260+0000 7f90d2a31740 1 --2- 172.21.15.107:0/583070983 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644bf56fb10 0x5644bf56e8d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f90c00013a0 tx=0x7f90c0015000 comp rx=0 tx=0).stop 2024-08-17T02:25:29.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.260+0000 7f90d2a31740 1 -- 172.21.15.107:0/583070983 shutdown_connections 2024-08-17T02:25:29.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.260+0000 7f90d2a31740 1 --2- 172.21.15.107:0/583070983 >> [v2:172.21.15.157:6833/1725535660,v1:172.21.15.157:6835/1725535660] conn(0x5644bf5e3870 0x5644bf5e3c40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.260+0000 7f90d2a31740 1 --2- 172.21.15.107:0/583070983 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644bf56fb10 0x5644bf56e8d0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.260+0000 7f90d2a31740 1 --2- 172.21.15.107:0/583070983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5644bf551a30 0x5644bf56e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.260+0000 7f90d2a31740 1 --2- 172.21.15.107:0/583070983 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5644bf52d0a0 0x5644bf5d64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.260+0000 7f90ae000640 0 client.5139 ms_handle_reset on v2:172.21.15.157:6833/1725535660 2024-08-17T02:25:29.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.260+0000 7f90d2a31740 1 -- 172.21.15.107:0/583070983 >> 172.21.15.107:0/583070983 conn(0x5644bf4c5030 msgr2=0x5644bf5895c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:29.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.260+0000 7f90d2a31740 1 -- 172.21.15.107:0/583070983 shutdown_connections 2024-08-17T02:25:29.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.260+0000 7f90d2a31740 1 -- 172.21.15.107:0/583070983 wait complete. 2024-08-17T02:25:29.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.261+0000 7f90d2a31740 20 client.5139 trim_cache size 0 max 16384 2024-08-17T02:25:29.268 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-08-17T02:25:29.268 INFO:teuthology.orchestra.run.smithi107.stdout: "cluster_fsid": "f207b4c0-329d-46b8-b83f-aaf30bdb6ce3", 2024-08-17T02:25:29.268 INFO:teuthology.orchestra.run.smithi107.stdout: "whoami": 0, 2024-08-17T02:25:29.268 INFO:teuthology.orchestra.run.smithi107.stdout: "id": 4920, 2024-08-17T02:25:29.268 INFO:teuthology.orchestra.run.smithi107.stdout: "want_state": "up:active", 2024-08-17T02:25:29.268 INFO:teuthology.orchestra.run.smithi107.stdout: "state": "up:active", 2024-08-17T02:25:29.268 INFO:teuthology.orchestra.run.smithi107.stdout: "fs_name": "cephfs", 2024-08-17T02:25:29.268 INFO:teuthology.orchestra.run.smithi107.stdout: "rank_uptime": 10.599450887, 2024-08-17T02:25:29.268 INFO:teuthology.orchestra.run.smithi107.stdout: "mdsmap_epoch": 17, 2024-08-17T02:25:29.268 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch": 32, 2024-08-17T02:25:29.268 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch_barrier": 32, 2024-08-17T02:25:29.268 INFO:teuthology.orchestra.run.smithi107.stdout: "uptime": 18.417456776000002 2024-08-17T02:25:29.268 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-08-17T02:25:29.269 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.261+0000 7f90d0400640 1 -- 172.21.15.107:0/544108920 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f90a8065180 msgr2=0x7f90a8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:29.269 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.261+0000 7f90d0400640 1 --2- 172.21.15.107:0/544108920 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f90a8065180 0x7f90a8067630 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f90b4006cf0 tx=0x7f90b4008040 comp rx=0 tx=0).stop 2024-08-17T02:25:29.269 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.261+0000 7f90d0400640 1 -- 172.21.15.107:0/544108920 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90b00039d0 msgr2=0x7f90c80acaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:29.269 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.261+0000 7f90d0400640 1 --2- 172.21.15.107:0/544108920 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90b00039d0 0x7f90c80acaf0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f90bc02ab10 tx=0x7f90bc035000 comp rx=0 tx=0).stop 2024-08-17T02:25:29.270 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.261+0000 7f90d0400640 1 -- 172.21.15.107:0/544108920 shutdown_connections 2024-08-17T02:25:29.270 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.261+0000 7f90d0400640 1 --2- 172.21.15.107:0/544108920 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f90a8065180 0x7f90a8067630 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.270 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.261+0000 7f90d0400640 1 --2- 172.21.15.107:0/544108920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90c81457b0 0x7f90c80c0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.270 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.261+0000 7f90d0400640 1 --2- 172.21.15.107:0/544108920 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90c80ad030 0x7f90c8145270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.270 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.261+0000 7f90d0400640 1 --2- 172.21.15.107:0/544108920 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90b00039d0 0x7f90c80acaf0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.270 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.261+0000 7f90d0400640 1 -- 172.21.15.107:0/544108920 >> 172.21.15.107:0/544108920 conn(0x7f90c80cb9b0 msgr2=0x7f90c80ad990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:29.270 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.261+0000 7f90d0400640 1 -- 172.21.15.107:0/544108920 shutdown_connections 2024-08-17T02:25:29.270 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.261+0000 7f90d0400640 1 -- 172.21.15.107:0/544108920 wait complete. 2024-08-17T02:25:29.278 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:25:29.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.424+0000 7f0a15a00640 1 Processor -- start 2024-08-17T02:25:29.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.424+0000 7f0a15a00640 1 -- start start 2024-08-17T02:25:29.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.426+0000 7f0a15a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0a1006df00 0x7f0a100adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:29.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.426+0000 7f0a15a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a10155df0 0x7f0a100ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:29.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.426+0000 7f0a15a00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a10156670 con 0x7f0a10155a20 2024-08-17T02:25:29.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.426+0000 7f0a15a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a100b0350 con 0x7f0a1006df00 2024-08-17T02:25:29.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.426+0000 7f0a15a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1006e5e0 con 0x7f0a10155df0 2024-08-17T02:25:29.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.426+0000 7f0a0e000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0a1006df00 0x7f0a100adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:29.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.426+0000 7f0a0e000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0a1006df00 0x7f0a100adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60502/0 (socket says 172.21.15.107:60502) 2024-08-17T02:25:29.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.426+0000 7f0a0e000640 1 -- 172.21.15.107:0/1629330662 learned_addr learned my addr 172.21.15.107:0/1629330662 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:29.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.426+0000 7f0a0f400640 1 --2- 172.21.15.107:0/1629330662 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a10155df0 0x7f0a100ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:29.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.426+0000 7f0a0e000640 1 -- 172.21.15.107:0/1629330662 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a10155df0 msgr2=0x7f0a100ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:29.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.426+0000 7f0a0e000640 1 --2- 172.21.15.107:0/1629330662 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a10155df0 0x7f0a100ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.426+0000 7f0a0e000640 1 -- 172.21.15.107:0/1629330662 >> v1:172.21.15.157:6789/0 conn(0x7f0a10155a20 legacy=0x7f0a1006d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:29.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.426+0000 7f0a0e000640 1 -- 172.21.15.107:0/1629330662 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a1006e8c0 con 0x7f0a1006df00 2024-08-17T02:25:29.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.427+0000 7f0a0e000640 1 --2- 172.21.15.107:0/1629330662 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a1006df00 0x7f0a100adf10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f09fc00bbc0 tx=0x7f09fc00b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=117cadcadaf97145 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:29.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.428+0000 7f0a0d600640 1 -- 172.21.15.107:0/1629330662 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc031610 con 0x7f0a1006df00 2024-08-17T02:25:29.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.428+0000 7f0a0d600640 1 -- 172.21.15.107:0/1629330662 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09fc031770 con 0x7f0a1006df00 2024-08-17T02:25:29.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.428+0000 7f0a0d600640 1 -- 172.21.15.107:0/1629330662 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc031b50 con 0x7f0a1006df00 2024-08-17T02:25:29.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.428+0000 7f0a15a00640 1 -- 172.21.15.107:0/1629330662 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a1006df00 msgr2=0x7f0a100adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:29.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.428+0000 7f0a15a00640 1 --2- 172.21.15.107:0/1629330662 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a1006df00 0x7f0a100adf10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f09fc00bbc0 tx=0x7f09fc00b460 comp rx=0 tx=0).stop 2024-08-17T02:25:29.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.428+0000 7f0a15a00640 1 -- 172.21.15.107:0/1629330662 shutdown_connections 2024-08-17T02:25:29.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.428+0000 7f0a15a00640 1 --2- 172.21.15.107:0/1629330662 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a10155df0 0x7f0a100ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.428+0000 7f0a15a00640 1 --2- 172.21.15.107:0/1629330662 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a1006df00 0x7f0a100adf10 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.428+0000 7f0a15a00640 1 -- 172.21.15.107:0/1629330662 >> 172.21.15.107:0/1629330662 conn(0x7f0a100cb9b0 msgr2=0x7f0a100cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:29.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.428+0000 7f0a15a00640 1 -- 172.21.15.107:0/1629330662 shutdown_connections 2024-08-17T02:25:29.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.428+0000 7f0a15a00640 1 -- 172.21.15.107:0/1629330662 wait complete. 2024-08-17T02:25:29.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.430+0000 7f0a15a00640 1 Processor -- start 2024-08-17T02:25:29.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.430+0000 7f0a15a00640 1 -- start start 2024-08-17T02:25:29.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.431+0000 7f0a15a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a1006df00 0x7f0a100aa910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:29.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.431+0000 7f0a15a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a10155a20 0x7f0a10168f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:29.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.431+0000 7f0a15a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a10155df0 0x7f0a1014f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:29.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.431+0000 7f0a15a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a10169ea0 con 0x7f0a1006df00 2024-08-17T02:25:29.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.431+0000 7f0a15a00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a101698e0 con 0x7f0a10155df0 2024-08-17T02:25:29.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.431+0000 7f0a15a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a10169bc0 con 0x7f0a10155a20 2024-08-17T02:25:29.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.431+0000 7f0a0ea00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a1006df00 0x7f0a100aa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:29.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.431+0000 7f0a0ea00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a1006df00 0x7f0a100aa910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60514/0 (socket says 172.21.15.107:60514) 2024-08-17T02:25:29.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.431+0000 7f0a0ea00640 1 -- 172.21.15.107:0/3341357470 learned_addr learned my addr 172.21.15.107:0/3341357470 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:29.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.431+0000 7f0a0e000640 1 --2- 172.21.15.107:0/3341357470 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a10155a20 0x7f0a10168f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:29.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.431+0000 7f0a0f400640 1 --2- 172.21.15.107:0/3341357470 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a10155df0 0x7f0a1014f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:29.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.431+0000 7f0a0ea00640 1 -- 172.21.15.107:0/3341357470 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a10155a20 msgr2=0x7f0a10168f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:29.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.431+0000 7f0a0ea00640 1 --2- 172.21.15.107:0/3341357470 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a10155a20 0x7f0a10168f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.431+0000 7f0a0ea00640 1 -- 172.21.15.107:0/3341357470 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a10155df0 msgr2=0x7f0a1014f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:29.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.431+0000 7f0a0ea00640 1 --2- 172.21.15.107:0/3341357470 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a10155df0 0x7f0a1014f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.431+0000 7f0a0ea00640 1 -- 172.21.15.107:0/3341357470 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09fc00b700 con 0x7f0a1006df00 2024-08-17T02:25:29.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.432+0000 7f0a0ea00640 1 --2- 172.21.15.107:0/3341357470 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a1006df00 0x7f0a100aa910 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0a0000c560 tx=0x7f0a00007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:29.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.432+0000 7f0a06000640 1 -- 172.21.15.107:0/3341357470 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a00011590 con 0x7f0a1006df00 2024-08-17T02:25:29.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.432+0000 7f0a06000640 1 -- 172.21.15.107:0/3341357470 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a00011710 con 0x7f0a1006df00 2024-08-17T02:25:29.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.432+0000 7f0a06000640 1 -- 172.21.15.107:0/3341357470 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a00011ad0 con 0x7f0a1006df00 2024-08-17T02:25:29.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.432+0000 7f0a15a00640 1 -- 172.21.15.107:0/3341357470 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a100c0ad0 con 0x7f0a1006df00 2024-08-17T02:25:29.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.432+0000 7f0a15a00640 1 -- 172.21.15.107:0/3341357470 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a101694b0 con 0x7f0a1006df00 2024-08-17T02:25:29.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.433+0000 7f0a15a00640 1 -- 172.21.15.107:0/3341357470 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a101696a0 con 0x7f0a1006df00 2024-08-17T02:25:29.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.434+0000 7f0a06000640 1 -- 172.21.15.107:0/3341357470 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0a0001b3b0 con 0x7f0a1006df00 2024-08-17T02:25:29.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.435+0000 7f0a06000640 1 --2- 172.21.15.107:0/3341357470 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f09f0065150 0x7f09f0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:29.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.435+0000 7f0a06000640 1 -- 172.21.15.107:0/3341357470 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0a000819f0 con 0x7f0a1006df00 2024-08-17T02:25:29.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.435+0000 7f0a0e000640 1 --2- 172.21.15.107:0/3341357470 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f09f0065150 0x7f09f0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:29.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.436+0000 7f0a0e000640 1 --2- 172.21.15.107:0/3341357470 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f09f0065150 0x7f09f0067600 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f09fc037000 tx=0x7f09fc03a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:29.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.439+0000 7f0a06000640 1 -- 172.21.15.107:0/3341357470 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0a101696a0 con 0x7f0a1006df00 2024-08-17T02:25:29.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.645+0000 7f0a15a00640 1 -- 172.21.15.107:0/3341357470 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0a101696a0 con 0x7f0a1006df00 2024-08-17T02:25:29.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.646+0000 7f0a06000640 1 -- 172.21.15.107:0/3341357470 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0a101696a0 con 0x7f0a1006df00 2024-08-17T02:25:29.647 INFO:teuthology.orchestra.run.smithi107.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:25:29.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.648+0000 7f0a15a00640 1 -- 172.21.15.107:0/3341357470 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f09f0065150 msgr2=0x7f09f0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:29.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.648+0000 7f0a15a00640 1 --2- 172.21.15.107:0/3341357470 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f09f0065150 0x7f09f0067600 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f09fc037000 tx=0x7f09fc03a000 comp rx=0 tx=0).stop 2024-08-17T02:25:29.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.648+0000 7f0a15a00640 1 -- 172.21.15.107:0/3341357470 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a1006df00 msgr2=0x7f0a100aa910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:29.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.648+0000 7f0a15a00640 1 --2- 172.21.15.107:0/3341357470 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a1006df00 0x7f0a100aa910 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0a0000c560 tx=0x7f0a00007ef0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.648+0000 7f0a15a00640 1 -- 172.21.15.107:0/3341357470 shutdown_connections 2024-08-17T02:25:29.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.648+0000 7f0a15a00640 1 --2- 172.21.15.107:0/3341357470 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f09f0065150 0x7f09f0067600 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.648+0000 7f0a15a00640 1 --2- 172.21.15.107:0/3341357470 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a10155df0 0x7f0a1014f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.648+0000 7f0a15a00640 1 --2- 172.21.15.107:0/3341357470 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a10155a20 0x7f0a10168f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.648+0000 7f0a15a00640 1 --2- 172.21.15.107:0/3341357470 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a1006df00 0x7f0a100aa910 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.648+0000 7f0a15a00640 1 -- 172.21.15.107:0/3341357470 >> 172.21.15.107:0/3341357470 conn(0x7f0a100cb9b0 msgr2=0x7f0a101504b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:29.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.648+0000 7f0a15a00640 1 -- 172.21.15.107:0/3341357470 shutdown_connections 2024-08-17T02:25:29.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:29.648+0000 7f0a15a00640 1 -- 172.21.15.107:0/3341357470 wait complete. 2024-08-17T02:25:29.665 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-17T02:25:29.665 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:25:29.665 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi107.front.sepia.ceph.com 2024-08-17T02:25:29.665 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-17T02:25:29.665 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-17T02:25:29.665 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-17T02:25:29.665 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-17T02:25:29.666 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:25:29.666 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:25:29.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:29.666 DEBUG:teuthology.orchestra.run.smithi107:> ip addr 2024-08-17T02:25:29.702 INFO:teuthology.orchestra.run.smithi107.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:25:29.702 INFO:teuthology.orchestra.run.smithi107.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:25:29.702 INFO:teuthology.orchestra.run.smithi107.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:25:29.702 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:29.702 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 ::1/128 scope host 2024-08-17T02:25:29.702 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:29.702 INFO:teuthology.orchestra.run.smithi107.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:25:29.702 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0a brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:29.703 INFO:teuthology.orchestra.run.smithi107.stdout: altname enp7s0f0 2024-08-17T02:25:29.703 INFO:teuthology.orchestra.run.smithi107.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:25:29.703 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0b brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:29.703 INFO:teuthology.orchestra.run.smithi107.stdout: altname enp7s0f1 2024-08-17T02:25:29.703 INFO:teuthology.orchestra.run.smithi107.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:25:29.703 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:ea brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:29.703 INFO:teuthology.orchestra.run.smithi107.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:25:29.703 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:eb brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:29.703 INFO:teuthology.orchestra.run.smithi107.stdout: inet 172.21.15.107/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:25:29.703 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft 42626sec preferred_lft 42626sec 2024-08-17T02:25:29.703 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::ec4:7aff:fe8f:47eb/64 scope link 2024-08-17T02:25:29.703 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:29.703 INFO:teuthology.orchestra.run.smithi107.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:25:29.704 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 1e:af:4e:90:fd:87 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:29.704 INFO:teuthology.orchestra.run.smithi107.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:25:29.704 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:29.704 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::60a7:3dff:feb5:107b/64 scope link 2024-08-17T02:25:29.704 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:29.704 INFO:teuthology.orchestra.run.smithi107.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:25:29.704 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 1e:af:4e:90:fd:87 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:25:29.704 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::1caf:4eff:fe90:fd87/64 scope link 2024-08-17T02:25:29.704 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:29.704 INFO:teuthology.orchestra.run.smithi107.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:25:29.704 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 7a:4e:3a:df:a8:7d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:25:29.704 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::784e:3aff:fedf:a87d/64 scope link 2024-08-17T02:25:29.704 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:29.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:29.705 DEBUG:teuthology.orchestra.run.smithi107:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:25:29.795 INFO:teuthology.orchestra.run.smithi107.stdout:1 2024-08-17T02:25:29.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:29.798 DEBUG:teuthology.orchestra.run.smithi107:> route 2024-08-17T02:25:29.834 INFO:teuthology.orchestra.run.smithi107.stdout:Kernel IP routing table 2024-08-17T02:25:29.835 INFO:teuthology.orchestra.run.smithi107.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:25:29.835 INFO:teuthology.orchestra.run.smithi107.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:25:29.835 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:25:29.835 INFO:teuthology.orchestra.run.smithi107.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:25:29.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:29.835 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2024-08-17T02:25:29.836 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-08-17T02:25:29.836 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:25:29.836 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:25:29.836 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:25:29.836 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-08-17T02:25:29.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:29.979 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-08-17T02:25:30.014 INFO:teuthology.orchestra.run.smithi107.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:25:30.015 INFO:teuthology.orchestra.run.smithi107.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-17T02:25:30.015 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:25:30.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:30.015 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set brx.0 up 2024-08-17T02:25:30.111 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:25:30.111 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-17T02:25:30.146 INFO:teuthology.orchestra.run.smithi107.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:25:30.146 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:25:30.146 DEBUG:teuthology.orchestra.run.smithi107:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:25:30.221 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-08-17T02:25:30.221 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:25:30.221 DEBUG:teuthology.orchestra.run.smithi107:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:25:30.341 INFO:teuthology.orchestra.run.smithi107.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:25:30.341 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:25:30.368 INFO:teuthology.orchestra.run.smithi107.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:25:30.369 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:25:30.369 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: resolved to: "172.21.15.107:3300,172.21.15.157:3300,172.21.15.157:3301" 2024-08-17T02:25:30.369 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: trying mount with new device syntax: 0@f207b4c0-329d-46b8-b83f-aaf30bdb6ce3.cephfs=/ 2024-08-17T02:25:30.369 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.107:3300/172.21.15.157:3300/172.21.15.157:3301" will pass to kernel 2024-08-17T02:25:30.370 INFO:teuthology.orchestra.run.smithi107.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-17T02:25:30.370 INFO:teuthology.orchestra.run.smithi107.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:25:30.370 INFO:teuthology.orchestra.run.smithi107.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:25:30.371 INFO:teuthology.orchestra.run.smithi107.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:25:30.371 INFO:teuthology.orchestra.run.smithi107.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:25:30.373 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:25:30.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:30.374 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:25:30.430 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:25:30.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.576+0000 7f2843c00640 1 Processor -- start 2024-08-17T02:25:30.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.576+0000 7f2843c00640 1 -- start start 2024-08-17T02:25:30.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.577+0000 7f2843c00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f283c15a090 0x7f283c0aa910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:30.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.577+0000 7f2843c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f283c0afb50 con 0x7f283c158cb0 2024-08-17T02:25:30.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.577+0000 7f2843c00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f283c0abc80 con 0x7f283c0af6d0 2024-08-17T02:25:30.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.577+0000 7f2843c00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f283c0aae50 con 0x7f283c15a090 2024-08-17T02:25:30.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.577+0000 7f2841200640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f283c158cb0 0x7f283c0ac110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:59912/0 (socket says 172.21.15.107:59912) 2024-08-17T02:25:30.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.577+0000 7f2841200640 1 -- 172.21.15.107:0/1183002845 learned_addr learned my addr 172.21.15.107:0/1183002845 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:25:30.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.578+0000 7f2841c00640 1 --2- 172.21.15.107:0/1183002845 >> v2:172.21.15.157:3300/0 conn(0x7f283c15a090 0x7f283c0aa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:30.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.578+0000 7f283b400640 1 -- 172.21.15.107:0/1183002845 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4058242299 0 0) 0x7f2830001110 con 0x7f283c158cb0 2024-08-17T02:25:30.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.578+0000 7f283b400640 1 -- 172.21.15.107:0/1183002845 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28240034e0 con 0x7f283c158cb0 2024-08-17T02:25:30.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.578+0000 7f283b400640 1 -- 172.21.15.107:0/1183002845 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2863166189 0 0) 0x7f283c0abc80 con 0x7f283c0af6d0 2024-08-17T02:25:30.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.578+0000 7f283b400640 1 -- 172.21.15.107:0/1183002845 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2830001110 con 0x7f283c0af6d0 2024-08-17T02:25:30.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.578+0000 7f283b400640 1 -- 172.21.15.107:0/1183002845 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 75098214 0 0) 0x7f28240034e0 con 0x7f283c158cb0 2024-08-17T02:25:30.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.578+0000 7f283b400640 1 -- 172.21.15.107:0/1183002845 >> v2:172.21.15.157:3300/0 conn(0x7f283c15a090 msgr2=0x7f283c0aa910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:30.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.578+0000 7f283b400640 1 --2- 172.21.15.107:0/1183002845 >> v2:172.21.15.157:3300/0 conn(0x7f283c15a090 0x7f283c0aa910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.578+0000 7f283b400640 1 -- 172.21.15.107:0/1183002845 >> v1:172.21.15.157:6789/0 conn(0x7f283c0af6d0 legacy=0x7f283c0ac820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:30.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.578+0000 7f283b400640 1 -- 172.21.15.107:0/1183002845 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f283c0ab070 con 0x7f283c158cb0 2024-08-17T02:25:30.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.578+0000 7f283b400640 1 -- 172.21.15.107:0/1183002845 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 537989081 0 0) 0x7f2830001600 con 0x7f283c158cb0 2024-08-17T02:25:30.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.578+0000 7f283b400640 1 -- 172.21.15.107:0/1183002845 >> v1:172.21.15.107:6789/0 conn(0x7f283c158cb0 legacy=0x7f283c0ac110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:30.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.578+0000 7f283b400640 1 --2- 172.21.15.107:0/1183002845 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2824003b60 0x7f2824003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:30.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.578+0000 7f283b400640 1 --2- 172.21.15.107:0/1183002845 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2824004780 0x7f2824004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:30.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.578+0000 7f283b400640 1 --2- 172.21.15.107:0/1183002845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2824005130 0x7f282400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:30.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.579+0000 7f283b400640 1 -- 172.21.15.107:0/1183002845 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283c0aae50 con 0x7f2824005130 2024-08-17T02:25:30.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.579+0000 7f283b400640 1 -- 172.21.15.107:0/1183002845 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282400c020 con 0x7f2824003b60 2024-08-17T02:25:30.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.579+0000 7f283b400640 1 -- 172.21.15.107:0/1183002845 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f282400c1e0 con 0x7f2824004780 2024-08-17T02:25:30.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.579+0000 7f2841c00640 1 --2- 172.21.15.107:0/1183002845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2824005130 0x7f282400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:30.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.579+0000 7f2841200640 1 --2- 172.21.15.107:0/1183002845 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2824003b60 0x7f2824003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:30.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.579+0000 7f283be00640 1 --2- 172.21.15.107:0/1183002845 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2824004780 0x7f2824004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:30.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.579+0000 7f2841c00640 1 -- 172.21.15.107:0/1183002845 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2824004780 msgr2=0x7f2824004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:30.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.579+0000 7f2841c00640 1 --2- 172.21.15.107:0/1183002845 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2824004780 0x7f2824004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.579+0000 7f2841c00640 1 -- 172.21.15.107:0/1183002845 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2824003b60 msgr2=0x7f2824003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:30.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.579+0000 7f2841c00640 1 --2- 172.21.15.107:0/1183002845 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2824003b60 0x7f2824003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.579+0000 7f2841c00640 1 -- 172.21.15.107:0/1183002845 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28240034e0 con 0x7f2824005130 2024-08-17T02:25:30.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.580+0000 7f2841c00640 1 -- 172.21.15.107:0/1183002845 reap_dead start 2024-08-17T02:25:30.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.580+0000 7f2841c00640 1 --2- 172.21.15.107:0/1183002845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2824005130 0x7f282400b9d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f283c06da70 tx=0x7f283400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=235c9fcd1e8cbfd4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:30.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.580+0000 7f283b400640 1 -- 172.21.15.107:0/1183002845 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283402c040 con 0x7f2824005130 2024-08-17T02:25:30.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.581+0000 7f283b400640 1 -- 172.21.15.107:0/1183002845 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f283400f040 con 0x7f2824005130 2024-08-17T02:25:30.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.581+0000 7f283b400640 1 -- 172.21.15.107:0/1183002845 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2834030650 con 0x7f2824005130 2024-08-17T02:25:30.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.581+0000 7f2843c00640 1 -- 172.21.15.107:0/1183002845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2824005130 msgr2=0x7f282400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:30.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.581+0000 7f2843c00640 1 --2- 172.21.15.107:0/1183002845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2824005130 0x7f282400b9d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f283c06da70 tx=0x7f283400b040 comp rx=0 tx=0).stop 2024-08-17T02:25:30.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.581+0000 7f2843c00640 1 -- 172.21.15.107:0/1183002845 shutdown_connections 2024-08-17T02:25:30.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.581+0000 7f2843c00640 1 --2- 172.21.15.107:0/1183002845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2824005130 0x7f282400b9d0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.581+0000 7f2843c00640 1 -- 172.21.15.107:0/1183002845 >> 172.21.15.107:0/1183002845 conn(0x7f283c096a70 msgr2=0x7f283c096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:30.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.581+0000 7f2843c00640 1 -- 172.21.15.107:0/1183002845 shutdown_connections 2024-08-17T02:25:30.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.581+0000 7f2843c00640 1 -- 172.21.15.107:0/1183002845 wait complete. 2024-08-17T02:25:30.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.583+0000 7f2843c00640 1 Processor -- start 2024-08-17T02:25:30.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.583+0000 7f2843c00640 1 -- start start 2024-08-17T02:25:30.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.584+0000 7f2843c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2824005130 0x7f283c0b33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:30.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.584+0000 7f2843c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f283c06b260 0x7f283c15e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:30.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.584+0000 7f2843c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f283c0b0b10 0x7f283c0b0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:30.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.584+0000 7f2843c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283c0b3920 con 0x7f283c06b260 2024-08-17T02:25:30.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.584+0000 7f2843c00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283c0b14c0 con 0x7f283c0b0b10 2024-08-17T02:25:30.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.584+0000 7f2843c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f283c06c2e0 con 0x7f2824005130 2024-08-17T02:25:30.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.584+0000 7f283be00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f283c06b260 0x7f283c15e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:30.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.584+0000 7f283be00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f283c06b260 0x7f283c15e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60540/0 (socket says 172.21.15.107:60540) 2024-08-17T02:25:30.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.584+0000 7f283be00640 1 -- 172.21.15.107:0/2738882276 learned_addr learned my addr 172.21.15.107:0/2738882276 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:30.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.584+0000 7f2841200640 1 --2- 172.21.15.107:0/2738882276 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2824005130 0x7f283c0b33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:30.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.584+0000 7f2841c00640 1 --2- 172.21.15.107:0/2738882276 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f283c0b0b10 0x7f283c0b0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:30.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.584+0000 7f283be00640 1 -- 172.21.15.107:0/2738882276 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2824005130 msgr2=0x7f283c0b33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:30.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.584+0000 7f283be00640 1 --2- 172.21.15.107:0/2738882276 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2824005130 0x7f283c0b33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.584+0000 7f283be00640 1 -- 172.21.15.107:0/2738882276 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f283c0b0b10 msgr2=0x7f283c0b0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:30.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.584+0000 7f283be00640 1 --2- 172.21.15.107:0/2738882276 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f283c0b0b10 0x7f283c0b0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.584+0000 7f283be00640 1 -- 172.21.15.107:0/2738882276 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f283c06ba40 con 0x7f283c06b260 2024-08-17T02:25:30.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.584+0000 7f2841c00640 1 --2- 172.21.15.107:0/2738882276 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f283c0b0b10 0x7f283c0b0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:30.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.585+0000 7f283be00640 1 --2- 172.21.15.107:0/2738882276 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f283c06b260 0x7f283c15e6e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2828002b70 tx=0x7f2828007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:30.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.585+0000 7f282fe00640 1 -- 172.21.15.107:0/2738882276 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282800fb50 con 0x7f283c06b260 2024-08-17T02:25:30.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.585+0000 7f282fe00640 1 -- 172.21.15.107:0/2738882276 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f282800fcf0 con 0x7f283c06b260 2024-08-17T02:25:30.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.585+0000 7f2843c00640 1 -- 172.21.15.107:0/2738882276 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f283c06bd20 con 0x7f283c06b260 2024-08-17T02:25:30.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.585+0000 7f282fe00640 1 -- 172.21.15.107:0/2738882276 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2828013640 con 0x7f283c06b260 2024-08-17T02:25:30.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.585+0000 7f2843c00640 1 -- 172.21.15.107:0/2738882276 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f283c15c890 con 0x7f283c06b260 2024-08-17T02:25:30.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.586+0000 7f2843c00640 1 -- 172.21.15.107:0/2738882276 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f283c15cab0 con 0x7f283c06b260 2024-08-17T02:25:30.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.587+0000 7f282fe00640 1 -- 172.21.15.107:0/2738882276 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f28280139b0 con 0x7f283c06b260 2024-08-17T02:25:30.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.587+0000 7f282fe00640 1 --2- 172.21.15.107:0/2738882276 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f281c065180 0x7f281c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:30.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.588+0000 7f282fe00640 1 -- 172.21.15.107:0/2738882276 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2828082c70 con 0x7f283c06b260 2024-08-17T02:25:30.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.588+0000 7f2841200640 1 --2- 172.21.15.107:0/2738882276 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f281c065180 0x7f281c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:30.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.588+0000 7f2841200640 1 --2- 172.21.15.107:0/2738882276 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f281c065180 0x7f281c067630 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f28300010e0 tx=0x7f2830009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:30.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.592+0000 7f282fe00640 1 -- 172.21.15.107:0/2738882276 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2828050c90 con 0x7f283c06b260 2024-08-17T02:25:30.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.801+0000 7f2843c00640 1 -- 172.21.15.107:0/2738882276 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f283c064db0 con 0x7f283c06b260 2024-08-17T02:25:30.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.801+0000 7f282fe00640 1 -- 172.21.15.107:0/2738882276 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f28280542b0 con 0x7f283c06b260 2024-08-17T02:25:30.803 INFO:teuthology.orchestra.run.smithi107.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:25:30.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.803+0000 7f2843c00640 1 -- 172.21.15.107:0/2738882276 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f281c065180 msgr2=0x7f281c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:30.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.803+0000 7f2843c00640 1 --2- 172.21.15.107:0/2738882276 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f281c065180 0x7f281c067630 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f28300010e0 tx=0x7f2830009040 comp rx=0 tx=0).stop 2024-08-17T02:25:30.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.803+0000 7f2843c00640 1 -- 172.21.15.107:0/2738882276 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f283c06b260 msgr2=0x7f283c15e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:30.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.803+0000 7f2843c00640 1 --2- 172.21.15.107:0/2738882276 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f283c06b260 0x7f283c15e6e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2828002b70 tx=0x7f2828007ca0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.804+0000 7f2843c00640 1 -- 172.21.15.107:0/2738882276 shutdown_connections 2024-08-17T02:25:30.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.804+0000 7f2843c00640 1 --2- 172.21.15.107:0/2738882276 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f281c065180 0x7f281c067630 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.804+0000 7f2843c00640 1 --2- 172.21.15.107:0/2738882276 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f283c0b0b10 0x7f283c0b0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.804+0000 7f2843c00640 1 --2- 172.21.15.107:0/2738882276 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f283c06b260 0x7f283c15e6e0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.804+0000 7f2843c00640 1 --2- 172.21.15.107:0/2738882276 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2824005130 0x7f283c0b33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.804+0000 7f2843c00640 1 -- 172.21.15.107:0/2738882276 >> 172.21.15.107:0/2738882276 conn(0x7f283c096a70 msgr2=0x7f283c067e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:30.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.804+0000 7f2843c00640 1 -- 172.21.15.107:0/2738882276 shutdown_connections 2024-08-17T02:25:30.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:30.804+0000 7f2843c00640 1 -- 172.21.15.107:0/2738882276 wait complete. 2024-08-17T02:25:30.821 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-17T02:25:30.821 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:25:30.821 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi157.front.sepia.ceph.com 2024-08-17T02:25:30.821 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-17T02:25:30.821 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-17T02:25:30.821 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-17T02:25:30.821 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-17T02:25:30.821 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:25:30.821 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:25:30.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:30.822 DEBUG:teuthology.orchestra.run.smithi157:> ip addr 2024-08-17T02:25:30.862 INFO:teuthology.orchestra.run.smithi157.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:25:30.863 INFO:teuthology.orchestra.run.smithi157.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:25:30.863 INFO:teuthology.orchestra.run.smithi157.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:25:30.863 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:30.863 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 ::1/128 scope host 2024-08-17T02:25:30.863 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:30.863 INFO:teuthology.orchestra.run.smithi157.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:25:30.863 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:d9:37:98 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:30.863 INFO:teuthology.orchestra.run.smithi157.stdout: altname enp7s0f0 2024-08-17T02:25:30.863 INFO:teuthology.orchestra.run.smithi157.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:25:30.863 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:d9:37:99 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:30.863 INFO:teuthology.orchestra.run.smithi157.stdout: altname enp7s0f1 2024-08-17T02:25:30.863 INFO:teuthology.orchestra.run.smithi157.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:25:30.863 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:88:7e:a0 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:30.864 INFO:teuthology.orchestra.run.smithi157.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:25:30.864 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:88:7e:a1 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:30.864 INFO:teuthology.orchestra.run.smithi157.stdout: inet 172.21.15.157/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:25:30.864 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft 42632sec preferred_lft 42632sec 2024-08-17T02:25:30.864 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 fe80::ec4:7aff:fe88:7ea1/64 scope link 2024-08-17T02:25:30.864 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:30.864 INFO:teuthology.orchestra.run.smithi157.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:25:30.864 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 76:5e:4d:70:41:27 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:30.864 INFO:teuthology.orchestra.run.smithi157.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:25:30.864 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:30.864 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 fe80::98f3:a8ff:feda:eb81/64 scope link 2024-08-17T02:25:30.864 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:30.864 INFO:teuthology.orchestra.run.smithi157.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:25:30.865 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether c2:4d:d6:49:c7:b7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:25:30.865 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 fe80::c04d:d6ff:fe49:c7b7/64 scope link 2024-08-17T02:25:30.865 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:30.865 INFO:teuthology.orchestra.run.smithi157.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:25:30.865 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 76:5e:4d:70:41:27 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:25:30.865 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 fe80::745e:4dff:fe70:4127/64 scope link 2024-08-17T02:25:30.865 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:30.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:30.866 DEBUG:teuthology.orchestra.run.smithi157:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:25:30.966 INFO:teuthology.orchestra.run.smithi157.stdout:1 2024-08-17T02:25:30.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:30.969 DEBUG:teuthology.orchestra.run.smithi157:> route 2024-08-17T02:25:31.006 INFO:teuthology.orchestra.run.smithi157.stdout:Kernel IP routing table 2024-08-17T02:25:31.006 INFO:teuthology.orchestra.run.smithi157.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:25:31.006 INFO:teuthology.orchestra.run.smithi157.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:25:31.007 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:25:31.007 INFO:teuthology.orchestra.run.smithi157.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:25:31.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:31.007 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2024-08-17T02:25:31.007 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2024-08-17T02:25:31.007 DEBUG:teuthology.orchestra.run.smithi157:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:25:31.007 DEBUG:teuthology.orchestra.run.smithi157:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:25:31.007 DEBUG:teuthology.orchestra.run.smithi157:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:25:31.007 DEBUG:teuthology.orchestra.run.smithi157:> ') 2024-08-17T02:25:31.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:31.153 DEBUG:teuthology.orchestra.run.smithi157:> ip netns list 2024-08-17T02:25:31.188 INFO:teuthology.orchestra.run.smithi157.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:25:31.189 INFO:teuthology.orchestra.run.smithi157.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-17T02:25:31.189 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:25:31.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:31.189 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link set brx.0 up 2024-08-17T02:25:31.286 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:25:31.286 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-17T02:25:31.322 INFO:teuthology.orchestra.run.smithi157.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:25:31.322 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:25:31.322 DEBUG:teuthology.orchestra.run.smithi157:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:25:31.396 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-08-17T02:25:31.396 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:25:31.396 DEBUG:teuthology.orchestra.run.smithi157:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:25:31.519 INFO:teuthology.orchestra.run.smithi157.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:25:31.519 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:25:31.545 INFO:teuthology.orchestra.run.smithi157.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:25:31.545 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:25:31.545 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: resolved to: "172.21.15.107:3300,172.21.15.157:3300,172.21.15.157:3301" 2024-08-17T02:25:31.545 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: trying mount with new device syntax: 1@f207b4c0-329d-46b8-b83f-aaf30bdb6ce3.cephfs=/ 2024-08-17T02:25:31.545 INFO:teuthology.orchestra.run.smithi157.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.107:3300/172.21.15.157:3300/172.21.15.157:3301" will pass to kernel 2024-08-17T02:25:31.546 INFO:teuthology.orchestra.run.smithi157.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-08-17T02:25:31.546 INFO:teuthology.orchestra.run.smithi157.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:25:31.546 INFO:teuthology.orchestra.run.smithi157.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:25:31.546 INFO:teuthology.orchestra.run.smithi157.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:25:31.547 INFO:teuthology.orchestra.run.smithi157.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:25:31.549 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:25:31.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:31.550 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:25:31.606 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-08-17T02:25:31.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.764+0000 7f4721600640 1 Processor -- start 2024-08-17T02:25:31.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.764+0000 7f4721600640 1 -- start start 2024-08-17T02:25:31.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.765+0000 7f4721600640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f471c0b2bb0 0x7f471c0b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:31.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.765+0000 7f4721600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f471c15c4b0 0x7f471c0aac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:31.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.765+0000 7f4721600640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f471c0d0a80 con 0x7f471c0b5740 2024-08-17T02:25:31.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.765+0000 7f4721600640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f471c0b2130 con 0x7f471c0b2bb0 2024-08-17T02:25:31.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.765+0000 7f4721600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f471c0b23f0 con 0x7f471c15c4b0 2024-08-17T02:25:31.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.765+0000 7f471be00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f471c0b2bb0 0x7f471c0b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:31.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.765+0000 7f4720c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f471c15c4b0 0x7f471c0aac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:31.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.765+0000 7f4713400640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f471c0b5740 0x7f471c15bda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:45262/0 (socket says 172.21.15.107:45262) 2024-08-17T02:25:31.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.766+0000 7f4713400640 1 -- 172.21.15.107:0/1484794875 learned_addr learned my addr 172.21.15.107:0/1484794875 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:25:31.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.766+0000 7f471be00640 1 -- 172.21.15.107:0/1484794875 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f471c15c4b0 msgr2=0x7f471c0aac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:31.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.766+0000 7f471be00640 1 --2- 172.21.15.107:0/1484794875 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f471c15c4b0 0x7f471c0aac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:31.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.766+0000 7f471be00640 1 -- 172.21.15.107:0/1484794875 >> v1:172.21.15.157:6789/0 conn(0x7f471c0b5740 legacy=0x7f471c15bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:31.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.766+0000 7f471b400640 1 -- 172.21.15.107:0/1484794875 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4135007984 0 0) 0x7f471c0d0a80 con 0x7f471c0b5740 2024-08-17T02:25:31.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.766+0000 7f471be00640 1 -- 172.21.15.107:0/1484794875 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f471c0b37a0 con 0x7f471c0b2bb0 2024-08-17T02:25:31.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.766+0000 7f4720c00640 1 --2- 172.21.15.107:0/1484794875 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f471c15c4b0 0x7f471c0aac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:31.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.767+0000 7f471be00640 1 --2- 172.21.15.107:0/1484794875 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f471c0b2bb0 0x7f471c0b2f80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f470c009e60 tx=0x7f470c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3dedbc2a8e032841 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:31.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.767+0000 7f471b400640 1 -- 172.21.15.107:0/1484794875 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470c007550 con 0x7f471c0b2bb0 2024-08-17T02:25:31.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.767+0000 7f471b400640 1 -- 172.21.15.107:0/1484794875 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f470c02d050 con 0x7f471c0b2bb0 2024-08-17T02:25:31.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.767+0000 7f471b400640 1 -- 172.21.15.107:0/1484794875 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470c007900 con 0x7f471c0b2bb0 2024-08-17T02:25:31.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.768+0000 7f4721600640 1 -- 172.21.15.107:0/1484794875 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f471c0b2bb0 msgr2=0x7f471c0b2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:31.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.768+0000 7f4721600640 1 --2- 172.21.15.107:0/1484794875 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f471c0b2bb0 0x7f471c0b2f80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f470c009e60 tx=0x7f470c009780 comp rx=0 tx=0).stop 2024-08-17T02:25:31.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.768+0000 7f4721600640 1 -- 172.21.15.107:0/1484794875 shutdown_connections 2024-08-17T02:25:31.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.768+0000 7f4721600640 1 --2- 172.21.15.107:0/1484794875 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f471c15c4b0 0x7f471c0aac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:31.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.768+0000 7f4721600640 1 --2- 172.21.15.107:0/1484794875 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f471c0b2bb0 0x7f471c0b2f80 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:31.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.768+0000 7f4721600640 1 -- 172.21.15.107:0/1484794875 >> 172.21.15.107:0/1484794875 conn(0x7f471c0cfbc0 msgr2=0x7f471c0cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:31.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.768+0000 7f4721600640 1 -- 172.21.15.107:0/1484794875 shutdown_connections 2024-08-17T02:25:31.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.768+0000 7f4721600640 1 -- 172.21.15.107:0/1484794875 wait complete. 2024-08-17T02:25:31.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.769+0000 7f4721600640 1 Processor -- start 2024-08-17T02:25:31.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.770+0000 7f4721600640 1 -- start start 2024-08-17T02:25:31.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.770+0000 7f4721600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f471c0b2bb0 0x7f471c099800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:31.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.771+0000 7f4721600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f471c0b5740 0x7f471c159e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:31.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.771+0000 7f4721600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f471c15c4b0 0x7f471c0cf060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:31.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.771+0000 7f4721600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f471c16b600 con 0x7f471c0b5740 2024-08-17T02:25:31.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.771+0000 7f4721600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f471c099d40 con 0x7f471c15c4b0 2024-08-17T02:25:31.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.771+0000 7f4721600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f471c16a9f0 con 0x7f471c0b2bb0 2024-08-17T02:25:31.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.771+0000 7f4713400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f471c0b5740 0x7f471c159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:31.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.771+0000 7f471be00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f471c0b2bb0 0x7f471c099800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:31.773 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.771+0000 7f471be00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f471c0b2bb0 0x7f471c099800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:57878/0 (socket says 172.21.15.107:57878) 2024-08-17T02:25:31.773 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.771+0000 7f471be00640 1 -- 172.21.15.107:0/728930211 learned_addr learned my addr 172.21.15.107:0/728930211 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:31.773 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.771+0000 7f4720c00640 1 --2- 172.21.15.107:0/728930211 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f471c15c4b0 0x7f471c0cf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:31.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.771+0000 7f471be00640 1 -- 172.21.15.107:0/728930211 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f471c15c4b0 msgr2=0x7f471c0cf060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:31.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.771+0000 7f471be00640 1 --2- 172.21.15.107:0/728930211 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f471c15c4b0 0x7f471c0cf060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:31.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.771+0000 7f471be00640 1 -- 172.21.15.107:0/728930211 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f471c0b5740 msgr2=0x7f471c159e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:31.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.771+0000 7f471be00640 1 --2- 172.21.15.107:0/728930211 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f471c0b5740 0x7f471c159e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:31.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.771+0000 7f471be00640 1 -- 172.21.15.107:0/728930211 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4714009390 con 0x7f471c0b2bb0 2024-08-17T02:25:31.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.771+0000 7f4720c00640 1 --2- 172.21.15.107:0/728930211 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f471c15c4b0 0x7f471c0cf060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:31.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.772+0000 7f471be00640 1 --2- 172.21.15.107:0/728930211 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f471c0b2bb0 0x7f471c099800 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f470c0097c0 tx=0x7f470c037000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:31.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.772+0000 7f4713e00640 1 -- 172.21.15.107:0/728930211 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470c042070 con 0x7f471c0b2bb0 2024-08-17T02:25:31.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.772+0000 7f4713e00640 1 -- 172.21.15.107:0/728930211 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f470c031ac0 con 0x7f471c0b2bb0 2024-08-17T02:25:31.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.772+0000 7f4713e00640 1 -- 172.21.15.107:0/728930211 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470c03d430 con 0x7f471c0b2bb0 2024-08-17T02:25:31.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.772+0000 7f4721600640 1 -- 172.21.15.107:0/728930211 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f470c009a20 con 0x7f471c0b2bb0 2024-08-17T02:25:31.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.772+0000 7f4721600640 1 -- 172.21.15.107:0/728930211 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f471c16afb0 con 0x7f471c0b2bb0 2024-08-17T02:25:31.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.773+0000 7f4721600640 1 -- 172.21.15.107:0/728930211 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f471c071050 con 0x7f471c0b2bb0 2024-08-17T02:25:31.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.774+0000 7f4713e00640 1 -- 172.21.15.107:0/728930211 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f470c003040 con 0x7f471c0b2bb0 2024-08-17T02:25:31.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.775+0000 7f4713e00640 1 --2- 172.21.15.107:0/728930211 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f46f8065150 0x7f46f8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:31.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.775+0000 7f4713e00640 1 -- 172.21.15.107:0/728930211 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f470c0a3580 con 0x7f471c0b2bb0 2024-08-17T02:25:31.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.775+0000 7f4713400640 1 --2- 172.21.15.107:0/728930211 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f46f8065150 0x7f46f8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:31.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.776+0000 7f4713400640 1 --2- 172.21.15.107:0/728930211 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f46f8065150 0x7f46f8067600 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f471c15f9b0 tx=0x7f4704007ca0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:31.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.780+0000 7f4713e00640 1 -- 172.21.15.107:0/728930211 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f470c0715a0 con 0x7f471c0b2bb0 2024-08-17T02:25:31.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:31.996+0000 7f4721600640 1 -- 172.21.15.107:0/728930211 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f471c0aeb90 con 0x7f471c0b2bb0 2024-08-17T02:25:32.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.731+0000 7f4713e00640 1 -- 172.21.15.107:0/728930211 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 136+0+0 (secure 0 0 0) 0x7f470c074bc0 con 0x7f471c0b2bb0 2024-08-17T02:25:32.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.734+0000 7f4721600640 1 -- 172.21.15.107:0/728930211 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f46f8065150 msgr2=0x7f46f8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:32.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.734+0000 7f4721600640 1 --2- 172.21.15.107:0/728930211 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f46f8065150 0x7f46f8067600 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f471c15f9b0 tx=0x7f4704007ca0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.734+0000 7f4721600640 1 -- 172.21.15.107:0/728930211 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f471c0b2bb0 msgr2=0x7f471c099800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:32.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.734+0000 7f4721600640 1 --2- 172.21.15.107:0/728930211 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f471c0b2bb0 0x7f471c099800 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f470c0097c0 tx=0x7f470c037000 comp rx=0 tx=0).stop 2024-08-17T02:25:32.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.734+0000 7f4721600640 1 -- 172.21.15.107:0/728930211 shutdown_connections 2024-08-17T02:25:32.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.734+0000 7f4721600640 1 --2- 172.21.15.107:0/728930211 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f46f8065150 0x7f46f8067600 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.734+0000 7f4721600640 1 --2- 172.21.15.107:0/728930211 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f471c15c4b0 0x7f471c0cf060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.734+0000 7f4721600640 1 --2- 172.21.15.107:0/728930211 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f471c0b5740 0x7f471c159e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.734+0000 7f4721600640 1 --2- 172.21.15.107:0/728930211 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f471c0b2bb0 0x7f471c099800 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.734+0000 7f4721600640 1 -- 172.21.15.107:0/728930211 >> 172.21.15.107:0/728930211 conn(0x7f471c0cfbc0 msgr2=0x7f471c0af830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:32.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.734+0000 7f4721600640 1 -- 172.21.15.107:0/728930211 shutdown_connections 2024-08-17T02:25:32.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.734+0000 7f4721600640 1 -- 172.21.15.107:0/728930211 wait complete. 2024-08-17T02:25:32.751 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-08-17T02:25:32.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.900+0000 7f049ba00640 1 Processor -- start 2024-08-17T02:25:32.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.900+0000 7f049ba00640 1 -- start start 2024-08-17T02:25:32.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.901+0000 7f049ba00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0494155df0 0x7f04940adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.902+0000 7f049ba00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0494156670 con 0x7f0494155a20 2024-08-17T02:25:32.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.902+0000 7f049ba00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f049406e5e0 con 0x7f049406df00 2024-08-17T02:25:32.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.902+0000 7f049ba00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04940b0350 con 0x7f0494155df0 2024-08-17T02:25:32.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.902+0000 7f0499000640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f0494155a20 0x7f049406d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:59920/0 (socket says 172.21.15.107:59920) 2024-08-17T02:25:32.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.902+0000 7f0499000640 1 -- 172.21.15.107:0/3862668617 learned_addr learned my addr 172.21.15.107:0/3862668617 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:25:32.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.902+0000 7f0499a00640 1 --2- 172.21.15.107:0/3862668617 >> v2:172.21.15.107:3300/0 conn(0x7f0494155df0 0x7f04940adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.902+0000 7f0493e00640 1 -- 172.21.15.107:0/3862668617 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1680213560 0 0) 0x7f0494156670 con 0x7f0494155a20 2024-08-17T02:25:32.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.902+0000 7f0499a00640 1 -- 172.21.15.107:0/3862668617 >> v1:172.21.15.157:6789/0 conn(0x7f049406df00 legacy=0x7f0494156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:32.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.902+0000 7f0499a00640 1 -- 172.21.15.107:0/3862668617 >> v1:172.21.15.107:6789/0 conn(0x7f0494155a20 legacy=0x7f049406d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:32.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.902+0000 7f0499a00640 1 -- 172.21.15.107:0/3862668617 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049406e8c0 con 0x7f0494155df0 2024-08-17T02:25:32.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.903+0000 7f0499a00640 1 --2- 172.21.15.107:0/3862668617 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0494155df0 0x7f04940adf10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f048c009e60 tx=0x7f048c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e2569f4dc0a66fd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:32.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.903+0000 7f0493e00640 1 -- 172.21.15.107:0/3862668617 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048c007550 con 0x7f0494155df0 2024-08-17T02:25:32.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.904+0000 7f0493e00640 1 -- 172.21.15.107:0/3862668617 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f048c02d050 con 0x7f0494155df0 2024-08-17T02:25:32.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.904+0000 7f0493e00640 1 -- 172.21.15.107:0/3862668617 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048c0078e0 con 0x7f0494155df0 2024-08-17T02:25:32.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.904+0000 7f049ba00640 1 -- 172.21.15.107:0/3862668617 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0494155df0 msgr2=0x7f04940adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:32.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.904+0000 7f049ba00640 1 --2- 172.21.15.107:0/3862668617 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0494155df0 0x7f04940adf10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f048c009e60 tx=0x7f048c009780 comp rx=0 tx=0).stop 2024-08-17T02:25:32.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.904+0000 7f049ba00640 1 -- 172.21.15.107:0/3862668617 shutdown_connections 2024-08-17T02:25:32.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.904+0000 7f049ba00640 1 --2- 172.21.15.107:0/3862668617 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0494155df0 0x7f04940adf10 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.904+0000 7f049ba00640 1 -- 172.21.15.107:0/3862668617 >> 172.21.15.107:0/3862668617 conn(0x7f04940cb9b0 msgr2=0x7f04940cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:32.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.904+0000 7f049ba00640 1 -- 172.21.15.107:0/3862668617 shutdown_connections 2024-08-17T02:25:32.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.904+0000 7f049ba00640 1 -- 172.21.15.107:0/3862668617 wait complete. 2024-08-17T02:25:32.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.906+0000 7f049ba00640 1 Processor -- start 2024-08-17T02:25:32.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.906+0000 7f049ba00640 1 -- start start 2024-08-17T02:25:32.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.907+0000 7f049ba00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f049406df00 0x7f0494151610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.907+0000 7f049ba00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0494155a20 0x7f049415dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.907+0000 7f049ba00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0494155df0 0x7f04940aa1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.907+0000 7f049ba00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0494151b50 con 0x7f049406df00 2024-08-17T02:25:32.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.907+0000 7f049ba00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04940accf0 con 0x7f0494155a20 2024-08-17T02:25:32.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.907+0000 7f049ba00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f049415e130 con 0x7f0494155df0 2024-08-17T02:25:32.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.907+0000 7f0499000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f049406df00 0x7f0494151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.907+0000 7f0499000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f049406df00 0x7f0494151610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60570/0 (socket says 172.21.15.107:60570) 2024-08-17T02:25:32.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.907+0000 7f0499000640 1 -- 172.21.15.107:0/3369981364 learned_addr learned my addr 172.21.15.107:0/3369981364 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:32.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.907+0000 7f048be00640 1 --2- 172.21.15.107:0/3369981364 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0494155a20 0x7f049415dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.907+0000 7f0499a00640 1 --2- 172.21.15.107:0/3369981364 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0494155df0 0x7f04940aa1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.907+0000 7f0499000640 1 -- 172.21.15.107:0/3369981364 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0494155df0 msgr2=0x7f04940aa1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:32.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.907+0000 7f0499000640 1 --2- 172.21.15.107:0/3369981364 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0494155df0 0x7f04940aa1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.907+0000 7f0499000640 1 -- 172.21.15.107:0/3369981364 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0494155a20 msgr2=0x7f049415dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:32.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.907+0000 7f0499000640 1 --2- 172.21.15.107:0/3369981364 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0494155a20 0x7f049415dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.907+0000 7f0499000640 1 -- 172.21.15.107:0/3369981364 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f048c009a20 con 0x7f049406df00 2024-08-17T02:25:32.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.907+0000 7f048be00640 1 --2- 172.21.15.107:0/3369981364 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0494155a20 0x7f049415dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:32.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.907+0000 7f0499a00640 1 --2- 172.21.15.107:0/3369981364 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0494155df0 0x7f04940aa1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:32.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.908+0000 7f0499000640 1 --2- 172.21.15.107:0/3369981364 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f049406df00 0x7f0494151610 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f048400c5e0 tx=0x7f0484007d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:32.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.908+0000 7f0490c00640 1 -- 172.21.15.107:0/3369981364 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0484005aa0 con 0x7f049406df00 2024-08-17T02:25:32.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.908+0000 7f0490c00640 1 -- 172.21.15.107:0/3369981364 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0484005c00 con 0x7f049406df00 2024-08-17T02:25:32.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.908+0000 7f0490c00640 1 -- 172.21.15.107:0/3369981364 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04840070f0 con 0x7f049406df00 2024-08-17T02:25:32.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.908+0000 7f049ba00640 1 -- 172.21.15.107:0/3369981364 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04940aacb0 con 0x7f049406df00 2024-08-17T02:25:32.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.908+0000 7f049ba00640 1 -- 172.21.15.107:0/3369981364 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04940ac980 con 0x7f049406df00 2024-08-17T02:25:32.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.909+0000 7f049ba00640 1 -- 172.21.15.107:0/3369981364 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0494064db0 con 0x7f049406df00 2024-08-17T02:25:32.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.910+0000 7f0490c00640 1 -- 172.21.15.107:0/3369981364 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0484007520 con 0x7f049406df00 2024-08-17T02:25:32.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.911+0000 7f0490c00640 1 --2- 172.21.15.107:0/3369981364 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f0470065180 0x7f0470067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.911+0000 7f0490c00640 1 -- 172.21.15.107:0/3369981364 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0484081f40 con 0x7f049406df00 2024-08-17T02:25:32.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.911+0000 7f048be00640 1 --2- 172.21.15.107:0/3369981364 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f0470065180 0x7f0470067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.911+0000 7f048be00640 1 --2- 172.21.15.107:0/3369981364 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f0470065180 0x7f0470067630 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f049415f7d0 tx=0x7f047c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:32.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:32.915+0000 7f0490c00640 1 -- 172.21.15.107:0/3369981364 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f048404ffe0 con 0x7f049406df00 2024-08-17T02:25:33.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.109+0000 7f049ba00640 1 -- 172.21.15.107:0/3369981364 --> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f04940ace30 con 0x7f0470065180 2024-08-17T02:25:33.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.110+0000 7f0490c00640 1 -- 172.21.15.107:0/3369981364 <== mgr.4110 v2:172.21.15.107:6832/37039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f047c001450 con 0x7f0470065180 2024-08-17T02:25:33.111 INFO:teuthology.orchestra.run.smithi107.stdout:[ 2024-08-17T02:25:33.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-08-17T02:25:33.112 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "cephfs" 2024-08-17T02:25:33.112 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-08-17T02:25:33.112 INFO:teuthology.orchestra.run.smithi107.stdout:] 2024-08-17T02:25:33.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.112+0000 7f049ba00640 1 -- 172.21.15.107:0/3369981364 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f0470065180 msgr2=0x7f0470067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:33.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.112+0000 7f049ba00640 1 --2- 172.21.15.107:0/3369981364 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f0470065180 0x7f0470067630 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f049415f7d0 tx=0x7f047c009040 comp rx=0 tx=0).stop 2024-08-17T02:25:33.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.112+0000 7f049ba00640 1 -- 172.21.15.107:0/3369981364 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f049406df00 msgr2=0x7f0494151610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:33.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.112+0000 7f049ba00640 1 --2- 172.21.15.107:0/3369981364 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f049406df00 0x7f0494151610 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f048400c5e0 tx=0x7f0484007d00 comp rx=0 tx=0).stop 2024-08-17T02:25:33.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.112+0000 7f049ba00640 1 -- 172.21.15.107:0/3369981364 shutdown_connections 2024-08-17T02:25:33.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.112+0000 7f049ba00640 1 --2- 172.21.15.107:0/3369981364 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f0470065180 0x7f0470067630 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.112+0000 7f049ba00640 1 --2- 172.21.15.107:0/3369981364 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0494155df0 0x7f04940aa1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.112+0000 7f049ba00640 1 --2- 172.21.15.107:0/3369981364 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0494155a20 0x7f049415dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.112+0000 7f049ba00640 1 --2- 172.21.15.107:0/3369981364 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f049406df00 0x7f0494151610 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.112+0000 7f049ba00640 1 -- 172.21.15.107:0/3369981364 >> 172.21.15.107:0/3369981364 conn(0x7f04940cb9b0 msgr2=0x7f0494154af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:33.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.113+0000 7f049ba00640 1 -- 172.21.15.107:0/3369981364 shutdown_connections 2024-08-17T02:25:33.116 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.113+0000 7f049ba00640 1 -- 172.21.15.107:0/3369981364 wait complete. 2024-08-17T02:25:33.129 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-17T02:25:33.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.277+0000 7f734de00640 1 Processor -- start 2024-08-17T02:25:33.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.278+0000 7f734de00640 1 -- start start 2024-08-17T02:25:33.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.279+0000 7f734de00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7348155a30 0x7f734806dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:33.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.279+0000 7f734de00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73480afc40 con 0x7f7348155660 2024-08-17T02:25:33.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.279+0000 7f734de00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73480af030 con 0x7f73480adfb0 2024-08-17T02:25:33.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.279+0000 7f734de00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73480af310 con 0x7f7348155a30 2024-08-17T02:25:33.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.279+0000 7f734ca00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f7348155660 0x7f73480c7fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:59926/0 (socket says 172.21.15.107:59926) 2024-08-17T02:25:33.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.279+0000 7f734ca00640 1 -- 172.21.15.107:0/45815886 learned_addr learned my addr 172.21.15.107:0/45815886 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:25:33.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.279+0000 7f734d400640 1 --2- 172.21.15.107:0/45815886 >> v2:172.21.15.107:3300/0 conn(0x7f7348155a30 0x7f734806dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:33.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.280+0000 7f734d400640 1 -- 172.21.15.107:0/45815886 >> v1:172.21.15.157:6789/0 conn(0x7f73480adfb0 legacy=0x7f73480ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:33.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.280+0000 7f734d400640 1 -- 172.21.15.107:0/45815886 >> v1:172.21.15.107:6789/0 conn(0x7f7348155660 legacy=0x7f73480c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:33.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.280+0000 7f7347e00640 1 -- 172.21.15.107:0/45815886 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3667106272 0 0) 0x7f73480afc40 con 0x7f7348155660 2024-08-17T02:25:33.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.280+0000 7f734d400640 1 -- 172.21.15.107:0/45815886 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73480af5f0 con 0x7f7348155a30 2024-08-17T02:25:33.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.281+0000 7f734d400640 1 --2- 172.21.15.107:0/45815886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7348155a30 0x7f734806dec0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7340009e60 tx=0x7f7340009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b018541b5a2bf70 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:33.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.281+0000 7f7347e00640 1 -- 172.21.15.107:0/45815886 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7340007550 con 0x7f7348155a30 2024-08-17T02:25:33.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.281+0000 7f7347e00640 1 -- 172.21.15.107:0/45815886 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f734002d050 con 0x7f7348155a30 2024-08-17T02:25:33.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.281+0000 7f7347e00640 1 -- 172.21.15.107:0/45815886 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7340007900 con 0x7f7348155a30 2024-08-17T02:25:33.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.281+0000 7f734de00640 1 -- 172.21.15.107:0/45815886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7348155a30 msgr2=0x7f734806dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:33.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.281+0000 7f734de00640 1 --2- 172.21.15.107:0/45815886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7348155a30 0x7f734806dec0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7340009e60 tx=0x7f7340009780 comp rx=0 tx=0).stop 2024-08-17T02:25:33.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.282+0000 7f734de00640 1 -- 172.21.15.107:0/45815886 shutdown_connections 2024-08-17T02:25:33.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.282+0000 7f734de00640 1 --2- 172.21.15.107:0/45815886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7348155a30 0x7f734806dec0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.282+0000 7f734de00640 1 -- 172.21.15.107:0/45815886 >> 172.21.15.107:0/45815886 conn(0x7f7348066cd0 msgr2=0x7f73480670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:33.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.282+0000 7f734de00640 1 -- 172.21.15.107:0/45815886 shutdown_connections 2024-08-17T02:25:33.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.282+0000 7f734de00640 1 -- 172.21.15.107:0/45815886 wait complete. 2024-08-17T02:25:33.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.283+0000 7f734de00640 1 Processor -- start 2024-08-17T02:25:33.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.283+0000 7f734de00640 1 -- start start 2024-08-17T02:25:33.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.284+0000 7f734de00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f73480adfb0 0x7f7348140930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:33.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.284+0000 7f734de00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7348155660 0x7f7348168d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:33.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.284+0000 7f734de00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7348155a30 0x7f7348169290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:33.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.284+0000 7f734de00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73481697d0 con 0x7f7348155660 2024-08-17T02:25:33.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.284+0000 7f734de00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7348154880 con 0x7f7348155a30 2024-08-17T02:25:33.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.284+0000 7f734de00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f734815b410 con 0x7f73480adfb0 2024-08-17T02:25:33.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.284+0000 7f733fe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7348155660 0x7f7348168d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:33.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.284+0000 7f733fe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7348155660 0x7f7348168d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60596/0 (socket says 172.21.15.107:60596) 2024-08-17T02:25:33.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.284+0000 7f733fe00640 1 -- 172.21.15.107:0/1555221419 learned_addr learned my addr 172.21.15.107:0/1555221419 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:33.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.284+0000 7f734d400640 1 --2- 172.21.15.107:0/1555221419 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7348155a30 0x7f7348169290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:33.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.285+0000 7f734ca00640 1 --2- 172.21.15.107:0/1555221419 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f73480adfb0 0x7f7348140930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:33.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.285+0000 7f733fe00640 1 -- 172.21.15.107:0/1555221419 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f73480adfb0 msgr2=0x7f7348140930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:33.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.285+0000 7f733fe00640 1 --2- 172.21.15.107:0/1555221419 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f73480adfb0 0x7f7348140930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.285+0000 7f733fe00640 1 -- 172.21.15.107:0/1555221419 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7348155a30 msgr2=0x7f7348169290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:33.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.285+0000 7f733fe00640 1 --2- 172.21.15.107:0/1555221419 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7348155a30 0x7f7348169290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.285+0000 7f733fe00640 1 -- 172.21.15.107:0/1555221419 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7340009a20 con 0x7f7348155660 2024-08-17T02:25:33.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.285+0000 7f734ca00640 1 --2- 172.21.15.107:0/1555221419 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f73480adfb0 0x7f7348140930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:33.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.285+0000 7f733fe00640 1 --2- 172.21.15.107:0/1555221419 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7348155660 0x7f7348168d50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f733000c590 tx=0x7f7330007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:33.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.285+0000 7f7344c00640 1 -- 172.21.15.107:0/1555221419 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7330011590 con 0x7f7348155660 2024-08-17T02:25:33.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.285+0000 7f7344c00640 1 -- 172.21.15.107:0/1555221419 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7330011710 con 0x7f7348155660 2024-08-17T02:25:33.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.285+0000 7f734de00640 1 -- 172.21.15.107:0/1555221419 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f734815b750 con 0x7f7348155660 2024-08-17T02:25:33.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.285+0000 7f7344c00640 1 -- 172.21.15.107:0/1555221419 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7330011ad0 con 0x7f7348155660 2024-08-17T02:25:33.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.285+0000 7f734de00640 1 -- 172.21.15.107:0/1555221419 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7348169f30 con 0x7f7348155660 2024-08-17T02:25:33.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.286+0000 7f734de00640 1 -- 172.21.15.107:0/1555221419 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f734816a150 con 0x7f7348155660 2024-08-17T02:25:33.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.287+0000 7f7344c00640 1 -- 172.21.15.107:0/1555221419 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f733001b3b0 con 0x7f7348155660 2024-08-17T02:25:33.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.288+0000 7f7344c00640 1 --2- 172.21.15.107:0/1555221419 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7324065150 0x7f7324067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:33.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.288+0000 7f7344c00640 1 -- 172.21.15.107:0/1555221419 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7330081a50 con 0x7f7348155660 2024-08-17T02:25:33.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.288+0000 7f734ca00640 1 --2- 172.21.15.107:0/1555221419 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7324065150 0x7f7324067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:33.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.289+0000 7f734ca00640 1 --2- 172.21.15.107:0/1555221419 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7324065150 0x7f7324067600 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f73480ad770 tx=0x7f7338009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:33.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.292+0000 7f7344c00640 1 -- 172.21.15.107:0/1555221419 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f733004fa70 con 0x7f7348155660 2024-08-17T02:25:33.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.464+0000 7f734de00640 1 -- 172.21.15.107:0/1555221419 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f7348071050 con 0x7f7348155660 2024-08-17T02:25:33.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.464+0000 7f7344c00640 1 -- 172.21.15.107:0/1555221419 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7330017070 con 0x7f7348155660 2024-08-17T02:25:33.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.466+0000 7f734de00640 1 -- 172.21.15.107:0/1555221419 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7324065150 msgr2=0x7f7324067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:33.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.466+0000 7f734de00640 1 --2- 172.21.15.107:0/1555221419 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7324065150 0x7f7324067600 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f73480ad770 tx=0x7f7338009040 comp rx=0 tx=0).stop 2024-08-17T02:25:33.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.466+0000 7f734de00640 1 -- 172.21.15.107:0/1555221419 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7348155660 msgr2=0x7f7348168d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:33.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.466+0000 7f734de00640 1 --2- 172.21.15.107:0/1555221419 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7348155660 0x7f7348168d50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f733000c590 tx=0x7f7330007ec0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.466+0000 7f734de00640 1 -- 172.21.15.107:0/1555221419 shutdown_connections 2024-08-17T02:25:33.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.466+0000 7f734de00640 1 --2- 172.21.15.107:0/1555221419 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7324065150 0x7f7324067600 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.466+0000 7f734de00640 1 --2- 172.21.15.107:0/1555221419 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7348155a30 0x7f7348169290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.466+0000 7f734de00640 1 --2- 172.21.15.107:0/1555221419 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7348155660 0x7f7348168d50 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.466+0000 7f734de00640 1 --2- 172.21.15.107:0/1555221419 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f73480adfb0 0x7f7348140930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.466+0000 7f734de00640 1 -- 172.21.15.107:0/1555221419 >> 172.21.15.107:0/1555221419 conn(0x7f7348066cd0 msgr2=0x7f73480c7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:33.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.466+0000 7f734de00640 1 -- 172.21.15.107:0/1555221419 shutdown_connections 2024-08-17T02:25:33.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.466+0000 7f734de00640 1 -- 172.21.15.107:0/1555221419 wait complete. 2024-08-17T02:25:33.482 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create volume_0000000000928569 2024-08-17T02:25:33.630 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.629+0000 7f6a40600640 1 Processor -- start 2024-08-17T02:25:33.630 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.629+0000 7f6a40600640 1 -- start start 2024-08-17T02:25:33.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.630+0000 7f6a40600640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6a38156990 0x7f6a380b05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:33.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.630+0000 7f6a40600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a3815b030 con 0x7f6a38156d60 2024-08-17T02:25:33.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.630+0000 7f6a40600640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a380cc2e0 con 0x7f6a380adec0 2024-08-17T02:25:33.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.630+0000 7f6a40600640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a380b1110 con 0x7f6a38156990 2024-08-17T02:25:33.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.630+0000 7f6a3d200640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f6a38156d60 0x7f6a380ad7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:59928/0 (socket says 172.21.15.107:59928) 2024-08-17T02:25:33.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.630+0000 7f6a3d200640 1 -- 172.21.15.107:0/2193979205 learned_addr learned my addr 172.21.15.107:0/2193979205 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:25:33.635 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.631+0000 7f6a3dc00640 1 --2- 172.21.15.107:0/2193979205 >> v2:172.21.15.157:3300/0 conn(0x7f6a38156990 0x7f6a380b05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:33.635 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.631+0000 7f6a37e00640 1 -- 172.21.15.107:0/2193979205 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1838375131 0 0) 0x7f6a3815b030 con 0x7f6a38156d60 2024-08-17T02:25:33.635 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.631+0000 7f6a37e00640 1 -- 172.21.15.107:0/2193979205 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a200034e0 con 0x7f6a38156d60 2024-08-17T02:25:33.636 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.631+0000 7f6a37e00640 1 -- 172.21.15.107:0/2193979205 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2031296193 0 0) 0x7f6a380cc2e0 con 0x7f6a380adec0 2024-08-17T02:25:33.636 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.631+0000 7f6a37e00640 1 -- 172.21.15.107:0/2193979205 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a3815b030 con 0x7f6a380adec0 2024-08-17T02:25:33.636 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.631+0000 7f6a37e00640 1 -- 172.21.15.107:0/2193979205 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2752508024 0 0) 0x7f6a200034e0 con 0x7f6a38156d60 2024-08-17T02:25:33.636 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.631+0000 7f6a37e00640 1 -- 172.21.15.107:0/2193979205 >> v2:172.21.15.157:3300/0 conn(0x7f6a38156990 msgr2=0x7f6a380b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:33.636 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.631+0000 7f6a37e00640 1 --2- 172.21.15.107:0/2193979205 >> v2:172.21.15.157:3300/0 conn(0x7f6a38156990 0x7f6a380b05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.636 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.631+0000 7f6a37e00640 1 -- 172.21.15.107:0/2193979205 >> v1:172.21.15.157:6789/0 conn(0x7f6a380adec0 legacy=0x7f6a380ae940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:33.636 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.631+0000 7f6a37e00640 1 -- 172.21.15.107:0/2193979205 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3815a700 con 0x7f6a38156d60 2024-08-17T02:25:33.636 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.631+0000 7f6a37e00640 1 -- 172.21.15.107:0/2193979205 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 537989081 0 0) 0x7f6a24001470 con 0x7f6a38156d60 2024-08-17T02:25:33.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.631+0000 7f6a3dc00640 1 --2- 172.21.15.107:0/2193979205 >> v2:172.21.15.157:3300/0 conn(0x7f6a38156990 0x7f6a380b05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:33.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.631+0000 7f6a37e00640 1 -- 172.21.15.107:0/2193979205 >> v1:172.21.15.107:6789/0 conn(0x7f6a38156d60 legacy=0x7f6a380ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:33.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.631+0000 7f6a37e00640 1 --2- 172.21.15.107:0/2193979205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a20003b60 0x7f6a20003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:33.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.631+0000 7f6a37e00640 1 --2- 172.21.15.107:0/2193979205 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a20004780 0x7f6a20004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:33.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.631+0000 7f6a37e00640 1 --2- 172.21.15.107:0/2193979205 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a20005130 0x7f6a2000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:33.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.631+0000 7f6a37e00640 1 -- 172.21.15.107:0/2193979205 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a380b1110 con 0x7f6a20003b60 2024-08-17T02:25:33.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.631+0000 7f6a37e00640 1 -- 172.21.15.107:0/2193979205 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2000c020 con 0x7f6a20004780 2024-08-17T02:25:33.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.631+0000 7f6a37e00640 1 -- 172.21.15.107:0/2193979205 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2000c1e0 con 0x7f6a20005130 2024-08-17T02:25:33.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.632+0000 7f6a3dc00640 1 --2- 172.21.15.107:0/2193979205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a20003b60 0x7f6a20003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:33.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.632+0000 7f6a3d200640 1 --2- 172.21.15.107:0/2193979205 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a20004780 0x7f6a20004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:33.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.632+0000 7f6a3e600640 1 --2- 172.21.15.107:0/2193979205 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a20005130 0x7f6a2000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:33.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.632+0000 7f6a3dc00640 1 -- 172.21.15.107:0/2193979205 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a20005130 msgr2=0x7f6a2000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:33.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.632+0000 7f6a3dc00640 1 --2- 172.21.15.107:0/2193979205 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a20005130 0x7f6a2000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.632+0000 7f6a3dc00640 1 -- 172.21.15.107:0/2193979205 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a20004780 msgr2=0x7f6a20004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:33.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.632+0000 7f6a3dc00640 1 --2- 172.21.15.107:0/2193979205 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a20004780 0x7f6a20004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.632+0000 7f6a3dc00640 1 -- 172.21.15.107:0/2193979205 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a200034e0 con 0x7f6a20003b60 2024-08-17T02:25:33.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.632+0000 7f6a3e600640 1 --2- 172.21.15.107:0/2193979205 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a20005130 0x7f6a2000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:33.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.632+0000 7f6a3e600640 1 -- 172.21.15.107:0/2193979205 reap_dead start 2024-08-17T02:25:33.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.633+0000 7f6a3dc00640 1 --2- 172.21.15.107:0/2193979205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a20003b60 0x7f6a20003f50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c009d60 tx=0x7f6a2c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=312ecad929546379 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:33.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.633+0000 7f6a37e00640 1 -- 172.21.15.107:0/2193979205 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c031400 con 0x7f6a20003b60 2024-08-17T02:25:33.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.633+0000 7f6a37e00640 1 -- 172.21.15.107:0/2193979205 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2c02d050 con 0x7f6a20003b60 2024-08-17T02:25:33.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.633+0000 7f6a37e00640 1 -- 172.21.15.107:0/2193979205 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c031770 con 0x7f6a20003b60 2024-08-17T02:25:33.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.634+0000 7f6a40600640 1 -- 172.21.15.107:0/2193979205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a20003b60 msgr2=0x7f6a20003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:33.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.634+0000 7f6a40600640 1 --2- 172.21.15.107:0/2193979205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a20003b60 0x7f6a20003f50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c009d60 tx=0x7f6a2c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.634+0000 7f6a40600640 1 -- 172.21.15.107:0/2193979205 shutdown_connections 2024-08-17T02:25:33.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.634+0000 7f6a40600640 1 --2- 172.21.15.107:0/2193979205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a20003b60 0x7f6a20003f50 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.634+0000 7f6a40600640 1 -- 172.21.15.107:0/2193979205 >> 172.21.15.107:0/2193979205 conn(0x7f6a38067750 msgr2=0x7f6a380cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:33.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.634+0000 7f6a40600640 1 -- 172.21.15.107:0/2193979205 shutdown_connections 2024-08-17T02:25:33.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.634+0000 7f6a40600640 1 -- 172.21.15.107:0/2193979205 wait complete. 2024-08-17T02:25:33.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.635+0000 7f6a40600640 1 Processor -- start 2024-08-17T02:25:33.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.636+0000 7f6a40600640 1 -- start start 2024-08-17T02:25:33.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.636+0000 7f6a40600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a20003b60 0x7f6a38169090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:33.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.636+0000 7f6a40600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a380acc00 0x7f6a381464c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:33.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.637+0000 7f6a40600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a380ab5a0 0x7f6a38159720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:33.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.637+0000 7f6a40600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a380ac770 con 0x7f6a380ab5a0 2024-08-17T02:25:33.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.637+0000 7f6a40600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a380abb60 con 0x7f6a380acc00 2024-08-17T02:25:33.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.637+0000 7f6a40600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a380abe40 con 0x7f6a20003b60 2024-08-17T02:25:33.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.637+0000 7f6a3e600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a380ab5a0 0x7f6a38159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:33.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.637+0000 7f6a3e600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a380ab5a0 0x7f6a38159720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60620/0 (socket says 172.21.15.107:60620) 2024-08-17T02:25:33.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.637+0000 7f6a3e600640 1 -- 172.21.15.107:0/4243683542 learned_addr learned my addr 172.21.15.107:0/4243683542 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:33.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.637+0000 7f6a3d200640 1 --2- 172.21.15.107:0/4243683542 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a380acc00 0x7f6a381464c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:33.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.637+0000 7f6a3dc00640 1 --2- 172.21.15.107:0/4243683542 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a20003b60 0x7f6a38169090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:33.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.637+0000 7f6a3e600640 1 -- 172.21.15.107:0/4243683542 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a20003b60 msgr2=0x7f6a38169090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:33.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.637+0000 7f6a3e600640 1 --2- 172.21.15.107:0/4243683542 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a20003b60 0x7f6a38169090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.637+0000 7f6a3e600640 1 -- 172.21.15.107:0/4243683542 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a380acc00 msgr2=0x7f6a381464c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:33.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.637+0000 7f6a3e600640 1 --2- 172.21.15.107:0/4243683542 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a380acc00 0x7f6a381464c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.637+0000 7f6a3e600640 1 -- 172.21.15.107:0/4243683542 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a380ac120 con 0x7f6a380ab5a0 2024-08-17T02:25:33.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.637+0000 7f6a3dc00640 1 --2- 172.21.15.107:0/4243683542 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a20003b60 0x7f6a38169090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:33.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.638+0000 7f6a3e600640 1 --2- 172.21.15.107:0/4243683542 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a380ab5a0 0x7f6a38159720 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6a380afd50 tx=0x7f6a30009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:33.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.638+0000 7f6a34c00640 1 -- 172.21.15.107:0/4243683542 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3000ed90 con 0x7f6a380ab5a0 2024-08-17T02:25:33.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.638+0000 7f6a34c00640 1 -- 172.21.15.107:0/4243683542 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a30006b10 con 0x7f6a380ab5a0 2024-08-17T02:25:33.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.638+0000 7f6a40600640 1 -- 172.21.15.107:0/4243683542 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a380ac400 con 0x7f6a380ab5a0 2024-08-17T02:25:33.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.638+0000 7f6a34c00640 1 -- 172.21.15.107:0/4243683542 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a300030d0 con 0x7f6a380ab5a0 2024-08-17T02:25:33.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.638+0000 7f6a40600640 1 -- 172.21.15.107:0/4243683542 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a38159c60 con 0x7f6a380ab5a0 2024-08-17T02:25:33.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.639+0000 7f6a40600640 1 -- 172.21.15.107:0/4243683542 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a380ac920 con 0x7f6a380ab5a0 2024-08-17T02:25:33.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.640+0000 7f6a34c00640 1 -- 172.21.15.107:0/4243683542 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6a300016e0 con 0x7f6a380ab5a0 2024-08-17T02:25:33.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.641+0000 7f6a34c00640 1 --2- 172.21.15.107:0/4243683542 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6a18065180 0x7f6a18067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:33.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.641+0000 7f6a34c00640 1 -- 172.21.15.107:0/4243683542 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6a300812f0 con 0x7f6a380ab5a0 2024-08-17T02:25:33.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.641+0000 7f6a3dc00640 1 --2- 172.21.15.107:0/4243683542 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6a18065180 0x7f6a18067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:33.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.642+0000 7f6a3dc00640 1 --2- 172.21.15.107:0/4243683542 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6a18065180 0x7f6a18067630 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c034000 tx=0x7f6a2c035000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:33.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.645+0000 7f6a34c00640 1 -- 172.21.15.107:0/4243683542 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6a380ac920 con 0x7f6a380ab5a0 2024-08-17T02:25:33.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:33.845+0000 7f6a40600640 1 -- 172.21.15.107:0/4243683542 --> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "volume_0000000000928569", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a38071050 con 0x7f6a18065180 2024-08-17T02:25:34.201 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:25:34.206 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:25:36.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.757+0000 7f6a34c00640 1 -- 172.21.15.107:0/4243683542 <== mgr.4110 v2:172.21.15.107:6832/37039 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7f6a38071050 con 0x7f6a18065180 2024-08-17T02:25:36.759 INFO:teuthology.orchestra.run.smithi107.stderr:Volume created successfully (no MDS daemons created) 2024-08-17T02:25:36.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.762+0000 7f6a40600640 1 -- 172.21.15.107:0/4243683542 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6a18065180 msgr2=0x7f6a18067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:36.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.762+0000 7f6a40600640 1 --2- 172.21.15.107:0/4243683542 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6a18065180 0x7f6a18067630 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c034000 tx=0x7f6a2c035000 comp rx=0 tx=0).stop 2024-08-17T02:25:36.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.762+0000 7f6a40600640 1 -- 172.21.15.107:0/4243683542 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a380ab5a0 msgr2=0x7f6a38159720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:36.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.762+0000 7f6a40600640 1 --2- 172.21.15.107:0/4243683542 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a380ab5a0 0x7f6a38159720 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6a380afd50 tx=0x7f6a30009040 comp rx=0 tx=0).stop 2024-08-17T02:25:36.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.763+0000 7f6a40600640 1 -- 172.21.15.107:0/4243683542 shutdown_connections 2024-08-17T02:25:36.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.763+0000 7f6a40600640 1 --2- 172.21.15.107:0/4243683542 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6a18065180 0x7f6a18067630 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.763+0000 7f6a40600640 1 --2- 172.21.15.107:0/4243683542 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a380ab5a0 0x7f6a38159720 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.763+0000 7f6a40600640 1 --2- 172.21.15.107:0/4243683542 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a380acc00 0x7f6a381464c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.763+0000 7f6a40600640 1 --2- 172.21.15.107:0/4243683542 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a20003b60 0x7f6a38169090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.763+0000 7f6a40600640 1 -- 172.21.15.107:0/4243683542 >> 172.21.15.107:0/4243683542 conn(0x7f6a38067750 msgr2=0x7f6a3806dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:36.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.763+0000 7f6a40600640 1 -- 172.21.15.107:0/4243683542 shutdown_connections 2024-08-17T02:25:36.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.763+0000 7f6a40600640 1 -- 172.21.15.107:0/4243683542 wait complete. 2024-08-17T02:25:36.789 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-08-17T02:25:36.940 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.939+0000 7fc4fa000640 1 Processor -- start 2024-08-17T02:25:36.940 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.939+0000 7fc4fa000640 1 -- start start 2024-08-17T02:25:36.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.940+0000 7fc4fa000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc4f406da20 0x7fc4f406ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:36.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.940+0000 7fc4fa000640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc4f40aa7d0 0x7fc4f4158890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:36.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.940+0000 7fc4fa000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc4f4158dd0 0x7fc4f40ab6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:36.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.940+0000 7fc4fa000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4f40ac400 con 0x7fc4f4158dd0 2024-08-17T02:25:36.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.940+0000 7fc4fa000640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4f40a9a10 con 0x7fc4f40aa7d0 2024-08-17T02:25:36.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.940+0000 7fc4fa000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f40a9cf0 con 0x7fc4f406da20 2024-08-17T02:25:36.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.940+0000 7fc4f3e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc4f4158dd0 0x7fc4f40ab6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:36.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.940+0000 7fc4f3e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc4f4158dd0 0x7fc4f40ab6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50832/0 (socket says 172.21.15.107:50832) 2024-08-17T02:25:36.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.940+0000 7fc4f3e00640 1 -- 172.21.15.107:0/552294294 learned_addr learned my addr 172.21.15.107:0/552294294 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:36.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.941+0000 7fc4ebe00640 1 --2- 172.21.15.107:0/552294294 >> v2:172.21.15.157:3300/0 conn(0x7fc4f40aa7d0 0x7fc4f4158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:36.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.941+0000 7fc4f3400640 1 --2- 172.21.15.107:0/552294294 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc4f406da20 0x7fc4f406ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:36.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.941+0000 7fc4f3e00640 1 -- 172.21.15.107:0/552294294 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc4f406da20 msgr2=0x7fc4f406ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:36.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.941+0000 7fc4f3e00640 1 --2- 172.21.15.107:0/552294294 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc4f406da20 0x7fc4f406ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.941+0000 7fc4f3e00640 1 -- 172.21.15.107:0/552294294 >> v2:172.21.15.157:3300/0 conn(0x7fc4f40aa7d0 msgr2=0x7fc4f4158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:36.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.941+0000 7fc4f3e00640 1 --2- 172.21.15.107:0/552294294 >> v2:172.21.15.157:3300/0 conn(0x7fc4f40aa7d0 0x7fc4f4158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.941+0000 7fc4f3e00640 1 -- 172.21.15.107:0/552294294 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f40a9fd0 con 0x7fc4f4158dd0 2024-08-17T02:25:36.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.942+0000 7fc4f3e00640 1 --2- 172.21.15.107:0/552294294 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc4f4158dd0 0x7fc4f40ab6d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc4f406c4d0 tx=0x7fc4ec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a4373665b8d8e31 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:36.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.942+0000 7fc4f2a00640 1 -- 172.21.15.107:0/552294294 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec031400 con 0x7fc4f4158dd0 2024-08-17T02:25:36.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.942+0000 7fc4f2a00640 1 -- 172.21.15.107:0/552294294 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ec02d050 con 0x7fc4f4158dd0 2024-08-17T02:25:36.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.942+0000 7fc4f2a00640 1 -- 172.21.15.107:0/552294294 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec0317d0 con 0x7fc4f4158dd0 2024-08-17T02:25:36.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.943+0000 7fc4fa000640 1 -- 172.21.15.107:0/552294294 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc4f4158dd0 msgr2=0x7fc4f40ab6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:36.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.943+0000 7fc4fa000640 1 --2- 172.21.15.107:0/552294294 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc4f4158dd0 0x7fc4f40ab6d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc4f406c4d0 tx=0x7fc4ec009840 comp rx=0 tx=0).stop 2024-08-17T02:25:36.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.943+0000 7fc4fa000640 1 -- 172.21.15.107:0/552294294 shutdown_connections 2024-08-17T02:25:36.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.943+0000 7fc4fa000640 1 --2- 172.21.15.107:0/552294294 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc4f4158dd0 0x7fc4f40ab6d0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.943+0000 7fc4fa000640 1 --2- 172.21.15.107:0/552294294 >> v2:172.21.15.157:3300/0 conn(0x7fc4f40aa7d0 0x7fc4f4158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.943+0000 7fc4fa000640 1 --2- 172.21.15.107:0/552294294 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc4f406da20 0x7fc4f406ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.943+0000 7fc4fa000640 1 -- 172.21.15.107:0/552294294 >> 172.21.15.107:0/552294294 conn(0x7fc4f40cb9b0 msgr2=0x7fc4f40cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:36.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.943+0000 7fc4fa000640 1 -- 172.21.15.107:0/552294294 shutdown_connections 2024-08-17T02:25:36.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.943+0000 7fc4fa000640 1 -- 172.21.15.107:0/552294294 wait complete. 2024-08-17T02:25:36.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.944+0000 7fc4fa000640 1 Processor -- start 2024-08-17T02:25:36.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.944+0000 7fc4fa000640 1 -- start start 2024-08-17T02:25:36.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.945+0000 7fc4fa000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc4f406da20 0x7fc4f40c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:36.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.945+0000 7fc4fa000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc4f40aa7d0 0x7fc4f415b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:36.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.945+0000 7fc4fa000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4f4158dd0 0x7fc4f416b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:36.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.945+0000 7fc4fa000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f4159cc0 con 0x7fc4f406da20 2024-08-17T02:25:36.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.945+0000 7fc4fa000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f40c1ce0 con 0x7fc4f4158dd0 2024-08-17T02:25:36.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.945+0000 7fc4fa000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f4159670 con 0x7fc4f40aa7d0 2024-08-17T02:25:36.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.945+0000 7fc4f3400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc4f406da20 0x7fc4f40c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:36.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.945+0000 7fc4f3400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc4f406da20 0x7fc4f40c13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50848/0 (socket says 172.21.15.107:50848) 2024-08-17T02:25:36.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.945+0000 7fc4f3400640 1 -- 172.21.15.107:0/3120589587 learned_addr learned my addr 172.21.15.107:0/3120589587 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:36.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.946+0000 7fc4f3e00640 1 --2- 172.21.15.107:0/3120589587 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4f4158dd0 0x7fc4f416b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:36.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.946+0000 7fc4ebe00640 1 --2- 172.21.15.107:0/3120589587 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc4f40aa7d0 0x7fc4f415b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:36.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.946+0000 7fc4f3400640 1 -- 172.21.15.107:0/3120589587 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc4f40aa7d0 msgr2=0x7fc4f415b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:36.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.946+0000 7fc4f3400640 1 --2- 172.21.15.107:0/3120589587 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc4f40aa7d0 0x7fc4f415b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.946+0000 7fc4f3400640 1 -- 172.21.15.107:0/3120589587 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4f4158dd0 msgr2=0x7fc4f416b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:36.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.946+0000 7fc4f3400640 1 --2- 172.21.15.107:0/3120589587 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4f4158dd0 0x7fc4f416b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.946+0000 7fc4f3400640 1 -- 172.21.15.107:0/3120589587 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ec009ae0 con 0x7fc4f406da20 2024-08-17T02:25:36.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.946+0000 7fc4ebe00640 1 --2- 172.21.15.107:0/3120589587 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc4f40aa7d0 0x7fc4f415b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:36.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.946+0000 7fc4f3400640 1 --2- 172.21.15.107:0/3120589587 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc4f406da20 0x7fc4f40c13b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc4e400ea20 tx=0x7fc4e40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:36.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.946+0000 7fc4eaa00640 1 -- 172.21.15.107:0/3120589587 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e400ca10 con 0x7fc4f406da20 2024-08-17T02:25:36.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.946+0000 7fc4eaa00640 1 -- 172.21.15.107:0/3120589587 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e400cb70 con 0x7fc4f406da20 2024-08-17T02:25:36.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.946+0000 7fc4eaa00640 1 -- 172.21.15.107:0/3120589587 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e4013470 con 0x7fc4f406da20 2024-08-17T02:25:36.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.946+0000 7fc4fa000640 1 -- 172.21.15.107:0/3120589587 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4f4159950 con 0x7fc4f406da20 2024-08-17T02:25:36.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.947+0000 7fc4fa000640 1 -- 172.21.15.107:0/3120589587 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4f415bb20 con 0x7fc4f406da20 2024-08-17T02:25:36.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.948+0000 7fc4fa000640 1 -- 172.21.15.107:0/3120589587 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4f41594d0 con 0x7fc4f406da20 2024-08-17T02:25:36.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.948+0000 7fc4eaa00640 1 -- 172.21.15.107:0/3120589587 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc4e4013860 con 0x7fc4f406da20 2024-08-17T02:25:36.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.949+0000 7fc4eaa00640 1 --2- 172.21.15.107:0/3120589587 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fc4d0065180 0x7fc4d0067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:36.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.949+0000 7fc4eaa00640 1 -- 172.21.15.107:0/3120589587 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fc4e4082b30 con 0x7fc4f406da20 2024-08-17T02:25:36.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.949+0000 7fc4ebe00640 1 --2- 172.21.15.107:0/3120589587 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fc4d0065180 0x7fc4d0067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:36.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.950+0000 7fc4ebe00640 1 --2- 172.21.15.107:0/3120589587 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fc4d0065180 0x7fc4d0067630 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc006e70 tx=0x7fc4dc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:36.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:36.954+0000 7fc4eaa00640 1 -- 172.21.15.107:0/3120589587 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc4f41594d0 con 0x7fc4f406da20 2024-08-17T02:25:37.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.148+0000 7fc4fa000640 1 -- 172.21.15.107:0/3120589587 --> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fc4f4159e00 con 0x7fc4d0065180 2024-08-17T02:25:37.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.149+0000 7fc4eaa00640 1 -- 172.21.15.107:0/3120589587 <== mgr.4110 v2:172.21.15.107:6832/37039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+96 (secure 0 0 0) 0x7fc4dc009dc0 con 0x7fc4d0065180 2024-08-17T02:25:37.150 INFO:teuthology.orchestra.run.smithi107.stdout:[ 2024-08-17T02:25:37.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-08-17T02:25:37.151 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "cephfs" 2024-08-17T02:25:37.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-08-17T02:25:37.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-08-17T02:25:37.151 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "volume_0000000000928569" 2024-08-17T02:25:37.151 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-08-17T02:25:37.151 INFO:teuthology.orchestra.run.smithi107.stdout:] 2024-08-17T02:25:37.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.151+0000 7fc4fa000640 1 -- 172.21.15.107:0/3120589587 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fc4d0065180 msgr2=0x7fc4d0067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.151+0000 7fc4fa000640 1 --2- 172.21.15.107:0/3120589587 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fc4d0065180 0x7fc4d0067630 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc006e70 tx=0x7fc4dc008040 comp rx=0 tx=0).stop 2024-08-17T02:25:37.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.151+0000 7fc4fa000640 1 -- 172.21.15.107:0/3120589587 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc4f406da20 msgr2=0x7fc4f40c13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.151+0000 7fc4fa000640 1 --2- 172.21.15.107:0/3120589587 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc4f406da20 0x7fc4f40c13b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc4e400ea20 tx=0x7fc4e40090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.151+0000 7fc4fa000640 1 -- 172.21.15.107:0/3120589587 shutdown_connections 2024-08-17T02:25:37.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.151+0000 7fc4fa000640 1 --2- 172.21.15.107:0/3120589587 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fc4d0065180 0x7fc4d0067630 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.151+0000 7fc4fa000640 1 --2- 172.21.15.107:0/3120589587 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4f4158dd0 0x7fc4f416b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.151+0000 7fc4fa000640 1 --2- 172.21.15.107:0/3120589587 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc4f40aa7d0 0x7fc4f415b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.151+0000 7fc4fa000640 1 --2- 172.21.15.107:0/3120589587 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc4f406da20 0x7fc4f40c13b0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.151+0000 7fc4fa000640 1 -- 172.21.15.107:0/3120589587 >> 172.21.15.107:0/3120589587 conn(0x7fc4f40cb9b0 msgr2=0x7fc4f4154500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:37.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.151+0000 7fc4fa000640 1 -- 172.21.15.107:0/3120589587 shutdown_connections 2024-08-17T02:25:37.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.151+0000 7fc4fa000640 1 -- 172.21.15.107:0/3120589587 wait complete. 2024-08-17T02:25:37.169 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool ls detail --format=json 2024-08-17T02:25:37.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.318+0000 7f8391800640 1 Processor -- start 2024-08-17T02:25:37.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.318+0000 7f8391800640 1 -- start start 2024-08-17T02:25:37.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.319+0000 7f8391800640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f838c156d60 0x7f838c0ad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:37.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.319+0000 7f8391800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f838c0adcf0 0x7f838c0ae940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:37.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.319+0000 7f8391800640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f838c15b030 con 0x7f838c156990 2024-08-17T02:25:37.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.319+0000 7f8391800640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f838c0ae130 con 0x7f838c156d60 2024-08-17T02:25:37.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.319+0000 7f8391800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f838c0cc2e0 con 0x7f838c0adcf0 2024-08-17T02:25:37.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.319+0000 7f838a000640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f838c156d60 0x7f838c0ad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.320+0000 7f838a000640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f838c156d60 0x7f838c0ad7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:42700/0 (socket says 172.21.15.107:42700) 2024-08-17T02:25:37.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.320+0000 7f838a000640 1 -- 172.21.15.107:0/1839467813 learned_addr learned my addr 172.21.15.107:0/1839467813 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:37.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.320+0000 7f838aa00640 1 --1- 172.21.15.107:0/1839467813 >> v1:172.21.15.157:6789/0 conn(0x7f838c156990 0x7f838c0b05a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:38992/0 (socket says 172.21.15.107:38992) 2024-08-17T02:25:37.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.320+0000 7f838b400640 1 --2- 172.21.15.107:0/1839467813 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f838c0adcf0 0x7f838c0ae940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.323 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.320+0000 7f838a000640 1 -- 172.21.15.107:0/1839467813 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f838c0adcf0 msgr2=0x7f838c0ae940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:37.323 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.320+0000 7f838a000640 1 --2- 172.21.15.107:0/1839467813 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f838c0adcf0 0x7f838c0ae940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.323 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.320+0000 7f838a000640 1 -- 172.21.15.107:0/1839467813 >> v1:172.21.15.157:6789/0 conn(0x7f838c156990 legacy=0x7f838c0b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.323 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.320+0000 7f8389600640 1 -- 172.21.15.107:0/1839467813 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3386315033 0 0) 0x7f838c15b030 con 0x7f838c156990 2024-08-17T02:25:37.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.320+0000 7f838a000640 1 -- 172.21.15.107:0/1839467813 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f838c0b1110 con 0x7f838c156d60 2024-08-17T02:25:37.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.321+0000 7f838a000640 1 --2- 172.21.15.107:0/1839467813 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f838c156d60 0x7f838c0ad7b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8378009910 tx=0x7f83780091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df430ad957f1e4df server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:37.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.321+0000 7f8389600640 1 -- 172.21.15.107:0/1839467813 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837802ae40 con 0x7f838c156d60 2024-08-17T02:25:37.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.321+0000 7f8389600640 1 -- 172.21.15.107:0/1839467813 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8378032440 con 0x7f838c156d60 2024-08-17T02:25:37.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.321+0000 7f8389600640 1 -- 172.21.15.107:0/1839467813 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83780327e0 con 0x7f838c156d60 2024-08-17T02:25:37.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.322+0000 7f8391800640 1 -- 172.21.15.107:0/1839467813 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f838c156d60 msgr2=0x7f838c0ad7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.322+0000 7f8391800640 1 --2- 172.21.15.107:0/1839467813 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f838c156d60 0x7f838c0ad7b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8378009910 tx=0x7f83780091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.322+0000 7f8391800640 1 -- 172.21.15.107:0/1839467813 shutdown_connections 2024-08-17T02:25:37.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.322+0000 7f8391800640 1 --2- 172.21.15.107:0/1839467813 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f838c0adcf0 0x7f838c0ae940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.322+0000 7f8391800640 1 --2- 172.21.15.107:0/1839467813 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f838c156d60 0x7f838c0ad7b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.322+0000 7f8391800640 1 -- 172.21.15.107:0/1839467813 >> 172.21.15.107:0/1839467813 conn(0x7f838c067750 msgr2=0x7f838c0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:37.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.322+0000 7f8391800640 1 -- 172.21.15.107:0/1839467813 shutdown_connections 2024-08-17T02:25:37.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.322+0000 7f8391800640 1 -- 172.21.15.107:0/1839467813 wait complete. 2024-08-17T02:25:37.327 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.323+0000 7f8391800640 1 Processor -- start 2024-08-17T02:25:37.327 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.323+0000 7f8391800640 1 -- start start 2024-08-17T02:25:37.327 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.324+0000 7f8391800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f838c0adcf0 0x7f838c147360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:37.327 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.324+0000 7f8391800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f838c156990 0x7f838c0acf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:37.327 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.324+0000 7f8391800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f838c156d60 0x7f838c069560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:37.327 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.324+0000 7f8391800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838c169260 con 0x7f838c0adcf0 2024-08-17T02:25:37.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.324+0000 7f8391800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838c16a0c0 con 0x7f838c156990 2024-08-17T02:25:37.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.324+0000 7f8391800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f838c1478a0 con 0x7f838c156d60 2024-08-17T02:25:37.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.325+0000 7f838aa00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f838c0adcf0 0x7f838c147360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.325+0000 7f838aa00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f838c0adcf0 0x7f838c147360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50850/0 (socket says 172.21.15.107:50850) 2024-08-17T02:25:37.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.325+0000 7f838aa00640 1 -- 172.21.15.107:0/2641553877 learned_addr learned my addr 172.21.15.107:0/2641553877 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:37.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.325+0000 7f838a000640 1 --2- 172.21.15.107:0/2641553877 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f838c156990 0x7f838c0acf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.325+0000 7f838b400640 1 --2- 172.21.15.107:0/2641553877 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f838c156d60 0x7f838c069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.325+0000 7f838a000640 1 -- 172.21.15.107:0/2641553877 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f838c156d60 msgr2=0x7f838c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.325+0000 7f838a000640 1 --2- 172.21.15.107:0/2641553877 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f838c156d60 0x7f838c069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.325+0000 7f838a000640 1 -- 172.21.15.107:0/2641553877 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f838c0adcf0 msgr2=0x7f838c147360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.325+0000 7f838a000640 1 --2- 172.21.15.107:0/2641553877 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f838c0adcf0 0x7f838c147360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.325+0000 7f838a000640 1 -- 172.21.15.107:0/2641553877 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8378009450 con 0x7f838c156990 2024-08-17T02:25:37.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.325+0000 7f838aa00640 1 --2- 172.21.15.107:0/2641553877 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f838c0adcf0 0x7f838c147360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:37.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.325+0000 7f838a000640 1 --2- 172.21.15.107:0/2641553877 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f838c156990 0x7f838c0acf90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8378031000 tx=0x7f8378032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:37.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.326+0000 7f8382000640 1 -- 172.21.15.107:0/2641553877 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8378000c40 con 0x7f838c156990 2024-08-17T02:25:37.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.326+0000 7f8382000640 1 -- 172.21.15.107:0/2641553877 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8378031a60 con 0x7f838c156990 2024-08-17T02:25:37.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.326+0000 7f8391800640 1 -- 172.21.15.107:0/2641553877 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f838c0ad4d0 con 0x7f838c156990 2024-08-17T02:25:37.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.326+0000 7f8382000640 1 -- 172.21.15.107:0/2641553877 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8378031e60 con 0x7f838c156990 2024-08-17T02:25:37.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.326+0000 7f8391800640 1 -- 172.21.15.107:0/2641553877 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f838c169720 con 0x7f838c156990 2024-08-17T02:25:37.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.327+0000 7f8391800640 1 -- 172.21.15.107:0/2641553877 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f838c16a200 con 0x7f838c156990 2024-08-17T02:25:37.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.328+0000 7f8382000640 1 -- 172.21.15.107:0/2641553877 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f837805ba50 con 0x7f838c156990 2024-08-17T02:25:37.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.329+0000 7f8382000640 1 --2- 172.21.15.107:0/2641553877 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f836c065180 0x7f836c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:37.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.329+0000 7f8382000640 1 -- 172.21.15.107:0/2641553877 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f837802ae40 con 0x7f838c156990 2024-08-17T02:25:37.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.329+0000 7f838aa00640 1 --2- 172.21.15.107:0/2641553877 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f836c065180 0x7f836c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.330+0000 7f838aa00640 1 --2- 172.21.15.107:0/2641553877 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f836c065180 0x7f836c067630 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f837c007fd0 tx=0x7f837c007f20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:37.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.333+0000 7f8382000640 1 -- 172.21.15.107:0/2641553877 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f83780707e0 con 0x7f838c156990 2024-08-17T02:25:37.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.505+0000 7f8391800640 1 -- 172.21.15.107:0/2641553877 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool ls", "detail": "detail", "format": "json"} v 0) v1 -- 0x7f838c071050 con 0x7f838c156990 2024-08-17T02:25:37.508 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.507+0000 7f8382000640 1 -- 172.21.15.107:0/2641553877 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls", "detail": "detail", "format": "json"}]=0 v35) v1 ==== 97+0+8050 (secure 0 0 0) 0x7f8378073e00 con 0x7f838c156990 2024-08-17T02:25:37.508 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:25:37.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.509+0000 7f8391800640 1 -- 172.21.15.107:0/2641553877 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f836c065180 msgr2=0x7f836c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.509+0000 7f8391800640 1 --2- 172.21.15.107:0/2641553877 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f836c065180 0x7f836c067630 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f837c007fd0 tx=0x7f837c007f20 comp rx=0 tx=0).stop 2024-08-17T02:25:37.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.509+0000 7f8391800640 1 -- 172.21.15.107:0/2641553877 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f838c156990 msgr2=0x7f838c0acf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.509+0000 7f8391800640 1 --2- 172.21.15.107:0/2641553877 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f838c156990 0x7f838c0acf90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8378031000 tx=0x7f8378032000 comp rx=0 tx=0).stop 2024-08-17T02:25:37.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.509+0000 7f8391800640 1 -- 172.21.15.107:0/2641553877 shutdown_connections 2024-08-17T02:25:37.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.509+0000 7f8391800640 1 --2- 172.21.15.107:0/2641553877 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f836c065180 0x7f836c067630 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.509+0000 7f8391800640 1 --2- 172.21.15.107:0/2641553877 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f838c156d60 0x7f838c069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.509+0000 7f8391800640 1 --2- 172.21.15.107:0/2641553877 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f838c156990 0x7f838c0acf90 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.509+0000 7f8391800640 1 --2- 172.21.15.107:0/2641553877 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f838c0adcf0 0x7f838c147360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.509+0000 7f8391800640 1 -- 172.21.15.107:0/2641553877 >> 172.21.15.107:0/2641553877 conn(0x7f838c067750 msgr2=0x7f838c1528e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:37.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.509+0000 7f8391800640 1 -- 172.21.15.107:0/2641553877 shutdown_connections 2024-08-17T02:25:37.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.509+0000 7f8391800640 1 -- 172.21.15.107:0/2641553877 wait complete. 2024-08-17T02:25:37.525 INFO:teuthology.orchestra.run.smithi107.stdout:[{"pool_id":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:23.456166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool_id":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:16.086009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool_id":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:17.060399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool_id":6,"pool_name":"cephfs.volume_0000000000928569.meta","create_time":"2024-08-17T02:25:33.885385+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000928569"}}},{"pool_id":7,"pool_name":"cephfs.volume_0000000000928569.data","create_time":"2024-08-17T02:25:34.790701+0000","flags":163841,"flags_names":"hashpspool,creating,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000928569"}}}] 2024-08-17T02:25:37.525 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs get volume_0000000000928569 --format=json 2024-08-17T02:25:37.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.671+0000 7f953ea00640 1 Processor -- start 2024-08-17T02:25:37.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.671+0000 7f953ea00640 1 -- start start 2024-08-17T02:25:37.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.672+0000 7f953ea00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f953806ddf0 0x7f9538158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:37.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.672+0000 7f953ea00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95380a9a10 con 0x7f95380aa7d0 2024-08-17T02:25:37.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.672+0000 7f953ea00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95380a9cf0 con 0x7f953806da20 2024-08-17T02:25:37.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.672+0000 7f953ea00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95380ac400 con 0x7f953806ddf0 2024-08-17T02:25:37.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.672+0000 7f953ca00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f953806ddf0 0x7f9538158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.673+0000 7f952f400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f95380aa7d0 0x7f95380ab6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:56740/0 (socket says 172.21.15.107:56740) 2024-08-17T02:25:37.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.673+0000 7f952f400640 1 -- 172.21.15.107:0/1213860939 learned_addr learned my addr 172.21.15.107:0/1213860939 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:25:37.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.673+0000 7f953ca00640 1 -- 172.21.15.107:0/1213860939 >> v1:172.21.15.157:6789/0 conn(0x7f953806da20 legacy=0x7f9538158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.673+0000 7f953ca00640 1 -- 172.21.15.107:0/1213860939 >> v1:172.21.15.107:6789/0 conn(0x7f95380aa7d0 legacy=0x7f95380ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.673+0000 7f953ca00640 1 -- 172.21.15.107:0/1213860939 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95380a9fd0 con 0x7f953806ddf0 2024-08-17T02:25:37.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.674+0000 7f953ca00640 1 --2- 172.21.15.107:0/1213860939 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f953806ddf0 0x7f9538158fa0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9530009e60 tx=0x7f9530009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcf026bf0142c5cc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:37.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.674+0000 7f9537400640 1 -- 172.21.15.107:0/1213860939 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9530007550 con 0x7f953806ddf0 2024-08-17T02:25:37.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.674+0000 7f9537400640 1 -- 172.21.15.107:0/1213860939 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f953002d050 con 0x7f953806ddf0 2024-08-17T02:25:37.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.674+0000 7f9537400640 1 -- 172.21.15.107:0/1213860939 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9530007920 con 0x7f953806ddf0 2024-08-17T02:25:37.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.675+0000 7f953ea00640 1 -- 172.21.15.107:0/1213860939 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f953806ddf0 msgr2=0x7f9538158fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.675+0000 7f953ea00640 1 --2- 172.21.15.107:0/1213860939 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f953806ddf0 0x7f9538158fa0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9530009e60 tx=0x7f9530009780 comp rx=0 tx=0).stop 2024-08-17T02:25:37.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.675+0000 7f953ea00640 1 -- 172.21.15.107:0/1213860939 shutdown_connections 2024-08-17T02:25:37.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.675+0000 7f953ea00640 1 --2- 172.21.15.107:0/1213860939 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f953806ddf0 0x7f9538158fa0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.675+0000 7f953ea00640 1 -- 172.21.15.107:0/1213860939 >> 172.21.15.107:0/1213860939 conn(0x7f95380cb9b0 msgr2=0x7f95380cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:37.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.675+0000 7f953ea00640 1 -- 172.21.15.107:0/1213860939 shutdown_connections 2024-08-17T02:25:37.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.675+0000 7f953ea00640 1 -- 172.21.15.107:0/1213860939 wait complete. 2024-08-17T02:25:37.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.676+0000 7f953ea00640 1 Processor -- start 2024-08-17T02:25:37.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.676+0000 7f953ea00640 1 -- start start 2024-08-17T02:25:37.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.677+0000 7f953ea00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f953806da20 0x7f95381544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:37.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.677+0000 7f953ea00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f953806ddf0 0x7f9538158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:37.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.677+0000 7f953ea00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95380aa7d0 0x7f9538159180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:37.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.677+0000 7f953ea00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953815c490 con 0x7f953806ddf0 2024-08-17T02:25:37.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.677+0000 7f953ea00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95380c9980 con 0x7f95380aa7d0 2024-08-17T02:25:37.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.677+0000 7f953ea00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f953815bbf0 con 0x7f953806da20 2024-08-17T02:25:37.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.678+0000 7f952f400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f953806ddf0 0x7f9538158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.678+0000 7f952f400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f953806ddf0 0x7f9538158c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50870/0 (socket says 172.21.15.107:50870) 2024-08-17T02:25:37.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.678+0000 7f952f400640 1 -- 172.21.15.107:0/2341168183 learned_addr learned my addr 172.21.15.107:0/2341168183 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:37.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.678+0000 7f9537e00640 1 --2- 172.21.15.107:0/2341168183 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f953806da20 0x7f95381544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.678+0000 7f953ca00640 1 --2- 172.21.15.107:0/2341168183 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95380aa7d0 0x7f9538159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.678+0000 7f952f400640 1 -- 172.21.15.107:0/2341168183 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f953806da20 msgr2=0x7f95381544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.678+0000 7f952f400640 1 --2- 172.21.15.107:0/2341168183 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f953806da20 0x7f95381544a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.678+0000 7f952f400640 1 -- 172.21.15.107:0/2341168183 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95380aa7d0 msgr2=0x7f9538159180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.678+0000 7f952f400640 1 --2- 172.21.15.107:0/2341168183 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95380aa7d0 0x7f9538159180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.678+0000 7f952f400640 1 -- 172.21.15.107:0/2341168183 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9530009a20 con 0x7f953806ddf0 2024-08-17T02:25:37.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.678+0000 7f952f400640 1 --2- 172.21.15.107:0/2341168183 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f953806ddf0 0x7f9538158c40 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f952000c590 tx=0x7f9520007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:37.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.679+0000 7f952fe00640 1 -- 172.21.15.107:0/2341168183 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9520005aa0 con 0x7f953806ddf0 2024-08-17T02:25:37.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.679+0000 7f952fe00640 1 -- 172.21.15.107:0/2341168183 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9520005c60 con 0x7f953806ddf0 2024-08-17T02:25:37.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.679+0000 7f952fe00640 1 -- 172.21.15.107:0/2341168183 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95200070d0 con 0x7f953806ddf0 2024-08-17T02:25:37.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.679+0000 7f953ea00640 1 -- 172.21.15.107:0/2341168183 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f953815bed0 con 0x7f953806ddf0 2024-08-17T02:25:37.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.679+0000 7f953ea00640 1 -- 172.21.15.107:0/2341168183 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95381549e0 con 0x7f953806ddf0 2024-08-17T02:25:37.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.680+0000 7f953ea00640 1 -- 172.21.15.107:0/2341168183 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9538064db0 con 0x7f953806ddf0 2024-08-17T02:25:37.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.681+0000 7f952fe00640 1 -- 172.21.15.107:0/2341168183 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9520007500 con 0x7f953806ddf0 2024-08-17T02:25:37.683 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.681+0000 7f952fe00640 1 --2- 172.21.15.107:0/2341168183 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f9514065150 0x7f9514067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:37.683 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.682+0000 7f952fe00640 1 -- 172.21.15.107:0/2341168183 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f9520081cc0 con 0x7f953806ddf0 2024-08-17T02:25:37.683 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.682+0000 7f9537e00640 1 --2- 172.21.15.107:0/2341168183 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f9514065150 0x7f9514067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.683 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.682+0000 7f9537e00640 1 --2- 172.21.15.107:0/2341168183 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f9514065150 0x7f9514067600 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9528007fd0 tx=0x7f9528007e30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:37.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.685+0000 7f952fe00640 1 -- 172.21.15.107:0/2341168183 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9520088080 con 0x7f953806ddf0 2024-08-17T02:25:37.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.909+0000 7f953ea00640 1 -- 172.21.15.107:0/2341168183 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs get", "fs_name": "volume_0000000000928569", "format": "json"} v 0) v1 -- 0x7f95380c9ac0 con 0x7f953806ddf0 2024-08-17T02:25:37.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.909+0000 7f952fe00640 1 -- 172.21.15.107:0/2341168183 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs get", "fs_name": "volume_0000000000928569", "format": "json"}]=0 v21) v1 ==== 110+0+1844 (secure 0 0 0) 0x7f95200170b0 con 0x7f953806ddf0 2024-08-17T02:25:37.910 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:25:37.911 INFO:teuthology.orchestra.run.smithi107.stdout:{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:35.757205+0000","modified":"2024-08-17T02:25:37.759836+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4914":{"gid":4914,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.107:6837/809431952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":809431952},{"type":"v1","addr":"172.21.15.107:6837","nonce":809431952}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000928569","balancer":"","standby_count_wanted":1},"id":3} 2024-08-17T02:25:37.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.911+0000 7f953ea00640 1 -- 172.21.15.107:0/2341168183 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f9514065150 msgr2=0x7f9514067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.911+0000 7f953ea00640 1 --2- 172.21.15.107:0/2341168183 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f9514065150 0x7f9514067600 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9528007fd0 tx=0x7f9528007e30 comp rx=0 tx=0).stop 2024-08-17T02:25:37.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.911+0000 7f953ea00640 1 -- 172.21.15.107:0/2341168183 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f953806ddf0 msgr2=0x7f9538158c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.911+0000 7f953ea00640 1 --2- 172.21.15.107:0/2341168183 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f953806ddf0 0x7f9538158c40 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f952000c590 tx=0x7f9520007f40 comp rx=0 tx=0).stop 2024-08-17T02:25:37.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.911+0000 7f953ea00640 1 -- 172.21.15.107:0/2341168183 shutdown_connections 2024-08-17T02:25:37.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.911+0000 7f953ea00640 1 --2- 172.21.15.107:0/2341168183 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f9514065150 0x7f9514067600 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.911+0000 7f953ea00640 1 --2- 172.21.15.107:0/2341168183 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95380aa7d0 0x7f9538159180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.911+0000 7f953ea00640 1 --2- 172.21.15.107:0/2341168183 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f953806ddf0 0x7f9538158c40 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.911+0000 7f953ea00640 1 --2- 172.21.15.107:0/2341168183 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f953806da20 0x7f95381544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.911+0000 7f953ea00640 1 -- 172.21.15.107:0/2341168183 >> 172.21.15.107:0/2341168183 conn(0x7f95380cb9b0 msgr2=0x7f953806c730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:37.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.911+0000 7f953ea00640 1 -- 172.21.15.107:0/2341168183 shutdown_connections 2024-08-17T02:25:37.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:37.911+0000 7f953ea00640 1 -- 172.21.15.107:0/2341168183 wait complete. 2024-08-17T02:25:37.928 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000928569 --yes-i-really-mean-it 2024-08-17T02:25:38.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.077+0000 7f54b4c00640 1 Processor -- start 2024-08-17T02:25:38.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.077+0000 7f54b4c00640 1 -- start start 2024-08-17T02:25:38.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.078+0000 7f54b4c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f54b0158a30 0x7f54b00c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.078+0000 7f54b4c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b00c61d0 con 0x7f54b00c4a20 2024-08-17T02:25:38.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.078+0000 7f54b4c00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b00c64b0 con 0x7f54b00ce890 2024-08-17T02:25:38.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.078+0000 7f54b4c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b00c6790 con 0x7f54b0158a30 2024-08-17T02:25:38.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.078+0000 7f54a7e00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f54b00c4a20 0x7f54b00ce180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:56744/0 (socket says 172.21.15.107:56744) 2024-08-17T02:25:38.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.078+0000 7f54a7e00640 1 -- 172.21.15.107:0/2598658193 learned_addr learned my addr 172.21.15.107:0/2598658193 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:25:38.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.079+0000 7f54af400640 1 --2- 172.21.15.107:0/2598658193 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f54b0158a30 0x7f54b00c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.079+0000 7f54aea00640 1 -- 172.21.15.107:0/2598658193 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2475598048 0 0) 0x7f54b00c61d0 con 0x7f54b00c4a20 2024-08-17T02:25:38.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.079+0000 7f54aea00640 1 -- 172.21.15.107:0/2598658193 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54940034e0 con 0x7f54b00c4a20 2024-08-17T02:25:38.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.079+0000 7f54aea00640 1 -- 172.21.15.107:0/2598658193 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 203057184 0 0) 0x7f54b00c64b0 con 0x7f54b00ce890 2024-08-17T02:25:38.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.079+0000 7f54aea00640 1 -- 172.21.15.107:0/2598658193 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54b00c61d0 con 0x7f54b00ce890 2024-08-17T02:25:38.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.079+0000 7f54aea00640 1 -- 172.21.15.107:0/2598658193 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2992548428 0 0) 0x7f54940034e0 con 0x7f54b00c4a20 2024-08-17T02:25:38.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.079+0000 7f54aea00640 1 -- 172.21.15.107:0/2598658193 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f54b0158a30 msgr2=0x7f54b00c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:38.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.079+0000 7f54aea00640 1 --2- 172.21.15.107:0/2598658193 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f54b0158a30 0x7f54b00c58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.079+0000 7f54aea00640 1 -- 172.21.15.107:0/2598658193 >> v1:172.21.15.157:6789/0 conn(0x7f54b00ce890 legacy=0x7f54b00cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.079+0000 7f54aea00640 1 -- 172.21.15.107:0/2598658193 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b00cab70 con 0x7f54b00c4a20 2024-08-17T02:25:38.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.079+0000 7f54aea00640 1 -- 172.21.15.107:0/2598658193 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 537989081 0 0) 0x7f5498001470 con 0x7f54b00c4a20 2024-08-17T02:25:38.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.079+0000 7f54aea00640 1 -- 172.21.15.107:0/2598658193 >> v1:172.21.15.107:6789/0 conn(0x7f54b00c4a20 legacy=0x7f54b00ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.079+0000 7f54aea00640 1 --2- 172.21.15.107:0/2598658193 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5494003b90 0x7f5494003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.079+0000 7f54aea00640 1 --2- 172.21.15.107:0/2598658193 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5494004780 0x7f5494004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.079+0000 7f54aea00640 1 --2- 172.21.15.107:0/2598658193 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5494005130 0x7f549400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.079+0000 7f54aea00640 1 -- 172.21.15.107:0/2598658193 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b00c6790 con 0x7f5494004780 2024-08-17T02:25:38.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.079+0000 7f54aea00640 1 -- 172.21.15.107:0/2598658193 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549400bf90 con 0x7f5494005130 2024-08-17T02:25:38.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.079+0000 7f54aea00640 1 -- 172.21.15.107:0/2598658193 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f549400c150 con 0x7f5494003b90 2024-08-17T02:25:38.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.080+0000 7f54a7e00640 1 --2- 172.21.15.107:0/2598658193 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5494004780 0x7f5494004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.080+0000 7f54af400640 1 --2- 172.21.15.107:0/2598658193 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5494003b90 0x7f5494003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.080+0000 7f54afe00640 1 --2- 172.21.15.107:0/2598658193 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5494005130 0x7f549400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.080+0000 7f54a7e00640 1 -- 172.21.15.107:0/2598658193 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5494003b90 msgr2=0x7f5494003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:38.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.080+0000 7f54a7e00640 1 --2- 172.21.15.107:0/2598658193 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5494003b90 0x7f5494003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.080+0000 7f54a7e00640 1 -- 172.21.15.107:0/2598658193 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5494005130 msgr2=0x7f549400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:38.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.080+0000 7f54a7e00640 1 --2- 172.21.15.107:0/2598658193 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5494005130 0x7f549400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.080+0000 7f54a7e00640 1 -- 172.21.15.107:0/2598658193 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54940034e0 con 0x7f5494004780 2024-08-17T02:25:38.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.081+0000 7f54a7e00640 1 --2- 172.21.15.107:0/2598658193 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5494004780 0x7f5494004bf0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f549800c210 tx=0x7f5498001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e6fc6869ee6e94f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:38.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.081+0000 7f54aea00640 1 -- 172.21.15.107:0/2598658193 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5498005890 con 0x7f5494004780 2024-08-17T02:25:38.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.081+0000 7f54aea00640 1 -- 172.21.15.107:0/2598658193 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549802d070 con 0x7f5494004780 2024-08-17T02:25:38.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.081+0000 7f54aea00640 1 -- 172.21.15.107:0/2598658193 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5498005a30 con 0x7f5494004780 2024-08-17T02:25:38.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.082+0000 7f54b4c00640 1 -- 172.21.15.107:0/2598658193 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5494004780 msgr2=0x7f5494004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.082+0000 7f54b4c00640 1 --2- 172.21.15.107:0/2598658193 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5494004780 0x7f5494004bf0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f549800c210 tx=0x7f5498001e10 comp rx=0 tx=0).stop 2024-08-17T02:25:38.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.082+0000 7f54afe00640 1 -- 172.21.15.107:0/2598658193 reap_dead start 2024-08-17T02:25:38.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.082+0000 7f54b4c00640 1 -- 172.21.15.107:0/2598658193 shutdown_connections 2024-08-17T02:25:38.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.082+0000 7f54b4c00640 1 -- 172.21.15.107:0/2598658193 >> 172.21.15.107:0/2598658193 conn(0x7f54b0098e30 msgr2=0x7f54b006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:38.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.082+0000 7f54b4c00640 1 -- 172.21.15.107:0/2598658193 shutdown_connections 2024-08-17T02:25:38.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.082+0000 7f54b4c00640 1 -- 172.21.15.107:0/2598658193 wait complete. 2024-08-17T02:25:38.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.083+0000 7f54b4c00640 1 Processor -- start 2024-08-17T02:25:38.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.083+0000 7f54b4c00640 1 -- start start 2024-08-17T02:25:38.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.084+0000 7f54b4c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5494004780 0x7f54b01539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.084+0000 7f54b4c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f54b00c8ce0 0x7f54b00c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.084+0000 7f54b4c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54b009cc00 0x7f54b009d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.084+0000 7f54b4c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b00c7bf0 con 0x7f5494004780 2024-08-17T02:25:38.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.084+0000 7f54b4c00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b0099bb0 con 0x7f54b009cc00 2024-08-17T02:25:38.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.084+0000 7f54b4c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b0153f20 con 0x7f54b00c8ce0 2024-08-17T02:25:38.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.084+0000 7f54af400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5494004780 0x7f54b01539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.084+0000 7f54af400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5494004780 0x7f54b01539e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50894/0 (socket says 172.21.15.107:50894) 2024-08-17T02:25:38.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.084+0000 7f54af400640 1 -- 172.21.15.107:0/2719801451 learned_addr learned my addr 172.21.15.107:0/2719801451 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:25:38.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.085+0000 7f54a7e00640 1 --2- 172.21.15.107:0/2719801451 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f54b00c8ce0 0x7f54b00c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.089 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.085+0000 7f54afe00640 1 --2- 172.21.15.107:0/2719801451 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54b009cc00 0x7f54b009d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.089 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.085+0000 7f54af400640 1 -- 172.21.15.107:0/2719801451 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f54b00c8ce0 msgr2=0x7f54b00c6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.089 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.085+0000 7f54af400640 1 --2- 172.21.15.107:0/2719801451 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f54b00c8ce0 0x7f54b00c6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.089 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.085+0000 7f54af400640 1 -- 172.21.15.107:0/2719801451 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54b009cc00 msgr2=0x7f54b009d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.089 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.085+0000 7f54af400640 1 --2- 172.21.15.107:0/2719801451 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54b009cc00 0x7f54b009d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.089 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.085+0000 7f54af400640 1 -- 172.21.15.107:0/2719801451 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b00c7630 con 0x7f5494004780 2024-08-17T02:25:38.089 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.085+0000 7f54af400640 1 --2- 172.21.15.107:0/2719801451 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5494004780 0x7f54b01539e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f54a0011a40 tx=0x7f54a00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:38.089 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.085+0000 7f54a6a00640 1 -- 172.21.15.107:0/2719801451 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a000f6e0 con 0x7f5494004780 2024-08-17T02:25:38.089 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.085+0000 7f54a6a00640 1 -- 172.21.15.107:0/2719801451 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a000f840 con 0x7f5494004780 2024-08-17T02:25:38.089 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.085+0000 7f54b4c00640 1 -- 172.21.15.107:0/2719801451 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54b00c7910 con 0x7f5494004780 2024-08-17T02:25:38.089 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.085+0000 7f54a6a00640 1 -- 172.21.15.107:0/2719801451 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a000fc00 con 0x7f5494004780 2024-08-17T02:25:38.089 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.086+0000 7f54b4c00640 1 -- 172.21.15.107:0/2719801451 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54b009d5b0 con 0x7f5494004780 2024-08-17T02:25:38.090 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.087+0000 7f54b4c00640 1 -- 172.21.15.107:0/2719801451 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54b00999e0 con 0x7f5494004780 2024-08-17T02:25:38.090 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.087+0000 7f54a6a00640 1 -- 172.21.15.107:0/2719801451 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f54a0014440 con 0x7f5494004780 2024-08-17T02:25:38.090 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.088+0000 7f54a6a00640 1 --2- 172.21.15.107:0/2719801451 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f548c065180 0x7f548c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.089+0000 7f54a6a00640 1 -- 172.21.15.107:0/2719801451 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f54a0018030 con 0x7f5494004780 2024-08-17T02:25:38.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.089+0000 7f54a7e00640 1 --2- 172.21.15.107:0/2719801451 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f548c065180 0x7f548c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.089+0000 7f54a7e00640 1 --2- 172.21.15.107:0/2719801451 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f548c065180 0x7f548c067630 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5498032000 tx=0x7f5498033000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:38.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.093+0000 7f54a6a00640 1 -- 172.21.15.107:0/2719801451 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f54a0054540 con 0x7f5494004780 2024-08-17T02:25:38.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:25:38.288+0000 7f54b4c00640 1 -- 172.21.15.107:0/2719801451 --> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "volume_0000000000928569", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7f54b0071050 con 0x7f548c065180 2024-08-17T02:25:41.642 INFO:tasks.ceph.mds.c.smithi107.stderr:2024-08-17T02:25:41.641+0000 7f4027000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:26:04.301 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:04.307 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:34.399 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:34.404 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:04.503 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:04.508 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:34.716 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:34.722 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:37.996 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-08-17T02:27:37.997 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-17T02:27:37.997 DEBUG:teuthology.orchestra.run.smithi107:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:27:38.089 DEBUG:teuthology.orchestra.run.smithi157:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:27:38.182 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-17T02:27:38.182 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-17T02:27:38.182 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:38.183 DEBUG:teuthology.orchestra.run.smithi107:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-17T02:27:38.249 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi107.front.sepia.ceph.com 2024-08-17T02:27:38.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:38.250 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-17T02:27:38.286 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-08-17T02:27:38.287 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:38.287 DEBUG:teuthology.orchestra.run.smithi157:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-08-17T02:27:38.355 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi157.front.sepia.ceph.com 2024-08-17T02:27:38.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:38.355 DEBUG:teuthology.orchestra.run.smithi157:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-17T02:27:38.392 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:38.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.539+0000 7f4fe1600640 1 Processor -- start 2024-08-17T02:27:38.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.539+0000 7f4fe1600640 1 -- start start 2024-08-17T02:27:38.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.540+0000 7f4fe1600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4fdc0b0270 0x7f4fdc1563e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:38.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.540+0000 7f4fe1600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fdc157690 con 0x7f4fdc155900 2024-08-17T02:27:38.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.540+0000 7f4fe1600640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fdc156a80 con 0x7f4fdc158b30 2024-08-17T02:27:38.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.540+0000 7f4fe1600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fdc156d60 con 0x7f4fdc0b0270 2024-08-17T02:27:38.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.540+0000 7f4fdbe00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f4fdc155900 0x7f4fdc155cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:48986/0 (socket says 172.21.15.107:48986) 2024-08-17T02:27:38.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.540+0000 7f4fdbe00640 1 -- 172.21.15.107:0/2577796299 learned_addr learned my addr 172.21.15.107:0/2577796299 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:27:38.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.540+0000 7f4fd3400640 1 --2- 172.21.15.107:0/2577796299 >> v2:172.21.15.107:3300/0 conn(0x7f4fdc0b0270 0x7f4fdc1563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:38.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.541+0000 7f4fdb400640 1 -- 172.21.15.107:0/2577796299 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 208204868 0 0) 0x7f4fdc157690 con 0x7f4fdc155900 2024-08-17T02:27:38.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.541+0000 7f4fdb400640 1 -- 172.21.15.107:0/2577796299 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fc00034e0 con 0x7f4fdc155900 2024-08-17T02:27:38.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.541+0000 7f4fd3400640 1 -- 172.21.15.107:0/2577796299 >> v1:172.21.15.157:6789/0 conn(0x7f4fdc158b30 legacy=0x7f4fdc0ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:38.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.541+0000 7f4fd3400640 1 -- 172.21.15.107:0/2577796299 >> v1:172.21.15.107:6789/0 conn(0x7f4fdc155900 legacy=0x7f4fdc155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:38.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.541+0000 7f4fd3400640 1 -- 172.21.15.107:0/2577796299 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fdc157040 con 0x7f4fdc0b0270 2024-08-17T02:27:38.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.542+0000 7f4fd3400640 1 --2- 172.21.15.107:0/2577796299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fdc0b0270 0x7f4fdc1563e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4fc4009850 tx=0x7f4fc40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d012feadddf771c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:38.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.542+0000 7f4fdb400640 1 -- 172.21.15.107:0/2577796299 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc402ae20 con 0x7f4fdc0b0270 2024-08-17T02:27:38.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.542+0000 7f4fdb400640 1 -- 172.21.15.107:0/2577796299 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc4032440 con 0x7f4fdc0b0270 2024-08-17T02:27:38.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.542+0000 7f4fdb400640 1 -- 172.21.15.107:0/2577796299 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc40327c0 con 0x7f4fdc0b0270 2024-08-17T02:27:38.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.542+0000 7f4fe1600640 1 -- 172.21.15.107:0/2577796299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fdc0b0270 msgr2=0x7f4fdc1563e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:38.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.542+0000 7f4fe1600640 1 --2- 172.21.15.107:0/2577796299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fdc0b0270 0x7f4fdc1563e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4fc4009850 tx=0x7f4fc40090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.543+0000 7f4fe1600640 1 -- 172.21.15.107:0/2577796299 shutdown_connections 2024-08-17T02:27:38.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.543+0000 7f4fe1600640 1 --2- 172.21.15.107:0/2577796299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fdc0b0270 0x7f4fdc1563e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.543+0000 7f4fe1600640 1 -- 172.21.15.107:0/2577796299 >> 172.21.15.107:0/2577796299 conn(0x7f4fdc067750 msgr2=0x7f4fdc0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:38.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.543+0000 7f4fe1600640 1 -- 172.21.15.107:0/2577796299 shutdown_connections 2024-08-17T02:27:38.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.543+0000 7f4fe1600640 1 -- 172.21.15.107:0/2577796299 wait complete. 2024-08-17T02:27:38.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.544+0000 7f4fe1600640 1 Processor -- start 2024-08-17T02:27:38.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.544+0000 7f4fe1600640 1 -- start start 2024-08-17T02:27:38.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.545+0000 7f4fe1600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4fdc0b0270 0x7f4fdc0ac250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:38.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.545+0000 7f4fe1600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4fdc155900 0x7f4fdc06d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:38.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.545+0000 7f4fe1600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fdc158b30 0x7f4fdc06dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:38.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.545+0000 7f4fe1600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fdc0c6830 con 0x7f4fdc158b30 2024-08-17T02:27:38.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.545+0000 7f4fe1600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fdc0c5c20 con 0x7f4fdc0b0270 2024-08-17T02:27:38.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.545+0000 7f4fe1600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fdc0c5f00 con 0x7f4fdc155900 2024-08-17T02:27:38.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.545+0000 7f4fe0c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fdc158b30 0x7f4fdc06dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:38.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.545+0000 7f4fe0c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fdc158b30 0x7f4fdc06dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:46688/0 (socket says 172.21.15.107:46688) 2024-08-17T02:27:38.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.545+0000 7f4fe0c00640 1 -- 172.21.15.107:0/1556881365 learned_addr learned my addr 172.21.15.107:0/1556881365 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:38.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.546+0000 7f4fdbe00640 1 --2- 172.21.15.107:0/1556881365 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4fdc0b0270 0x7f4fdc0ac250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:38.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.546+0000 7f4fd3400640 1 --2- 172.21.15.107:0/1556881365 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4fdc155900 0x7f4fdc06d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:38.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.546+0000 7f4fe0c00640 1 -- 172.21.15.107:0/1556881365 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4fdc155900 msgr2=0x7f4fdc06d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:38.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.546+0000 7f4fe0c00640 1 --2- 172.21.15.107:0/1556881365 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4fdc155900 0x7f4fdc06d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.546+0000 7f4fe0c00640 1 -- 172.21.15.107:0/1556881365 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4fdc0b0270 msgr2=0x7f4fdc0ac250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:38.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.546+0000 7f4fe0c00640 1 --2- 172.21.15.107:0/1556881365 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4fdc0b0270 0x7f4fdc0ac250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.546+0000 7f4fe0c00640 1 -- 172.21.15.107:0/1556881365 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc4009390 con 0x7f4fdc158b30 2024-08-17T02:27:38.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.546+0000 7f4fe0c00640 1 --2- 172.21.15.107:0/1556881365 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fdc158b30 0x7f4fdc06dab0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f4fd400c7c0 tx=0x7f4fd40015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:38.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.546+0000 7f4fd3e00640 1 -- 172.21.15.107:0/1556881365 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd400a640 con 0x7f4fdc158b30 2024-08-17T02:27:38.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.546+0000 7f4fd3e00640 1 -- 172.21.15.107:0/1556881365 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd400a7c0 con 0x7f4fdc158b30 2024-08-17T02:27:38.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.546+0000 7f4fe1600640 1 -- 172.21.15.107:0/1556881365 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fdc0c61e0 con 0x7f4fdc158b30 2024-08-17T02:27:38.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.546+0000 7f4fd3e00640 1 -- 172.21.15.107:0/1556881365 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd400ab80 con 0x7f4fdc158b30 2024-08-17T02:27:38.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.546+0000 7f4fe1600640 1 -- 172.21.15.107:0/1556881365 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fdc0c5900 con 0x7f4fdc158b30 2024-08-17T02:27:38.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.547+0000 7f4fe1600640 1 -- 172.21.15.107:0/1556881365 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fdc071050 con 0x7f4fdc158b30 2024-08-17T02:27:38.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.548+0000 7f4fd3e00640 1 -- 172.21.15.107:0/1556881365 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4fd4003030 con 0x7f4fdc158b30 2024-08-17T02:27:38.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.549+0000 7f4fd3e00640 1 --2- 172.21.15.107:0/1556881365 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4fb8065150 0x7f4fb8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:38.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.549+0000 7f4fd3e00640 1 -- 172.21.15.107:0/1556881365 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f4fd40827c0 con 0x7f4fdc158b30 2024-08-17T02:27:38.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.549+0000 7f4fdbe00640 1 --2- 172.21.15.107:0/1556881365 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4fb8065150 0x7f4fb8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:38.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.550+0000 7f4fdbe00640 1 --2- 172.21.15.107:0/1556881365 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4fb8065150 0x7f4fb8067600 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc005840 tx=0x7f4fcc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:38.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.553+0000 7f4fd3e00640 1 -- 172.21.15.107:0/1556881365 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4fd4050460 con 0x7f4fdc158b30 2024-08-17T02:27:38.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.760+0000 7f4fe1600640 1 -- 172.21.15.107:0/1556881365 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4fdc06f480 con 0x7f4fdc158b30 2024-08-17T02:27:38.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.761+0000 7f4fd3e00640 1 -- 172.21.15.107:0/1556881365 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5690 (secure 0 0 0) 0x7f4fd4053a80 con 0x7f4fdc158b30 2024-08-17T02:27:38.762 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:27:38.763 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4682,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/855770365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":855770365},{"type":"v1","addr":"172.21.15.107:6836","nonce":855770365}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4688,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6834/1749905502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1749905502},{"type":"v1","addr":"172.21.15.157:6834","nonce":1749905502}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:18.071301+0000","modified":"2024-08-17T02:25:21.685727+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4920":{"gid":4920,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6835/1725535660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6833","nonce":1725535660},{"type":"v1","addr":"172.21.15.157:6835","nonce":1725535660}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:35.757205+0000","modified":"2024-08-17T02:25:37.759836+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4914":{"gid":4914,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.107:6837/809431952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":809431952},{"type":"v1","addr":"172.21.15.107:6837","nonce":809431952}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000928569","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:27:38.763 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 21 2024-08-17T02:27:38.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.763+0000 7f4fe1600640 1 -- 172.21.15.107:0/1556881365 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4fb8065150 msgr2=0x7f4fb8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:38.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.763+0000 7f4fe1600640 1 --2- 172.21.15.107:0/1556881365 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4fb8065150 0x7f4fb8067600 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc005840 tx=0x7f4fcc009040 comp rx=0 tx=0).stop 2024-08-17T02:27:38.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.763+0000 7f4fe1600640 1 -- 172.21.15.107:0/1556881365 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fdc158b30 msgr2=0x7f4fdc06dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:38.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.763+0000 7f4fe1600640 1 --2- 172.21.15.107:0/1556881365 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fdc158b30 0x7f4fdc06dab0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f4fd400c7c0 tx=0x7f4fd40015f0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.763+0000 7f4fe1600640 1 -- 172.21.15.107:0/1556881365 shutdown_connections 2024-08-17T02:27:38.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.763+0000 7f4fe1600640 1 --2- 172.21.15.107:0/1556881365 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4fb8065150 0x7f4fb8067600 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.763+0000 7f4fe1600640 1 --2- 172.21.15.107:0/1556881365 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fdc158b30 0x7f4fdc06dab0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.763+0000 7f4fe1600640 1 --2- 172.21.15.107:0/1556881365 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4fdc155900 0x7f4fdc06d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.763+0000 7f4fe1600640 1 --2- 172.21.15.107:0/1556881365 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4fdc0b0270 0x7f4fdc0ac250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.763+0000 7f4fe1600640 1 -- 172.21.15.107:0/1556881365 >> 172.21.15.107:0/1556881365 conn(0x7f4fdc067750 msgr2=0x7f4fdc152600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:38.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.763+0000 7f4fe1600640 1 -- 172.21.15.107:0/1556881365 shutdown_connections 2024-08-17T02:27:38.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.763+0000 7f4fe1600640 1 -- 172.21.15.107:0/1556881365 wait complete. 2024-08-17T02:27:38.780 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:38.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.926+0000 7fe8ed600640 1 Processor -- start 2024-08-17T02:27:38.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.926+0000 7fe8ed600640 1 -- start start 2024-08-17T02:27:38.929 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.927+0000 7fe8ed600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe8e8155550 0x7fe8e80aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:38.929 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.927+0000 7fe8ed600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe8e806e080 0x7fe8e806e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:38.930 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.927+0000 7fe8ed600640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e80afc10 con 0x7fe8e8155180 2024-08-17T02:27:38.930 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.927+0000 7fe8ed600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8e806ea00 con 0x7fe8e8155550 2024-08-17T02:27:38.930 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.927+0000 7fe8ed600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e80af000 con 0x7fe8e806e080 2024-08-17T02:27:38.931 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.928+0000 7fe8e6000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe8e8155550 0x7fe8e80aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:38.931 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.928+0000 7fe8e6000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe8e8155550 0x7fe8e80aea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:46692/0 (socket says 172.21.15.107:46692) 2024-08-17T02:27:38.931 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.928+0000 7fe8e6000640 1 -- 172.21.15.107:0/672127625 learned_addr learned my addr 172.21.15.107:0/672127625 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:38.931 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.928+0000 7fe8e7400640 1 --2- 172.21.15.107:0/672127625 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe8e806e080 0x7fe8e806e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:38.931 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.928+0000 7fe8e6000640 1 -- 172.21.15.107:0/672127625 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe8e806e080 msgr2=0x7fe8e806e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:38.931 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.928+0000 7fe8e6000640 1 --2- 172.21.15.107:0/672127625 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe8e806e080 0x7fe8e806e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.931 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.928+0000 7fe8e6000640 1 -- 172.21.15.107:0/672127625 >> v1:172.21.15.157:6789/0 conn(0x7fe8e8155180 legacy=0x7fe8e80ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:38.931 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.928+0000 7fe8e6000640 1 -- 172.21.15.107:0/672127625 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e80af2e0 con 0x7fe8e8155550 2024-08-17T02:27:38.932 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.929+0000 7fe8e6000640 1 --2- 172.21.15.107:0/672127625 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe8e8155550 0x7fe8e80aea20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe8d400bbb0 tx=0x7fe8d400b4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=625df22082104c0a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:38.932 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.929+0000 7fe8e5600640 1 -- 172.21.15.107:0/672127625 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4032420 con 0x7fe8e8155550 2024-08-17T02:27:38.932 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.930+0000 7fe8e5600640 1 -- 172.21.15.107:0/672127625 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d4030070 con 0x7fe8e8155550 2024-08-17T02:27:38.932 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.930+0000 7fe8e5600640 1 -- 172.21.15.107:0/672127625 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d40327f0 con 0x7fe8e8155550 2024-08-17T02:27:38.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.930+0000 7fe8ed600640 1 -- 172.21.15.107:0/672127625 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe8e8155550 msgr2=0x7fe8e80aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:38.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.930+0000 7fe8ed600640 1 --2- 172.21.15.107:0/672127625 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe8e8155550 0x7fe8e80aea20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe8d400bbb0 tx=0x7fe8d400b4b0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.930+0000 7fe8ed600640 1 -- 172.21.15.107:0/672127625 shutdown_connections 2024-08-17T02:27:38.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.930+0000 7fe8ed600640 1 --2- 172.21.15.107:0/672127625 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe8e806e080 0x7fe8e806e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.930+0000 7fe8ed600640 1 --2- 172.21.15.107:0/672127625 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe8e8155550 0x7fe8e80aea20 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.930+0000 7fe8ed600640 1 -- 172.21.15.107:0/672127625 >> 172.21.15.107:0/672127625 conn(0x7fe8e80cb9b0 msgr2=0x7fe8e80cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:38.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.930+0000 7fe8ed600640 1 -- 172.21.15.107:0/672127625 shutdown_connections 2024-08-17T02:27:38.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.930+0000 7fe8ed600640 1 -- 172.21.15.107:0/672127625 wait complete. 2024-08-17T02:27:38.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.932+0000 7fe8ed600640 1 Processor -- start 2024-08-17T02:27:38.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.932+0000 7fe8ed600640 1 -- start start 2024-08-17T02:27:38.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.933+0000 7fe8ed600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8e806e080 0x7fe8e8155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:38.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.933+0000 7fe8ed600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe8e8155180 0x7fe8e8151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:38.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.933+0000 7fe8ed600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe8e8155550 0x7fe8e8168ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:38.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.933+0000 7fe8ed600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e8156b10 con 0x7fe8e8155550 2024-08-17T02:27:38.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.933+0000 7fe8ed600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e8156df0 con 0x7fe8e806e080 2024-08-17T02:27:38.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.933+0000 7fe8ed600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e81561c0 con 0x7fe8e8155180 2024-08-17T02:27:38.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.933+0000 7fe8e7400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe8e8155550 0x7fe8e8168ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:38.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.933+0000 7fe8e7400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe8e8155550 0x7fe8e8168ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:46694/0 (socket says 172.21.15.107:46694) 2024-08-17T02:27:38.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.933+0000 7fe8e7400640 1 -- 172.21.15.107:0/141375212 learned_addr learned my addr 172.21.15.107:0/141375212 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:38.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.933+0000 7fe8e6a00640 1 --2- 172.21.15.107:0/141375212 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8e806e080 0x7fe8e8155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:38.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.933+0000 7fe8e6000640 1 --2- 172.21.15.107:0/141375212 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe8e8155180 0x7fe8e8151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:38.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.933+0000 7fe8e7400640 1 -- 172.21.15.107:0/141375212 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe8e8155180 msgr2=0x7fe8e8151560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:38.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.933+0000 7fe8e7400640 1 --2- 172.21.15.107:0/141375212 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe8e8155180 0x7fe8e8151560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.933+0000 7fe8e7400640 1 -- 172.21.15.107:0/141375212 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8e806e080 msgr2=0x7fe8e8155970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:38.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.933+0000 7fe8e7400640 1 --2- 172.21.15.107:0/141375212 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8e806e080 0x7fe8e8155970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.933+0000 7fe8e7400640 1 -- 172.21.15.107:0/141375212 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d400b6f0 con 0x7fe8e8155550 2024-08-17T02:27:38.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.933+0000 7fe8e6000640 1 --2- 172.21.15.107:0/141375212 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe8e8155180 0x7fe8e8151560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:38.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.934+0000 7fe8e7400640 1 --2- 172.21.15.107:0/141375212 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe8e8155550 0x7fe8e8168ce0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0007f50 tx=0x7fe8e0009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:38.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.934+0000 7fe8de000640 1 -- 172.21.15.107:0/141375212 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e000ee10 con 0x7fe8e8155550 2024-08-17T02:27:38.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.934+0000 7fe8de000640 1 -- 172.21.15.107:0/141375212 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e0014420 con 0x7fe8e8155550 2024-08-17T02:27:38.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.934+0000 7fe8de000640 1 -- 172.21.15.107:0/141375212 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e00147e0 con 0x7fe8e8155550 2024-08-17T02:27:38.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.934+0000 7fe8ed600640 1 -- 172.21.15.107:0/141375212 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e81564a0 con 0x7fe8e8155550 2024-08-17T02:27:38.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.934+0000 7fe8ed600640 1 -- 172.21.15.107:0/141375212 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e8155eb0 con 0x7fe8e8155550 2024-08-17T02:27:38.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.935+0000 7fe8ed600640 1 -- 172.21.15.107:0/141375212 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8e8064db0 con 0x7fe8e8155550 2024-08-17T02:27:38.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.936+0000 7fe8de000640 1 -- 172.21.15.107:0/141375212 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe8e0014b50 con 0x7fe8e8155550 2024-08-17T02:27:38.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.937+0000 7fe8de000640 1 --2- 172.21.15.107:0/141375212 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe8c8065150 0x7fe8c8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:38.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.937+0000 7fe8de000640 1 -- 172.21.15.107:0/141375212 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fe8e0082e50 con 0x7fe8e8155550 2024-08-17T02:27:38.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.937+0000 7fe8e6a00640 1 --2- 172.21.15.107:0/141375212 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe8c8065150 0x7fe8c8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:38.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.938+0000 7fe8e6a00640 1 --2- 172.21.15.107:0/141375212 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe8c8065150 0x7fe8c8067600 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8007fd0 tx=0x7fe8d8007e30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:38.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:38.941+0000 7fe8de000640 1 -- 172.21.15.107:0/141375212 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe8e0050b90 con 0x7fe8e8155550 2024-08-17T02:27:39.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.116+0000 7fe8ed600640 1 -- 172.21.15.107:0/141375212 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8e80cbfd0 con 0x7fe8e8155550 2024-08-17T02:27:39.118 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.117+0000 7fe8de000640 1 -- 172.21.15.107:0/141375212 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18647 (secure 0 0 0) 0x7fe8e00541b0 con 0x7fe8e8155550 2024-08-17T02:27:39.119 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:27:39.119 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":37,"fsid":"f207b4c0-329d-46b8-b83f-aaf30bdb6ce3","created":"2024-08-17T02:24:11.038049+0000","modified":"2024-08-17T02:25:38.761303+0000","last_up_change":"2024-08-17T02:24:22.047790+0000","last_in_change":"2024-08-17T02:24:13.892720+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:23.456166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:16.086009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:17.060399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000928569.meta","create_time":"2024-08-17T02:25:33.885385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000928569"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000928569.data","create_time":"2024-08-17T02:25:34.790701+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000928569"}}}],"osds":[{"osd":0,"uuid":"376363f3-b8bf-4f1e-b691-51cdd39171ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37302},{"type":"v1","addr":"172.21.15.107:6801","nonce":37302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37302},{"type":"v1","addr":"172.21.15.107:6803","nonce":37302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37302},{"type":"v1","addr":"172.21.15.107:6807","nonce":37302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37302},{"type":"v1","addr":"172.21.15.107:6805","nonce":37302}]},"public_addr":"172.21.15.107:6801/37302","cluster_addr":"172.21.15.107:6803/37302","heartbeat_back_addr":"172.21.15.107:6807/37302","heartbeat_front_addr":"172.21.15.107:6805/37302","state":["exists","up"]},{"osd":1,"uuid":"cc6624e3-2ad4-4db4-b377-05dfe57424e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37305},{"type":"v1","addr":"172.21.15.107:6824","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37305},{"type":"v1","addr":"172.21.15.107:6827","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37305},{"type":"v1","addr":"172.21.15.107:6831","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37305},{"type":"v1","addr":"172.21.15.107:6829","nonce":37305}]},"public_addr":"172.21.15.107:6824/37305","cluster_addr":"172.21.15.107:6827/37305","heartbeat_back_addr":"172.21.15.107:6831/37305","heartbeat_front_addr":"172.21.15.107:6829/37305","state":["exists","up"]},{"osd":2,"uuid":"25229542-29b5-4281-bcb0-798ae0930aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37307},{"type":"v1","addr":"172.21.15.107:6817","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37307},{"type":"v1","addr":"172.21.15.107:6819","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6823","nonce":37307},{"type":"v1","addr":"172.21.15.107:6825","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37307},{"type":"v1","addr":"172.21.15.107:6821","nonce":37307}]},"public_addr":"172.21.15.107:6817/37307","cluster_addr":"172.21.15.107:6819/37307","heartbeat_back_addr":"172.21.15.107:6825/37307","heartbeat_front_addr":"172.21.15.107:6821/37307","state":["exists","up"]},{"osd":3,"uuid":"5f16aee8-8950-4268-a61a-5cf6ebd670e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37306},{"type":"v1","addr":"172.21.15.107:6809","nonce":37306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37306},{"type":"v1","addr":"172.21.15.107:6811","nonce":37306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37306},{"type":"v1","addr":"172.21.15.107:6815","nonce":37306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37306},{"type":"v1","addr":"172.21.15.107:6813","nonce":37306}]},"public_addr":"172.21.15.107:6809/37306","cluster_addr":"172.21.15.107:6811/37306","heartbeat_back_addr":"172.21.15.107:6815/37306","heartbeat_front_addr":"172.21.15.107:6813/37306","state":["exists","up"]},{"osd":4,"uuid":"23232e28-e23b-4b4e-a531-4939246dbbde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":37329},{"type":"v1","addr":"172.21.15.157:6817","nonce":37329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":37329},{"type":"v1","addr":"172.21.15.157:6819","nonce":37329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":37329},{"type":"v1","addr":"172.21.15.157:6823","nonce":37329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":37329},{"type":"v1","addr":"172.21.15.157:6821","nonce":37329}]},"public_addr":"172.21.15.157:6817/37329","cluster_addr":"172.21.15.157:6819/37329","heartbeat_back_addr":"172.21.15.157:6823/37329","heartbeat_front_addr":"172.21.15.157:6821/37329","state":["exists","up"]},{"osd":5,"uuid":"f87ec331-3e59-4886-a317-6f7e26ec8e21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":37328},{"type":"v1","addr":"172.21.15.157:6804","nonce":37328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":37328},{"type":"v1","addr":"172.21.15.157:6808","nonce":37328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":37328},{"type":"v1","addr":"172.21.15.157:6815","nonce":37328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":37328},{"type":"v1","addr":"172.21.15.157:6812","nonce":37328}]},"public_addr":"172.21.15.157:6804/37328","cluster_addr":"172.21.15.157:6808/37328","heartbeat_back_addr":"172.21.15.157:6815/37328","heartbeat_front_addr":"172.21.15.157:6812/37328","state":["exists","up"]},{"osd":6,"uuid":"92852235-ce49-4d96-a940-6f18d97b13ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":37330},{"type":"v1","addr":"172.21.15.157:6801","nonce":37330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6803","nonce":37330},{"type":"v1","addr":"172.21.15.157:6805","nonce":37330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":37330},{"type":"v1","addr":"172.21.15.157:6813","nonce":37330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":37330},{"type":"v1","addr":"172.21.15.157:6809","nonce":37330}]},"public_addr":"172.21.15.157:6801/37330","cluster_addr":"172.21.15.157:6805/37330","heartbeat_back_addr":"172.21.15.157:6813/37330","heartbeat_front_addr":"172.21.15.157:6809/37330","state":["exists","up"]},{"osd":7,"uuid":"7484a061-723d-4663-b28f-b01766d62f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":37373},{"type":"v1","addr":"172.21.15.157:6825","nonce":37373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":37373},{"type":"v1","addr":"172.21.15.157:6827","nonce":37373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":37373},{"type":"v1","addr":"172.21.15.157:6831","nonce":37373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":37373},{"type":"v1","addr":"172.21.15.157:6829","nonce":37373}]},"public_addr":"172.21.15.157:6825/37373","cluster_addr":"172.21.15.157:6827/37373","heartbeat_back_addr":"172.21.15.157:6831/37373","heartbeat_front_addr":"172.21.15.157:6829/37373","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.110188+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.280265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.252119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.267996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.284582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.144420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.174764+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.308002+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:39.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.119+0000 7fe8ed600640 1 -- 172.21.15.107:0/141375212 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe8c8065150 msgr2=0x7fe8c8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.119+0000 7fe8ed600640 1 --2- 172.21.15.107:0/141375212 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe8c8065150 0x7fe8c8067600 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8007fd0 tx=0x7fe8d8007e30 comp rx=0 tx=0).stop 2024-08-17T02:27:39.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.119+0000 7fe8ed600640 1 -- 172.21.15.107:0/141375212 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe8e8155550 msgr2=0x7fe8e8168ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.119+0000 7fe8ed600640 1 --2- 172.21.15.107:0/141375212 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe8e8155550 0x7fe8e8168ce0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0007f50 tx=0x7fe8e0009860 comp rx=0 tx=0).stop 2024-08-17T02:27:39.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.119+0000 7fe8ed600640 1 -- 172.21.15.107:0/141375212 shutdown_connections 2024-08-17T02:27:39.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.119+0000 7fe8ed600640 1 --2- 172.21.15.107:0/141375212 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe8c8065150 0x7fe8c8067600 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.119+0000 7fe8ed600640 1 --2- 172.21.15.107:0/141375212 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe8e8155550 0x7fe8e8168ce0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.119+0000 7fe8ed600640 1 --2- 172.21.15.107:0/141375212 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe8e8155180 0x7fe8e8151560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.119+0000 7fe8ed600640 1 --2- 172.21.15.107:0/141375212 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8e806e080 0x7fe8e8155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.119+0000 7fe8ed600640 1 -- 172.21.15.107:0/141375212 >> 172.21.15.107:0/141375212 conn(0x7fe8e80cb9b0 msgr2=0x7fe8e80b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:39.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.119+0000 7fe8ed600640 1 -- 172.21.15.107:0/141375212 shutdown_connections 2024-08-17T02:27:39.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.120+0000 7fe8ed600640 1 -- 172.21.15.107:0/141375212 wait complete. 2024-08-17T02:27:39.136 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:24:23.456166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:25:16.086009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:25:17.060399+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs.volume_0000000000928569.meta', 'create_time': '2024-08-17T02:25:33.885385+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000928569'}}}, {'pool': 7, 'pool_name': 'cephfs.volume_0000000000928569.data', 'create_time': '2024-08-17T02:25:34.790701+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000928569'}}}] 2024-08-17T02:27:39.136 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:27:39.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.284+0000 7f63d6600640 1 Processor -- start 2024-08-17T02:27:39.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.284+0000 7f63d6600640 1 -- start start 2024-08-17T02:27:39.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.285+0000 7f63d6600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63d006df00 0x7f63d006e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.286+0000 7f63d6600640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f63d00ab010 0x7f63d00ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.286+0000 7f63d6600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63d00af5f0 con 0x7f63d015a0e0 2024-08-17T02:27:39.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.286+0000 7f63d6600640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63d0159600 con 0x7f63d00ab010 2024-08-17T02:27:39.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.286+0000 7f63d6600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d01598e0 con 0x7f63d006df00 2024-08-17T02:27:39.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.286+0000 7f63c7e00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f63d015a0e0 0x7f63d00aa900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:49002/0 (socket says 172.21.15.107:49002) 2024-08-17T02:27:39.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.286+0000 7f63c7e00640 1 -- 172.21.15.107:0/635654802 learned_addr learned my addr 172.21.15.107:0/635654802 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:27:39.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.286+0000 7f63d5c00640 1 --2- 172.21.15.107:0/635654802 >> v2:172.21.15.157:3300/0 conn(0x7f63d00ab010 0x7f63d00ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.286+0000 7f63d5200640 1 --2- 172.21.15.107:0/635654802 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63d006df00 0x7f63d006e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.286+0000 7f63cfe00640 1 -- 172.21.15.107:0/635654802 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3088383520 0 0) 0x7f63d00af5f0 con 0x7f63d015a0e0 2024-08-17T02:27:39.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.286+0000 7f63cfe00640 1 -- 172.21.15.107:0/635654802 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63b40034e0 con 0x7f63d015a0e0 2024-08-17T02:27:39.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.287+0000 7f63d5200640 1 -- 172.21.15.107:0/635654802 >> v2:172.21.15.157:3300/0 conn(0x7f63d00ab010 msgr2=0x7f63d00ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:39.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.287+0000 7f63d5200640 1 --2- 172.21.15.107:0/635654802 >> v2:172.21.15.157:3300/0 conn(0x7f63d00ab010 0x7f63d00ae8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.287+0000 7f63d5200640 1 -- 172.21.15.107:0/635654802 >> v1:172.21.15.107:6789/0 conn(0x7f63d015a0e0 legacy=0x7f63d00aa900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.287+0000 7f63d5200640 1 -- 172.21.15.107:0/635654802 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d0159bc0 con 0x7f63d006df00 2024-08-17T02:27:39.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.288+0000 7f63d5200640 1 --2- 172.21.15.107:0/635654802 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63d006df00 0x7f63d006e2d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f63c0009850 tx=0x7f63c00090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f4e1192df91ac08 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:39.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.288+0000 7f63cfe00640 1 -- 172.21.15.107:0/635654802 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c002ad80 con 0x7f63d006df00 2024-08-17T02:27:39.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.288+0000 7f63cfe00640 1 -- 172.21.15.107:0/635654802 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c0032440 con 0x7f63d006df00 2024-08-17T02:27:39.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.288+0000 7f63cfe00640 1 -- 172.21.15.107:0/635654802 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c0032820 con 0x7f63d006df00 2024-08-17T02:27:39.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.288+0000 7f63d6600640 1 -- 172.21.15.107:0/635654802 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63d006df00 msgr2=0x7f63d006e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.288+0000 7f63d6600640 1 --2- 172.21.15.107:0/635654802 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63d006df00 0x7f63d006e2d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f63c0009850 tx=0x7f63c00090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.289+0000 7f63d6600640 1 -- 172.21.15.107:0/635654802 shutdown_connections 2024-08-17T02:27:39.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.289+0000 7f63d6600640 1 --2- 172.21.15.107:0/635654802 >> v2:172.21.15.157:3300/0 conn(0x7f63d00ab010 0x7f63d00ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.289+0000 7f63d6600640 1 --2- 172.21.15.107:0/635654802 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63d006df00 0x7f63d006e2d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.289+0000 7f63d6600640 1 -- 172.21.15.107:0/635654802 >> 172.21.15.107:0/635654802 conn(0x7f63d0067750 msgr2=0x7f63d006c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:39.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.289+0000 7f63d6600640 1 -- 172.21.15.107:0/635654802 shutdown_connections 2024-08-17T02:27:39.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.289+0000 7f63d6600640 1 -- 172.21.15.107:0/635654802 wait complete. 2024-08-17T02:27:39.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.290+0000 7f63d6600640 1 Processor -- start 2024-08-17T02:27:39.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.290+0000 7f63d6600640 1 -- start start 2024-08-17T02:27:39.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.291+0000 7f63d6600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63d006df00 0x7f63d0158960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.291+0000 7f63d6600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63d00ab010 0x7f63d0154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.291+0000 7f63d6600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63d015a0e0 0x7f63d015b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.291+0000 7f63d6600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d01584d0 con 0x7f63d00ab010 2024-08-17T02:27:39.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.291+0000 7f63d6600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d01578c0 con 0x7f63d006df00 2024-08-17T02:27:39.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.291+0000 7f63d6600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d0157ba0 con 0x7f63d015a0e0 2024-08-17T02:27:39.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.291+0000 7f63c7e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63d00ab010 0x7f63d0154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.291+0000 7f63c7e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63d00ab010 0x7f63d0154230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:46702/0 (socket says 172.21.15.107:46702) 2024-08-17T02:27:39.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.291+0000 7f63c7e00640 1 -- 172.21.15.107:0/2583882574 learned_addr learned my addr 172.21.15.107:0/2583882574 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:39.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.291+0000 7f63d5c00640 1 --2- 172.21.15.107:0/2583882574 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63d015a0e0 0x7f63d015b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.291+0000 7f63d5200640 1 --2- 172.21.15.107:0/2583882574 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63d006df00 0x7f63d0158960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.292+0000 7f63c7e00640 1 -- 172.21.15.107:0/2583882574 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63d015a0e0 msgr2=0x7f63d015b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.292+0000 7f63c7e00640 1 --2- 172.21.15.107:0/2583882574 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63d015a0e0 0x7f63d015b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.292+0000 7f63c7e00640 1 -- 172.21.15.107:0/2583882574 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63d006df00 msgr2=0x7f63d0158960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.292+0000 7f63c7e00640 1 --2- 172.21.15.107:0/2583882574 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63d006df00 0x7f63d0158960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.292+0000 7f63c7e00640 1 -- 172.21.15.107:0/2583882574 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c0009390 con 0x7f63d00ab010 2024-08-17T02:27:39.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.292+0000 7f63c7e00640 1 --2- 172.21.15.107:0/2583882574 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63d00ab010 0x7f63d0154230 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f63b800c590 tx=0x7f63b8007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:39.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.292+0000 7f63ccc00640 1 -- 172.21.15.107:0/2583882574 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b8005b70 con 0x7f63d00ab010 2024-08-17T02:27:39.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.292+0000 7f63ccc00640 1 -- 172.21.15.107:0/2583882574 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b8005cf0 con 0x7f63d00ab010 2024-08-17T02:27:39.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.292+0000 7f63d6600640 1 -- 172.21.15.107:0/2583882574 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63d0157e80 con 0x7f63d00ab010 2024-08-17T02:27:39.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.292+0000 7f63ccc00640 1 -- 172.21.15.107:0/2583882574 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b8007340 con 0x7f63d00ab010 2024-08-17T02:27:39.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.292+0000 7f63d6600640 1 -- 172.21.15.107:0/2583882574 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d0154770 con 0x7f63d00ab010 2024-08-17T02:27:39.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.293+0000 7f63d6600640 1 -- 172.21.15.107:0/2583882574 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63d0158680 con 0x7f63d00ab010 2024-08-17T02:27:39.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.294+0000 7f63ccc00640 1 -- 172.21.15.107:0/2583882574 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f63b801b400 con 0x7f63d00ab010 2024-08-17T02:27:39.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.295+0000 7f63ccc00640 1 --2- 172.21.15.107:0/2583882574 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f63ac065150 0x7f63ac067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.295+0000 7f63ccc00640 1 -- 172.21.15.107:0/2583882574 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f63b8082290 con 0x7f63d00ab010 2024-08-17T02:27:39.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.295+0000 7f63d5200640 1 --2- 172.21.15.107:0/2583882574 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f63ac065150 0x7f63ac067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.296+0000 7f63d5200640 1 --2- 172.21.15.107:0/2583882574 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f63ac065150 0x7f63ac067600 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f63c0034000 tx=0x7f63c0032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:39.300 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.299+0000 7f63ccc00640 1 -- 172.21.15.107:0/2583882574 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f63b8050050 con 0x7f63d00ab010 2024-08-17T02:27:39.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.469+0000 7f63d6600640 1 -- 172.21.15.107:0/2583882574 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f63d0071050 con 0x7f63d00ab010 2024-08-17T02:27:39.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.469+0000 7f63ccc00640 1 -- 172.21.15.107:0/2583882574 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f63b8053670 con 0x7f63d00ab010 2024-08-17T02:27:39.471 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2024-08-17T02:27:39.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.471+0000 7f63d6600640 1 -- 172.21.15.107:0/2583882574 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f63ac065150 msgr2=0x7f63ac067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.472+0000 7f63d6600640 1 --2- 172.21.15.107:0/2583882574 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f63ac065150 0x7f63ac067600 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f63c0034000 tx=0x7f63c0032000 comp rx=0 tx=0).stop 2024-08-17T02:27:39.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.472+0000 7f63d6600640 1 -- 172.21.15.107:0/2583882574 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63d00ab010 msgr2=0x7f63d0154230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.472+0000 7f63d6600640 1 --2- 172.21.15.107:0/2583882574 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63d00ab010 0x7f63d0154230 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f63b800c590 tx=0x7f63b8007d70 comp rx=0 tx=0).stop 2024-08-17T02:27:39.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.472+0000 7f63d6600640 1 -- 172.21.15.107:0/2583882574 shutdown_connections 2024-08-17T02:27:39.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.472+0000 7f63d6600640 1 --2- 172.21.15.107:0/2583882574 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f63ac065150 0x7f63ac067600 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.472+0000 7f63d6600640 1 --2- 172.21.15.107:0/2583882574 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f63d015a0e0 0x7f63d015b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.472+0000 7f63d6600640 1 --2- 172.21.15.107:0/2583882574 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63d00ab010 0x7f63d0154230 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.472+0000 7f63d6600640 1 --2- 172.21.15.107:0/2583882574 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63d006df00 0x7f63d0158960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.472+0000 7f63d6600640 1 -- 172.21.15.107:0/2583882574 >> 172.21.15.107:0/2583882574 conn(0x7f63d0067750 msgr2=0x7f63d01551f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:39.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.472+0000 7f63d6600640 1 -- 172.21.15.107:0/2583882574 shutdown_connections 2024-08-17T02:27:39.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.472+0000 7f63d6600640 1 -- 172.21.15.107:0/2583882574 wait complete. 2024-08-17T02:27:39.488 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:27:39.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.637+0000 7fb5a7400640 1 Processor -- start 2024-08-17T02:27:39.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.637+0000 7fb5a7400640 1 -- start start 2024-08-17T02:27:39.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.638+0000 7fb5a7400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb5a00d0890 0x7fb5a00b0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.638+0000 7fb5a7400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5a00b0d50 0x7fb5a00b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.638+0000 7fb5a7400640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5a00afbb0 con 0x7fb5a015c2f0 2024-08-17T02:27:39.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.638+0000 7fb5a7400640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5a00b1e10 con 0x7fb5a00d0890 2024-08-17T02:27:39.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.638+0000 7fb5a7400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a00b11d0 con 0x7fb5a00b0d50 2024-08-17T02:27:39.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.639+0000 7fb5a5400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5a00b0d50 0x7fb5a00b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.639+0000 7fb5a5400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5a00b0d50 0x7fb5a00b31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:57726/0 (socket says 172.21.15.107:57726) 2024-08-17T02:27:39.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.639+0000 7fb5a5400640 1 -- 172.21.15.107:0/474794388 learned_addr learned my addr 172.21.15.107:0/474794388 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:39.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.639+0000 7fb597e00640 1 --2- 172.21.15.107:0/474794388 >> v2:172.21.15.157:3300/0 conn(0x7fb5a00d0890 0x7fb5a00b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.639+0000 7fb5a4a00640 1 --1- 172.21.15.107:0/474794388 >> v1:172.21.15.157:6789/0 conn(0x7fb5a015c2f0 0x7fb5a00af3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:38036/0 (socket says 172.21.15.107:38036) 2024-08-17T02:27:39.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.639+0000 7fb5a5400640 1 -- 172.21.15.107:0/474794388 >> v2:172.21.15.157:3300/0 conn(0x7fb5a00d0890 msgr2=0x7fb5a00b0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:39.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.639+0000 7fb5a5400640 1 --2- 172.21.15.107:0/474794388 >> v2:172.21.15.157:3300/0 conn(0x7fb5a00d0890 0x7fb5a00b0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.639+0000 7fb5a5400640 1 -- 172.21.15.107:0/474794388 >> v1:172.21.15.157:6789/0 conn(0x7fb5a015c2f0 legacy=0x7fb5a00af3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.639+0000 7fb5a5400640 1 -- 172.21.15.107:0/474794388 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a00afe90 con 0x7fb5a00b0d50 2024-08-17T02:27:39.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.640+0000 7fb5a5400640 1 --2- 172.21.15.107:0/474794388 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5a00b0d50 0x7fb5a00b31e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb598009f20 tx=0x7fb598009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5900958e86b48895 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:39.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.641+0000 7fb59fe00640 1 -- 172.21.15.107:0/474794388 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb598031400 con 0x7fb5a00b0d50 2024-08-17T02:27:39.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.641+0000 7fb59fe00640 1 -- 172.21.15.107:0/474794388 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59802d050 con 0x7fb5a00b0d50 2024-08-17T02:27:39.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.641+0000 7fb59fe00640 1 -- 172.21.15.107:0/474794388 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb598031790 con 0x7fb5a00b0d50 2024-08-17T02:27:39.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.641+0000 7fb5a7400640 1 -- 172.21.15.107:0/474794388 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5a00b0d50 msgr2=0x7fb5a00b31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.641+0000 7fb5a7400640 1 --2- 172.21.15.107:0/474794388 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5a00b0d50 0x7fb5a00b31e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb598009f20 tx=0x7fb598009840 comp rx=0 tx=0).stop 2024-08-17T02:27:39.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.641+0000 7fb5a7400640 1 -- 172.21.15.107:0/474794388 shutdown_connections 2024-08-17T02:27:39.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.641+0000 7fb5a7400640 1 --2- 172.21.15.107:0/474794388 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5a00b0d50 0x7fb5a00b31e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.641+0000 7fb5a7400640 1 --2- 172.21.15.107:0/474794388 >> v2:172.21.15.157:3300/0 conn(0x7fb5a00d0890 0x7fb5a00b0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.641+0000 7fb5a7400640 1 -- 172.21.15.107:0/474794388 >> 172.21.15.107:0/474794388 conn(0x7fb5a00cfdb0 msgr2=0x7fb5a00d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:39.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.641+0000 7fb5a7400640 1 -- 172.21.15.107:0/474794388 shutdown_connections 2024-08-17T02:27:39.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.641+0000 7fb5a7400640 1 -- 172.21.15.107:0/474794388 wait complete. 2024-08-17T02:27:39.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.643+0000 7fb5a7400640 1 Processor -- start 2024-08-17T02:27:39.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.643+0000 7fb5a7400640 1 -- start start 2024-08-17T02:27:39.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.644+0000 7fb5a7400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5a00b0d50 0x7fb5a0099d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.644+0000 7fb5a7400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5a00d0890 0x7fb5a00cde40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.644+0000 7fb5a7400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5a015c2f0 0x7fb5a0148910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.644+0000 7fb5a7400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a0169dc0 con 0x7fb5a015c2f0 2024-08-17T02:27:39.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.644+0000 7fb5a7400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a009c660 con 0x7fb5a00d0890 2024-08-17T02:27:39.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.644+0000 7fb5a7400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a009c900 con 0x7fb5a00b0d50 2024-08-17T02:27:39.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.644+0000 7fb5a5400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5a015c2f0 0x7fb5a0148910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.644+0000 7fb5a5400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5a015c2f0 0x7fb5a0148910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:46718/0 (socket says 172.21.15.107:46718) 2024-08-17T02:27:39.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.644+0000 7fb5a5400640 1 -- 172.21.15.107:0/3646995097 learned_addr learned my addr 172.21.15.107:0/3646995097 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:39.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.644+0000 7fb5a4a00640 1 --2- 172.21.15.107:0/3646995097 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5a00b0d50 0x7fb5a0099d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.644+0000 7fb597e00640 1 --2- 172.21.15.107:0/3646995097 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5a00d0890 0x7fb5a00cde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.644+0000 7fb5a5400640 1 -- 172.21.15.107:0/3646995097 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5a00b0d50 msgr2=0x7fb5a0099d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.644+0000 7fb5a5400640 1 --2- 172.21.15.107:0/3646995097 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5a00b0d50 0x7fb5a0099d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.644+0000 7fb5a5400640 1 -- 172.21.15.107:0/3646995097 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5a00d0890 msgr2=0x7fb5a00cde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.644+0000 7fb5a5400640 1 --2- 172.21.15.107:0/3646995097 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5a00d0890 0x7fb5a00cde40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.644+0000 7fb5a5400640 1 -- 172.21.15.107:0/3646995097 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb598009ae0 con 0x7fb5a015c2f0 2024-08-17T02:27:39.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.644+0000 7fb597e00640 1 --2- 172.21.15.107:0/3646995097 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5a00d0890 0x7fb5a00cde40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:39.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.645+0000 7fb5a5400640 1 --2- 172.21.15.107:0/3646995097 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5a015c2f0 0x7fb5a0148910 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb598009f80 tx=0x7fb598036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:39.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.645+0000 7fb59cc00640 1 -- 172.21.15.107:0/3646995097 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb598008770 con 0x7fb5a015c2f0 2024-08-17T02:27:39.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.645+0000 7fb59cc00640 1 -- 172.21.15.107:0/3646995097 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5980088d0 con 0x7fb5a015c2f0 2024-08-17T02:27:39.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.645+0000 7fb59cc00640 1 -- 172.21.15.107:0/3646995097 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb598008c90 con 0x7fb5a015c2f0 2024-08-17T02:27:39.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.645+0000 7fb5a7400640 1 -- 172.21.15.107:0/3646995097 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5a0169520 con 0x7fb5a015c2f0 2024-08-17T02:27:39.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.645+0000 7fb5a7400640 1 -- 172.21.15.107:0/3646995097 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5a0169ae0 con 0x7fb5a015c2f0 2024-08-17T02:27:39.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.646+0000 7fb5a7400640 1 -- 172.21.15.107:0/3646995097 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5a0071050 con 0x7fb5a015c2f0 2024-08-17T02:27:39.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.647+0000 7fb59cc00640 1 -- 172.21.15.107:0/3646995097 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb598038050 con 0x7fb5a015c2f0 2024-08-17T02:27:39.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.647+0000 7fb59cc00640 1 --2- 172.21.15.107:0/3646995097 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fb57c065150 0x7fb57c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.648+0000 7fb59cc00640 1 -- 172.21.15.107:0/3646995097 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fb5980a3130 con 0x7fb5a015c2f0 2024-08-17T02:27:39.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.648+0000 7fb5a4a00640 1 --2- 172.21.15.107:0/3646995097 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fb57c065150 0x7fb57c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.648+0000 7fb5a4a00640 1 --2- 172.21.15.107:0/3646995097 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fb57c065150 0x7fb57c067600 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb5a00b4be0 tx=0x7fb590007cc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:39.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.651+0000 7fb59cc00640 1 -- 172.21.15.107:0/3646995097 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb598070e90 con 0x7fb5a015c2f0 2024-08-17T02:27:39.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.822+0000 7fb5a7400640 1 -- 172.21.15.107:0/3646995097 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb5a0156420 con 0x7fb5a015c2f0 2024-08-17T02:27:39.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.823+0000 7fb59cc00640 1 -- 172.21.15.107:0/3646995097 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb5980744b0 con 0x7fb5a015c2f0 2024-08-17T02:27:39.824 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2024-08-17T02:27:39.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.825+0000 7fb5a7400640 1 -- 172.21.15.107:0/3646995097 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fb57c065150 msgr2=0x7fb57c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.825+0000 7fb5a7400640 1 --2- 172.21.15.107:0/3646995097 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fb57c065150 0x7fb57c067600 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb5a00b4be0 tx=0x7fb590007cc0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.825+0000 7fb5a7400640 1 -- 172.21.15.107:0/3646995097 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5a015c2f0 msgr2=0x7fb5a0148910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.825+0000 7fb5a7400640 1 --2- 172.21.15.107:0/3646995097 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5a015c2f0 0x7fb5a0148910 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb598009f80 tx=0x7fb598036000 comp rx=0 tx=0).stop 2024-08-17T02:27:39.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.825+0000 7fb5a7400640 1 -- 172.21.15.107:0/3646995097 shutdown_connections 2024-08-17T02:27:39.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.825+0000 7fb5a7400640 1 --2- 172.21.15.107:0/3646995097 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fb57c065150 0x7fb57c067600 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.825+0000 7fb5a7400640 1 --2- 172.21.15.107:0/3646995097 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5a015c2f0 0x7fb5a0148910 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.825+0000 7fb5a7400640 1 --2- 172.21.15.107:0/3646995097 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5a00d0890 0x7fb5a00cde40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.825+0000 7fb5a7400640 1 --2- 172.21.15.107:0/3646995097 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5a00b0d50 0x7fb5a0099d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.825+0000 7fb5a7400640 1 -- 172.21.15.107:0/3646995097 >> 172.21.15.107:0/3646995097 conn(0x7fb5a00cfdb0 msgr2=0x7fb5a015aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:39.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.825+0000 7fb5a7400640 1 -- 172.21.15.107:0/3646995097 shutdown_connections 2024-08-17T02:27:39.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.825+0000 7fb5a7400640 1 -- 172.21.15.107:0/3646995097 wait complete. 2024-08-17T02:27:39.841 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:27:39.990 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.989+0000 7f3eb7000640 1 Processor -- start 2024-08-17T02:27:39.990 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.989+0000 7f3eb7000640 1 -- start start 2024-08-17T02:27:39.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.990+0000 7f3eb7000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3eb0156c50 0x7f3eb00c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.990+0000 7f3eb7000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eb00ab130 con 0x7f3eb00c8bd0 2024-08-17T02:27:39.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.990+0000 7f3eb7000640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eb00ae5a0 con 0x7f3eb00adcf0 2024-08-17T02:27:39.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.990+0000 7f3eb7000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb00ae2c0 con 0x7f3eb0156c50 2024-08-17T02:27:39.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.991+0000 7f3eb5000640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f3eb00c8bd0 0x7f3eb00aeb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:49006/0 (socket says 172.21.15.107:49006) 2024-08-17T02:27:39.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.991+0000 7f3eb5000640 1 -- 172.21.15.107:0/3749922715 learned_addr learned my addr 172.21.15.107:0/3749922715 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:27:39.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.991+0000 7f3eafe00640 1 --2- 172.21.15.107:0/3749922715 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3eb0156c50 0x7f3eb00c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.991+0000 7f3eaea00640 1 -- 172.21.15.107:0/3749922715 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3265602220 0 0) 0x7f3eb00ab130 con 0x7f3eb00c8bd0 2024-08-17T02:27:39.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.991+0000 7f3eaea00640 1 -- 172.21.15.107:0/3749922715 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e940034e0 con 0x7f3eb00c8bd0 2024-08-17T02:27:39.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.991+0000 7f3eaea00640 1 -- 172.21.15.107:0/3749922715 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3696302274 0 0) 0x7f3eb00ae5a0 con 0x7f3eb00adcf0 2024-08-17T02:27:39.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.991+0000 7f3eaea00640 1 -- 172.21.15.107:0/3749922715 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3eb00ab130 con 0x7f3eb00adcf0 2024-08-17T02:27:39.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.991+0000 7f3eaea00640 1 -- 172.21.15.107:0/3749922715 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2207903519 0 0) 0x7f3e940034e0 con 0x7f3eb00c8bd0 2024-08-17T02:27:39.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.991+0000 7f3eaea00640 1 -- 172.21.15.107:0/3749922715 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3eb0156c50 msgr2=0x7f3eb00c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:39.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.991+0000 7f3eaea00640 1 --2- 172.21.15.107:0/3749922715 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3eb0156c50 0x7f3eb00c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.991+0000 7f3eaea00640 1 -- 172.21.15.107:0/3749922715 >> v1:172.21.15.157:6789/0 conn(0x7f3eb00adcf0 legacy=0x7f3eb00ab5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.991+0000 7f3eaea00640 1 -- 172.21.15.107:0/3749922715 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb00aaae0 con 0x7f3eb00c8bd0 2024-08-17T02:27:39.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.991+0000 7f3eaea00640 1 -- 172.21.15.107:0/3749922715 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 537989081 0 0) 0x7f3ea80017f0 con 0x7f3eb00c8bd0 2024-08-17T02:27:39.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.991+0000 7f3eaea00640 1 -- 172.21.15.107:0/3749922715 >> v1:172.21.15.107:6789/0 conn(0x7f3eb00c8bd0 legacy=0x7f3eb00aeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.991+0000 7f3eaea00640 1 --2- 172.21.15.107:0/3749922715 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e94003b90 0x7f3e94003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.991+0000 7f3eaea00640 1 --2- 172.21.15.107:0/3749922715 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3eb0156c50 0x7f3e94004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.992+0000 7f3eaea00640 1 --2- 172.21.15.107:0/3749922715 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e94004cc0 0x7f3e94005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.992+0000 7f3eaea00640 1 -- 172.21.15.107:0/3749922715 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb00ae2c0 con 0x7f3e94003b90 2024-08-17T02:27:39.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.992+0000 7f3eaea00640 1 -- 172.21.15.107:0/3749922715 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9400bb60 con 0x7f3e94004cc0 2024-08-17T02:27:39.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.992+0000 7f3eaea00640 1 -- 172.21.15.107:0/3749922715 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9400bcd0 con 0x7f3eb0156c50 2024-08-17T02:27:39.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.992+0000 7f3eafe00640 1 --2- 172.21.15.107:0/3749922715 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e94003b90 0x7f3e94003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.992+0000 7f3eaf400640 1 --2- 172.21.15.107:0/3749922715 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3eb0156c50 0x7f3e94004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.992+0000 7f3eb5000640 1 --2- 172.21.15.107:0/3749922715 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e94004cc0 0x7f3e94005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.992+0000 7f3eafe00640 1 -- 172.21.15.107:0/3749922715 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3eb0156c50 msgr2=0x7f3e94004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:39.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.992+0000 7f3eafe00640 1 --2- 172.21.15.107:0/3749922715 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3eb0156c50 0x7f3e94004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.992+0000 7f3eafe00640 1 -- 172.21.15.107:0/3749922715 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e94004cc0 msgr2=0x7f3e94005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:39.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.992+0000 7f3eafe00640 1 --2- 172.21.15.107:0/3749922715 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e94004cc0 0x7f3e94005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.992+0000 7f3eafe00640 1 -- 172.21.15.107:0/3749922715 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e940034e0 con 0x7f3e94003b90 2024-08-17T02:27:39.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.992+0000 7f3eb5000640 1 --2- 172.21.15.107:0/3749922715 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e94004cc0 0x7f3e94005130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:39.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.993+0000 7f3eafe00640 1 --2- 172.21.15.107:0/3749922715 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e94003b90 0x7f3e94003f80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0006e70 tx=0x7f3ea00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fbb0a8ec27a9950 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:39.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.993+0000 7f3eaea00640 1 -- 172.21.15.107:0/3749922715 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea0031400 con 0x7f3e94003b90 2024-08-17T02:27:39.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.994+0000 7f3eaea00640 1 -- 172.21.15.107:0/3749922715 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea002d050 con 0x7f3e94003b90 2024-08-17T02:27:39.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.994+0000 7f3eaea00640 1 -- 172.21.15.107:0/3749922715 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea0031790 con 0x7f3e94003b90 2024-08-17T02:27:39.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.994+0000 7f3eb7000640 1 -- 172.21.15.107:0/3749922715 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e94003b90 msgr2=0x7f3e94003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.994+0000 7f3eb7000640 1 --2- 172.21.15.107:0/3749922715 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e94003b90 0x7f3e94003f80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0006e70 tx=0x7f3ea00090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.994+0000 7f3eb5000640 1 -- 172.21.15.107:0/3749922715 reap_dead start 2024-08-17T02:27:39.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.994+0000 7f3eb7000640 1 -- 172.21.15.107:0/3749922715 shutdown_connections 2024-08-17T02:27:39.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.994+0000 7f3eb7000640 1 -- 172.21.15.107:0/3749922715 >> 172.21.15.107:0/3749922715 conn(0x7f3eb0067750 msgr2=0x7f3eb00c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:39.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.994+0000 7f3eb7000640 1 -- 172.21.15.107:0/3749922715 shutdown_connections 2024-08-17T02:27:39.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.994+0000 7f3eb7000640 1 -- 172.21.15.107:0/3749922715 wait complete. 2024-08-17T02:27:39.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.995+0000 7f3eb7000640 1 Processor -- start 2024-08-17T02:27:39.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.996+0000 7f3eb7000640 1 -- start start 2024-08-17T02:27:39.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.996+0000 7f3eb7000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e94003b90 0x7f3eb014dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.996+0000 7f3eb7000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3eb0157020 0x7f3eb0159100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.996+0000 7f3eb7000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3eb0159640 0x7f3eb0159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.997+0000 7f3eb7000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb01576f0 con 0x7f3eb0157020 2024-08-17T02:27:40.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.997+0000 7f3eb7000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb014e410 con 0x7f3e94003b90 2024-08-17T02:27:40.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.997+0000 7f3eb7000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb014e6f0 con 0x7f3eb0159640 2024-08-17T02:27:40.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.997+0000 7f3eaf400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3eb0157020 0x7f3eb0159100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.997+0000 7f3eaf400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3eb0157020 0x7f3eb0159100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:46742/0 (socket says 172.21.15.107:46742) 2024-08-17T02:27:40.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.997+0000 7f3eaf400640 1 -- 172.21.15.107:0/3262567908 learned_addr learned my addr 172.21.15.107:0/3262567908 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:40.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.997+0000 7f3eafe00640 1 --2- 172.21.15.107:0/3262567908 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e94003b90 0x7f3eb014dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.997+0000 7f3eb5000640 1 --2- 172.21.15.107:0/3262567908 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3eb0159640 0x7f3eb0159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.997+0000 7f3eaf400640 1 -- 172.21.15.107:0/3262567908 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3eb0159640 msgr2=0x7f3eb0159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:40.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.997+0000 7f3eaf400640 1 --2- 172.21.15.107:0/3262567908 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3eb0159640 0x7f3eb0159ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.997+0000 7f3eaf400640 1 -- 172.21.15.107:0/3262567908 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e94003b90 msgr2=0x7f3eb014dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:40.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.997+0000 7f3eaf400640 1 --2- 172.21.15.107:0/3262567908 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e94003b90 0x7f3eb014dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.997+0000 7f3eaf400640 1 -- 172.21.15.107:0/3262567908 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb014e9d0 con 0x7f3eb0157020 2024-08-17T02:27:40.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.997+0000 7f3eaf400640 1 --2- 172.21.15.107:0/3262567908 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3eb0157020 0x7f3eb0159100 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c0029d0 tx=0x7f3e9c007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:40.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.998+0000 7f3ea7400640 1 -- 172.21.15.107:0/3262567908 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c007260 con 0x7f3eb0157020 2024-08-17T02:27:40.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.998+0000 7f3ea7400640 1 -- 172.21.15.107:0/3262567908 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e9c0073c0 con 0x7f3eb0157020 2024-08-17T02:27:40.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.998+0000 7f3ea7400640 1 -- 172.21.15.107:0/3262567908 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c006790 con 0x7f3eb0157020 2024-08-17T02:27:40.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.998+0000 7f3eb7000640 1 -- 172.21.15.107:0/3262567908 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eb0153e70 con 0x7f3eb0157020 2024-08-17T02:27:40.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.998+0000 7f3eb7000640 1 -- 172.21.15.107:0/3262567908 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eb014e100 con 0x7f3eb0157020 2024-08-17T02:27:40.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:39.999+0000 7f3eb7000640 1 -- 172.21.15.107:0/3262567908 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eb01542f0 con 0x7f3eb0157020 2024-08-17T02:27:40.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.000+0000 7f3ea7400640 1 -- 172.21.15.107:0/3262567908 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3e9c006b00 con 0x7f3eb0157020 2024-08-17T02:27:40.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.000+0000 7f3ea7400640 1 --2- 172.21.15.107:0/3262567908 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3e90065150 0x7f3e90067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.001+0000 7f3ea7400640 1 -- 172.21.15.107:0/3262567908 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f3e9c082b30 con 0x7f3eb0157020 2024-08-17T02:27:40.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.001+0000 7f3eafe00640 1 --2- 172.21.15.107:0/3262567908 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3e90065150 0x7f3e90067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.001+0000 7f3eafe00640 1 --2- 172.21.15.107:0/3262567908 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3e90065150 0x7f3e90067600 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0034000 tx=0x7f3ea0035000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:40.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.004+0000 7f3ea7400640 1 -- 172.21.15.107:0/3262567908 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3e9c0507d0 con 0x7f3eb0157020 2024-08-17T02:27:40.179 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.177+0000 7f3eb7000640 1 -- 172.21.15.107:0/3262567908 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3eb0071050 con 0x7f3eb0157020 2024-08-17T02:27:40.179 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.178+0000 7f3ea7400640 1 -- 172.21.15.107:0/3262567908 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3e9c006db0 con 0x7f3eb0157020 2024-08-17T02:27:40.179 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 64 2024-08-17T02:27:40.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.180+0000 7f3eb7000640 1 -- 172.21.15.107:0/3262567908 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3e90065150 msgr2=0x7f3e90067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:40.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.180+0000 7f3eb7000640 1 --2- 172.21.15.107:0/3262567908 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3e90065150 0x7f3e90067600 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0034000 tx=0x7f3ea0035000 comp rx=0 tx=0).stop 2024-08-17T02:27:40.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.180+0000 7f3eb7000640 1 -- 172.21.15.107:0/3262567908 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3eb0157020 msgr2=0x7f3eb0159100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:40.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.180+0000 7f3eb7000640 1 --2- 172.21.15.107:0/3262567908 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3eb0157020 0x7f3eb0159100 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c0029d0 tx=0x7f3e9c007ca0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.180+0000 7f3eb7000640 1 -- 172.21.15.107:0/3262567908 shutdown_connections 2024-08-17T02:27:40.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.180+0000 7f3eb7000640 1 --2- 172.21.15.107:0/3262567908 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f3e90065150 0x7f3e90067600 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.180+0000 7f3eb7000640 1 --2- 172.21.15.107:0/3262567908 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3eb0159640 0x7f3eb0159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.180+0000 7f3eb7000640 1 --2- 172.21.15.107:0/3262567908 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3eb0157020 0x7f3eb0159100 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.180+0000 7f3eb7000640 1 --2- 172.21.15.107:0/3262567908 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e94003b90 0x7f3eb014dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.180+0000 7f3eb7000640 1 -- 172.21.15.107:0/3262567908 >> 172.21.15.107:0/3262567908 conn(0x7f3eb0067750 msgr2=0x7f3eb015f030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:40.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.180+0000 7f3eb7000640 1 -- 172.21.15.107:0/3262567908 shutdown_connections 2024-08-17T02:27:40.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.180+0000 7f3eb7000640 1 -- 172.21.15.107:0/3262567908 wait complete. 2024-08-17T02:27:40.195 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000928569.meta pg_num 2024-08-17T02:27:40.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.345+0000 7f33f4400640 1 Processor -- start 2024-08-17T02:27:40.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.345+0000 7f33f4400640 1 -- start start 2024-08-17T02:27:40.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.346+0000 7f33f4400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f33ec0adcf0 0x7f33ec0ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.346+0000 7f33f4400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33ec0abb00 0x7f33ec0c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.346+0000 7f33f4400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33ec0ab130 con 0x7f33ec156c50 2024-08-17T02:27:40.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.346+0000 7f33f4400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33ec0ae5a0 con 0x7f33ec0adcf0 2024-08-17T02:27:40.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.346+0000 7f33f4400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33ec0ae2c0 con 0x7f33ec0abb00 2024-08-17T02:27:40.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.346+0000 7f33f1000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f33ec0adcf0 0x7f33ec0ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.346+0000 7f33f1a00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f33ec156c50 0x7f33ec0c7cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:49008/0 (socket says 172.21.15.107:49008) 2024-08-17T02:27:40.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.346+0000 7f33f1a00640 1 -- 172.21.15.107:0/1562196932 learned_addr learned my addr 172.21.15.107:0/1562196932 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:27:40.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.347+0000 7f33f2400640 1 --2- 172.21.15.107:0/1562196932 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33ec0abb00 0x7f33ec0c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.347+0000 7f33f1000640 1 -- 172.21.15.107:0/1562196932 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33ec0abb00 msgr2=0x7f33ec0c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:40.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.347+0000 7f33f1000640 1 --2- 172.21.15.107:0/1562196932 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33ec0abb00 0x7f33ec0c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.347+0000 7f33f1000640 1 -- 172.21.15.107:0/1562196932 >> v1:172.21.15.107:6789/0 conn(0x7f33ec156c50 legacy=0x7f33ec0c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:40.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.347+0000 7f33f1000640 1 -- 172.21.15.107:0/1562196932 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ec0aaae0 con 0x7f33ec0adcf0 2024-08-17T02:27:40.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.348+0000 7f33f1000640 1 --2- 172.21.15.107:0/1562196932 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33ec0adcf0 0x7f33ec0ab5c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f33d8009850 tx=0x7f33d80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbd95bdb26d8fff server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:40.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.348+0000 7f33ebe00640 1 -- 172.21.15.107:0/1562196932 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d802ac70 con 0x7f33ec0adcf0 2024-08-17T02:27:40.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.348+0000 7f33ebe00640 1 -- 172.21.15.107:0/1562196932 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d802add0 con 0x7f33ec0adcf0 2024-08-17T02:27:40.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.348+0000 7f33ebe00640 1 -- 172.21.15.107:0/1562196932 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d8032670 con 0x7f33ec0adcf0 2024-08-17T02:27:40.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.349+0000 7f33f4400640 1 -- 172.21.15.107:0/1562196932 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33ec0adcf0 msgr2=0x7f33ec0ab5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:40.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.349+0000 7f33f4400640 1 --2- 172.21.15.107:0/1562196932 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33ec0adcf0 0x7f33ec0ab5c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f33d8009850 tx=0x7f33d80090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.349+0000 7f33f4400640 1 -- 172.21.15.107:0/1562196932 shutdown_connections 2024-08-17T02:27:40.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.349+0000 7f33f4400640 1 --2- 172.21.15.107:0/1562196932 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33ec0abb00 0x7f33ec0c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.349+0000 7f33f4400640 1 --2- 172.21.15.107:0/1562196932 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33ec0adcf0 0x7f33ec0ab5c0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.349+0000 7f33f4400640 1 -- 172.21.15.107:0/1562196932 >> 172.21.15.107:0/1562196932 conn(0x7f33ec067750 msgr2=0x7f33ec0c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:40.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.349+0000 7f33f4400640 1 -- 172.21.15.107:0/1562196932 shutdown_connections 2024-08-17T02:27:40.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.349+0000 7f33f4400640 1 -- 172.21.15.107:0/1562196932 wait complete. 2024-08-17T02:27:40.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.350+0000 7f33f4400640 1 Processor -- start 2024-08-17T02:27:40.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.350+0000 7f33f4400640 1 -- start start 2024-08-17T02:27:40.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.351+0000 7f33f4400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33ec0abb00 0x7f33ec1492f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.351+0000 7f33f4400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33ec0adcf0 0x7f33ec1555c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.351+0000 7f33f4400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33ec156c50 0x7f33ec155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.351+0000 7f33f4400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ec14dc00 con 0x7f33ec0abb00 2024-08-17T02:27:40.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.351+0000 7f33f4400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ec14d310 con 0x7f33ec156c50 2024-08-17T02:27:40.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.351+0000 7f33f4400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33ec14d5b0 con 0x7f33ec0adcf0 2024-08-17T02:27:40.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.352+0000 7f33f1a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33ec0abb00 0x7f33ec1492f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.352+0000 7f33f1a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33ec0abb00 0x7f33ec1492f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:46758/0 (socket says 172.21.15.107:46758) 2024-08-17T02:27:40.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.352+0000 7f33f1a00640 1 -- 172.21.15.107:0/2842448822 learned_addr learned my addr 172.21.15.107:0/2842448822 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:40.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.352+0000 7f33f2400640 1 --2- 172.21.15.107:0/2842448822 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33ec156c50 0x7f33ec155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.352+0000 7f33f1000640 1 --2- 172.21.15.107:0/2842448822 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33ec0adcf0 0x7f33ec1555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.352+0000 7f33f1a00640 1 -- 172.21.15.107:0/2842448822 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33ec0adcf0 msgr2=0x7f33ec1555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:40.355 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.352+0000 7f33f1a00640 1 --2- 172.21.15.107:0/2842448822 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33ec0adcf0 0x7f33ec1555c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.355 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.352+0000 7f33f1a00640 1 -- 172.21.15.107:0/2842448822 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33ec156c50 msgr2=0x7f33ec155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:40.355 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.352+0000 7f33f1a00640 1 --2- 172.21.15.107:0/2842448822 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33ec156c50 0x7f33ec155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.355 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.352+0000 7f33f1a00640 1 -- 172.21.15.107:0/2842448822 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d8009390 con 0x7f33ec0abb00 2024-08-17T02:27:40.355 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.352+0000 7f33f2400640 1 --2- 172.21.15.107:0/2842448822 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33ec156c50 0x7f33ec155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:40.355 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.352+0000 7f33f1a00640 1 --2- 172.21.15.107:0/2842448822 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33ec0abb00 0x7f33ec1492f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f33e000c560 tx=0x7f33e0007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:40.355 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.352+0000 7f33e8c00640 1 -- 172.21.15.107:0/2842448822 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e0005aa0 con 0x7f33ec0abb00 2024-08-17T02:27:40.355 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.352+0000 7f33e8c00640 1 -- 172.21.15.107:0/2842448822 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e0005c20 con 0x7f33ec0abb00 2024-08-17T02:27:40.355 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.353+0000 7f33f4400640 1 -- 172.21.15.107:0/2842448822 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33ec14d890 con 0x7f33ec0abb00 2024-08-17T02:27:40.355 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.353+0000 7f33e8c00640 1 -- 172.21.15.107:0/2842448822 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e0007320 con 0x7f33ec0abb00 2024-08-17T02:27:40.355 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.353+0000 7f33f4400640 1 -- 172.21.15.107:0/2842448822 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33ec149830 con 0x7f33ec0abb00 2024-08-17T02:27:40.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.354+0000 7f33f4400640 1 -- 172.21.15.107:0/2842448822 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33ec149a20 con 0x7f33ec0abb00 2024-08-17T02:27:40.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.355+0000 7f33e8c00640 1 -- 172.21.15.107:0/2842448822 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f33e0012400 con 0x7f33ec0abb00 2024-08-17T02:27:40.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.355+0000 7f33e8c00640 1 --2- 172.21.15.107:0/2842448822 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f33cc065150 0x7f33cc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.356+0000 7f33e8c00640 1 -- 172.21.15.107:0/2842448822 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f33e0081bc0 con 0x7f33ec0abb00 2024-08-17T02:27:40.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.356+0000 7f33f1000640 1 --2- 172.21.15.107:0/2842448822 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f33cc065150 0x7f33cc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.356+0000 7f33f1000640 1 --2- 172.21.15.107:0/2842448822 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f33cc065150 0x7f33cc067600 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f33d8034000 tx=0x7f33d8032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:40.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.359+0000 7f33e8c00640 1 -- 172.21.15.107:0/2842448822 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f33e004be40 con 0x7f33ec0abb00 2024-08-17T02:27:40.530 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.529+0000 7f33f4400640 1 -- 172.21.15.107:0/2842448822 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000928569.meta", "var": "pg_num"} v 0) v1 -- 0x7f33ec071050 con 0x7f33ec0abb00 2024-08-17T02:27:40.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.530+0000 7f33e8c00640 1 -- 172.21.15.107:0/2842448822 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000928569.meta", "var": "pg_num"}]=0 v37) v1 ==== 124+0+11 (secure 0 0 0) 0x7f33e00170c0 con 0x7f33ec0abb00 2024-08-17T02:27:40.531 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2024-08-17T02:27:40.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.532+0000 7f33f4400640 1 -- 172.21.15.107:0/2842448822 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f33cc065150 msgr2=0x7f33cc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:40.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.532+0000 7f33f4400640 1 --2- 172.21.15.107:0/2842448822 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f33cc065150 0x7f33cc067600 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f33d8034000 tx=0x7f33d8032000 comp rx=0 tx=0).stop 2024-08-17T02:27:40.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.532+0000 7f33f4400640 1 -- 172.21.15.107:0/2842448822 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33ec0abb00 msgr2=0x7f33ec1492f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:40.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.532+0000 7f33f4400640 1 --2- 172.21.15.107:0/2842448822 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33ec0abb00 0x7f33ec1492f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f33e000c560 tx=0x7f33e0007f40 comp rx=0 tx=0).stop 2024-08-17T02:27:40.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.532+0000 7f33f4400640 1 -- 172.21.15.107:0/2842448822 shutdown_connections 2024-08-17T02:27:40.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.532+0000 7f33f4400640 1 --2- 172.21.15.107:0/2842448822 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f33cc065150 0x7f33cc067600 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.532+0000 7f33f4400640 1 --2- 172.21.15.107:0/2842448822 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33ec156c50 0x7f33ec155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.532+0000 7f33f4400640 1 --2- 172.21.15.107:0/2842448822 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33ec0adcf0 0x7f33ec1555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.532+0000 7f33f4400640 1 --2- 172.21.15.107:0/2842448822 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33ec0abb00 0x7f33ec1492f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.532+0000 7f33f4400640 1 -- 172.21.15.107:0/2842448822 >> 172.21.15.107:0/2842448822 conn(0x7f33ec067750 msgr2=0x7f33ec0ca730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:40.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.532+0000 7f33f4400640 1 -- 172.21.15.107:0/2842448822 shutdown_connections 2024-08-17T02:27:40.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.532+0000 7f33f4400640 1 -- 172.21.15.107:0/2842448822 wait complete. 2024-08-17T02:27:40.548 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000928569.data pg_num 2024-08-17T02:27:40.697 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.696+0000 7ff642600640 1 Processor -- start 2024-08-17T02:27:40.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.696+0000 7ff642600640 1 -- start start 2024-08-17T02:27:40.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.697+0000 7ff642600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff63c1590b0 0x7ff63c0c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.697+0000 7ff642600640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff63c0c9110 0x7ff63c0aee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.697+0000 7ff642600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff63c06d790 con 0x7ff63c158ce0 2024-08-17T02:27:40.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.697+0000 7ff642600640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff63c0c95b0 con 0x7ff63c0c9110 2024-08-17T02:27:40.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.697+0000 7ff642600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c06cb80 con 0x7ff63c1590b0 2024-08-17T02:27:40.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.698+0000 7ff63b400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7ff63c158ce0 0x7ff63c06a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:49016/0 (socket says 172.21.15.107:49016) 2024-08-17T02:27:40.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.698+0000 7ff63b400640 1 -- 172.21.15.107:0/2731021561 learned_addr learned my addr 172.21.15.107:0/2731021561 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:27:40.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.698+0000 7ff63aa00640 1 --2- 172.21.15.107:0/2731021561 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff63c1590b0 0x7ff63c0c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.698+0000 7ff63be00640 1 --2- 172.21.15.107:0/2731021561 >> v2:172.21.15.157:3300/0 conn(0x7ff63c0c9110 0x7ff63c0aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.698+0000 7ff63a000640 1 -- 172.21.15.107:0/2731021561 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3646733980 0 0) 0x7ff63c06d790 con 0x7ff63c158ce0 2024-08-17T02:27:40.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.698+0000 7ff63a000640 1 -- 172.21.15.107:0/2731021561 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6200034e0 con 0x7ff63c158ce0 2024-08-17T02:27:40.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.698+0000 7ff63aa00640 1 -- 172.21.15.107:0/2731021561 >> v2:172.21.15.157:3300/0 conn(0x7ff63c0c9110 msgr2=0x7ff63c0aee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:40.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.698+0000 7ff63aa00640 1 --2- 172.21.15.107:0/2731021561 >> v2:172.21.15.157:3300/0 conn(0x7ff63c0c9110 0x7ff63c0aee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.698+0000 7ff63aa00640 1 -- 172.21.15.107:0/2731021561 >> v1:172.21.15.107:6789/0 conn(0x7ff63c158ce0 legacy=0x7ff63c06a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:40.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.698+0000 7ff63aa00640 1 -- 172.21.15.107:0/2731021561 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff63c06ce60 con 0x7ff63c1590b0 2024-08-17T02:27:40.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.698+0000 7ff63be00640 1 --2- 172.21.15.107:0/2731021561 >> v2:172.21.15.157:3300/0 conn(0x7ff63c0c9110 0x7ff63c0aee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:40.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.699+0000 7ff63aa00640 1 --2- 172.21.15.107:0/2731021561 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff63c1590b0 0x7ff63c0c8bd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff628009850 tx=0x7ff6280090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80a06b4bc548f5ce server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:40.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.700+0000 7ff63a000640 1 -- 172.21.15.107:0/2731021561 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62802ad90 con 0x7ff63c1590b0 2024-08-17T02:27:40.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.700+0000 7ff63a000640 1 -- 172.21.15.107:0/2731021561 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff628032440 con 0x7ff63c1590b0 2024-08-17T02:27:40.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.700+0000 7ff63a000640 1 -- 172.21.15.107:0/2731021561 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff628032820 con 0x7ff63c1590b0 2024-08-17T02:27:40.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.700+0000 7ff642600640 1 -- 172.21.15.107:0/2731021561 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff63c1590b0 msgr2=0x7ff63c0c8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:40.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.700+0000 7ff642600640 1 --2- 172.21.15.107:0/2731021561 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff63c1590b0 0x7ff63c0c8bd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff628009850 tx=0x7ff6280090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.700+0000 7ff642600640 1 -- 172.21.15.107:0/2731021561 shutdown_connections 2024-08-17T02:27:40.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.700+0000 7ff642600640 1 --2- 172.21.15.107:0/2731021561 >> v2:172.21.15.157:3300/0 conn(0x7ff63c0c9110 0x7ff63c0aee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.700+0000 7ff642600640 1 --2- 172.21.15.107:0/2731021561 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff63c1590b0 0x7ff63c0c8bd0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.700+0000 7ff642600640 1 -- 172.21.15.107:0/2731021561 >> 172.21.15.107:0/2731021561 conn(0x7ff63c067750 msgr2=0x7ff63c0c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:40.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.700+0000 7ff642600640 1 -- 172.21.15.107:0/2731021561 shutdown_connections 2024-08-17T02:27:40.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.701+0000 7ff642600640 1 -- 172.21.15.107:0/2731021561 wait complete. 2024-08-17T02:27:40.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.702+0000 7ff642600640 1 Processor -- start 2024-08-17T02:27:40.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.702+0000 7ff642600640 1 -- start start 2024-08-17T02:27:40.705 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.703+0000 7ff642600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff63c0c9110 0x7ff63c14d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.705 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.703+0000 7ff642600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff63c158ce0 0x7ff63c149470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.705 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.703+0000 7ff642600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff63c1590b0 0x7ff63c0ad010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.705 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.703+0000 7ff642600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c0acc10 con 0x7ff63c1590b0 2024-08-17T02:27:40.705 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.703+0000 7ff642600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c14e580 con 0x7ff63c0c9110 2024-08-17T02:27:40.706 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.703+0000 7ff642600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c14d970 con 0x7ff63c158ce0 2024-08-17T02:27:40.706 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.703+0000 7ff63be00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff63c1590b0 0x7ff63c0ad010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.706 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.703+0000 7ff63be00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff63c1590b0 0x7ff63c0ad010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:46768/0 (socket says 172.21.15.107:46768) 2024-08-17T02:27:40.706 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.703+0000 7ff63be00640 1 -- 172.21.15.107:0/3121847932 learned_addr learned my addr 172.21.15.107:0/3121847932 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:40.706 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.703+0000 7ff63aa00640 1 --2- 172.21.15.107:0/3121847932 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff63c158ce0 0x7ff63c149470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.706 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.703+0000 7ff63b400640 1 --2- 172.21.15.107:0/3121847932 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff63c0c9110 0x7ff63c14d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.706 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.703+0000 7ff63be00640 1 -- 172.21.15.107:0/3121847932 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff63c158ce0 msgr2=0x7ff63c149470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:40.706 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.703+0000 7ff63be00640 1 --2- 172.21.15.107:0/3121847932 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff63c158ce0 0x7ff63c149470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.706 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.703+0000 7ff63be00640 1 -- 172.21.15.107:0/3121847932 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff63c0c9110 msgr2=0x7ff63c14d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:40.706 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.703+0000 7ff63be00640 1 --2- 172.21.15.107:0/3121847932 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff63c0c9110 0x7ff63c14d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.703+0000 7ff63be00640 1 -- 172.21.15.107:0/3121847932 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff634009a20 con 0x7ff63c1590b0 2024-08-17T02:27:40.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.704+0000 7ff63b400640 1 --2- 172.21.15.107:0/3121847932 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff63c0c9110 0x7ff63c14d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:40.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.704+0000 7ff63be00640 1 --2- 172.21.15.107:0/3121847932 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff63c1590b0 0x7ff63c0ad010 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff634009fc0 tx=0x7ff63400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:40.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.704+0000 7ff632a00640 1 -- 172.21.15.107:0/3121847932 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63400ce70 con 0x7ff63c1590b0 2024-08-17T02:27:40.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.704+0000 7ff632a00640 1 -- 172.21.15.107:0/3121847932 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff63400f040 con 0x7ff63c1590b0 2024-08-17T02:27:40.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.704+0000 7ff632a00640 1 -- 172.21.15.107:0/3121847932 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6340146d0 con 0x7ff63c1590b0 2024-08-17T02:27:40.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.704+0000 7ff642600640 1 -- 172.21.15.107:0/3121847932 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff628009390 con 0x7ff63c1590b0 2024-08-17T02:27:40.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.704+0000 7ff642600640 1 -- 172.21.15.107:0/3121847932 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff63c14df30 con 0x7ff63c1590b0 2024-08-17T02:27:40.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.705+0000 7ff642600640 1 -- 172.21.15.107:0/3121847932 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff63c14e6f0 con 0x7ff63c1590b0 2024-08-17T02:27:40.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.706+0000 7ff632a00640 1 -- 172.21.15.107:0/3121847932 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff634003020 con 0x7ff63c1590b0 2024-08-17T02:27:40.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.707+0000 7ff632a00640 1 --2- 172.21.15.107:0/3121847932 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ff61c065150 0x7ff61c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.707+0000 7ff632a00640 1 -- 172.21.15.107:0/3121847932 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7ff6340832e0 con 0x7ff63c1590b0 2024-08-17T02:27:40.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.707+0000 7ff63b400640 1 --2- 172.21.15.107:0/3121847932 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ff61c065150 0x7ff61c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.709 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.708+0000 7ff63b400640 1 --2- 172.21.15.107:0/3121847932 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ff61c065150 0x7ff61c067600 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff62c005840 tx=0x7ff62c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:40.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.711+0000 7ff632a00640 1 -- 172.21.15.107:0/3121847932 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff634050f80 con 0x7ff63c1590b0 2024-08-17T02:27:40.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.881+0000 7ff642600640 1 -- 172.21.15.107:0/3121847932 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000928569.data", "var": "pg_num"} v 0) v1 -- 0x7ff63c071050 con 0x7ff63c1590b0 2024-08-17T02:27:40.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.881+0000 7ff632a00640 1 -- 172.21.15.107:0/3121847932 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000928569.data", "var": "pg_num"}]=0 v37) v1 ==== 124+0+11 (secure 0 0 0) 0x7ff6340545a0 con 0x7ff63c1590b0 2024-08-17T02:27:40.883 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2024-08-17T02:27:40.885 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.883+0000 7ff642600640 1 -- 172.21.15.107:0/3121847932 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ff61c065150 msgr2=0x7ff61c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:40.885 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.883+0000 7ff642600640 1 --2- 172.21.15.107:0/3121847932 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ff61c065150 0x7ff61c067600 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff62c005840 tx=0x7ff62c009040 comp rx=0 tx=0).stop 2024-08-17T02:27:40.885 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.883+0000 7ff642600640 1 -- 172.21.15.107:0/3121847932 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff63c1590b0 msgr2=0x7ff63c0ad010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:40.885 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.883+0000 7ff642600640 1 --2- 172.21.15.107:0/3121847932 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff63c1590b0 0x7ff63c0ad010 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff634009fc0 tx=0x7ff63400b040 comp rx=0 tx=0).stop 2024-08-17T02:27:40.885 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.884+0000 7ff642600640 1 -- 172.21.15.107:0/3121847932 shutdown_connections 2024-08-17T02:27:40.885 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.884+0000 7ff642600640 1 --2- 172.21.15.107:0/3121847932 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ff61c065150 0x7ff61c067600 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.885 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.884+0000 7ff642600640 1 --2- 172.21.15.107:0/3121847932 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff63c1590b0 0x7ff63c0ad010 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.884+0000 7ff642600640 1 --2- 172.21.15.107:0/3121847932 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff63c158ce0 0x7ff63c149470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.884+0000 7ff642600640 1 --2- 172.21.15.107:0/3121847932 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff63c0c9110 0x7ff63c14d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.884+0000 7ff642600640 1 -- 172.21.15.107:0/3121847932 >> 172.21.15.107:0/3121847932 conn(0x7ff63c067750 msgr2=0x7ff63c0aa9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:40.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.884+0000 7ff642600640 1 -- 172.21.15.107:0/3121847932 shutdown_connections 2024-08-17T02:27:40.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:40.884+0000 7ff642600640 1 -- 172.21.15.107:0/3121847932 wait complete. 2024-08-17T02:27:40.901 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:41.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.049+0000 7fa7e4c00640 1 Processor -- start 2024-08-17T02:27:41.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.049+0000 7fa7e4c00640 1 -- start start 2024-08-17T02:27:41.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.050+0000 7fa7e4c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7e0155180 0x7fa7e00aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:41.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.050+0000 7fa7e4c00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa7e0155550 0x7fa7e00ae070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:41.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.050+0000 7fa7e4c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e00afc10 con 0x7fa7e006e080 2024-08-17T02:27:41.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.050+0000 7fa7e4c00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7e00ae5b0 con 0x7fa7e0155550 2024-08-17T02:27:41.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.050+0000 7fa7e4c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e00af000 con 0x7fa7e0155180 2024-08-17T02:27:41.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.051+0000 7fa7de800640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fa7e006e080 0x7fa7e006e490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:49020/0 (socket says 172.21.15.107:49020) 2024-08-17T02:27:41.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.051+0000 7fa7de800640 1 -- 172.21.15.107:0/737237125 learned_addr learned my addr 172.21.15.107:0/737237125 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:27:41.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.051+0000 7fa7dde00640 1 --2- 172.21.15.107:0/737237125 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7e0155180 0x7fa7e00aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:41.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.051+0000 7fa7dd400640 1 --2- 172.21.15.107:0/737237125 >> v2:172.21.15.157:3300/0 conn(0x7fa7e0155550 0x7fa7e00ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:41.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.051+0000 7fa7dca00640 1 -- 172.21.15.107:0/737237125 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3125942273 0 0) 0x7fa7e00afc10 con 0x7fa7e006e080 2024-08-17T02:27:41.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.051+0000 7fa7dca00640 1 -- 172.21.15.107:0/737237125 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7c40034e0 con 0x7fa7e006e080 2024-08-17T02:27:41.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.051+0000 7fa7dde00640 1 -- 172.21.15.107:0/737237125 >> v2:172.21.15.157:3300/0 conn(0x7fa7e0155550 msgr2=0x7fa7e00ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:41.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.051+0000 7fa7dde00640 1 --2- 172.21.15.107:0/737237125 >> v2:172.21.15.157:3300/0 conn(0x7fa7e0155550 0x7fa7e00ae070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.051+0000 7fa7dde00640 1 -- 172.21.15.107:0/737237125 >> v1:172.21.15.107:6789/0 conn(0x7fa7e006e080 legacy=0x7fa7e006e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:41.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.051+0000 7fa7dde00640 1 -- 172.21.15.107:0/737237125 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e00af2e0 con 0x7fa7e0155180 2024-08-17T02:27:41.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.051+0000 7fa7dd400640 1 --2- 172.21.15.107:0/737237125 >> v2:172.21.15.157:3300/0 conn(0x7fa7e0155550 0x7fa7e00ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:41.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.052+0000 7fa7dde00640 1 --2- 172.21.15.107:0/737237125 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7e0155180 0x7fa7e00aea20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa7d000a9f0 tx=0x7fa7d000a2b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfeede8d36f18f78 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:41.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.053+0000 7fa7dca00640 1 -- 172.21.15.107:0/737237125 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d0030510 con 0x7fa7e0155180 2024-08-17T02:27:41.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.053+0000 7fa7dca00640 1 -- 172.21.15.107:0/737237125 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d002e050 con 0x7fa7e0155180 2024-08-17T02:27:41.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.053+0000 7fa7dca00640 1 -- 172.21.15.107:0/737237125 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d00308e0 con 0x7fa7e0155180 2024-08-17T02:27:41.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.053+0000 7fa7e4c00640 1 -- 172.21.15.107:0/737237125 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7e0155180 msgr2=0x7fa7e00aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:41.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.053+0000 7fa7e4c00640 1 --2- 172.21.15.107:0/737237125 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7e0155180 0x7fa7e00aea20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa7d000a9f0 tx=0x7fa7d000a2b0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.053+0000 7fa7e4c00640 1 -- 172.21.15.107:0/737237125 shutdown_connections 2024-08-17T02:27:41.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.053+0000 7fa7e4c00640 1 --2- 172.21.15.107:0/737237125 >> v2:172.21.15.157:3300/0 conn(0x7fa7e0155550 0x7fa7e00ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.053+0000 7fa7e4c00640 1 --2- 172.21.15.107:0/737237125 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7e0155180 0x7fa7e00aea20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.053+0000 7fa7e4c00640 1 -- 172.21.15.107:0/737237125 >> 172.21.15.107:0/737237125 conn(0x7fa7e00cb9b0 msgr2=0x7fa7e00cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:41.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.053+0000 7fa7e4c00640 1 -- 172.21.15.107:0/737237125 shutdown_connections 2024-08-17T02:27:41.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.053+0000 7fa7e4c00640 1 -- 172.21.15.107:0/737237125 wait complete. 2024-08-17T02:27:41.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.055+0000 7fa7e4c00640 1 Processor -- start 2024-08-17T02:27:41.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.055+0000 7fa7e4c00640 1 -- start start 2024-08-17T02:27:41.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.056+0000 7fa7e4c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7e006e080 0x7fa7e016cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:41.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.056+0000 7fa7e4c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7e0155180 0x7fa7e0168c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:41.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.056+0000 7fa7e4c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7e0155550 0x7fa7e0150320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:41.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.056+0000 7fa7e4c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e0169bc0 con 0x7fa7e006e080 2024-08-17T02:27:41.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.056+0000 7fa7e4c00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e0169600 con 0x7fa7e0155180 2024-08-17T02:27:41.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.056+0000 7fa7e4c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e01698e0 con 0x7fa7e0155550 2024-08-17T02:27:41.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.056+0000 7fa7dde00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7e006e080 0x7fa7e016cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:41.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.056+0000 7fa7dde00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7e006e080 0x7fa7e016cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:46778/0 (socket says 172.21.15.107:46778) 2024-08-17T02:27:41.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.056+0000 7fa7dde00640 1 -- 172.21.15.107:0/2874204154 learned_addr learned my addr 172.21.15.107:0/2874204154 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:41.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.056+0000 7fa7dd400640 1 --2- 172.21.15.107:0/2874204154 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7e0155180 0x7fa7e0168c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:41.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.056+0000 7fa7de800640 1 --2- 172.21.15.107:0/2874204154 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7e0155550 0x7fa7e0150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:41.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.056+0000 7fa7dde00640 1 -- 172.21.15.107:0/2874204154 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7e0155550 msgr2=0x7fa7e0150320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:41.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.056+0000 7fa7dde00640 1 --2- 172.21.15.107:0/2874204154 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7e0155550 0x7fa7e0150320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.056+0000 7fa7dde00640 1 -- 172.21.15.107:0/2874204154 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7e0155180 msgr2=0x7fa7e0168c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:41.059 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.056+0000 7fa7dde00640 1 --2- 172.21.15.107:0/2874204154 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7e0155180 0x7fa7e0168c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.059 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.056+0000 7fa7dde00640 1 -- 172.21.15.107:0/2874204154 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7cc009390 con 0x7fa7e006e080 2024-08-17T02:27:41.059 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.057+0000 7fa7dde00640 1 --2- 172.21.15.107:0/2874204154 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7e006e080 0x7fa7e016cbc0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa7d000a2f0 tx=0x7fa7d0038000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:41.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.057+0000 7fa7d5600640 1 -- 172.21.15.107:0/2874204154 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d0032960 con 0x7fa7e006e080 2024-08-17T02:27:41.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.057+0000 7fa7d5600640 1 -- 172.21.15.107:0/2874204154 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d0032ac0 con 0x7fa7e006e080 2024-08-17T02:27:41.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.057+0000 7fa7d5600640 1 -- 172.21.15.107:0/2874204154 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d0032e80 con 0x7fa7e006e080 2024-08-17T02:27:41.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.057+0000 7fa7e4c00640 1 -- 172.21.15.107:0/2874204154 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7d000a530 con 0x7fa7e006e080 2024-08-17T02:27:41.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.057+0000 7fa7e4c00640 1 -- 172.21.15.107:0/2874204154 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e016c6a0 con 0x7fa7e006e080 2024-08-17T02:27:41.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.058+0000 7fa7e4c00640 1 -- 172.21.15.107:0/2874204154 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7e016c890 con 0x7fa7e006e080 2024-08-17T02:27:41.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.059+0000 7fa7d5600640 1 -- 172.21.15.107:0/2874204154 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa7d003c620 con 0x7fa7e006e080 2024-08-17T02:27:41.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.060+0000 7fa7d5600640 1 --2- 172.21.15.107:0/2874204154 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fa7c0065150 0x7fa7c0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:41.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.060+0000 7fa7d5600640 1 -- 172.21.15.107:0/2874204154 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fa7d00a3500 con 0x7fa7e006e080 2024-08-17T02:27:41.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.060+0000 7fa7dd400640 1 --2- 172.21.15.107:0/2874204154 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fa7c0065150 0x7fa7c0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:41.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.061+0000 7fa7dd400640 1 --2- 172.21.15.107:0/2874204154 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fa7c0065150 0x7fa7c0067600 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa7e006d9c0 tx=0x7fa7cc0090f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:41.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.064+0000 7fa7d5600640 1 -- 172.21.15.107:0/2874204154 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa7d0071250 con 0x7fa7e006e080 2024-08-17T02:27:41.272 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.271+0000 7fa7e4c00640 1 -- 172.21.15.107:0/2874204154 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7e0064db0 con 0x7fa7e006e080 2024-08-17T02:27:41.272 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.271+0000 7fa7d5600640 1 -- 172.21.15.107:0/2874204154 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5690 (secure 0 0 0) 0x7fa7d0074870 con 0x7fa7e006e080 2024-08-17T02:27:41.273 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:27:41.273 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4682,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/855770365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":855770365},{"type":"v1","addr":"172.21.15.107:6836","nonce":855770365}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4688,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6834/1749905502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1749905502},{"type":"v1","addr":"172.21.15.157:6834","nonce":1749905502}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:18.071301+0000","modified":"2024-08-17T02:25:21.685727+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4920":{"gid":4920,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6835/1725535660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6833","nonce":1725535660},{"type":"v1","addr":"172.21.15.157:6835","nonce":1725535660}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:35.757205+0000","modified":"2024-08-17T02:25:37.759836+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4914":{"gid":4914,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.107:6837/809431952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":809431952},{"type":"v1","addr":"172.21.15.107:6837","nonce":809431952}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000928569","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:27:41.273 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 21 2024-08-17T02:27:41.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.273+0000 7fa7e4c00640 1 -- 172.21.15.107:0/2874204154 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fa7c0065150 msgr2=0x7fa7c0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:41.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.273+0000 7fa7e4c00640 1 --2- 172.21.15.107:0/2874204154 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fa7c0065150 0x7fa7c0067600 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa7e006d9c0 tx=0x7fa7cc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.273+0000 7fa7e4c00640 1 -- 172.21.15.107:0/2874204154 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7e006e080 msgr2=0x7fa7e016cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:41.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.273+0000 7fa7e4c00640 1 --2- 172.21.15.107:0/2874204154 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7e006e080 0x7fa7e016cbc0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa7d000a2f0 tx=0x7fa7d0038000 comp rx=0 tx=0).stop 2024-08-17T02:27:41.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.273+0000 7fa7e4c00640 1 -- 172.21.15.107:0/2874204154 shutdown_connections 2024-08-17T02:27:41.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.274+0000 7fa7e4c00640 1 --2- 172.21.15.107:0/2874204154 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fa7c0065150 0x7fa7c0067600 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.274+0000 7fa7e4c00640 1 --2- 172.21.15.107:0/2874204154 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7e0155550 0x7fa7e0150320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.274+0000 7fa7e4c00640 1 --2- 172.21.15.107:0/2874204154 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7e0155180 0x7fa7e0168c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.274+0000 7fa7e4c00640 1 --2- 172.21.15.107:0/2874204154 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7e006e080 0x7fa7e016cbc0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.274+0000 7fa7e4c00640 1 -- 172.21.15.107:0/2874204154 >> 172.21.15.107:0/2874204154 conn(0x7fa7e00cb9b0 msgr2=0x7fa7e006c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:41.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.274+0000 7fa7e4c00640 1 -- 172.21.15.107:0/2874204154 shutdown_connections 2024-08-17T02:27:41.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.274+0000 7fa7e4c00640 1 -- 172.21.15.107:0/2874204154 wait complete. 2024-08-17T02:27:41.290 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:41.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.436+0000 7f7fb6800640 1 Processor -- start 2024-08-17T02:27:41.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.436+0000 7f7fb6800640 1 -- start start 2024-08-17T02:27:41.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.437+0000 7f7fb6800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7fb0155a20 0x7f7fb00adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:41.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.437+0000 7f7fb6800640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7fb0155df0 0x7f7fb00ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:41.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.437+0000 7f7fb6800640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb0156670 con 0x7f7fb006d7f0 2024-08-17T02:27:41.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.437+0000 7f7fb6800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fb00b0350 con 0x7f7fb0155a20 2024-08-17T02:27:41.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.437+0000 7f7fb6800640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fb006e5e0 con 0x7f7fb0155df0 2024-08-17T02:27:41.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.437+0000 7f7faf400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7fb0155a20 0x7f7fb00adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:41.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.438+0000 7f7faf400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7fb0155a20 0x7f7fb00adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:46786/0 (socket says 172.21.15.107:46786) 2024-08-17T02:27:41.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.438+0000 7f7faf400640 1 -- 172.21.15.107:0/1583401441 learned_addr learned my addr 172.21.15.107:0/1583401441 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:41.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.438+0000 7f7faea00640 1 --2- 172.21.15.107:0/1583401441 >> v2:172.21.15.157:3300/0 conn(0x7f7fb0155df0 0x7f7fb00ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:41.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.438+0000 7f7faf400640 1 -- 172.21.15.107:0/1583401441 >> v2:172.21.15.157:3300/0 conn(0x7f7fb0155df0 msgr2=0x7f7fb00ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:41.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.438+0000 7f7faf400640 1 --2- 172.21.15.107:0/1583401441 >> v2:172.21.15.157:3300/0 conn(0x7f7fb0155df0 0x7f7fb00ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.438+0000 7f7faf400640 1 -- 172.21.15.107:0/1583401441 >> v1:172.21.15.157:6789/0 conn(0x7f7fb006d7f0 legacy=0x7f7fb00ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:41.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.438+0000 7f7faf400640 1 -- 172.21.15.107:0/1583401441 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb006e8c0 con 0x7f7fb0155a20 2024-08-17T02:27:41.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.439+0000 7f7faf400640 1 --2- 172.21.15.107:0/1583401441 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fb0155a20 0x7f7fb00adf10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7fb006aa10 tx=0x7f7fa00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68461a3b83b1bae7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:41.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.439+0000 7f7fae000640 1 -- 172.21.15.107:0/1583401441 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa002ae80 con 0x7f7fb0155a20 2024-08-17T02:27:41.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.439+0000 7f7fae000640 1 -- 172.21.15.107:0/1583401441 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa0032440 con 0x7f7fb0155a20 2024-08-17T02:27:41.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.439+0000 7f7fae000640 1 -- 172.21.15.107:0/1583401441 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa0032800 con 0x7f7fb0155a20 2024-08-17T02:27:41.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.440+0000 7f7fb6800640 1 -- 172.21.15.107:0/1583401441 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fb0155a20 msgr2=0x7f7fb00adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:41.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.440+0000 7f7fb6800640 1 --2- 172.21.15.107:0/1583401441 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fb0155a20 0x7f7fb00adf10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7fb006aa10 tx=0x7f7fa00091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.440+0000 7f7fb6800640 1 -- 172.21.15.107:0/1583401441 shutdown_connections 2024-08-17T02:27:41.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.440+0000 7f7fb6800640 1 --2- 172.21.15.107:0/1583401441 >> v2:172.21.15.157:3300/0 conn(0x7f7fb0155df0 0x7f7fb00ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.440+0000 7f7fb6800640 1 --2- 172.21.15.107:0/1583401441 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fb0155a20 0x7f7fb00adf10 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.440+0000 7f7fb6800640 1 -- 172.21.15.107:0/1583401441 >> 172.21.15.107:0/1583401441 conn(0x7f7fb00cb9b0 msgr2=0x7f7fb00cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:41.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.440+0000 7f7fb6800640 1 -- 172.21.15.107:0/1583401441 shutdown_connections 2024-08-17T02:27:41.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.440+0000 7f7fb6800640 1 -- 172.21.15.107:0/1583401441 wait complete. 2024-08-17T02:27:41.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.441+0000 7f7fb6800640 1 Processor -- start 2024-08-17T02:27:41.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.441+0000 7f7fb6800640 1 -- start start 2024-08-17T02:27:41.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.442+0000 7f7fb6800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fb006d7f0 0x7f7fb00aaaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:41.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.442+0000 7f7fb6800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7fb0155a20 0x7f7fb0167070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:41.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.442+0000 7f7fb6800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7fb0155df0 0x7f7fb01675b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:41.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.442+0000 7f7fb6800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb00c0e20 con 0x7f7fb006d7f0 2024-08-17T02:27:41.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.442+0000 7f7fb6800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb0151130 con 0x7f7fb0155a20 2024-08-17T02:27:41.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.442+0000 7f7fb6800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb00ab4e0 con 0x7f7fb0155df0 2024-08-17T02:27:41.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.442+0000 7f7faf400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fb006d7f0 0x7f7fb00aaaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:41.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.443+0000 7f7faf400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fb006d7f0 0x7f7fb00aaaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:46800/0 (socket says 172.21.15.107:46800) 2024-08-17T02:27:41.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.443+0000 7f7faf400640 1 -- 172.21.15.107:0/3033128218 learned_addr learned my addr 172.21.15.107:0/3033128218 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:41.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.443+0000 7f7faea00640 1 --2- 172.21.15.107:0/3033128218 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7fb0155a20 0x7f7fb0167070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:41.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.443+0000 7f7fafe00640 1 --2- 172.21.15.107:0/3033128218 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7fb0155df0 0x7f7fb01675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:41.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.443+0000 7f7faf400640 1 -- 172.21.15.107:0/3033128218 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7fb0155df0 msgr2=0x7f7fb01675b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:41.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.443+0000 7f7faf400640 1 --2- 172.21.15.107:0/3033128218 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7fb0155df0 0x7f7fb01675b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.443+0000 7f7faf400640 1 -- 172.21.15.107:0/3033128218 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7fb0155a20 msgr2=0x7f7fb0167070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:41.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.443+0000 7f7faf400640 1 --2- 172.21.15.107:0/3033128218 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7fb0155a20 0x7f7fb0167070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.443+0000 7f7faf400640 1 -- 172.21.15.107:0/3033128218 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa0009450 con 0x7f7fb006d7f0 2024-08-17T02:27:41.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.443+0000 7f7faf400640 1 --2- 172.21.15.107:0/3033128218 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fb006d7f0 0x7f7fb00aaaa0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0009210 tx=0x7f7fa0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:41.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.444+0000 7f7fa6a00640 1 -- 172.21.15.107:0/3033128218 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa0031de0 con 0x7f7fb006d7f0 2024-08-17T02:27:41.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.444+0000 7f7fa6a00640 1 -- 172.21.15.107:0/3033128218 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa0000c40 con 0x7f7fb006d7f0 2024-08-17T02:27:41.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.444+0000 7f7fb6800640 1 -- 172.21.15.107:0/3033128218 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fb00ab7c0 con 0x7f7fb006d7f0 2024-08-17T02:27:41.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.444+0000 7f7fa6a00640 1 -- 172.21.15.107:0/3033128218 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa003d690 con 0x7f7fb006d7f0 2024-08-17T02:27:41.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.444+0000 7f7fb6800640 1 -- 172.21.15.107:0/3033128218 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fb00c0a40 con 0x7f7fb006d7f0 2024-08-17T02:27:41.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.445+0000 7f7fb6800640 1 -- 172.21.15.107:0/3033128218 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fb00c0f60 con 0x7f7fb006d7f0 2024-08-17T02:27:41.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.445+0000 7f7fa6a00640 1 -- 172.21.15.107:0/3033128218 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7fa0039040 con 0x7f7fb006d7f0 2024-08-17T02:27:41.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.446+0000 7f7fa6a00640 1 --2- 172.21.15.107:0/3033128218 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7f90065180 0x7f7f90067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:41.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.446+0000 7f7fa6a00640 1 -- 172.21.15.107:0/3033128218 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f7fa00a28f0 con 0x7f7fb006d7f0 2024-08-17T02:27:41.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.447+0000 7f7faea00640 1 --2- 172.21.15.107:0/3033128218 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7f90065180 0x7f7f90067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:41.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.447+0000 7f7faea00640 1 --2- 172.21.15.107:0/3033128218 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7f90065180 0x7f7f90067630 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7fb01524e0 tx=0x7f7f9c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:41.451 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.450+0000 7f7fa6a00640 1 -- 172.21.15.107:0/3033128218 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7fb00c0f60 con 0x7f7fb006d7f0 2024-08-17T02:27:41.630 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.629+0000 7f7fb6800640 1 -- 172.21.15.107:0/3033128218 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7fb00c0f60 con 0x7f7fb006d7f0 2024-08-17T02:27:41.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.630+0000 7f7fa6a00640 1 -- 172.21.15.107:0/3033128218 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18647 (secure 0 0 0) 0x7f7fb00c0f60 con 0x7f7fb006d7f0 2024-08-17T02:27:41.631 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:27:41.631 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":37,"fsid":"f207b4c0-329d-46b8-b83f-aaf30bdb6ce3","created":"2024-08-17T02:24:11.038049+0000","modified":"2024-08-17T02:25:38.761303+0000","last_up_change":"2024-08-17T02:24:22.047790+0000","last_in_change":"2024-08-17T02:24:13.892720+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:23.456166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:16.086009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:17.060399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000928569.meta","create_time":"2024-08-17T02:25:33.885385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000928569"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000928569.data","create_time":"2024-08-17T02:25:34.790701+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000928569"}}}],"osds":[{"osd":0,"uuid":"376363f3-b8bf-4f1e-b691-51cdd39171ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37302},{"type":"v1","addr":"172.21.15.107:6801","nonce":37302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37302},{"type":"v1","addr":"172.21.15.107:6803","nonce":37302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37302},{"type":"v1","addr":"172.21.15.107:6807","nonce":37302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37302},{"type":"v1","addr":"172.21.15.107:6805","nonce":37302}]},"public_addr":"172.21.15.107:6801/37302","cluster_addr":"172.21.15.107:6803/37302","heartbeat_back_addr":"172.21.15.107:6807/37302","heartbeat_front_addr":"172.21.15.107:6805/37302","state":["exists","up"]},{"osd":1,"uuid":"cc6624e3-2ad4-4db4-b377-05dfe57424e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37305},{"type":"v1","addr":"172.21.15.107:6824","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37305},{"type":"v1","addr":"172.21.15.107:6827","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37305},{"type":"v1","addr":"172.21.15.107:6831","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37305},{"type":"v1","addr":"172.21.15.107:6829","nonce":37305}]},"public_addr":"172.21.15.107:6824/37305","cluster_addr":"172.21.15.107:6827/37305","heartbeat_back_addr":"172.21.15.107:6831/37305","heartbeat_front_addr":"172.21.15.107:6829/37305","state":["exists","up"]},{"osd":2,"uuid":"25229542-29b5-4281-bcb0-798ae0930aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37307},{"type":"v1","addr":"172.21.15.107:6817","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37307},{"type":"v1","addr":"172.21.15.107:6819","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6823","nonce":37307},{"type":"v1","addr":"172.21.15.107:6825","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37307},{"type":"v1","addr":"172.21.15.107:6821","nonce":37307}]},"public_addr":"172.21.15.107:6817/37307","cluster_addr":"172.21.15.107:6819/37307","heartbeat_back_addr":"172.21.15.107:6825/37307","heartbeat_front_addr":"172.21.15.107:6821/37307","state":["exists","up"]},{"osd":3,"uuid":"5f16aee8-8950-4268-a61a-5cf6ebd670e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37306},{"type":"v1","addr":"172.21.15.107:6809","nonce":37306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37306},{"type":"v1","addr":"172.21.15.107:6811","nonce":37306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37306},{"type":"v1","addr":"172.21.15.107:6815","nonce":37306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37306},{"type":"v1","addr":"172.21.15.107:6813","nonce":37306}]},"public_addr":"172.21.15.107:6809/37306","cluster_addr":"172.21.15.107:6811/37306","heartbeat_back_addr":"172.21.15.107:6815/37306","heartbeat_front_addr":"172.21.15.107:6813/37306","state":["exists","up"]},{"osd":4,"uuid":"23232e28-e23b-4b4e-a531-4939246dbbde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":37329},{"type":"v1","addr":"172.21.15.157:6817","nonce":37329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":37329},{"type":"v1","addr":"172.21.15.157:6819","nonce":37329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":37329},{"type":"v1","addr":"172.21.15.157:6823","nonce":37329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":37329},{"type":"v1","addr":"172.21.15.157:6821","nonce":37329}]},"public_addr":"172.21.15.157:6817/37329","cluster_addr":"172.21.15.157:6819/37329","heartbeat_back_addr":"172.21.15.157:6823/37329","heartbeat_front_addr":"172.21.15.157:6821/37329","state":["exists","up"]},{"osd":5,"uuid":"f87ec331-3e59-4886-a317-6f7e26ec8e21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":37328},{"type":"v1","addr":"172.21.15.157:6804","nonce":37328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":37328},{"type":"v1","addr":"172.21.15.157:6808","nonce":37328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":37328},{"type":"v1","addr":"172.21.15.157:6815","nonce":37328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":37328},{"type":"v1","addr":"172.21.15.157:6812","nonce":37328}]},"public_addr":"172.21.15.157:6804/37328","cluster_addr":"172.21.15.157:6808/37328","heartbeat_back_addr":"172.21.15.157:6815/37328","heartbeat_front_addr":"172.21.15.157:6812/37328","state":["exists","up"]},{"osd":6,"uuid":"92852235-ce49-4d96-a940-6f18d97b13ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":37330},{"type":"v1","addr":"172.21.15.157:6801","nonce":37330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6803","nonce":37330},{"type":"v1","addr":"172.21.15.157:6805","nonce":37330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":37330},{"type":"v1","addr":"172.21.15.157:6813","nonce":37330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":37330},{"type":"v1","addr":"172.21.15.157:6809","nonce":37330}]},"public_addr":"172.21.15.157:6801/37330","cluster_addr":"172.21.15.157:6805/37330","heartbeat_back_addr":"172.21.15.157:6813/37330","heartbeat_front_addr":"172.21.15.157:6809/37330","state":["exists","up"]},{"osd":7,"uuid":"7484a061-723d-4663-b28f-b01766d62f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":37373},{"type":"v1","addr":"172.21.15.157:6825","nonce":37373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":37373},{"type":"v1","addr":"172.21.15.157:6827","nonce":37373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":37373},{"type":"v1","addr":"172.21.15.157:6831","nonce":37373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":37373},{"type":"v1","addr":"172.21.15.157:6829","nonce":37373}]},"public_addr":"172.21.15.157:6825/37373","cluster_addr":"172.21.15.157:6827/37373","heartbeat_back_addr":"172.21.15.157:6831/37373","heartbeat_front_addr":"172.21.15.157:6829/37373","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.110188+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.280265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.252119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.267996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.284582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.144420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.174764+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.308002+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:41.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.632+0000 7f7fb6800640 1 -- 172.21.15.107:0/3033128218 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7f90065180 msgr2=0x7f7f90067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:41.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.632+0000 7f7fb6800640 1 --2- 172.21.15.107:0/3033128218 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7f90065180 0x7f7f90067630 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7fb01524e0 tx=0x7f7f9c008040 comp rx=0 tx=0).stop 2024-08-17T02:27:41.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.632+0000 7f7fb6800640 1 -- 172.21.15.107:0/3033128218 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fb006d7f0 msgr2=0x7f7fb00aaaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:41.634 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.632+0000 7f7fb6800640 1 --2- 172.21.15.107:0/3033128218 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fb006d7f0 0x7f7fb00aaaa0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0009210 tx=0x7f7fa0032000 comp rx=0 tx=0).stop 2024-08-17T02:27:41.634 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.632+0000 7f7fb6800640 1 -- 172.21.15.107:0/3033128218 shutdown_connections 2024-08-17T02:27:41.634 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.632+0000 7f7fb6800640 1 --2- 172.21.15.107:0/3033128218 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7f90065180 0x7f7f90067630 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.634 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.632+0000 7f7fb6800640 1 --2- 172.21.15.107:0/3033128218 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7fb0155df0 0x7f7fb01675b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.634 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.632+0000 7f7fb6800640 1 --2- 172.21.15.107:0/3033128218 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7fb0155a20 0x7f7fb0167070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.634 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.632+0000 7f7fb6800640 1 --2- 172.21.15.107:0/3033128218 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fb006d7f0 0x7f7fb00aaaa0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.634 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.632+0000 7f7fb6800640 1 -- 172.21.15.107:0/3033128218 >> 172.21.15.107:0/3033128218 conn(0x7f7fb00cb9b0 msgr2=0x7f7fb0152730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:41.634 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.632+0000 7f7fb6800640 1 -- 172.21.15.107:0/3033128218 shutdown_connections 2024-08-17T02:27:41.634 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.632+0000 7f7fb6800640 1 -- 172.21.15.107:0/3033128218 wait complete. 2024-08-17T02:27:41.649 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:27:41.649 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:41.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.797+0000 7fbabac00640 1 Processor -- start 2024-08-17T02:27:41.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.797+0000 7fbabac00640 1 -- start start 2024-08-17T02:27:41.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.798+0000 7fbabac00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fbab40ca350 0x7fbab40cf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:41.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.798+0000 7fbabac00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbab40ca720 0x7fbab40cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:41.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.798+0000 7fbabac00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbab40cab30 0x7fbab40cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:41.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.798+0000 7fbabac00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbab40cb730 con 0x7fbab40ca720 2024-08-17T02:27:41.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.798+0000 7fbabac00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbab40cf9c0 con 0x7fbab40ca350 2024-08-17T02:27:41.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.798+0000 7fbabac00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbab40cb0e0 con 0x7fbab40cab30 2024-08-17T02:27:41.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.798+0000 7fbab8e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbab40ca720 0x7fbab40cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:41.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.798+0000 7fbab8e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbab40ca720 0x7fbab40cd8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:46806/0 (socket says 172.21.15.107:46806) 2024-08-17T02:27:41.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.798+0000 7fbab8e00640 1 -- 172.21.15.107:0/104493105 learned_addr learned my addr 172.21.15.107:0/104493105 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:41.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.798+0000 7fbab9800640 1 --2- 172.21.15.107:0/104493105 >> v2:172.21.15.157:3300/0 conn(0x7fbab40ca350 0x7fbab40cf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:41.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.798+0000 7fbaba200640 1 --2- 172.21.15.107:0/104493105 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbab40cab30 0x7fbab40cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:41.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.799+0000 7fbab8e00640 1 -- 172.21.15.107:0/104493105 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbab40cab30 msgr2=0x7fbab40cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:41.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.799+0000 7fbab8e00640 1 --2- 172.21.15.107:0/104493105 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbab40cab30 0x7fbab40cde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.799+0000 7fbab8e00640 1 -- 172.21.15.107:0/104493105 >> v2:172.21.15.157:3300/0 conn(0x7fbab40ca350 msgr2=0x7fbab40cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:41.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.799+0000 7fbab8e00640 1 --2- 172.21.15.107:0/104493105 >> v2:172.21.15.157:3300/0 conn(0x7fbab40ca350 0x7fbab40cf2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.799+0000 7fbab8e00640 1 -- 172.21.15.107:0/104493105 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab40cb3c0 con 0x7fbab40ca720 2024-08-17T02:27:41.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.799+0000 7fbab9800640 1 --2- 172.21.15.107:0/104493105 >> v2:172.21.15.157:3300/0 conn(0x7fbab40ca350 0x7fbab40cf2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:41.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.800+0000 7fbab8e00640 1 --2- 172.21.15.107:0/104493105 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbab40ca720 0x7fbab40cd8e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbab4064630 tx=0x7fbaa00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36509d6ff3de8d63 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:41.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.800+0000 7fbab3e00640 1 -- 172.21.15.107:0/104493105 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa002add0 con 0x7fbab40ca720 2024-08-17T02:27:41.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.800+0000 7fbab3e00640 1 -- 172.21.15.107:0/104493105 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaa0032440 con 0x7fbab40ca720 2024-08-17T02:27:41.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.800+0000 7fbab3e00640 1 -- 172.21.15.107:0/104493105 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa0032820 con 0x7fbab40ca720 2024-08-17T02:27:41.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.800+0000 7fbabac00640 1 -- 172.21.15.107:0/104493105 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbab40ca720 msgr2=0x7fbab40cd8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:41.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.800+0000 7fbabac00640 1 --2- 172.21.15.107:0/104493105 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbab40ca720 0x7fbab40cd8e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbab4064630 tx=0x7fbaa00091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.801+0000 7fbabac00640 1 -- 172.21.15.107:0/104493105 shutdown_connections 2024-08-17T02:27:41.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.801+0000 7fbabac00640 1 --2- 172.21.15.107:0/104493105 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbab40ca720 0x7fbab40cd8e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.801+0000 7fbabac00640 1 --2- 172.21.15.107:0/104493105 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbab40cab30 0x7fbab40cde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.801+0000 7fbabac00640 1 --2- 172.21.15.107:0/104493105 >> v2:172.21.15.157:3300/0 conn(0x7fbab40ca350 0x7fbab40cf2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.801+0000 7fbabac00640 1 -- 172.21.15.107:0/104493105 >> 172.21.15.107:0/104493105 conn(0x7fbab40cfdb0 msgr2=0x7fbab40d01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:41.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.801+0000 7fbabac00640 1 -- 172.21.15.107:0/104493105 shutdown_connections 2024-08-17T02:27:41.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.801+0000 7fbabac00640 1 -- 172.21.15.107:0/104493105 wait complete. 2024-08-17T02:27:41.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.802+0000 7fbabac00640 1 Processor -- start 2024-08-17T02:27:41.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.802+0000 7fbabac00640 1 -- start start 2024-08-17T02:27:41.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.803+0000 7fbabac00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbab40ca350 0x7fbab40afc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:41.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.803+0000 7fbabac00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbab40ca720 0x7fbab409a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:41.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.803+0000 7fbabac00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbab40cab30 0x7fbab40c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:41.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.803+0000 7fbabac00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab40c6ef0 con 0x7fbab40ca720 2024-08-17T02:27:41.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.803+0000 7fbabac00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab40c71d0 con 0x7fbab40ca350 2024-08-17T02:27:41.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.803+0000 7fbabac00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbab40c74b0 con 0x7fbab40cab30 2024-08-17T02:27:41.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.803+0000 7fbab8e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbab40ca720 0x7fbab409a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:41.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.803+0000 7fbab8e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbab40ca720 0x7fbab409a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:46818/0 (socket says 172.21.15.107:46818) 2024-08-17T02:27:41.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.803+0000 7fbab8e00640 1 -- 172.21.15.107:0/1630957562 learned_addr learned my addr 172.21.15.107:0/1630957562 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:41.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.803+0000 7fbab8e00640 1 -- 172.21.15.107:0/1630957562 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbab40cab30 msgr2=0x7fbab40c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:41.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.803+0000 7fbab8e00640 1 --2- 172.21.15.107:0/1630957562 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbab40cab30 0x7fbab40c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.804+0000 7fbab8e00640 1 -- 172.21.15.107:0/1630957562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbab40ca350 msgr2=0x7fbab40afc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:41.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.804+0000 7fbab8e00640 1 --2- 172.21.15.107:0/1630957562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbab40ca350 0x7fbab40afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.804+0000 7fbab8e00640 1 -- 172.21.15.107:0/1630957562 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa0009450 con 0x7fbab40ca720 2024-08-17T02:27:41.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.804+0000 7fbab8e00640 1 --2- 172.21.15.107:0/1630957562 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbab40ca720 0x7fbab409a7e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0009210 tx=0x7fbaa0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:41.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.804+0000 7fbab0c00640 1 -- 172.21.15.107:0/1630957562 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa0006b30 con 0x7fbab40ca720 2024-08-17T02:27:41.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.804+0000 7fbab0c00640 1 -- 172.21.15.107:0/1630957562 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaa0031a40 con 0x7fbab40ca720 2024-08-17T02:27:41.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.804+0000 7fbabac00640 1 -- 172.21.15.107:0/1630957562 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbab40c7790 con 0x7fbab40ca720 2024-08-17T02:27:41.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.804+0000 7fbab0c00640 1 -- 172.21.15.107:0/1630957562 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa0031e00 con 0x7fbab40ca720 2024-08-17T02:27:41.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.804+0000 7fbabac00640 1 -- 172.21.15.107:0/1630957562 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbab40c96a0 con 0x7fbab40ca720 2024-08-17T02:27:41.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.805+0000 7fbabac00640 1 -- 172.21.15.107:0/1630957562 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbab40aec80 con 0x7fbab40ca720 2024-08-17T02:27:41.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.806+0000 7fbab0c00640 1 -- 172.21.15.107:0/1630957562 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbaa0039040 con 0x7fbab40ca720 2024-08-17T02:27:41.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.807+0000 7fbab0c00640 1 --2- 172.21.15.107:0/1630957562 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fba94065150 0x7fba94067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:41.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.807+0000 7fbab0c00640 1 -- 172.21.15.107:0/1630957562 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fbaa00a26e0 con 0x7fbab40ca720 2024-08-17T02:27:41.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.807+0000 7fbab9800640 1 --2- 172.21.15.107:0/1630957562 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fba94065150 0x7fba94067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:41.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.808+0000 7fbab9800640 1 --2- 172.21.15.107:0/1630957562 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fba94065150 0x7fba94067600 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8006e70 tx=0x7fbaa8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:41.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:41.811+0000 7fbab0c00640 1 -- 172.21.15.107:0/1630957562 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbab40aec80 con 0x7fbab40ca720 2024-08-17T02:27:42.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.024+0000 7fbabac00640 1 -- 172.21.15.107:0/1630957562 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbab40aec80 con 0x7fbab40ca720 2024-08-17T02:27:42.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.024+0000 7fbab0c00640 1 -- 172.21.15.107:0/1630957562 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5690 (secure 0 0 0) 0x7fbab40aec80 con 0x7fbab40ca720 2024-08-17T02:27:42.025 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:27:42.026 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4682,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/855770365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":855770365},{"type":"v1","addr":"172.21.15.107:6836","nonce":855770365}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4688,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6834/1749905502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1749905502},{"type":"v1","addr":"172.21.15.157:6834","nonce":1749905502}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:18.071301+0000","modified":"2024-08-17T02:25:21.685727+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4920":{"gid":4920,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6835/1725535660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6833","nonce":1725535660},{"type":"v1","addr":"172.21.15.157:6835","nonce":1725535660}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:35.757205+0000","modified":"2024-08-17T02:25:37.759836+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4914":{"gid":4914,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.107:6837/809431952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":809431952},{"type":"v1","addr":"172.21.15.107:6837","nonce":809431952}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000928569","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:27:42.026 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 21 2024-08-17T02:27:42.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.026+0000 7fbabac00640 1 -- 172.21.15.107:0/1630957562 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fba94065150 msgr2=0x7fba94067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:42.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.026+0000 7fbabac00640 1 --2- 172.21.15.107:0/1630957562 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fba94065150 0x7fba94067600 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8006e70 tx=0x7fbaa8008040 comp rx=0 tx=0).stop 2024-08-17T02:27:42.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.026+0000 7fbabac00640 1 -- 172.21.15.107:0/1630957562 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbab40ca720 msgr2=0x7fbab409a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:42.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.026+0000 7fbabac00640 1 --2- 172.21.15.107:0/1630957562 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbab40ca720 0x7fbab409a7e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0009210 tx=0x7fbaa0032000 comp rx=0 tx=0).stop 2024-08-17T02:27:42.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.026+0000 7fbabac00640 1 -- 172.21.15.107:0/1630957562 shutdown_connections 2024-08-17T02:27:42.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.026+0000 7fbabac00640 1 --2- 172.21.15.107:0/1630957562 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fba94065150 0x7fba94067600 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.026+0000 7fbabac00640 1 --2- 172.21.15.107:0/1630957562 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbab40cab30 0x7fbab40c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.026+0000 7fbabac00640 1 --2- 172.21.15.107:0/1630957562 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbab40ca720 0x7fbab409a7e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.026+0000 7fbabac00640 1 --2- 172.21.15.107:0/1630957562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbab40ca350 0x7fbab40afc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.026+0000 7fbabac00640 1 -- 172.21.15.107:0/1630957562 >> 172.21.15.107:0/1630957562 conn(0x7fbab40cfdb0 msgr2=0x7fbab40cd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:42.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.027+0000 7fbabac00640 1 -- 172.21.15.107:0/1630957562 shutdown_connections 2024-08-17T02:27:42.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.027+0000 7fbabac00640 1 -- 172.21.15.107:0/1630957562 wait complete. 2024-08-17T02:27:42.043 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:42.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.189+0000 7f6eefe00640 1 Processor -- start 2024-08-17T02:27:42.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.189+0000 7f6eefe00640 1 -- start start 2024-08-17T02:27:42.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.190+0000 7f6eefe00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6ef0158bd0 0x7f6ef0069000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:42.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.190+0000 7f6eefe00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6ef0069540 0x7f6ef00ac000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:42.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.190+0000 7f6eefe00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ef00aec20 con 0x7f6ef00ac540 2024-08-17T02:27:42.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.190+0000 7f6eefe00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ef00699c0 con 0x7f6ef0158bd0 2024-08-17T02:27:42.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.190+0000 7f6eefe00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef00ae330 con 0x7f6ef0069540 2024-08-17T02:27:42.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.190+0000 7f6eeea00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6ef0158bd0 0x7f6ef0069000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:42.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.190+0000 7f6eeea00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6ef0158bd0 0x7f6ef0069000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:46826/0 (socket says 172.21.15.107:46826) 2024-08-17T02:27:42.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.190+0000 7f6eeea00640 1 -- 172.21.15.107:0/1636330292 learned_addr learned my addr 172.21.15.107:0/1636330292 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:42.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.190+0000 7f6eef400640 1 --1- 172.21.15.107:0/1636330292 >> v1:172.21.15.107:6789/0 conn(0x7f6ef00ac540 0x7f6ef0067d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:49032/0 (socket says 172.21.15.107:49032) 2024-08-17T02:27:42.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.191+0000 7f6ee6000640 1 --2- 172.21.15.107:0/1636330292 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6ef0069540 0x7f6ef00ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:42.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.191+0000 7f6eeea00640 1 -- 172.21.15.107:0/1636330292 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6ef0069540 msgr2=0x7f6ef00ac000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:42.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.191+0000 7f6eeea00640 1 --2- 172.21.15.107:0/1636330292 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6ef0069540 0x7f6ef00ac000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.191+0000 7f6eeea00640 1 -- 172.21.15.107:0/1636330292 >> v1:172.21.15.107:6789/0 conn(0x7f6ef00ac540 legacy=0x7f6ef0067d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:42.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.191+0000 7f6eee000640 1 -- 172.21.15.107:0/1636330292 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 212970394 0 0) 0x7f6ef00aec20 con 0x7f6ef00ac540 2024-08-17T02:27:42.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.191+0000 7f6eeea00640 1 -- 172.21.15.107:0/1636330292 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef00acd30 con 0x7f6ef0158bd0 2024-08-17T02:27:42.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.191+0000 7f6ee6000640 1 --2- 172.21.15.107:0/1636330292 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6ef0069540 0x7f6ef00ac000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:42.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.192+0000 7f6eeea00640 1 --2- 172.21.15.107:0/1636330292 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ef0158bd0 0x7f6ef0069000 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0009910 tx=0x7f6ee00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c20b708b71e900b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:42.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.192+0000 7f6eee000640 1 -- 172.21.15.107:0/1636330292 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee002adb0 con 0x7f6ef0158bd0 2024-08-17T02:27:42.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.192+0000 7f6eee000640 1 -- 172.21.15.107:0/1636330292 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee0032440 con 0x7f6ef0158bd0 2024-08-17T02:27:42.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.192+0000 7f6eee000640 1 -- 172.21.15.107:0/1636330292 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee00327e0 con 0x7f6ef0158bd0 2024-08-17T02:27:42.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.193+0000 7f6eefe00640 1 -- 172.21.15.107:0/1636330292 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ef0158bd0 msgr2=0x7f6ef0069000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:42.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.193+0000 7f6eefe00640 1 --2- 172.21.15.107:0/1636330292 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ef0158bd0 0x7f6ef0069000 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0009910 tx=0x7f6ee00091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.193+0000 7f6eefe00640 1 -- 172.21.15.107:0/1636330292 shutdown_connections 2024-08-17T02:27:42.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.193+0000 7f6eefe00640 1 --2- 172.21.15.107:0/1636330292 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6ef0069540 0x7f6ef00ac000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.193+0000 7f6eefe00640 1 --2- 172.21.15.107:0/1636330292 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ef0158bd0 0x7f6ef0069000 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.193+0000 7f6eefe00640 1 -- 172.21.15.107:0/1636330292 >> 172.21.15.107:0/1636330292 conn(0x7f6ef0096a70 msgr2=0x7f6ef00cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:42.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.193+0000 7f6eefe00640 1 -- 172.21.15.107:0/1636330292 shutdown_connections 2024-08-17T02:27:42.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.193+0000 7f6eefe00640 1 -- 172.21.15.107:0/1636330292 wait complete. 2024-08-17T02:27:42.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.194+0000 7f6eefe00640 1 Processor -- start 2024-08-17T02:27:42.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.194+0000 7f6eefe00640 1 -- start start 2024-08-17T02:27:42.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.195+0000 7f6eefe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ef0069540 0x7f6ef0169db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:42.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.195+0000 7f6eefe00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6ef00ac540 0x7f6ef0153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:42.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.195+0000 7f6eefe00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ef0158bd0 0x7f6ef0166820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:42.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.195+0000 7f6eefe00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef016b210 con 0x7f6ef0069540 2024-08-17T02:27:42.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.195+0000 7f6eefe00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef016a600 con 0x7f6ef0158bd0 2024-08-17T02:27:42.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.195+0000 7f6eefe00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef016a8e0 con 0x7f6ef00ac540 2024-08-17T02:27:42.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.195+0000 7f6eeea00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ef0069540 0x7f6ef0169db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:42.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.195+0000 7f6eeea00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ef0069540 0x7f6ef0169db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:46834/0 (socket says 172.21.15.107:46834) 2024-08-17T02:27:42.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.195+0000 7f6eeea00640 1 -- 172.21.15.107:0/413378275 learned_addr learned my addr 172.21.15.107:0/413378275 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:42.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.196+0000 7f6ee6000640 1 --2- 172.21.15.107:0/413378275 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6ef00ac540 0x7f6ef0153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:42.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.196+0000 7f6eef400640 1 --2- 172.21.15.107:0/413378275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ef0158bd0 0x7f6ef0166820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:42.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.196+0000 7f6eeea00640 1 -- 172.21.15.107:0/413378275 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6ef00ac540 msgr2=0x7f6ef0153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:42.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.196+0000 7f6eeea00640 1 --2- 172.21.15.107:0/413378275 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6ef00ac540 0x7f6ef0153620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.196+0000 7f6eeea00640 1 -- 172.21.15.107:0/413378275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ef0158bd0 msgr2=0x7f6ef0166820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:42.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.196+0000 7f6eeea00640 1 --2- 172.21.15.107:0/413378275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ef0158bd0 0x7f6ef0166820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.196+0000 7f6eeea00640 1 -- 172.21.15.107:0/413378275 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee0009450 con 0x7f6ef0069540 2024-08-17T02:27:42.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.196+0000 7f6ee6000640 1 --2- 172.21.15.107:0/413378275 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6ef00ac540 0x7f6ef0153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:42.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.196+0000 7f6eef400640 1 --2- 172.21.15.107:0/413378275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ef0158bd0 0x7f6ef0166820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:42.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.196+0000 7f6eeea00640 1 --2- 172.21.15.107:0/413378275 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ef0069540 0x7f6ef0169db0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6ee002a7b0 tx=0x7f6ee0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:42.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.196+0000 7f6ee6a00640 1 -- 172.21.15.107:0/413378275 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0031a60 con 0x7f6ef0069540 2024-08-17T02:27:42.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.196+0000 7f6ee6a00640 1 -- 172.21.15.107:0/413378275 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee0031be0 con 0x7f6ef0069540 2024-08-17T02:27:42.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.196+0000 7f6ee6a00640 1 -- 172.21.15.107:0/413378275 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee003e450 con 0x7f6ef0069540 2024-08-17T02:27:42.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.196+0000 7f6eefe00640 1 -- 172.21.15.107:0/413378275 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ef016abc0 con 0x7f6ef0069540 2024-08-17T02:27:42.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.197+0000 7f6eefe00640 1 -- 172.21.15.107:0/413378275 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ef016a2f0 con 0x7f6ef0069540 2024-08-17T02:27:42.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.198+0000 7f6eefe00640 1 -- 172.21.15.107:0/413378275 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ef0071050 con 0x7f6ef0069540 2024-08-17T02:27:42.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.198+0000 7f6ee6a00640 1 -- 172.21.15.107:0/413378275 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6ee0047450 con 0x7f6ef0069540 2024-08-17T02:27:42.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.199+0000 7f6ee6a00640 1 --2- 172.21.15.107:0/413378275 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6ecc065150 0x7f6ecc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:42.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.199+0000 7f6ee6a00640 1 -- 172.21.15.107:0/413378275 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f6ee00a2ca0 con 0x7f6ef0069540 2024-08-17T02:27:42.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.199+0000 7f6ee6000640 1 --2- 172.21.15.107:0/413378275 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6ecc065150 0x7f6ecc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:42.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.200+0000 7f6ee6000640 1 --2- 172.21.15.107:0/413378275 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6ecc065150 0x7f6ecc067600 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0098570 tx=0x7f6ed8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:42.204 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.203+0000 7f6ee6a00640 1 -- 172.21.15.107:0/413378275 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6ee0070940 con 0x7f6ef0069540 2024-08-17T02:27:42.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.410+0000 7f6eefe00640 1 -- 172.21.15.107:0/413378275 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ef00ce850 con 0x7f6ef0069540 2024-08-17T02:27:42.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.411+0000 7f6ee6a00640 1 -- 172.21.15.107:0/413378275 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5690 (secure 0 0 0) 0x7f6ee0034ed0 con 0x7f6ef0069540 2024-08-17T02:27:42.412 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:27:42.412 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4682,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/855770365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":855770365},{"type":"v1","addr":"172.21.15.107:6836","nonce":855770365}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4688,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6834/1749905502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1749905502},{"type":"v1","addr":"172.21.15.157:6834","nonce":1749905502}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:18.071301+0000","modified":"2024-08-17T02:25:21.685727+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4920":{"gid":4920,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6835/1725535660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6833","nonce":1725535660},{"type":"v1","addr":"172.21.15.157:6835","nonce":1725535660}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:35.757205+0000","modified":"2024-08-17T02:25:37.759836+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4914":{"gid":4914,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.107:6837/809431952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":809431952},{"type":"v1","addr":"172.21.15.107:6837","nonce":809431952}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000928569","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:27:42.413 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 21 2024-08-17T02:27:42.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.413+0000 7f6eefe00640 1 -- 172.21.15.107:0/413378275 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6ecc065150 msgr2=0x7f6ecc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:42.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.413+0000 7f6eefe00640 1 --2- 172.21.15.107:0/413378275 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6ecc065150 0x7f6ecc067600 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0098570 tx=0x7f6ed8008040 comp rx=0 tx=0).stop 2024-08-17T02:27:42.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.413+0000 7f6eefe00640 1 -- 172.21.15.107:0/413378275 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ef0069540 msgr2=0x7f6ef0169db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:42.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.413+0000 7f6eefe00640 1 --2- 172.21.15.107:0/413378275 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ef0069540 0x7f6ef0169db0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6ee002a7b0 tx=0x7f6ee0032000 comp rx=0 tx=0).stop 2024-08-17T02:27:42.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.413+0000 7f6eefe00640 1 -- 172.21.15.107:0/413378275 shutdown_connections 2024-08-17T02:27:42.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.413+0000 7f6eefe00640 1 --2- 172.21.15.107:0/413378275 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6ecc065150 0x7f6ecc067600 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.413+0000 7f6eefe00640 1 --2- 172.21.15.107:0/413378275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ef0158bd0 0x7f6ef0166820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.413+0000 7f6eefe00640 1 --2- 172.21.15.107:0/413378275 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6ef00ac540 0x7f6ef0153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.413+0000 7f6eefe00640 1 --2- 172.21.15.107:0/413378275 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ef0069540 0x7f6ef0169db0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.413+0000 7f6eefe00640 1 -- 172.21.15.107:0/413378275 >> 172.21.15.107:0/413378275 conn(0x7f6ef0096a70 msgr2=0x7f6ef006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:42.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.413+0000 7f6eefe00640 1 -- 172.21.15.107:0/413378275 shutdown_connections 2024-08-17T02:27:42.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.413+0000 7f6eefe00640 1 -- 172.21.15.107:0/413378275 wait complete. 2024-08-17T02:27:42.429 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:42.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.576+0000 7fcc51400640 1 Processor -- start 2024-08-17T02:27:42.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.576+0000 7fcc51400640 1 -- start start 2024-08-17T02:27:42.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.577+0000 7fcc51400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcc4c06da20 0x7fcc4c06ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:42.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.577+0000 7fcc51400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fcc4c0aa7d0 0x7fcc4c158890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:42.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.577+0000 7fcc51400640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc4c0a9a10 con 0x7fcc4c158dd0 2024-08-17T02:27:42.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.577+0000 7fcc51400640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc4c0ac400 con 0x7fcc4c0aa7d0 2024-08-17T02:27:42.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.577+0000 7fcc51400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c0a9cf0 con 0x7fcc4c06da20 2024-08-17T02:27:42.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.578+0000 7fcc4a800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcc4c06da20 0x7fcc4c06ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:42.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.578+0000 7fcc4b200640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fcc4c158dd0 0x7fcc4c0ab6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:38072/0 (socket says 172.21.15.107:38072) 2024-08-17T02:27:42.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.578+0000 7fcc4b200640 1 -- 172.21.15.107:0/2806169083 learned_addr learned my addr 172.21.15.107:0/2806169083 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:27:42.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.578+0000 7fcc49e00640 1 --2- 172.21.15.107:0/2806169083 >> v2:172.21.15.157:3300/0 conn(0x7fcc4c0aa7d0 0x7fcc4c158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:42.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.578+0000 7fcc49400640 1 -- 172.21.15.107:0/2806169083 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3534570634 0 0) 0x7fcc4c0a9a10 con 0x7fcc4c158dd0 2024-08-17T02:27:42.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.578+0000 7fcc4a800640 1 -- 172.21.15.107:0/2806169083 >> v2:172.21.15.157:3300/0 conn(0x7fcc4c0aa7d0 msgr2=0x7fcc4c158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:42.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.578+0000 7fcc4a800640 1 --2- 172.21.15.107:0/2806169083 >> v2:172.21.15.157:3300/0 conn(0x7fcc4c0aa7d0 0x7fcc4c158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.578+0000 7fcc4a800640 1 -- 172.21.15.107:0/2806169083 >> v1:172.21.15.157:6789/0 conn(0x7fcc4c158dd0 legacy=0x7fcc4c0ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:42.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.578+0000 7fcc4a800640 1 -- 172.21.15.107:0/2806169083 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc4c0a9fd0 con 0x7fcc4c06da20 2024-08-17T02:27:42.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.579+0000 7fcc4a800640 1 --2- 172.21.15.107:0/2806169083 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcc4c06da20 0x7fcc4c06ddf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c009850 tx=0x7fcc3c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ac9192d66044f40 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:42.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.580+0000 7fcc49400640 1 -- 172.21.15.107:0/2806169083 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c02ad00 con 0x7fcc4c06da20 2024-08-17T02:27:42.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.580+0000 7fcc49400640 1 -- 172.21.15.107:0/2806169083 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc3c02ae60 con 0x7fcc4c06da20 2024-08-17T02:27:42.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.580+0000 7fcc49400640 1 -- 172.21.15.107:0/2806169083 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c032670 con 0x7fcc4c06da20 2024-08-17T02:27:42.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.580+0000 7fcc51400640 1 -- 172.21.15.107:0/2806169083 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcc4c06da20 msgr2=0x7fcc4c06ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:42.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.580+0000 7fcc51400640 1 --2- 172.21.15.107:0/2806169083 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcc4c06da20 0x7fcc4c06ddf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c009850 tx=0x7fcc3c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.580+0000 7fcc51400640 1 -- 172.21.15.107:0/2806169083 shutdown_connections 2024-08-17T02:27:42.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.580+0000 7fcc51400640 1 --2- 172.21.15.107:0/2806169083 >> v2:172.21.15.157:3300/0 conn(0x7fcc4c0aa7d0 0x7fcc4c158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.580+0000 7fcc51400640 1 --2- 172.21.15.107:0/2806169083 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcc4c06da20 0x7fcc4c06ddf0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.580+0000 7fcc51400640 1 -- 172.21.15.107:0/2806169083 >> 172.21.15.107:0/2806169083 conn(0x7fcc4c0cb9b0 msgr2=0x7fcc4c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:42.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.580+0000 7fcc51400640 1 -- 172.21.15.107:0/2806169083 shutdown_connections 2024-08-17T02:27:42.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.580+0000 7fcc51400640 1 -- 172.21.15.107:0/2806169083 wait complete. 2024-08-17T02:27:42.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.582+0000 7fcc51400640 1 Processor -- start 2024-08-17T02:27:42.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.582+0000 7fcc51400640 1 -- start start 2024-08-17T02:27:42.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.583+0000 7fcc51400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc4c06da20 0x7fcc4c0c2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:42.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.583+0000 7fcc51400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcc4c0aa7d0 0x7fcc4c144fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:42.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.583+0000 7fcc51400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcc4c158dd0 0x7fcc4c168cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:42.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.583+0000 7fcc51400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c0c5cc0 con 0x7fcc4c06da20 2024-08-17T02:27:42.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.583+0000 7fcc51400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c0c3020 con 0x7fcc4c158dd0 2024-08-17T02:27:42.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.583+0000 7fcc51400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c0c3300 con 0x7fcc4c0aa7d0 2024-08-17T02:27:42.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.583+0000 7fcc4a800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc4c06da20 0x7fcc4c0c2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:42.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.583+0000 7fcc4a800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc4c06da20 0x7fcc4c0c2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:46844/0 (socket says 172.21.15.107:46844) 2024-08-17T02:27:42.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.583+0000 7fcc4a800640 1 -- 172.21.15.107:0/1898519089 learned_addr learned my addr 172.21.15.107:0/1898519089 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:42.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.583+0000 7fcc49e00640 1 --2- 172.21.15.107:0/1898519089 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcc4c0aa7d0 0x7fcc4c144fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:42.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.583+0000 7fcc4b200640 1 --2- 172.21.15.107:0/1898519089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcc4c158dd0 0x7fcc4c168cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:42.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.583+0000 7fcc4a800640 1 -- 172.21.15.107:0/1898519089 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcc4c0aa7d0 msgr2=0x7fcc4c144fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:42.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.583+0000 7fcc4a800640 1 --2- 172.21.15.107:0/1898519089 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcc4c0aa7d0 0x7fcc4c144fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.583+0000 7fcc4a800640 1 -- 172.21.15.107:0/1898519089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcc4c158dd0 msgr2=0x7fcc4c168cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:42.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.583+0000 7fcc4a800640 1 --2- 172.21.15.107:0/1898519089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcc4c158dd0 0x7fcc4c168cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.583+0000 7fcc4a800640 1 -- 172.21.15.107:0/1898519089 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc3c009390 con 0x7fcc4c06da20 2024-08-17T02:27:42.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.583+0000 7fcc4b200640 1 --2- 172.21.15.107:0/1898519089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcc4c158dd0 0x7fcc4c168cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:42.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.584+0000 7fcc4a800640 1 --2- 172.21.15.107:0/1898519089 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc4c06da20 0x7fcc4c0c2a70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c009850 tx=0x7fcc3c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:42.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.584+0000 7fcc42000640 1 -- 172.21.15.107:0/1898519089 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c031700 con 0x7fcc4c06da20 2024-08-17T02:27:42.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.584+0000 7fcc42000640 1 -- 172.21.15.107:0/1898519089 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc3c031860 con 0x7fcc4c06da20 2024-08-17T02:27:42.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.584+0000 7fcc42000640 1 -- 172.21.15.107:0/1898519089 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c031c00 con 0x7fcc4c06da20 2024-08-17T02:27:42.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.584+0000 7fcc51400640 1 -- 172.21.15.107:0/1898519089 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc4c169590 con 0x7fcc4c06da20 2024-08-17T02:27:42.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.584+0000 7fcc51400640 1 -- 172.21.15.107:0/1898519089 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc4c169b50 con 0x7fcc4c06da20 2024-08-17T02:27:42.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.585+0000 7fcc51400640 1 -- 172.21.15.107:0/1898519089 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc4c064db0 con 0x7fcc4c06da20 2024-08-17T02:27:42.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.586+0000 7fcc42000640 1 -- 172.21.15.107:0/1898519089 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fcc3c039040 con 0x7fcc4c06da20 2024-08-17T02:27:42.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.587+0000 7fcc42000640 1 --2- 172.21.15.107:0/1898519089 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fcc2c065150 0x7fcc2c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:42.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.587+0000 7fcc42000640 1 -- 172.21.15.107:0/1898519089 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fcc3c0a2940 con 0x7fcc4c06da20 2024-08-17T02:27:42.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.587+0000 7fcc49e00640 1 --2- 172.21.15.107:0/1898519089 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fcc2c065150 0x7fcc2c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:42.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.588+0000 7fcc49e00640 1 --2- 172.21.15.107:0/1898519089 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fcc2c065150 0x7fcc2c067600 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c06b340 tx=0x7fcc380090f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:42.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.591+0000 7fcc42000640 1 -- 172.21.15.107:0/1898519089 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fcc3c070690 con 0x7fcc4c06da20 2024-08-17T02:27:42.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.769+0000 7fcc51400640 1 -- 172.21.15.107:0/1898519089 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc4c06e770 con 0x7fcc4c06da20 2024-08-17T02:27:42.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.770+0000 7fcc42000640 1 -- 172.21.15.107:0/1898519089 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18647 (secure 0 0 0) 0x7fcc3c049090 con 0x7fcc4c06da20 2024-08-17T02:27:42.771 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:27:42.771 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":37,"fsid":"f207b4c0-329d-46b8-b83f-aaf30bdb6ce3","created":"2024-08-17T02:24:11.038049+0000","modified":"2024-08-17T02:25:38.761303+0000","last_up_change":"2024-08-17T02:24:22.047790+0000","last_in_change":"2024-08-17T02:24:13.892720+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:23.456166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:16.086009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:17.060399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000928569.meta","create_time":"2024-08-17T02:25:33.885385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000928569"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000928569.data","create_time":"2024-08-17T02:25:34.790701+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000928569"}}}],"osds":[{"osd":0,"uuid":"376363f3-b8bf-4f1e-b691-51cdd39171ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37302},{"type":"v1","addr":"172.21.15.107:6801","nonce":37302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37302},{"type":"v1","addr":"172.21.15.107:6803","nonce":37302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37302},{"type":"v1","addr":"172.21.15.107:6807","nonce":37302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37302},{"type":"v1","addr":"172.21.15.107:6805","nonce":37302}]},"public_addr":"172.21.15.107:6801/37302","cluster_addr":"172.21.15.107:6803/37302","heartbeat_back_addr":"172.21.15.107:6807/37302","heartbeat_front_addr":"172.21.15.107:6805/37302","state":["exists","up"]},{"osd":1,"uuid":"cc6624e3-2ad4-4db4-b377-05dfe57424e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37305},{"type":"v1","addr":"172.21.15.107:6824","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37305},{"type":"v1","addr":"172.21.15.107:6827","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37305},{"type":"v1","addr":"172.21.15.107:6831","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37305},{"type":"v1","addr":"172.21.15.107:6829","nonce":37305}]},"public_addr":"172.21.15.107:6824/37305","cluster_addr":"172.21.15.107:6827/37305","heartbeat_back_addr":"172.21.15.107:6831/37305","heartbeat_front_addr":"172.21.15.107:6829/37305","state":["exists","up"]},{"osd":2,"uuid":"25229542-29b5-4281-bcb0-798ae0930aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37307},{"type":"v1","addr":"172.21.15.107:6817","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37307},{"type":"v1","addr":"172.21.15.107:6819","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6823","nonce":37307},{"type":"v1","addr":"172.21.15.107:6825","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37307},{"type":"v1","addr":"172.21.15.107:6821","nonce":37307}]},"public_addr":"172.21.15.107:6817/37307","cluster_addr":"172.21.15.107:6819/37307","heartbeat_back_addr":"172.21.15.107:6825/37307","heartbeat_front_addr":"172.21.15.107:6821/37307","state":["exists","up"]},{"osd":3,"uuid":"5f16aee8-8950-4268-a61a-5cf6ebd670e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37306},{"type":"v1","addr":"172.21.15.107:6809","nonce":37306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37306},{"type":"v1","addr":"172.21.15.107:6811","nonce":37306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37306},{"type":"v1","addr":"172.21.15.107:6815","nonce":37306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37306},{"type":"v1","addr":"172.21.15.107:6813","nonce":37306}]},"public_addr":"172.21.15.107:6809/37306","cluster_addr":"172.21.15.107:6811/37306","heartbeat_back_addr":"172.21.15.107:6815/37306","heartbeat_front_addr":"172.21.15.107:6813/37306","state":["exists","up"]},{"osd":4,"uuid":"23232e28-e23b-4b4e-a531-4939246dbbde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":37329},{"type":"v1","addr":"172.21.15.157:6817","nonce":37329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":37329},{"type":"v1","addr":"172.21.15.157:6819","nonce":37329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":37329},{"type":"v1","addr":"172.21.15.157:6823","nonce":37329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":37329},{"type":"v1","addr":"172.21.15.157:6821","nonce":37329}]},"public_addr":"172.21.15.157:6817/37329","cluster_addr":"172.21.15.157:6819/37329","heartbeat_back_addr":"172.21.15.157:6823/37329","heartbeat_front_addr":"172.21.15.157:6821/37329","state":["exists","up"]},{"osd":5,"uuid":"f87ec331-3e59-4886-a317-6f7e26ec8e21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":37328},{"type":"v1","addr":"172.21.15.157:6804","nonce":37328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":37328},{"type":"v1","addr":"172.21.15.157:6808","nonce":37328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":37328},{"type":"v1","addr":"172.21.15.157:6815","nonce":37328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":37328},{"type":"v1","addr":"172.21.15.157:6812","nonce":37328}]},"public_addr":"172.21.15.157:6804/37328","cluster_addr":"172.21.15.157:6808/37328","heartbeat_back_addr":"172.21.15.157:6815/37328","heartbeat_front_addr":"172.21.15.157:6812/37328","state":["exists","up"]},{"osd":6,"uuid":"92852235-ce49-4d96-a940-6f18d97b13ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":37330},{"type":"v1","addr":"172.21.15.157:6801","nonce":37330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6803","nonce":37330},{"type":"v1","addr":"172.21.15.157:6805","nonce":37330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":37330},{"type":"v1","addr":"172.21.15.157:6813","nonce":37330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":37330},{"type":"v1","addr":"172.21.15.157:6809","nonce":37330}]},"public_addr":"172.21.15.157:6801/37330","cluster_addr":"172.21.15.157:6805/37330","heartbeat_back_addr":"172.21.15.157:6813/37330","heartbeat_front_addr":"172.21.15.157:6809/37330","state":["exists","up"]},{"osd":7,"uuid":"7484a061-723d-4663-b28f-b01766d62f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":37373},{"type":"v1","addr":"172.21.15.157:6825","nonce":37373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":37373},{"type":"v1","addr":"172.21.15.157:6827","nonce":37373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":37373},{"type":"v1","addr":"172.21.15.157:6831","nonce":37373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":37373},{"type":"v1","addr":"172.21.15.157:6829","nonce":37373}]},"public_addr":"172.21.15.157:6825/37373","cluster_addr":"172.21.15.157:6827/37373","heartbeat_back_addr":"172.21.15.157:6831/37373","heartbeat_front_addr":"172.21.15.157:6829/37373","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.110188+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.280265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.252119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.267996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.284582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.144420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.174764+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.308002+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:42.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.772+0000 7fcc51400640 1 -- 172.21.15.107:0/1898519089 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fcc2c065150 msgr2=0x7fcc2c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:42.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.772+0000 7fcc51400640 1 --2- 172.21.15.107:0/1898519089 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fcc2c065150 0x7fcc2c067600 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c06b340 tx=0x7fcc380090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.772+0000 7fcc51400640 1 -- 172.21.15.107:0/1898519089 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc4c06da20 msgr2=0x7fcc4c0c2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:42.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.772+0000 7fcc51400640 1 --2- 172.21.15.107:0/1898519089 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc4c06da20 0x7fcc4c0c2a70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c009850 tx=0x7fcc3c032000 comp rx=0 tx=0).stop 2024-08-17T02:27:42.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.772+0000 7fcc51400640 1 -- 172.21.15.107:0/1898519089 shutdown_connections 2024-08-17T02:27:42.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.772+0000 7fcc51400640 1 --2- 172.21.15.107:0/1898519089 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fcc2c065150 0x7fcc2c067600 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.772+0000 7fcc51400640 1 --2- 172.21.15.107:0/1898519089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcc4c158dd0 0x7fcc4c168cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.772+0000 7fcc51400640 1 --2- 172.21.15.107:0/1898519089 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcc4c0aa7d0 0x7fcc4c144fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.772+0000 7fcc51400640 1 --2- 172.21.15.107:0/1898519089 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc4c06da20 0x7fcc4c0c2a70 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.772+0000 7fcc51400640 1 -- 172.21.15.107:0/1898519089 >> 172.21.15.107:0/1898519089 conn(0x7fcc4c0cb9b0 msgr2=0x7fcc4c0b1470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:42.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.772+0000 7fcc51400640 1 -- 172.21.15.107:0/1898519089 shutdown_connections 2024-08-17T02:27:42.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.772+0000 7fcc51400640 1 -- 172.21.15.107:0/1898519089 wait complete. 2024-08-17T02:27:42.789 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-17T02:27:42.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.936+0000 7f1894c00640 1 Processor -- start 2024-08-17T02:27:42.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.936+0000 7f1894c00640 1 -- start start 2024-08-17T02:27:42.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.938+0000 7f1894c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f18900cbea0 0x7f1890158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:42.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.938+0000 7f1894c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18900cc2b0 con 0x7f189006db70 2024-08-17T02:27:42.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.938+0000 7f1894c00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18900aa0d0 con 0x7f189006d7a0 2024-08-17T02:27:42.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.938+0000 7f1894c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18900cc4f0 con 0x7f18900cbea0 2024-08-17T02:27:42.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.938+0000 7f188fe00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f18900cbea0 0x7f1890158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:42.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.938+0000 7f188fe00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f18900cbea0 0x7f1890158fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:46848/0 (socket says 172.21.15.107:46848) 2024-08-17T02:27:42.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.938+0000 7f188fe00640 1 -- 172.21.15.107:0/2181909985 learned_addr learned my addr 172.21.15.107:0/2181909985 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:42.940 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.938+0000 7f188fe00640 1 -- 172.21.15.107:0/2181909985 >> v1:172.21.15.157:6789/0 conn(0x7f189006d7a0 legacy=0x7f18901588a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:42.940 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.938+0000 7f188fe00640 1 -- 172.21.15.107:0/2181909985 >> v1:172.21.15.107:6789/0 conn(0x7f189006db70 legacy=0x7f18900ab5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:42.940 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.938+0000 7f188fe00640 1 -- 172.21.15.107:0/2181909985 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18900a9a80 con 0x7f18900cbea0 2024-08-17T02:27:42.940 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.939+0000 7f188fe00640 1 --2- 172.21.15.107:0/2181909985 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18900cbea0 0x7f1890158fb0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f1888009f20 tx=0x7f1888009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a27b3214823fab48 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:42.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.940+0000 7f188ea00640 1 -- 172.21.15.107:0/2181909985 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1888007400 con 0x7f18900cbea0 2024-08-17T02:27:42.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.940+0000 7f188ea00640 1 -- 172.21.15.107:0/2181909985 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1888007560 con 0x7f18900cbea0 2024-08-17T02:27:42.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.940+0000 7f188ea00640 1 -- 172.21.15.107:0/2181909985 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1888007940 con 0x7f18900cbea0 2024-08-17T02:27:42.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.940+0000 7f1894c00640 1 -- 172.21.15.107:0/2181909985 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18900cbea0 msgr2=0x7f1890158fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:42.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.940+0000 7f1894c00640 1 --2- 172.21.15.107:0/2181909985 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18900cbea0 0x7f1890158fb0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f1888009f20 tx=0x7f1888009840 comp rx=0 tx=0).stop 2024-08-17T02:27:42.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.940+0000 7f1894c00640 1 -- 172.21.15.107:0/2181909985 shutdown_connections 2024-08-17T02:27:42.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.940+0000 7f1894c00640 1 --2- 172.21.15.107:0/2181909985 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18900cbea0 0x7f1890158fb0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.940+0000 7f1894c00640 1 -- 172.21.15.107:0/2181909985 >> 172.21.15.107:0/2181909985 conn(0x7f1890067750 msgr2=0x7f18900cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:42.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.940+0000 7f1894c00640 1 -- 172.21.15.107:0/2181909985 shutdown_connections 2024-08-17T02:27:42.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.940+0000 7f1894c00640 1 -- 172.21.15.107:0/2181909985 wait complete. 2024-08-17T02:27:42.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.942+0000 7f1894c00640 1 Processor -- start 2024-08-17T02:27:42.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.942+0000 7f1894c00640 1 -- start start 2024-08-17T02:27:42.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.943+0000 7f1894c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f189006d7a0 0x7f1890158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:42.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.943+0000 7f1894c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f189006db70 0x7f189016c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:42.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.943+0000 7f1894c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18900cbea0 0x7f189013cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:42.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.943+0000 7f1894c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189014f990 con 0x7f189006d7a0 2024-08-17T02:27:42.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.943+0000 7f1894c00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189014fc70 con 0x7f18900cbea0 2024-08-17T02:27:42.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.943+0000 7f1894c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f189014ff50 con 0x7f189006db70 2024-08-17T02:27:42.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.943+0000 7f188f400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f189006d7a0 0x7f1890158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:42.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.943+0000 7f188f400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f189006d7a0 0x7f1890158670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:46850/0 (socket says 172.21.15.107:46850) 2024-08-17T02:27:42.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.943+0000 7f188f400640 1 -- 172.21.15.107:0/4042434578 learned_addr learned my addr 172.21.15.107:0/4042434578 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:42.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.943+0000 7f188fe00640 1 --2- 172.21.15.107:0/4042434578 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18900cbea0 0x7f189013cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:42.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.943+0000 7f1887e00640 1 --2- 172.21.15.107:0/4042434578 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f189006db70 0x7f189016c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:42.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.943+0000 7f188f400640 1 -- 172.21.15.107:0/4042434578 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f189006db70 msgr2=0x7f189016c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:42.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.943+0000 7f188f400640 1 --2- 172.21.15.107:0/4042434578 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f189006db70 0x7f189016c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.943+0000 7f188f400640 1 -- 172.21.15.107:0/4042434578 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18900cbea0 msgr2=0x7f189013cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:42.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.943+0000 7f188f400640 1 --2- 172.21.15.107:0/4042434578 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18900cbea0 0x7f189013cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.943+0000 7f188f400640 1 -- 172.21.15.107:0/4042434578 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1888009ae0 con 0x7f189006d7a0 2024-08-17T02:27:42.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.943+0000 7f188fe00640 1 --2- 172.21.15.107:0/4042434578 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18900cbea0 0x7f189013cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:42.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.943+0000 7f188f400640 1 --2- 172.21.15.107:0/4042434578 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f189006d7a0 0x7f1890158670 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f188000c560 tx=0x7f1880007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:42.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.944+0000 7f1886a00640 1 -- 172.21.15.107:0/4042434578 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1880011590 con 0x7f189006d7a0 2024-08-17T02:27:42.947 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.944+0000 7f1886a00640 1 -- 172.21.15.107:0/4042434578 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1880011710 con 0x7f189006d7a0 2024-08-17T02:27:42.947 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.944+0000 7f1894c00640 1 -- 172.21.15.107:0/4042434578 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1890150230 con 0x7f189006d7a0 2024-08-17T02:27:42.947 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.944+0000 7f1886a00640 1 -- 172.21.15.107:0/4042434578 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1880011ad0 con 0x7f189006d7a0 2024-08-17T02:27:42.947 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.944+0000 7f1894c00640 1 -- 172.21.15.107:0/4042434578 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1890158bb0 con 0x7f189006d7a0 2024-08-17T02:27:42.947 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.945+0000 7f1894c00640 1 -- 172.21.15.107:0/4042434578 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1890150730 con 0x7f189006d7a0 2024-08-17T02:27:42.947 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.946+0000 7f1886a00640 1 -- 172.21.15.107:0/4042434578 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f188001b3b0 con 0x7f189006d7a0 2024-08-17T02:27:42.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.947+0000 7f1886a00640 1 --2- 172.21.15.107:0/4042434578 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f186c065150 0x7f186c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:42.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.947+0000 7f1886a00640 1 -- 172.21.15.107:0/4042434578 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f1880081e10 con 0x7f189006d7a0 2024-08-17T02:27:42.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.947+0000 7f1887e00640 1 --2- 172.21.15.107:0/4042434578 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f186c065150 0x7f186c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:42.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.948+0000 7f1887e00640 1 --2- 172.21.15.107:0/4042434578 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f186c065150 0x7f186c067600 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1890140e40 tx=0x7f1878009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:42.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:42.951+0000 7f1886a00640 1 -- 172.21.15.107:0/4042434578 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1880085030 con 0x7f189006d7a0 2024-08-17T02:27:43.162 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.161+0000 7f1894c00640 1 -- 172.21.15.107:0/4042434578 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1890071050 con 0x7f189006d7a0 2024-08-17T02:27:43.163 INFO:tasks.ceph.mon.a.smithi107.stderr:2024-08-17T02:27:43.162+0000 7ff651400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:27:43.168 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.167+0000 7f1886a00640 1 -- 172.21.15.107:0/4042434578 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v22) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1880017070 con 0x7f189006d7a0 2024-08-17T02:27:43.168 INFO:teuthology.orchestra.run.smithi107.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:27:43.171 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.169+0000 7f1894c00640 1 -- 172.21.15.107:0/4042434578 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f186c065150 msgr2=0x7f186c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:43.171 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.169+0000 7f1894c00640 1 --2- 172.21.15.107:0/4042434578 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f186c065150 0x7f186c067600 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1890140e40 tx=0x7f1878009040 comp rx=0 tx=0).stop 2024-08-17T02:27:43.171 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.169+0000 7f1894c00640 1 -- 172.21.15.107:0/4042434578 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f189006d7a0 msgr2=0x7f1890158670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:43.171 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.169+0000 7f1894c00640 1 --2- 172.21.15.107:0/4042434578 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f189006d7a0 0x7f1890158670 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f188000c560 tx=0x7f1880007ef0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.171 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.169+0000 7f1894c00640 1 -- 172.21.15.107:0/4042434578 shutdown_connections 2024-08-17T02:27:43.171 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.169+0000 7f1894c00640 1 --2- 172.21.15.107:0/4042434578 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f186c065150 0x7f186c067600 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.171 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.169+0000 7f1894c00640 1 --2- 172.21.15.107:0/4042434578 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18900cbea0 0x7f189013cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.171 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.169+0000 7f1894c00640 1 --2- 172.21.15.107:0/4042434578 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f189006db70 0x7f189016c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.171 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.169+0000 7f1894c00640 1 --2- 172.21.15.107:0/4042434578 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f189006d7a0 0x7f1890158670 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.169+0000 7f1894c00640 1 -- 172.21.15.107:0/4042434578 >> 172.21.15.107:0/4042434578 conn(0x7f1890067750 msgr2=0x7f189014e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:43.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.169+0000 7f1894c00640 1 -- 172.21.15.107:0/4042434578 shutdown_connections 2024-08-17T02:27:43.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.170+0000 7f1894c00640 1 -- 172.21.15.107:0/4042434578 wait complete. 2024-08-17T02:27:43.181 INFO:tasks.ceph.mds.d.smithi157.stderr: -7333> 2024-08-17T02:25:22.644+0000 7f6c70000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:27:43.185 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-17T02:27:43.227 INFO:tasks.ceph.mds.d.smithi157.stdout:starting mds.d at 2024-08-17T02:27:43.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.336+0000 7fd81d200640 1 Processor -- start 2024-08-17T02:27:43.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.336+0000 7fd81d200640 1 -- start start 2024-08-17T02:27:43.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.337+0000 7fd81d200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd818155980 0x7fd818156f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:43.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.337+0000 7fd81d200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd818158400 con 0x7fd8180af580 2024-08-17T02:27:43.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.337+0000 7fd81d200640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8181577f0 con 0x7fd8180a54d0 2024-08-17T02:27:43.339 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.337+0000 7fd81d200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd818157ad0 con 0x7fd818155980 2024-08-17T02:27:43.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.338+0000 7fd816800640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fd8180af580 0x7fd818158890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:49044/0 (socket says 172.21.15.107:49044) 2024-08-17T02:27:43.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.338+0000 7fd816800640 1 -- 172.21.15.107:0/3795459766 learned_addr learned my addr 172.21.15.107:0/3795459766 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:27:43.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.338+0000 7fd815e00640 1 --2- 172.21.15.107:0/3795459766 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd818155980 0x7fd818156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:43.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.338+0000 7fd814a00640 1 -- 172.21.15.107:0/3795459766 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3151038616 0 0) 0x7fd818158400 con 0x7fd8180af580 2024-08-17T02:27:43.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.338+0000 7fd814a00640 1 -- 172.21.15.107:0/3795459766 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7fc0034e0 con 0x7fd8180af580 2024-08-17T02:27:43.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.338+0000 7fd814a00640 1 -- 172.21.15.107:0/3795459766 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1840041266 0 0) 0x7fd8181577f0 con 0x7fd8180a54d0 2024-08-17T02:27:43.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.338+0000 7fd814a00640 1 -- 172.21.15.107:0/3795459766 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd818158400 con 0x7fd8180a54d0 2024-08-17T02:27:43.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.338+0000 7fd815e00640 1 -- 172.21.15.107:0/3795459766 >> v1:172.21.15.157:6789/0 conn(0x7fd8180a54d0 legacy=0x7fd818155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:43.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.338+0000 7fd815e00640 1 -- 172.21.15.107:0/3795459766 >> v1:172.21.15.107:6789/0 conn(0x7fd8180af580 legacy=0x7fd818158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:43.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.338+0000 7fd815e00640 1 -- 172.21.15.107:0/3795459766 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd818157db0 con 0x7fd818155980 2024-08-17T02:27:43.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.339+0000 7fd815e00640 1 --2- 172.21.15.107:0/3795459766 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd818155980 0x7fd818156f70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd808009880 tx=0x7fd8080090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1c9cf50096e9045 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:43.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.340+0000 7fd814a00640 1 -- 172.21.15.107:0/3795459766 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd808031510 con 0x7fd818155980 2024-08-17T02:27:43.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.340+0000 7fd814a00640 1 -- 172.21.15.107:0/3795459766 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd80802f050 con 0x7fd818155980 2024-08-17T02:27:43.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.340+0000 7fd814a00640 1 -- 172.21.15.107:0/3795459766 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd808031880 con 0x7fd818155980 2024-08-17T02:27:43.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.340+0000 7fd81d200640 1 -- 172.21.15.107:0/3795459766 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd818155980 msgr2=0x7fd818156f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:43.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.340+0000 7fd81d200640 1 --2- 172.21.15.107:0/3795459766 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd818155980 0x7fd818156f70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd808009880 tx=0x7fd8080090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.340+0000 7fd81d200640 1 -- 172.21.15.107:0/3795459766 shutdown_connections 2024-08-17T02:27:43.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.340+0000 7fd81d200640 1 --2- 172.21.15.107:0/3795459766 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd818155980 0x7fd818156f70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.340+0000 7fd81d200640 1 -- 172.21.15.107:0/3795459766 >> 172.21.15.107:0/3795459766 conn(0x7fd818067750 msgr2=0x7fd8180cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:43.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.340+0000 7fd81d200640 1 -- 172.21.15.107:0/3795459766 shutdown_connections 2024-08-17T02:27:43.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.340+0000 7fd81d200640 1 -- 172.21.15.107:0/3795459766 wait complete. 2024-08-17T02:27:43.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.342+0000 7fd81d200640 1 Processor -- start 2024-08-17T02:27:43.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.342+0000 7fd81d200640 1 -- start start 2024-08-17T02:27:43.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.342+0000 7fd81d200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8180a54d0 0x7fd81815a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:43.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.342+0000 7fd81d200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8180af580 0x7fd8180ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:43.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.342+0000 7fd81d200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd818155980 0x7fd8180caf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:43.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.342+0000 7fd81d200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8180cb450 con 0x7fd818155980 2024-08-17T02:27:43.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.342+0000 7fd81d200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8180ac7a0 con 0x7fd8180af580 2024-08-17T02:27:43.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.342+0000 7fd81d200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8180aca80 con 0x7fd8180a54d0 2024-08-17T02:27:43.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.343+0000 7fd816800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd818155980 0x7fd8180caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:43.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.343+0000 7fd816800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd818155980 0x7fd8180caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:46854/0 (socket says 172.21.15.107:46854) 2024-08-17T02:27:43.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.343+0000 7fd816800640 1 -- 172.21.15.107:0/1040365477 learned_addr learned my addr 172.21.15.107:0/1040365477 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:43.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.343+0000 7fd815400640 1 --2- 172.21.15.107:0/1040365477 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8180af580 0x7fd8180ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:43.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.343+0000 7fd815e00640 1 --2- 172.21.15.107:0/1040365477 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8180a54d0 0x7fd81815a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:43.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.343+0000 7fd816800640 1 -- 172.21.15.107:0/1040365477 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8180a54d0 msgr2=0x7fd81815a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:43.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.343+0000 7fd816800640 1 --2- 172.21.15.107:0/1040365477 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8180a54d0 0x7fd81815a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.343+0000 7fd816800640 1 -- 172.21.15.107:0/1040365477 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8180af580 msgr2=0x7fd8180ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:43.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.343+0000 7fd816800640 1 --2- 172.21.15.107:0/1040365477 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8180af580 0x7fd8180ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.343+0000 7fd816800640 1 -- 172.21.15.107:0/1040365477 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd808009390 con 0x7fd818155980 2024-08-17T02:27:43.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.344+0000 7fd816800640 1 --2- 172.21.15.107:0/1040365477 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd818155980 0x7fd8180caf10 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd81000cc60 tx=0x7fd810001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:43.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.344+0000 7fd80d600640 1 -- 172.21.15.107:0/1040365477 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd81000ce80 con 0x7fd818155980 2024-08-17T02:27:43.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.344+0000 7fd80d600640 1 -- 172.21.15.107:0/1040365477 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd81000a850 con 0x7fd818155980 2024-08-17T02:27:43.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.344+0000 7fd81d200640 1 -- 172.21.15.107:0/1040365477 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8180acd60 con 0x7fd818155980 2024-08-17T02:27:43.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.344+0000 7fd80d600640 1 -- 172.21.15.107:0/1040365477 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd81000ac10 con 0x7fd818155980 2024-08-17T02:27:43.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.344+0000 7fd81d200640 1 -- 172.21.15.107:0/1040365477 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8180ad320 con 0x7fd818155980 2024-08-17T02:27:43.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.345+0000 7fd81d200640 1 -- 172.21.15.107:0/1040365477 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8180ad540 con 0x7fd818155980 2024-08-17T02:27:43.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.346+0000 7fd80d600640 1 -- 172.21.15.107:0/1040365477 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd810007300 con 0x7fd818155980 2024-08-17T02:27:43.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.346+0000 7fd80d600640 1 --2- 172.21.15.107:0/1040365477 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd7f8065150 0x7fd7f8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:43.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.347+0000 7fd80d600640 1 -- 172.21.15.107:0/1040365477 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6689+0+0 (secure 0 0 0) 0x7fd8100829b0 con 0x7fd818155980 2024-08-17T02:27:43.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.347+0000 7fd815e00640 1 --2- 172.21.15.107:0/1040365477 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd7f8065150 0x7fd7f8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:43.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.347+0000 7fd815e00640 1 --2- 172.21.15.107:0/1040365477 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd7f8065150 0x7fd7f8067600 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd808036000 tx=0x7fd808037000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:43.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.350+0000 7fd80d600640 1 -- 172.21.15.107:0/1040365477 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd8100506a0 con 0x7fd818155980 2024-08-17T02:27:43.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:43.556+0000 7fd81d200640 1 -- 172.21.15.107:0/1040365477 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd818071050 con 0x7fd818155980 2024-08-17T02:27:44.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.172+0000 7fd80d600640 1 -- 172.21.15.107:0/1040365477 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd810053cc0 con 0x7fd818155980 2024-08-17T02:27:44.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.174+0000 7fd81d200640 1 -- 172.21.15.107:0/1040365477 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd7f8065150 msgr2=0x7fd7f8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:44.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.174+0000 7fd81d200640 1 --2- 172.21.15.107:0/1040365477 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd7f8065150 0x7fd7f8067600 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd808036000 tx=0x7fd808037000 comp rx=0 tx=0).stop 2024-08-17T02:27:44.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.174+0000 7fd81d200640 1 -- 172.21.15.107:0/1040365477 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd818155980 msgr2=0x7fd8180caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:44.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.174+0000 7fd81d200640 1 --2- 172.21.15.107:0/1040365477 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd818155980 0x7fd8180caf10 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd81000cc60 tx=0x7fd810001ae0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.174+0000 7fd81d200640 1 -- 172.21.15.107:0/1040365477 shutdown_connections 2024-08-17T02:27:44.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.174+0000 7fd81d200640 1 --2- 172.21.15.107:0/1040365477 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd7f8065150 0x7fd7f8067600 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.174+0000 7fd81d200640 1 --2- 172.21.15.107:0/1040365477 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd818155980 0x7fd8180caf10 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.174+0000 7fd81d200640 1 --2- 172.21.15.107:0/1040365477 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8180af580 0x7fd8180ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.174+0000 7fd81d200640 1 --2- 172.21.15.107:0/1040365477 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8180a54d0 0x7fd81815a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.174+0000 7fd81d200640 1 -- 172.21.15.107:0/1040365477 >> 172.21.15.107:0/1040365477 conn(0x7fd818067750 msgr2=0x7fd81806d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:44.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.174+0000 7fd81d200640 1 -- 172.21.15.107:0/1040365477 shutdown_connections 2024-08-17T02:27:44.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.174+0000 7fd81d200640 1 -- 172.21.15.107:0/1040365477 wait complete. 2024-08-17T02:27:44.192 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-17T02:27:44.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.341+0000 7feb36000640 1 Processor -- start 2024-08-17T02:27:44.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.341+0000 7feb36000640 1 -- start start 2024-08-17T02:27:44.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.342+0000 7feb36000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb3015d610 0x7feb30067700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:44.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.342+0000 7feb36000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb3015d180 con 0x7feb30158d80 2024-08-17T02:27:44.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.342+0000 7feb36000640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb3006a790 con 0x7feb300c9a50 2024-08-17T02:27:44.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.342+0000 7feb36000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb3015cb30 con 0x7feb3015d610 2024-08-17T02:27:44.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.343+0000 7feb2f400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7feb30158d80 0x7feb300c9340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:49054/0 (socket says 172.21.15.107:49054) 2024-08-17T02:27:44.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.343+0000 7feb2f400640 1 -- 172.21.15.107:0/2071179448 learned_addr learned my addr 172.21.15.107:0/2071179448 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:27:44.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.343+0000 7feb2fe00640 1 --2- 172.21.15.107:0/2071179448 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb3015d610 0x7feb30067700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:44.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.343+0000 7feb2ea00640 1 --1- 172.21.15.107:0/2071179448 >> v1:172.21.15.157:6789/0 conn(0x7feb300c9a50 0x7feb30159150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:38110/0 (socket says 172.21.15.107:38110) 2024-08-17T02:27:44.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.343+0000 7feb2e000640 1 -- 172.21.15.107:0/2071179448 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3079630510 0 0) 0x7feb3015d180 con 0x7feb30158d80 2024-08-17T02:27:44.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.343+0000 7feb2e000640 1 -- 172.21.15.107:0/2071179448 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb140034e0 con 0x7feb30158d80 2024-08-17T02:27:44.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.343+0000 7feb2e000640 1 -- 172.21.15.107:0/2071179448 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 310552596 0 0) 0x7feb3006a790 con 0x7feb300c9a50 2024-08-17T02:27:44.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.343+0000 7feb2fe00640 1 -- 172.21.15.107:0/2071179448 >> v1:172.21.15.157:6789/0 conn(0x7feb300c9a50 legacy=0x7feb30159150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:44.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.343+0000 7feb2fe00640 1 -- 172.21.15.107:0/2071179448 >> v1:172.21.15.107:6789/0 conn(0x7feb30158d80 legacy=0x7feb300c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:44.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.343+0000 7feb2fe00640 1 -- 172.21.15.107:0/2071179448 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb3015ce10 con 0x7feb3015d610 2024-08-17T02:27:44.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.345+0000 7feb2fe00640 1 --2- 172.21.15.107:0/2071179448 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb3015d610 0x7feb30067700 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7feb28009e90 tx=0x7feb28009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82954e5fa645d798 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:44.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.345+0000 7feb2e000640 1 -- 172.21.15.107:0/2071179448 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2802aea0 con 0x7feb3015d610 2024-08-17T02:27:44.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.345+0000 7feb2e000640 1 -- 172.21.15.107:0/2071179448 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb2802d050 con 0x7feb3015d610 2024-08-17T02:27:44.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.345+0000 7feb2e000640 1 -- 172.21.15.107:0/2071179448 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb28007780 con 0x7feb3015d610 2024-08-17T02:27:44.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.346+0000 7feb36000640 1 -- 172.21.15.107:0/2071179448 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb3015d610 msgr2=0x7feb30067700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:44.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.346+0000 7feb36000640 1 --2- 172.21.15.107:0/2071179448 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb3015d610 0x7feb30067700 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7feb28009e90 tx=0x7feb28009780 comp rx=0 tx=0).stop 2024-08-17T02:27:44.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.346+0000 7feb36000640 1 -- 172.21.15.107:0/2071179448 shutdown_connections 2024-08-17T02:27:44.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.346+0000 7feb36000640 1 --2- 172.21.15.107:0/2071179448 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb3015d610 0x7feb30067700 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.346+0000 7feb36000640 1 -- 172.21.15.107:0/2071179448 >> 172.21.15.107:0/2071179448 conn(0x7feb300ccc50 msgr2=0x7feb300c8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:44.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.346+0000 7feb36000640 1 -- 172.21.15.107:0/2071179448 shutdown_connections 2024-08-17T02:27:44.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.346+0000 7feb36000640 1 -- 172.21.15.107:0/2071179448 wait complete. 2024-08-17T02:27:44.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.347+0000 7feb36000640 1 Processor -- start 2024-08-17T02:27:44.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.348+0000 7feb36000640 1 -- start start 2024-08-17T02:27:44.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.348+0000 7feb36000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb300c9a50 0x7feb301566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:44.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.348+0000 7feb36000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb30158d80 0x7feb300af960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:44.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.349+0000 7feb36000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb3015d610 0x7feb300afea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:44.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.349+0000 7feb36000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb300ad2f0 con 0x7feb3015d610 2024-08-17T02:27:44.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.349+0000 7feb36000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb300b03e0 con 0x7feb30158d80 2024-08-17T02:27:44.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.349+0000 7feb36000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb3015c1b0 con 0x7feb300c9a50 2024-08-17T02:27:44.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.349+0000 7feb2fe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb3015d610 0x7feb300afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:44.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.349+0000 7feb2fe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb3015d610 0x7feb300afea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:46866/0 (socket says 172.21.15.107:46866) 2024-08-17T02:27:44.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.349+0000 7feb2fe00640 1 -- 172.21.15.107:0/1072062866 learned_addr learned my addr 172.21.15.107:0/1072062866 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:44.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.349+0000 7feb2fe00640 1 -- 172.21.15.107:0/1072062866 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb300c9a50 msgr2=0x7feb301566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:44.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.349+0000 7feb2fe00640 1 --2- 172.21.15.107:0/1072062866 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb300c9a50 0x7feb301566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.349+0000 7feb2fe00640 1 -- 172.21.15.107:0/1072062866 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb30158d80 msgr2=0x7feb300af960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:44.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.349+0000 7feb2fe00640 1 --2- 172.21.15.107:0/1072062866 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb30158d80 0x7feb300af960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.349+0000 7feb2fe00640 1 -- 172.21.15.107:0/1072062866 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb28009a20 con 0x7feb3015d610 2024-08-17T02:27:44.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.349+0000 7feb2fe00640 1 --2- 172.21.15.107:0/1072062866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb3015d610 0x7feb300afea0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7feb28009de0 tx=0x7feb28037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:44.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.350+0000 7feb26a00640 1 -- 172.21.15.107:0/1072062866 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb28031ac0 con 0x7feb3015d610 2024-08-17T02:27:44.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.350+0000 7feb26a00640 1 -- 172.21.15.107:0/1072062866 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb28031c20 con 0x7feb3015d610 2024-08-17T02:27:44.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.350+0000 7feb36000640 1 -- 172.21.15.107:0/1072062866 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb300ac9c0 con 0x7feb3015d610 2024-08-17T02:27:44.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.350+0000 7feb26a00640 1 -- 172.21.15.107:0/1072062866 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb28045460 con 0x7feb3015d610 2024-08-17T02:27:44.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.350+0000 7feb36000640 1 -- 172.21.15.107:0/1072062866 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb300acf80 con 0x7feb3015d610 2024-08-17T02:27:44.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.351+0000 7feb36000640 1 -- 172.21.15.107:0/1072062866 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb300710c0 con 0x7feb3015d610 2024-08-17T02:27:44.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.352+0000 7feb26a00640 1 -- 172.21.15.107:0/1072062866 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7feb280457d0 con 0x7feb3015d610 2024-08-17T02:27:44.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.352+0000 7feb26a00640 1 --2- 172.21.15.107:0/1072062866 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7feb10065150 0x7feb10067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:44.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.352+0000 7feb26a00640 1 -- 172.21.15.107:0/1072062866 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6689+0+0 (secure 0 0 0) 0x7feb280a4400 con 0x7feb3015d610 2024-08-17T02:27:44.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.353+0000 7feb2f400640 1 --2- 172.21.15.107:0/1072062866 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7feb10065150 0x7feb10067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:44.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.353+0000 7feb2f400640 1 --2- 172.21.15.107:0/1072062866 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7feb10065150 0x7feb10067600 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7feb20005840 tx=0x7feb20007940 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:44.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.357+0000 7feb26a00640 1 -- 172.21.15.107:0/1072062866 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7feb280720f0 con 0x7feb3015d610 2024-08-17T02:27:44.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:44.530+0000 7feb36000640 1 -- 172.21.15.107:0/1072062866 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7feb300ad4a0 con 0x7feb3015d610 2024-08-17T02:27:45.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.175+0000 7feb26a00640 1 -- 172.21.15.107:0/1072062866 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v39) v1 ==== 181+0+0 (secure 0 0 0) 0x7feb300ad4a0 con 0x7feb3015d610 2024-08-17T02:27:45.180 INFO:teuthology.orchestra.run.smithi107.stderr:pool 'cephfs_metadata' removed 2024-08-17T02:27:45.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.182+0000 7feb36000640 1 -- 172.21.15.107:0/1072062866 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7feb10065150 msgr2=0x7feb10067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.182+0000 7feb36000640 1 --2- 172.21.15.107:0/1072062866 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7feb10065150 0x7feb10067600 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7feb20005840 tx=0x7feb20007940 comp rx=0 tx=0).stop 2024-08-17T02:27:45.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.182+0000 7feb36000640 1 -- 172.21.15.107:0/1072062866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb3015d610 msgr2=0x7feb300afea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.182+0000 7feb36000640 1 --2- 172.21.15.107:0/1072062866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb3015d610 0x7feb300afea0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7feb28009de0 tx=0x7feb28037000 comp rx=0 tx=0).stop 2024-08-17T02:27:45.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.182+0000 7feb36000640 1 -- 172.21.15.107:0/1072062866 shutdown_connections 2024-08-17T02:27:45.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.182+0000 7feb36000640 1 --2- 172.21.15.107:0/1072062866 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7feb10065150 0x7feb10067600 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.182+0000 7feb36000640 1 --2- 172.21.15.107:0/1072062866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb3015d610 0x7feb300afea0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.182+0000 7feb36000640 1 --2- 172.21.15.107:0/1072062866 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb30158d80 0x7feb300af960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.182+0000 7feb36000640 1 --2- 172.21.15.107:0/1072062866 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb300c9a50 0x7feb301566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.182+0000 7feb36000640 1 -- 172.21.15.107:0/1072062866 >> 172.21.15.107:0/1072062866 conn(0x7feb300ccc50 msgr2=0x7feb30069a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:45.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.183+0000 7feb36000640 1 -- 172.21.15.107:0/1072062866 shutdown_connections 2024-08-17T02:27:45.185 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.183+0000 7feb36000640 1 -- 172.21.15.107:0/1072062866 wait complete. 2024-08-17T02:27:45.203 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-17T02:27:45.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.355+0000 7f8176a00640 1 Processor -- start 2024-08-17T02:27:45.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.355+0000 7f8176a00640 1 -- start start 2024-08-17T02:27:45.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.356+0000 7f8176a00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8170156d40 0x7f817006dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.357+0000 7f8176a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f817006e420 0x7f81700ab510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.357+0000 7f8176a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f817006e880 con 0x7f8170150130 2024-08-17T02:27:45.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.357+0000 7f8176a00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81701568b0 con 0x7f8170156d40 2024-08-17T02:27:45.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.357+0000 7f8176a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8170150500 con 0x7f817006e420 2024-08-17T02:27:45.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.357+0000 7f816fe00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f8170150130 0x7f81700aa730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:49062/0 (socket says 172.21.15.107:49062) 2024-08-17T02:27:45.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.357+0000 7f816fe00640 1 -- 172.21.15.107:0/2776623939 learned_addr learned my addr 172.21.15.107:0/2776623939 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:27:45.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.357+0000 7f8167400640 1 --2- 172.21.15.107:0/2776623939 >> v2:172.21.15.157:3300/0 conn(0x7f8170156d40 0x7f817006dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.357+0000 7f8174a00640 1 --2- 172.21.15.107:0/2776623939 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f817006e420 0x7f81700ab510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.357+0000 7f816f400640 1 -- 172.21.15.107:0/2776623939 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1845762060 0 0) 0x7f8160001110 con 0x7f8170150130 2024-08-17T02:27:45.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.357+0000 7f816f400640 1 -- 172.21.15.107:0/2776623939 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81540034e0 con 0x7f8170150130 2024-08-17T02:27:45.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.358+0000 7f816f400640 1 -- 172.21.15.107:0/2776623939 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3197566065 0 0) 0x7f81540034e0 con 0x7f8170150130 2024-08-17T02:27:45.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.358+0000 7f816f400640 1 -- 172.21.15.107:0/2776623939 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f817006e420 msgr2=0x7f81700ab510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:45.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.358+0000 7f816f400640 1 --2- 172.21.15.107:0/2776623939 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f817006e420 0x7f81700ab510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.358+0000 7f816f400640 1 -- 172.21.15.107:0/2776623939 >> v2:172.21.15.157:3300/0 conn(0x7f8170156d40 msgr2=0x7f817006dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:45.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.358+0000 7f816f400640 1 --2- 172.21.15.107:0/2776623939 >> v2:172.21.15.157:3300/0 conn(0x7f8170156d40 0x7f817006dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.358+0000 7f816f400640 1 -- 172.21.15.107:0/2776623939 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8170155fc0 con 0x7f8170150130 2024-08-17T02:27:45.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.358+0000 7f816f400640 1 -- 172.21.15.107:0/2776623939 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 537989081 0 0) 0x7f8160001620 con 0x7f8170150130 2024-08-17T02:27:45.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.358+0000 7f816f400640 1 -- 172.21.15.107:0/2776623939 >> v1:172.21.15.107:6789/0 conn(0x7f8170150130 legacy=0x7f81700aa730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.358+0000 7f816f400640 1 --2- 172.21.15.107:0/2776623939 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81540039d0 0x7f8154003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.358+0000 7f816f400640 1 --2- 172.21.15.107:0/2776623939 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8154004780 0x7f8154004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.358+0000 7f816f400640 1 --2- 172.21.15.107:0/2776623939 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f817006e420 0x7f8154005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.358+0000 7f816f400640 1 -- 172.21.15.107:0/2776623939 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81701568b0 con 0x7f81540039d0 2024-08-17T02:27:45.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.358+0000 7f816f400640 1 -- 172.21.15.107:0/2776623939 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8170150500 con 0x7f8154004780 2024-08-17T02:27:45.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.358+0000 7f816f400640 1 -- 172.21.15.107:0/2776623939 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f815400dbe0 con 0x7f817006e420 2024-08-17T02:27:45.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.358+0000 7f816fe00640 1 --2- 172.21.15.107:0/2776623939 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81540039d0 0x7f8154003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.358+0000 7f8174a00640 1 --2- 172.21.15.107:0/2776623939 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f817006e420 0x7f8154005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.358+0000 7f8167400640 1 --2- 172.21.15.107:0/2776623939 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8154004780 0x7f8154004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.358+0000 7f816fe00640 1 -- 172.21.15.107:0/2776623939 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f817006e420 msgr2=0x7f8154005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:45.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.358+0000 7f816fe00640 1 --2- 172.21.15.107:0/2776623939 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f817006e420 0x7f8154005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.358+0000 7f816fe00640 1 -- 172.21.15.107:0/2776623939 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8154004780 msgr2=0x7f8154004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:45.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.358+0000 7f816fe00640 1 --2- 172.21.15.107:0/2776623939 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8154004780 0x7f8154004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.358+0000 7f816fe00640 1 -- 172.21.15.107:0/2776623939 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81540034e0 con 0x7f81540039d0 2024-08-17T02:27:45.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.358+0000 7f8167400640 1 --2- 172.21.15.107:0/2776623939 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8154004780 0x7f8154004bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:45.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.359+0000 7f816fe00640 1 --2- 172.21.15.107:0/2776623939 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81540039d0 0x7f8154003de0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f816000c440 tx=0x7f8170156820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a23571ccbcb13e30 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.360+0000 7f816f400640 1 -- 172.21.15.107:0/2776623939 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8160005890 con 0x7f81540039d0 2024-08-17T02:27:45.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.360+0000 7f816f400640 1 -- 172.21.15.107:0/2776623939 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8160005a30 con 0x7f81540039d0 2024-08-17T02:27:45.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.360+0000 7f816f400640 1 -- 172.21.15.107:0/2776623939 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8160005df0 con 0x7f81540039d0 2024-08-17T02:27:45.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.360+0000 7f8176a00640 1 -- 172.21.15.107:0/2776623939 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81540039d0 msgr2=0x7f8154003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.360+0000 7f8176a00640 1 --2- 172.21.15.107:0/2776623939 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81540039d0 0x7f8154003de0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f816000c440 tx=0x7f8170156820 comp rx=0 tx=0).stop 2024-08-17T02:27:45.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.360+0000 7f8174a00640 1 -- 172.21.15.107:0/2776623939 reap_dead start 2024-08-17T02:27:45.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.360+0000 7f8176a00640 1 -- 172.21.15.107:0/2776623939 shutdown_connections 2024-08-17T02:27:45.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.360+0000 7f8176a00640 1 -- 172.21.15.107:0/2776623939 >> 172.21.15.107:0/2776623939 conn(0x7f8170067750 msgr2=0x7f817006c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:45.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.360+0000 7f8176a00640 1 -- 172.21.15.107:0/2776623939 shutdown_connections 2024-08-17T02:27:45.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.360+0000 7f8176a00640 1 -- 172.21.15.107:0/2776623939 wait complete. 2024-08-17T02:27:45.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.362+0000 7f8176a00640 1 Processor -- start 2024-08-17T02:27:45.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.362+0000 7f8176a00640 1 -- start start 2024-08-17T02:27:45.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.362+0000 7f8176a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81540039d0 0x7f81701539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.362+0000 7f8176a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f81700a5ea0 0x7f817014daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.362+0000 7f8176a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8170168150 0x7f81701685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.362+0000 7f8176a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8170169050 con 0x7f81540039d0 2024-08-17T02:27:45.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.362+0000 7f8176a00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8170168b10 con 0x7f8170168150 2024-08-17T02:27:45.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.362+0000 7f8176a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81700aac60 con 0x7f81700a5ea0 2024-08-17T02:27:45.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.363+0000 7f816fe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81540039d0 0x7f81701539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.363+0000 7f816fe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81540039d0 0x7f81701539f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:46876/0 (socket says 172.21.15.107:46876) 2024-08-17T02:27:45.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.363+0000 7f816fe00640 1 -- 172.21.15.107:0/972994468 learned_addr learned my addr 172.21.15.107:0/972994468 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:45.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.363+0000 7f8167400640 1 --2- 172.21.15.107:0/972994468 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f81700a5ea0 0x7f817014daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.363+0000 7f8174a00640 1 --2- 172.21.15.107:0/972994468 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8170168150 0x7f81701685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.363+0000 7f816fe00640 1 -- 172.21.15.107:0/972994468 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f81700a5ea0 msgr2=0x7f817014daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.363+0000 7f816fe00640 1 --2- 172.21.15.107:0/972994468 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f81700a5ea0 0x7f817014daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.363+0000 7f816fe00640 1 -- 172.21.15.107:0/972994468 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8170168150 msgr2=0x7f81701685d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.363+0000 7f816fe00640 1 --2- 172.21.15.107:0/972994468 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8170168150 0x7f81701685d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.363+0000 7f816fe00640 1 -- 172.21.15.107:0/972994468 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8170154310 con 0x7f81540039d0 2024-08-17T02:27:45.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.363+0000 7f816fe00640 1 --2- 172.21.15.107:0/972994468 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81540039d0 0x7f81701539f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8160007de0 tx=0x7f8160034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.364+0000 7f8167e00640 1 -- 172.21.15.107:0/972994468 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8160007300 con 0x7f81540039d0 2024-08-17T02:27:45.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.364+0000 7f8167e00640 1 -- 172.21.15.107:0/972994468 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8160007460 con 0x7f81540039d0 2024-08-17T02:27:45.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.364+0000 7f8167e00640 1 -- 172.21.15.107:0/972994468 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8160007800 con 0x7f81540039d0 2024-08-17T02:27:45.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.364+0000 7f8176a00640 1 -- 172.21.15.107:0/972994468 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81700a6310 con 0x7f81540039d0 2024-08-17T02:27:45.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.364+0000 7f8176a00640 1 -- 172.21.15.107:0/972994468 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81700aa980 con 0x7f81540039d0 2024-08-17T02:27:45.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.365+0000 7f8176a00640 1 -- 172.21.15.107:0/972994468 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81700710c0 con 0x7f81540039d0 2024-08-17T02:27:45.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.366+0000 7f8167e00640 1 -- 172.21.15.107:0/972994468 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8160039640 con 0x7f81540039d0 2024-08-17T02:27:45.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.366+0000 7f8167e00640 1 --2- 172.21.15.107:0/972994468 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f814c065150 0x7f814c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.367+0000 7f8167e00640 1 -- 172.21.15.107:0/972994468 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6251+0+0 (secure 0 0 0) 0x7f81600a2d30 con 0x7f81540039d0 2024-08-17T02:27:45.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.367+0000 7f8167400640 1 --2- 172.21.15.107:0/972994468 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f814c065150 0x7f814c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.367+0000 7f8167400640 1 --2- 172.21.15.107:0/972994468 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f814c065150 0x7f814c067600 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8170157130 tx=0x7f8158008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.370+0000 7f8167e00640 1 -- 172.21.15.107:0/972994468 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8160070be0 con 0x7f81540039d0 2024-08-17T02:27:45.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:45.542+0000 7f8176a00640 1 -- 172.21.15.107:0/972994468 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f817006e880 con 0x7f81540039d0 2024-08-17T02:27:46.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.181+0000 7f8167e00640 1 -- 172.21.15.107:0/972994468 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v40) v1 ==== 169+0+0 (secure 0 0 0) 0x7f817006e880 con 0x7f81540039d0 2024-08-17T02:27:46.183 INFO:teuthology.orchestra.run.smithi107.stderr:pool 'cephfs_data' removed 2024-08-17T02:27:46.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.185+0000 7f8176a00640 1 -- 172.21.15.107:0/972994468 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f814c065150 msgr2=0x7f814c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:46.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.185+0000 7f8176a00640 1 --2- 172.21.15.107:0/972994468 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f814c065150 0x7f814c067600 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8170157130 tx=0x7f8158008040 comp rx=0 tx=0).stop 2024-08-17T02:27:46.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.185+0000 7f8176a00640 1 -- 172.21.15.107:0/972994468 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81540039d0 msgr2=0x7f81701539f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:46.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.185+0000 7f8176a00640 1 --2- 172.21.15.107:0/972994468 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81540039d0 0x7f81701539f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8160007de0 tx=0x7f8160034000 comp rx=0 tx=0).stop 2024-08-17T02:27:46.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.186+0000 7f8176a00640 1 -- 172.21.15.107:0/972994468 shutdown_connections 2024-08-17T02:27:46.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.186+0000 7f8176a00640 1 --2- 172.21.15.107:0/972994468 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f814c065150 0x7f814c067600 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.186+0000 7f8176a00640 1 --2- 172.21.15.107:0/972994468 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8170168150 0x7f81701685d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.186+0000 7f8176a00640 1 --2- 172.21.15.107:0/972994468 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f81700a5ea0 0x7f817014daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.186+0000 7f8176a00640 1 --2- 172.21.15.107:0/972994468 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81540039d0 0x7f81701539f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.186+0000 7f8176a00640 1 -- 172.21.15.107:0/972994468 >> 172.21.15.107:0/972994468 conn(0x7f8170067750 msgr2=0x7f81700687f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:46.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.187+0000 7f8176a00640 1 -- 172.21.15.107:0/972994468 shutdown_connections 2024-08-17T02:27:46.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.187+0000 7f8176a00640 1 -- 172.21.15.107:0/972994468 wait complete. 2024-08-17T02:27:46.206 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:46.355 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.354+0000 7f4725600640 1 Processor -- start 2024-08-17T02:27:46.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.354+0000 7f4725600640 1 -- start start 2024-08-17T02:27:46.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.355+0000 7f4725600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4720155a20 0x7f47200adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:46.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.355+0000 7f4725600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f472006df00 0x7f47200ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:46.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.355+0000 7f4725600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4720156670 con 0x7f4720155df0 2024-08-17T02:27:46.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.356+0000 7f4725600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47200b0350 con 0x7f4720155a20 2024-08-17T02:27:46.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.356+0000 7f4725600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f472006e5e0 con 0x7f472006df00 2024-08-17T02:27:46.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.356+0000 7f471ea00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4720155a20 0x7f47200adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:46.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.356+0000 7f471ea00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4720155a20 0x7f47200adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:46888/0 (socket says 172.21.15.107:46888) 2024-08-17T02:27:46.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.356+0000 7f471ea00640 1 -- 172.21.15.107:0/2519851429 learned_addr learned my addr 172.21.15.107:0/2519851429 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:46.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.356+0000 7f471f400640 1 --2- 172.21.15.107:0/2519851429 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f472006df00 0x7f47200ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:46.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.356+0000 7f471ea00640 1 -- 172.21.15.107:0/2519851429 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f472006df00 msgr2=0x7f47200ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:46.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.356+0000 7f471ea00640 1 --2- 172.21.15.107:0/2519851429 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f472006df00 0x7f47200ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.356+0000 7f471ea00640 1 -- 172.21.15.107:0/2519851429 >> v1:172.21.15.107:6789/0 conn(0x7f4720155df0 legacy=0x7f472006d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:46.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.356+0000 7f471ea00640 1 -- 172.21.15.107:0/2519851429 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f472006e8c0 con 0x7f4720155a20 2024-08-17T02:27:46.359 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.357+0000 7f471ea00640 1 --2- 172.21.15.107:0/2519851429 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4720155a20 0x7f47200adf10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4710009f20 tx=0x7f4710009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a67ac398f1b8ea2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:46.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.357+0000 7f471e000640 1 -- 172.21.15.107:0/2519851429 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4710031400 con 0x7f4720155a20 2024-08-17T02:27:46.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.357+0000 7f471e000640 1 -- 172.21.15.107:0/2519851429 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471002d050 con 0x7f4720155a20 2024-08-17T02:27:46.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.357+0000 7f471e000640 1 -- 172.21.15.107:0/2519851429 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47100317d0 con 0x7f4720155a20 2024-08-17T02:27:46.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.358+0000 7f4725600640 1 -- 172.21.15.107:0/2519851429 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4720155a20 msgr2=0x7f47200adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:46.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.358+0000 7f4725600640 1 --2- 172.21.15.107:0/2519851429 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4720155a20 0x7f47200adf10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4710009f20 tx=0x7f4710009840 comp rx=0 tx=0).stop 2024-08-17T02:27:46.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.358+0000 7f4725600640 1 -- 172.21.15.107:0/2519851429 shutdown_connections 2024-08-17T02:27:46.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.358+0000 7f4725600640 1 --2- 172.21.15.107:0/2519851429 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f472006df00 0x7f47200ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.358+0000 7f4725600640 1 --2- 172.21.15.107:0/2519851429 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4720155a20 0x7f47200adf10 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.358+0000 7f4725600640 1 -- 172.21.15.107:0/2519851429 >> 172.21.15.107:0/2519851429 conn(0x7f47200cb9b0 msgr2=0x7f47200cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:46.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.358+0000 7f4725600640 1 -- 172.21.15.107:0/2519851429 shutdown_connections 2024-08-17T02:27:46.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.358+0000 7f4725600640 1 -- 172.21.15.107:0/2519851429 wait complete. 2024-08-17T02:27:46.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.360+0000 7f4725600640 1 Processor -- start 2024-08-17T02:27:46.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.360+0000 7f4725600640 1 -- start start 2024-08-17T02:27:46.363 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.360+0000 7f4725600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f472006df00 0x7f472013d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:46.363 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.361+0000 7f4725600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4720155a20 0x7f4720169380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:46.363 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.361+0000 7f4725600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4720155df0 0x7f47201484b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:46.363 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.361+0000 7f4725600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472013d980 con 0x7f472006df00 2024-08-17T02:27:46.363 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.361+0000 7f4725600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47201698c0 con 0x7f4720155a20 2024-08-17T02:27:46.363 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.361+0000 7f4725600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4720144c00 con 0x7f4720155df0 2024-08-17T02:27:46.363 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.361+0000 7f471ea00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f472006df00 0x7f472013d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:46.363 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.361+0000 7f471ea00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f472006df00 0x7f472013d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:46892/0 (socket says 172.21.15.107:46892) 2024-08-17T02:27:46.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.361+0000 7f471ea00640 1 -- 172.21.15.107:0/675781720 learned_addr learned my addr 172.21.15.107:0/675781720 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:46.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.361+0000 7f471f400640 1 --2- 172.21.15.107:0/675781720 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4720155df0 0x7f47201484b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:46.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.361+0000 7f471ea00640 1 -- 172.21.15.107:0/675781720 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4720155df0 msgr2=0x7f47201484b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:46.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.361+0000 7f4716000640 1 --2- 172.21.15.107:0/675781720 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4720155a20 0x7f4720169380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:46.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.361+0000 7f471ea00640 1 --2- 172.21.15.107:0/675781720 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4720155df0 0x7f47201484b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.361+0000 7f471ea00640 1 -- 172.21.15.107:0/675781720 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4720155a20 msgr2=0x7f4720169380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:46.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.361+0000 7f471ea00640 1 --2- 172.21.15.107:0/675781720 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4720155a20 0x7f4720169380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.361+0000 7f471ea00640 1 -- 172.21.15.107:0/675781720 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4710009ae0 con 0x7f472006df00 2024-08-17T02:27:46.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.361+0000 7f471f400640 1 --2- 172.21.15.107:0/675781720 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4720155df0 0x7f47201484b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:46.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.361+0000 7f4716000640 1 --2- 172.21.15.107:0/675781720 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4720155a20 0x7f4720169380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:46.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.361+0000 7f471ea00640 1 --2- 172.21.15.107:0/675781720 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f472006df00 0x7f472013d440 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4710009f80 tx=0x7f4710036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:46.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.362+0000 7f4716a00640 1 -- 172.21.15.107:0/675781720 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4710008ad0 con 0x7f472006df00 2024-08-17T02:27:46.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.362+0000 7f4716a00640 1 -- 172.21.15.107:0/675781720 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4710008c50 con 0x7f472006df00 2024-08-17T02:27:46.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.362+0000 7f4725600640 1 -- 172.21.15.107:0/675781720 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4720143ff0 con 0x7f472006df00 2024-08-17T02:27:46.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.362+0000 7f4716a00640 1 -- 172.21.15.107:0/675781720 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471003b410 con 0x7f472006df00 2024-08-17T02:27:46.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.362+0000 7f4725600640 1 -- 172.21.15.107:0/675781720 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47201445b0 con 0x7f472006df00 2024-08-17T02:27:46.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.363+0000 7f4725600640 1 -- 172.21.15.107:0/675781720 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4720064db0 con 0x7f472006df00 2024-08-17T02:27:46.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.363+0000 7f4716a00640 1 -- 172.21.15.107:0/675781720 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4710003020 con 0x7f472006df00 2024-08-17T02:27:46.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.365+0000 7f4716a00640 1 --2- 172.21.15.107:0/675781720 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f46fc065180 0x7f46fc067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:46.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.365+0000 7f4716a00640 1 -- 172.21.15.107:0/675781720 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f47100a2f50 con 0x7f472006df00 2024-08-17T02:27:46.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.365+0000 7f4716000640 1 --2- 172.21.15.107:0/675781720 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f46fc065180 0x7f46fc067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:46.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.366+0000 7f4716000640 1 --2- 172.21.15.107:0/675781720 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f46fc065180 0x7f46fc067630 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4720153560 tx=0x7f4708009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:46.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.371+0000 7f4716a00640 1 -- 172.21.15.107:0/675781720 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4710070ef0 con 0x7f472006df00 2024-08-17T02:27:46.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.548+0000 7f4725600640 1 -- 172.21.15.107:0/675781720 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4720068e10 con 0x7f472006df00 2024-08-17T02:27:46.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.549+0000 7f4716a00640 1 -- 172.21.15.107:0/675781720 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+15562 (secure 0 0 0) 0x7f4710074510 con 0x7f472006df00 2024-08-17T02:27:46.550 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:27:46.550 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":40,"fsid":"f207b4c0-329d-46b8-b83f-aaf30bdb6ce3","created":"2024-08-17T02:24:11.038049+0000","modified":"2024-08-17T02:27:46.174092+0000","last_up_change":"2024-08-17T02:24:22.047790+0000","last_in_change":"2024-08-17T02:24:13.892720+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:23.456166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000928569.meta","create_time":"2024-08-17T02:25:33.885385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000928569"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000928569.data","create_time":"2024-08-17T02:25:34.790701+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000928569"}}}],"osds":[{"osd":0,"uuid":"376363f3-b8bf-4f1e-b691-51cdd39171ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37302},{"type":"v1","addr":"172.21.15.107:6801","nonce":37302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37302},{"type":"v1","addr":"172.21.15.107:6803","nonce":37302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37302},{"type":"v1","addr":"172.21.15.107:6807","nonce":37302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37302},{"type":"v1","addr":"172.21.15.107:6805","nonce":37302}]},"public_addr":"172.21.15.107:6801/37302","cluster_addr":"172.21.15.107:6803/37302","heartbeat_back_addr":"172.21.15.107:6807/37302","heartbeat_front_addr":"172.21.15.107:6805/37302","state":["exists","up"]},{"osd":1,"uuid":"cc6624e3-2ad4-4db4-b377-05dfe57424e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37305},{"type":"v1","addr":"172.21.15.107:6824","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37305},{"type":"v1","addr":"172.21.15.107:6827","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37305},{"type":"v1","addr":"172.21.15.107:6831","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37305},{"type":"v1","addr":"172.21.15.107:6829","nonce":37305}]},"public_addr":"172.21.15.107:6824/37305","cluster_addr":"172.21.15.107:6827/37305","heartbeat_back_addr":"172.21.15.107:6831/37305","heartbeat_front_addr":"172.21.15.107:6829/37305","state":["exists","up"]},{"osd":2,"uuid":"25229542-29b5-4281-bcb0-798ae0930aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37307},{"type":"v1","addr":"172.21.15.107:6817","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37307},{"type":"v1","addr":"172.21.15.107:6819","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6823","nonce":37307},{"type":"v1","addr":"172.21.15.107:6825","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37307},{"type":"v1","addr":"172.21.15.107:6821","nonce":37307}]},"public_addr":"172.21.15.107:6817/37307","cluster_addr":"172.21.15.107:6819/37307","heartbeat_back_addr":"172.21.15.107:6825/37307","heartbeat_front_addr":"172.21.15.107:6821/37307","state":["exists","up"]},{"osd":3,"uuid":"5f16aee8-8950-4268-a61a-5cf6ebd670e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37306},{"type":"v1","addr":"172.21.15.107:6809","nonce":37306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37306},{"type":"v1","addr":"172.21.15.107:6811","nonce":37306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37306},{"type":"v1","addr":"172.21.15.107:6815","nonce":37306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37306},{"type":"v1","addr":"172.21.15.107:6813","nonce":37306}]},"public_addr":"172.21.15.107:6809/37306","cluster_addr":"172.21.15.107:6811/37306","heartbeat_back_addr":"172.21.15.107:6815/37306","heartbeat_front_addr":"172.21.15.107:6813/37306","state":["exists","up"]},{"osd":4,"uuid":"23232e28-e23b-4b4e-a531-4939246dbbde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":37329},{"type":"v1","addr":"172.21.15.157:6817","nonce":37329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":37329},{"type":"v1","addr":"172.21.15.157:6819","nonce":37329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":37329},{"type":"v1","addr":"172.21.15.157:6823","nonce":37329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":37329},{"type":"v1","addr":"172.21.15.157:6821","nonce":37329}]},"public_addr":"172.21.15.157:6817/37329","cluster_addr":"172.21.15.157:6819/37329","heartbeat_back_addr":"172.21.15.157:6823/37329","heartbeat_front_addr":"172.21.15.157:6821/37329","state":["exists","up"]},{"osd":5,"uuid":"f87ec331-3e59-4886-a317-6f7e26ec8e21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":37328},{"type":"v1","addr":"172.21.15.157:6804","nonce":37328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":37328},{"type":"v1","addr":"172.21.15.157:6808","nonce":37328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":37328},{"type":"v1","addr":"172.21.15.157:6815","nonce":37328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":37328},{"type":"v1","addr":"172.21.15.157:6812","nonce":37328}]},"public_addr":"172.21.15.157:6804/37328","cluster_addr":"172.21.15.157:6808/37328","heartbeat_back_addr":"172.21.15.157:6815/37328","heartbeat_front_addr":"172.21.15.157:6812/37328","state":["exists","up"]},{"osd":6,"uuid":"92852235-ce49-4d96-a940-6f18d97b13ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":37330},{"type":"v1","addr":"172.21.15.157:6801","nonce":37330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6803","nonce":37330},{"type":"v1","addr":"172.21.15.157:6805","nonce":37330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":37330},{"type":"v1","addr":"172.21.15.157:6813","nonce":37330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":37330},{"type":"v1","addr":"172.21.15.157:6809","nonce":37330}]},"public_addr":"172.21.15.157:6801/37330","cluster_addr":"172.21.15.157:6805/37330","heartbeat_back_addr":"172.21.15.157:6813/37330","heartbeat_front_addr":"172.21.15.157:6809/37330","state":["exists","up"]},{"osd":7,"uuid":"7484a061-723d-4663-b28f-b01766d62f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":37373},{"type":"v1","addr":"172.21.15.157:6825","nonce":37373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":37373},{"type":"v1","addr":"172.21.15.157:6827","nonce":37373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":37373},{"type":"v1","addr":"172.21.15.157:6831","nonce":37373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":37373},{"type":"v1","addr":"172.21.15.157:6829","nonce":37373}]},"public_addr":"172.21.15.157:6825/37373","cluster_addr":"172.21.15.157:6827/37373","heartbeat_back_addr":"172.21.15.157:6831/37373","heartbeat_front_addr":"172.21.15.157:6829/37373","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.110188+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.280265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.252119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.267996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.284582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.144420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.174764+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.308002+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.157:6835/1725535660":"2024-08-18T02:27:43.163351+0000","172.21.15.157:6833/1725535660":"2024-08-18T02:27:43.163351+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:46.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.551+0000 7f4725600640 1 -- 172.21.15.107:0/675781720 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f46fc065180 msgr2=0x7f46fc067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:46.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.551+0000 7f4725600640 1 --2- 172.21.15.107:0/675781720 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f46fc065180 0x7f46fc067630 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4720153560 tx=0x7f4708009040 comp rx=0 tx=0).stop 2024-08-17T02:27:46.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.551+0000 7f4725600640 1 -- 172.21.15.107:0/675781720 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f472006df00 msgr2=0x7f472013d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:46.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.551+0000 7f4725600640 1 --2- 172.21.15.107:0/675781720 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f472006df00 0x7f472013d440 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4710009f80 tx=0x7f4710036000 comp rx=0 tx=0).stop 2024-08-17T02:27:46.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.551+0000 7f4725600640 1 -- 172.21.15.107:0/675781720 shutdown_connections 2024-08-17T02:27:46.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.551+0000 7f4725600640 1 --2- 172.21.15.107:0/675781720 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f46fc065180 0x7f46fc067630 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.551+0000 7f4725600640 1 --2- 172.21.15.107:0/675781720 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4720155df0 0x7f47201484b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.551+0000 7f4725600640 1 --2- 172.21.15.107:0/675781720 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4720155a20 0x7f4720169380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.551+0000 7f4725600640 1 --2- 172.21.15.107:0/675781720 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f472006df00 0x7f472013d440 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.551+0000 7f4725600640 1 -- 172.21.15.107:0/675781720 >> 172.21.15.107:0/675781720 conn(0x7f47200cb9b0 msgr2=0x7f4720157700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:46.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.551+0000 7f4725600640 1 -- 172.21.15.107:0/675781720 shutdown_connections 2024-08-17T02:27:46.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.551+0000 7f4725600640 1 -- 172.21.15.107:0/675781720 wait complete. 2024-08-17T02:27:46.567 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:24:23.456166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 6, 'pool_name': 'cephfs.volume_0000000000928569.meta', 'create_time': '2024-08-17T02:25:33.885385+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000928569'}}}, {'pool': 7, 'pool_name': 'cephfs.volume_0000000000928569.data', 'create_time': '2024-08-17T02:25:34.790701+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000928569'}}}] 2024-08-17T02:27:46.568 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:27:46.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.716+0000 7fb1a1000640 1 Processor -- start 2024-08-17T02:27:46.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.716+0000 7fb1a1000640 1 -- start start 2024-08-17T02:27:46.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.717+0000 7fb1a1000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb19c0b0a80 0x7fb19c0b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:46.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.717+0000 7fb1a1000640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb19c0adec0 0x7fb19c15a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:46.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.717+0000 7fb1a1000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb19c157070 con 0x7fb19c157e10 2024-08-17T02:27:46.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.717+0000 7fb1a1000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb19c0b1390 con 0x7fb19c0b0a80 2024-08-17T02:27:46.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.717+0000 7fb1a1000640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb19c15b410 con 0x7fb19c0adec0 2024-08-17T02:27:46.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.718+0000 7fb199e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb19c0b0a80 0x7fb19c0b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:46.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.718+0000 7fb199e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb19c0b0a80 0x7fb19c0b0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36292/0 (socket says 172.21.15.107:36292) 2024-08-17T02:27:46.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.718+0000 7fb199e00640 1 -- 172.21.15.107:0/1012828233 learned_addr learned my addr 172.21.15.107:0/1012828233 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:46.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.718+0000 7fb199e00640 1 -- 172.21.15.107:0/1012828233 >> v2:172.21.15.157:3300/0 conn(0x7fb19c0adec0 msgr2=0x7fb19c15a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:46.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.718+0000 7fb199e00640 1 --2- 172.21.15.107:0/1012828233 >> v2:172.21.15.157:3300/0 conn(0x7fb19c0adec0 0x7fb19c15a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.718+0000 7fb199e00640 1 -- 172.21.15.107:0/1012828233 >> v1:172.21.15.107:6789/0 conn(0x7fb19c157e10 legacy=0x7fb19c0ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:46.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.718+0000 7fb199e00640 1 -- 172.21.15.107:0/1012828233 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb19c157330 con 0x7fb19c0b0a80 2024-08-17T02:27:46.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.719+0000 7fb199e00640 1 --2- 172.21.15.107:0/1012828233 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb19c0b0a80 0x7fb19c0b0e50 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb19c0c8810 tx=0x7fb18c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d33e584ef7395d02 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:46.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.719+0000 7fb199400640 1 -- 172.21.15.107:0/1012828233 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18c02add0 con 0x7fb19c0b0a80 2024-08-17T02:27:46.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.719+0000 7fb199400640 1 -- 172.21.15.107:0/1012828233 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18c032440 con 0x7fb19c0b0a80 2024-08-17T02:27:46.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.719+0000 7fb199400640 1 -- 172.21.15.107:0/1012828233 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18c032820 con 0x7fb19c0b0a80 2024-08-17T02:27:46.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.720+0000 7fb1a1000640 1 -- 172.21.15.107:0/1012828233 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb19c0b0a80 msgr2=0x7fb19c0b0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:46.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.720+0000 7fb1a1000640 1 --2- 172.21.15.107:0/1012828233 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb19c0b0a80 0x7fb19c0b0e50 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb19c0c8810 tx=0x7fb18c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.720+0000 7fb1a1000640 1 -- 172.21.15.107:0/1012828233 shutdown_connections 2024-08-17T02:27:46.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.720+0000 7fb1a1000640 1 --2- 172.21.15.107:0/1012828233 >> v2:172.21.15.157:3300/0 conn(0x7fb19c0adec0 0x7fb19c15a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.720+0000 7fb1a1000640 1 --2- 172.21.15.107:0/1012828233 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb19c0b0a80 0x7fb19c0b0e50 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.720+0000 7fb1a1000640 1 -- 172.21.15.107:0/1012828233 >> 172.21.15.107:0/1012828233 conn(0x7fb19c067750 msgr2=0x7fb19c0cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:46.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.720+0000 7fb1a1000640 1 -- 172.21.15.107:0/1012828233 shutdown_connections 2024-08-17T02:27:46.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.720+0000 7fb1a1000640 1 -- 172.21.15.107:0/1012828233 wait complete. 2024-08-17T02:27:46.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.721+0000 7fb1a1000640 1 Processor -- start 2024-08-17T02:27:46.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.721+0000 7fb1a1000640 1 -- start start 2024-08-17T02:27:46.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.722+0000 7fb1a1000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb19c0adec0 0x7fb19c14f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:46.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.722+0000 7fb1a1000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb19c0b0a80 0x7fb19c169b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:46.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.722+0000 7fb1a1000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb19c157e10 0x7fb19c1593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:46.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.722+0000 7fb1a1000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c14cd80 con 0x7fb19c0b0a80 2024-08-17T02:27:46.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.722+0000 7fb1a1000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c150510 con 0x7fb19c157e10 2024-08-17T02:27:46.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.722+0000 7fb1a1000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c14f680 con 0x7fb19c0adec0 2024-08-17T02:27:46.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.723+0000 7fb191400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb19c0b0a80 0x7fb19c169b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:46.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.723+0000 7fb191400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb19c0b0a80 0x7fb19c169b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36298/0 (socket says 172.21.15.107:36298) 2024-08-17T02:27:46.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.723+0000 7fb191400640 1 -- 172.21.15.107:0/1294770230 learned_addr learned my addr 172.21.15.107:0/1294770230 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:46.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.723+0000 7fb199e00640 1 --2- 172.21.15.107:0/1294770230 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb19c0adec0 0x7fb19c14f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:46.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.723+0000 7fb19a800640 1 --2- 172.21.15.107:0/1294770230 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb19c157e10 0x7fb19c1593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:46.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.723+0000 7fb191400640 1 -- 172.21.15.107:0/1294770230 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb19c0adec0 msgr2=0x7fb19c14f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:46.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.723+0000 7fb191400640 1 --2- 172.21.15.107:0/1294770230 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb19c0adec0 0x7fb19c14f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.723+0000 7fb191400640 1 -- 172.21.15.107:0/1294770230 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb19c157e10 msgr2=0x7fb19c1593c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:46.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.723+0000 7fb191400640 1 --2- 172.21.15.107:0/1294770230 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb19c157e10 0x7fb19c1593c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.723+0000 7fb191400640 1 -- 172.21.15.107:0/1294770230 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb18c009450 con 0x7fb19c0b0a80 2024-08-17T02:27:46.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.723+0000 7fb19a800640 1 --2- 172.21.15.107:0/1294770230 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb19c157e10 0x7fb19c1593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:46.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.723+0000 7fb191400640 1 --2- 172.21.15.107:0/1294770230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb19c0b0a80 0x7fb19c169b60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb18400c590 tx=0x7fb184007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:46.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.723+0000 7fb192000640 1 -- 172.21.15.107:0/1294770230 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb184012630 con 0x7fb19c0b0a80 2024-08-17T02:27:46.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.724+0000 7fb192000640 1 -- 172.21.15.107:0/1294770230 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1840127b0 con 0x7fb19c0b0a80 2024-08-17T02:27:46.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.724+0000 7fb1a1000640 1 -- 172.21.15.107:0/1294770230 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb19c14f900 con 0x7fb19c0b0a80 2024-08-17T02:27:46.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.724+0000 7fb192000640 1 -- 172.21.15.107:0/1294770230 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb184012b70 con 0x7fb19c0b0a80 2024-08-17T02:27:46.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.724+0000 7fb1a1000640 1 -- 172.21.15.107:0/1294770230 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb19c14fec0 con 0x7fb19c0b0a80 2024-08-17T02:27:46.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.725+0000 7fb1a1000640 1 -- 172.21.15.107:0/1294770230 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb19c064db0 con 0x7fb19c0b0a80 2024-08-17T02:27:46.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.725+0000 7fb192000640 1 -- 172.21.15.107:0/1294770230 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb18401b400 con 0x7fb19c0b0a80 2024-08-17T02:27:46.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.726+0000 7fb192000640 1 --2- 172.21.15.107:0/1294770230 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fb178065150 0x7fb178067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:46.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.726+0000 7fb192000640 1 -- 172.21.15.107:0/1294770230 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fb184081fc0 con 0x7fb19c0b0a80 2024-08-17T02:27:46.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.726+0000 7fb199e00640 1 --2- 172.21.15.107:0/1294770230 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fb178065150 0x7fb178067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:46.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.727+0000 7fb199e00640 1 --2- 172.21.15.107:0/1294770230 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fb178065150 0x7fb178067600 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb18c034000 tx=0x7fb18c032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:46.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.730+0000 7fb192000640 1 -- 172.21.15.107:0/1294770230 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb18404ff60 con 0x7fb19c0b0a80 2024-08-17T02:27:46.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.902+0000 7fb1a1000640 1 -- 172.21.15.107:0/1294770230 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb19c15a8b0 con 0x7fb19c0b0a80 2024-08-17T02:27:46.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.903+0000 7fb192000640 1 -- 172.21.15.107:0/1294770230 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb184053580 con 0x7fb19c0b0a80 2024-08-17T02:27:46.904 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2024-08-17T02:27:46.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.905+0000 7fb1a1000640 1 -- 172.21.15.107:0/1294770230 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fb178065150 msgr2=0x7fb178067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:46.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.905+0000 7fb1a1000640 1 --2- 172.21.15.107:0/1294770230 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fb178065150 0x7fb178067600 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb18c034000 tx=0x7fb18c032000 comp rx=0 tx=0).stop 2024-08-17T02:27:46.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.905+0000 7fb1a1000640 1 -- 172.21.15.107:0/1294770230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb19c0b0a80 msgr2=0x7fb19c169b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:46.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.905+0000 7fb1a1000640 1 --2- 172.21.15.107:0/1294770230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb19c0b0a80 0x7fb19c169b60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb18400c590 tx=0x7fb184007ef0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.905+0000 7fb1a1000640 1 -- 172.21.15.107:0/1294770230 shutdown_connections 2024-08-17T02:27:46.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.905+0000 7fb1a1000640 1 --2- 172.21.15.107:0/1294770230 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fb178065150 0x7fb178067600 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.905+0000 7fb1a1000640 1 --2- 172.21.15.107:0/1294770230 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb19c157e10 0x7fb19c1593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.905+0000 7fb1a1000640 1 --2- 172.21.15.107:0/1294770230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb19c0b0a80 0x7fb19c169b60 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.905+0000 7fb1a1000640 1 --2- 172.21.15.107:0/1294770230 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb19c0adec0 0x7fb19c14f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.905+0000 7fb1a1000640 1 -- 172.21.15.107:0/1294770230 >> 172.21.15.107:0/1294770230 conn(0x7fb19c067750 msgr2=0x7fb19c068630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:46.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.905+0000 7fb1a1000640 1 -- 172.21.15.107:0/1294770230 shutdown_connections 2024-08-17T02:27:46.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:46.905+0000 7fb1a1000640 1 -- 172.21.15.107:0/1294770230 wait complete. 2024-08-17T02:27:46.921 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000928569.meta pg_num 2024-08-17T02:27:47.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.069+0000 7f4b82800640 1 Processor -- start 2024-08-17T02:27:47.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.070+0000 7f4b82800640 1 -- start start 2024-08-17T02:27:47.072 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.071+0000 7f4b82800640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4b7c155660 0x7f4b7c0c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.072 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.071+0000 7f4b82800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4b7c155a30 0x7f4b7c06dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.072 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.071+0000 7f4b82800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b7c0afc40 con 0x7f4b7c0adfb0 2024-08-17T02:27:47.073 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.071+0000 7f4b82800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b7c0af030 con 0x7f4b7c155a30 2024-08-17T02:27:47.073 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.071+0000 7f4b82800640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b7c0af310 con 0x7f4b7c155660 2024-08-17T02:27:47.073 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.071+0000 7f4b81e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4b7c155a30 0x7f4b7c06dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.073 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.071+0000 7f4b81e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4b7c155a30 0x7f4b7c06dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36312/0 (socket says 172.21.15.107:36312) 2024-08-17T02:27:47.073 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.071+0000 7f4b81e00640 1 -- 172.21.15.107:0/2785519261 learned_addr learned my addr 172.21.15.107:0/2785519261 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:47.073 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.071+0000 7f4b81400640 1 --2- 172.21.15.107:0/2785519261 >> v2:172.21.15.157:3300/0 conn(0x7f4b7c155660 0x7f4b7c0c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.072+0000 7f4b81e00640 1 -- 172.21.15.107:0/2785519261 >> v2:172.21.15.157:3300/0 conn(0x7f4b7c155660 msgr2=0x7f4b7c0c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:47.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.072+0000 7f4b81e00640 1 --2- 172.21.15.107:0/2785519261 >> v2:172.21.15.157:3300/0 conn(0x7f4b7c155660 0x7f4b7c0c7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.072+0000 7f4b81e00640 1 -- 172.21.15.107:0/2785519261 >> v1:172.21.15.107:6789/0 conn(0x7f4b7c0adfb0 legacy=0x7f4b7c0ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.072+0000 7f4b81e00640 1 -- 172.21.15.107:0/2785519261 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b7c0af5f0 con 0x7f4b7c155a30 2024-08-17T02:27:47.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.073+0000 7f4b81e00640 1 --2- 172.21.15.107:0/2785519261 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b7c155a30 0x7f4b7c06dec0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c06aa30 tx=0x7f4b74009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d0d536c378b0251 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.073+0000 7f4b7be00640 1 -- 172.21.15.107:0/2785519261 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b74032400 con 0x7f4b7c155a30 2024-08-17T02:27:47.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.073+0000 7f4b7be00640 1 -- 172.21.15.107:0/2785519261 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7402e050 con 0x7f4b7c155a30 2024-08-17T02:27:47.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.073+0000 7f4b7be00640 1 -- 172.21.15.107:0/2785519261 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b740327f0 con 0x7f4b7c155a30 2024-08-17T02:27:47.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.073+0000 7f4b82800640 1 -- 172.21.15.107:0/2785519261 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b7c155a30 msgr2=0x7f4b7c06dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.073+0000 7f4b82800640 1 --2- 172.21.15.107:0/2785519261 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b7c155a30 0x7f4b7c06dec0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c06aa30 tx=0x7f4b74009840 comp rx=0 tx=0).stop 2024-08-17T02:27:47.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.074+0000 7f4b82800640 1 -- 172.21.15.107:0/2785519261 shutdown_connections 2024-08-17T02:27:47.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.074+0000 7f4b82800640 1 --2- 172.21.15.107:0/2785519261 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b7c155a30 0x7f4b7c06dec0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.074+0000 7f4b82800640 1 --2- 172.21.15.107:0/2785519261 >> v2:172.21.15.157:3300/0 conn(0x7f4b7c155660 0x7f4b7c0c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.074+0000 7f4b82800640 1 -- 172.21.15.107:0/2785519261 >> 172.21.15.107:0/2785519261 conn(0x7f4b7c066cd0 msgr2=0x7f4b7c0670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:47.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.074+0000 7f4b82800640 1 -- 172.21.15.107:0/2785519261 shutdown_connections 2024-08-17T02:27:47.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.074+0000 7f4b82800640 1 -- 172.21.15.107:0/2785519261 wait complete. 2024-08-17T02:27:47.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.075+0000 7f4b82800640 1 Processor -- start 2024-08-17T02:27:47.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.075+0000 7f4b82800640 1 -- start start 2024-08-17T02:27:47.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.076+0000 7f4b82800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b7c0adfb0 0x7f4b7c14ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.076+0000 7f4b82800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b7c155660 0x7f4b7c14ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.076+0000 7f4b82800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b7c155a30 0x7f4b7c14f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.076+0000 7f4b82800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c151580 con 0x7f4b7c155a30 2024-08-17T02:27:47.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.076+0000 7f4b82800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c0a5ea0 con 0x7f4b7c0adfb0 2024-08-17T02:27:47.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.076+0000 7f4b82800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c0aaba0 con 0x7f4b7c155660 2024-08-17T02:27:47.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.076+0000 7f4b81e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b7c155a30 0x7f4b7c14f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.076+0000 7f4b81e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b7c155a30 0x7f4b7c14f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36328/0 (socket says 172.21.15.107:36328) 2024-08-17T02:27:47.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.076+0000 7f4b81e00640 1 -- 172.21.15.107:0/3004627261 learned_addr learned my addr 172.21.15.107:0/3004627261 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:47.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.076+0000 7f4b81400640 1 --2- 172.21.15.107:0/3004627261 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b7c0adfb0 0x7f4b7c14ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.076+0000 7f4b80a00640 1 --2- 172.21.15.107:0/3004627261 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b7c155660 0x7f4b7c14ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.077+0000 7f4b81e00640 1 -- 172.21.15.107:0/3004627261 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b7c155660 msgr2=0x7f4b7c14ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.077+0000 7f4b81e00640 1 --2- 172.21.15.107:0/3004627261 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b7c155660 0x7f4b7c14ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.077+0000 7f4b81e00640 1 -- 172.21.15.107:0/3004627261 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b7c0adfb0 msgr2=0x7f4b7c14ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.077+0000 7f4b81e00640 1 --2- 172.21.15.107:0/3004627261 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b7c0adfb0 0x7f4b7c14ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.077+0000 7f4b81e00640 1 -- 172.21.15.107:0/3004627261 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b74009ae0 con 0x7f4b7c155a30 2024-08-17T02:27:47.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.077+0000 7f4b81e00640 1 --2- 172.21.15.107:0/3004627261 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b7c155a30 0x7f4b7c14f490 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4b74009880 tx=0x7f4b74037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.077+0000 7f4b78c00640 1 -- 172.21.15.107:0/3004627261 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b740078e0 con 0x7f4b7c155a30 2024-08-17T02:27:47.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.077+0000 7f4b78c00640 1 -- 172.21.15.107:0/3004627261 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b74007a40 con 0x7f4b7c155a30 2024-08-17T02:27:47.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.077+0000 7f4b82800640 1 -- 172.21.15.107:0/3004627261 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b7c0a5570 con 0x7f4b7c155a30 2024-08-17T02:27:47.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.077+0000 7f4b78c00640 1 -- 172.21.15.107:0/3004627261 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b74007e00 con 0x7f4b7c155a30 2024-08-17T02:27:47.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.077+0000 7f4b82800640 1 -- 172.21.15.107:0/3004627261 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b7c0a5b30 con 0x7f4b7c155a30 2024-08-17T02:27:47.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.079+0000 7f4b82800640 1 -- 172.21.15.107:0/3004627261 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b7c0a6050 con 0x7f4b7c155a30 2024-08-17T02:27:47.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.079+0000 7f4b78c00640 1 -- 172.21.15.107:0/3004627261 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4b74003040 con 0x7f4b7c155a30 2024-08-17T02:27:47.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.080+0000 7f4b78c00640 1 --2- 172.21.15.107:0/3004627261 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4b5c065150 0x7f4b5c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.080+0000 7f4b78c00640 1 -- 172.21.15.107:0/3004627261 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f4b740a2ad0 con 0x7f4b7c155a30 2024-08-17T02:27:47.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.080+0000 7f4b81400640 1 --2- 172.21.15.107:0/3004627261 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4b5c065150 0x7f4b5c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.081+0000 7f4b81400640 1 --2- 172.21.15.107:0/3004627261 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4b5c065150 0x7f4b5c067600 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4b70007ba0 tx=0x7f4b70008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.085+0000 7f4b78c00640 1 -- 172.21.15.107:0/3004627261 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4b7c0a6050 con 0x7f4b7c155a30 2024-08-17T02:27:47.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.255+0000 7f4b82800640 1 -- 172.21.15.107:0/3004627261 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000928569.meta", "var": "pg_num"} v 0) v1 -- 0x7f4b7c0a6050 con 0x7f4b7c155a30 2024-08-17T02:27:47.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.255+0000 7f4b78c00640 1 -- 172.21.15.107:0/3004627261 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000928569.meta", "var": "pg_num"}]=0 v40) v1 ==== 124+0+11 (secure 0 0 0) 0x7f4b74043020 con 0x7f4b7c155a30 2024-08-17T02:27:47.257 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2024-08-17T02:27:47.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.258+0000 7f4b82800640 1 -- 172.21.15.107:0/3004627261 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4b5c065150 msgr2=0x7f4b5c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.258+0000 7f4b82800640 1 --2- 172.21.15.107:0/3004627261 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4b5c065150 0x7f4b5c067600 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4b70007ba0 tx=0x7f4b70008040 comp rx=0 tx=0).stop 2024-08-17T02:27:47.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.258+0000 7f4b82800640 1 -- 172.21.15.107:0/3004627261 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b7c155a30 msgr2=0x7f4b7c14f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.258+0000 7f4b82800640 1 --2- 172.21.15.107:0/3004627261 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b7c155a30 0x7f4b7c14f490 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4b74009880 tx=0x7f4b74037000 comp rx=0 tx=0).stop 2024-08-17T02:27:47.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.258+0000 7f4b82800640 1 -- 172.21.15.107:0/3004627261 shutdown_connections 2024-08-17T02:27:47.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.258+0000 7f4b82800640 1 --2- 172.21.15.107:0/3004627261 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4b5c065150 0x7f4b5c067600 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.258+0000 7f4b82800640 1 --2- 172.21.15.107:0/3004627261 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b7c155a30 0x7f4b7c14f490 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.258+0000 7f4b82800640 1 --2- 172.21.15.107:0/3004627261 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b7c155660 0x7f4b7c14ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.258+0000 7f4b82800640 1 --2- 172.21.15.107:0/3004627261 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b7c0adfb0 0x7f4b7c14ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.258+0000 7f4b82800640 1 -- 172.21.15.107:0/3004627261 >> 172.21.15.107:0/3004627261 conn(0x7f4b7c066cd0 msgr2=0x7f4b7c069ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:47.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.258+0000 7f4b82800640 1 -- 172.21.15.107:0/3004627261 shutdown_connections 2024-08-17T02:27:47.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.258+0000 7f4b82800640 1 -- 172.21.15.107:0/3004627261 wait complete. 2024-08-17T02:27:47.274 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000928569.data pg_num 2024-08-17T02:27:47.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.424+0000 7f67c6e00640 1 Processor -- start 2024-08-17T02:27:47.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.424+0000 7f67c6e00640 1 -- start start 2024-08-17T02:27:47.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.425+0000 7f67c6e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f67c00af0f0 0x7f67c00abc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.425+0000 7f67c6e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67c00ab790 con 0x7f67c00ae540 2024-08-17T02:27:47.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.425+0000 7f67c6e00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67c00aab80 con 0x7f67c00af520 2024-08-17T02:27:47.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.425+0000 7f67c6e00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67c00aae60 con 0x7f67c00af0f0 2024-08-17T02:27:47.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.425+0000 7f67c5a00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f67c00ae540 0x7f67c00ae910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:40852/0 (socket says 172.21.15.107:40852) 2024-08-17T02:27:47.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.425+0000 7f67c5a00640 1 -- 172.21.15.107:0/3447873959 learned_addr learned my addr 172.21.15.107:0/3447873959 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:27:47.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.426+0000 7f67c5000640 1 --2- 172.21.15.107:0/3447873959 >> v2:172.21.15.157:3300/0 conn(0x7f67c00af0f0 0x7f67c00abc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.426+0000 7f67bfe00640 1 -- 172.21.15.107:0/3447873959 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1283888814 0 0) 0x7f67c00ab790 con 0x7f67c00ae540 2024-08-17T02:27:47.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.426+0000 7f67bfe00640 1 -- 172.21.15.107:0/3447873959 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67a80034e0 con 0x7f67c00ae540 2024-08-17T02:27:47.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.426+0000 7f67bfe00640 1 -- 172.21.15.107:0/3447873959 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2015921346 0 0) 0x7f67a80034e0 con 0x7f67c00ae540 2024-08-17T02:27:47.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.426+0000 7f67bfe00640 1 -- 172.21.15.107:0/3447873959 >> v2:172.21.15.157:3300/0 conn(0x7f67c00af0f0 msgr2=0x7f67c00abc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:47.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.426+0000 7f67bfe00640 1 --2- 172.21.15.107:0/3447873959 >> v2:172.21.15.157:3300/0 conn(0x7f67c00af0f0 0x7f67c00abc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.426+0000 7f67bfe00640 1 -- 172.21.15.107:0/3447873959 >> v1:172.21.15.157:6789/0 conn(0x7f67c00af520 legacy=0x7f67c00ac160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.426+0000 7f67bfe00640 1 -- 172.21.15.107:0/3447873959 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c00ab140 con 0x7f67c00ae540 2024-08-17T02:27:47.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.426+0000 7f67bfe00640 1 -- 172.21.15.107:0/3447873959 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 537989081 0 0) 0x7f67b4001470 con 0x7f67c00ae540 2024-08-17T02:27:47.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.426+0000 7f67bfe00640 1 -- 172.21.15.107:0/3447873959 >> v1:172.21.15.107:6789/0 conn(0x7f67c00ae540 legacy=0x7f67c00ae910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.426+0000 7f67bfe00640 1 --2- 172.21.15.107:0/3447873959 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67a80039d0 0x7f67a8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.426+0000 7f67bfe00640 1 --2- 172.21.15.107:0/3447873959 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67a8004780 0x7f67a8004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.426+0000 7f67bfe00640 1 --2- 172.21.15.107:0/3447873959 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67a8005130 0x7f67a800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.426+0000 7f67bfe00640 1 -- 172.21.15.107:0/3447873959 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c00aae60 con 0x7f67a8004780 2024-08-17T02:27:47.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.426+0000 7f67bfe00640 1 -- 172.21.15.107:0/3447873959 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a800bfc0 con 0x7f67a8005130 2024-08-17T02:27:47.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.426+0000 7f67bfe00640 1 -- 172.21.15.107:0/3447873959 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67a800c180 con 0x7f67a80039d0 2024-08-17T02:27:47.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.426+0000 7f67c5000640 1 --2- 172.21.15.107:0/3447873959 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67a8004780 0x7f67a8004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.427+0000 7f67c6400640 1 --2- 172.21.15.107:0/3447873959 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67a8005130 0x7f67a800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.427+0000 7f67c5a00640 1 --2- 172.21.15.107:0/3447873959 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67a80039d0 0x7f67a8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.427+0000 7f67c5000640 1 -- 172.21.15.107:0/3447873959 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67a80039d0 msgr2=0x7f67a8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:47.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.427+0000 7f67c5000640 1 --2- 172.21.15.107:0/3447873959 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67a80039d0 0x7f67a8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.427+0000 7f67c5000640 1 -- 172.21.15.107:0/3447873959 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67a8005130 msgr2=0x7f67a800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:47.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.427+0000 7f67c5000640 1 --2- 172.21.15.107:0/3447873959 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67a8005130 0x7f67a800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.427+0000 7f67c5000640 1 -- 172.21.15.107:0/3447873959 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a80034e0 con 0x7f67a8004780 2024-08-17T02:27:47.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.427+0000 7f67c6400640 1 -- 172.21.15.107:0/3447873959 reap_dead start 2024-08-17T02:27:47.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.427+0000 7f67c5a00640 1 --2- 172.21.15.107:0/3447873959 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67a80039d0 0x7f67a8003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:47.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.428+0000 7f67c5000640 1 --2- 172.21.15.107:0/3447873959 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67a8004780 0x7f67a8004bf0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f67c0068d40 tx=0x7f67ac0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64e146a47046cc2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.428+0000 7f67bfe00640 1 -- 172.21.15.107:0/3447873959 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ac031400 con 0x7f67a8004780 2024-08-17T02:27:47.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.428+0000 7f67bfe00640 1 -- 172.21.15.107:0/3447873959 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67ac02d050 con 0x7f67a8004780 2024-08-17T02:27:47.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.428+0000 7f67bfe00640 1 -- 172.21.15.107:0/3447873959 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ac031790 con 0x7f67a8004780 2024-08-17T02:27:47.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.429+0000 7f67c6e00640 1 -- 172.21.15.107:0/3447873959 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67a8004780 msgr2=0x7f67a8004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.429+0000 7f67c6e00640 1 --2- 172.21.15.107:0/3447873959 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67a8004780 0x7f67a8004bf0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f67c0068d40 tx=0x7f67ac0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.429+0000 7f67c6e00640 1 -- 172.21.15.107:0/3447873959 shutdown_connections 2024-08-17T02:27:47.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.429+0000 7f67c6e00640 1 --2- 172.21.15.107:0/3447873959 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67a8004780 0x7f67a8004bf0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.429+0000 7f67c6e00640 1 -- 172.21.15.107:0/3447873959 >> 172.21.15.107:0/3447873959 conn(0x7f67c0096a70 msgr2=0x7f67c0096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:47.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.429+0000 7f67c6e00640 1 -- 172.21.15.107:0/3447873959 shutdown_connections 2024-08-17T02:27:47.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.429+0000 7f67c6e00640 1 -- 172.21.15.107:0/3447873959 wait complete. 2024-08-17T02:27:47.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.430+0000 7f67c6e00640 1 Processor -- start 2024-08-17T02:27:47.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.430+0000 7f67c6e00640 1 -- start start 2024-08-17T02:27:47.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.431+0000 7f67c6e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67a8004780 0x7f67c00c9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.431+0000 7f67c6e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67c00cb720 0x7f67c0159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.431+0000 7f67c6e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67c015a190 0x7f67c014d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.431+0000 7f67c6e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c016c630 con 0x7f67c00cb720 2024-08-17T02:27:47.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.431+0000 7f67c6e00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c016c840 con 0x7f67c015a190 2024-08-17T02:27:47.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.431+0000 7f67c6e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67c016cb20 con 0x7f67a8004780 2024-08-17T02:27:47.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.431+0000 7f67c5000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67c00cb720 0x7f67c0159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.431+0000 7f67c5000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67c00cb720 0x7f67c0159c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36340/0 (socket says 172.21.15.107:36340) 2024-08-17T02:27:47.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.431+0000 7f67c5000640 1 -- 172.21.15.107:0/2934324326 learned_addr learned my addr 172.21.15.107:0/2934324326 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:47.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.432+0000 7f67c5a00640 1 --2- 172.21.15.107:0/2934324326 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67a8004780 0x7f67c00c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.432+0000 7f67c5000640 1 -- 172.21.15.107:0/2934324326 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67a8004780 msgr2=0x7f67c00c9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.432+0000 7f67c6400640 1 --2- 172.21.15.107:0/2934324326 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67c015a190 0x7f67c014d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.432+0000 7f67c5000640 1 --2- 172.21.15.107:0/2934324326 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67a8004780 0x7f67c00c9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.432+0000 7f67c5000640 1 -- 172.21.15.107:0/2934324326 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67c015a190 msgr2=0x7f67c014d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.432+0000 7f67c5000640 1 --2- 172.21.15.107:0/2934324326 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67c015a190 0x7f67c014d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.432+0000 7f67c5000640 1 -- 172.21.15.107:0/2934324326 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c016ce00 con 0x7f67c00cb720 2024-08-17T02:27:47.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.432+0000 7f67c5a00640 1 --2- 172.21.15.107:0/2934324326 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67a8004780 0x7f67c00c9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:47.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.432+0000 7f67c6400640 1 --2- 172.21.15.107:0/2934324326 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67c015a190 0x7f67c014d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:47.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.432+0000 7f67c5000640 1 --2- 172.21.15.107:0/2934324326 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67c00cb720 0x7f67c0159c50 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f67ac02ab70 tx=0x7f67ac035000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.432+0000 7f67bcc00640 1 -- 172.21.15.107:0/2934324326 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ac0307d0 con 0x7f67c00cb720 2024-08-17T02:27:47.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.432+0000 7f67bcc00640 1 -- 172.21.15.107:0/2934324326 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67ac030930 con 0x7f67c00cb720 2024-08-17T02:27:47.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.432+0000 7f67c6e00640 1 -- 172.21.15.107:0/2934324326 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67c016d0e0 con 0x7f67c00cb720 2024-08-17T02:27:47.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.432+0000 7f67bcc00640 1 -- 172.21.15.107:0/2934324326 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ac030cf0 con 0x7f67c00cb720 2024-08-17T02:27:47.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.432+0000 7f67c6e00640 1 -- 172.21.15.107:0/2934324326 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67c014d5a0 con 0x7f67c00cb720 2024-08-17T02:27:47.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.434+0000 7f67c6e00640 1 -- 172.21.15.107:0/2934324326 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67c016d270 con 0x7f67c00cb720 2024-08-17T02:27:47.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.434+0000 7f67bcc00640 1 -- 172.21.15.107:0/2934324326 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f67ac045620 con 0x7f67c00cb720 2024-08-17T02:27:47.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.435+0000 7f67bcc00640 1 --2- 172.21.15.107:0/2934324326 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f67a0065150 0x7f67a0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.435+0000 7f67bcc00640 1 -- 172.21.15.107:0/2934324326 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f67ac0a3700 con 0x7f67c00cb720 2024-08-17T02:27:47.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.435+0000 7f67c5a00640 1 --2- 172.21.15.107:0/2934324326 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f67a0065150 0x7f67a0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.436+0000 7f67c5a00640 1 --2- 172.21.15.107:0/2934324326 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f67a0065150 0x7f67a0067600 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f67b4001ed0 tx=0x7f67b4000f60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.439+0000 7f67bcc00640 1 -- 172.21.15.107:0/2934324326 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f67ac0716a0 con 0x7f67c00cb720 2024-08-17T02:27:47.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.609+0000 7f67c6e00640 1 -- 172.21.15.107:0/2934324326 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000928569.data", "var": "pg_num"} v 0) v1 -- 0x7f67c0071050 con 0x7f67c00cb720 2024-08-17T02:27:47.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.609+0000 7f67bcc00640 1 -- 172.21.15.107:0/2934324326 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000928569.data", "var": "pg_num"}]=0 v40) v1 ==== 124+0+11 (secure 0 0 0) 0x7f67ac074cc0 con 0x7f67c00cb720 2024-08-17T02:27:47.611 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2024-08-17T02:27:47.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.611+0000 7f67c6e00640 1 -- 172.21.15.107:0/2934324326 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f67a0065150 msgr2=0x7f67a0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.611+0000 7f67c6e00640 1 --2- 172.21.15.107:0/2934324326 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f67a0065150 0x7f67a0067600 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f67b4001ed0 tx=0x7f67b4000f60 comp rx=0 tx=0).stop 2024-08-17T02:27:47.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.611+0000 7f67c6e00640 1 -- 172.21.15.107:0/2934324326 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67c00cb720 msgr2=0x7f67c0159c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.611+0000 7f67c6e00640 1 --2- 172.21.15.107:0/2934324326 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67c00cb720 0x7f67c0159c50 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f67ac02ab70 tx=0x7f67ac035000 comp rx=0 tx=0).stop 2024-08-17T02:27:47.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.611+0000 7f67c6e00640 1 -- 172.21.15.107:0/2934324326 shutdown_connections 2024-08-17T02:27:47.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.611+0000 7f67c6e00640 1 --2- 172.21.15.107:0/2934324326 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f67a0065150 0x7f67a0067600 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.611+0000 7f67c6e00640 1 --2- 172.21.15.107:0/2934324326 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67c015a190 0x7f67c014d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.611+0000 7f67c6e00640 1 --2- 172.21.15.107:0/2934324326 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67c00cb720 0x7f67c0159c50 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.611+0000 7f67c6e00640 1 --2- 172.21.15.107:0/2934324326 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67a8004780 0x7f67c00c9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.611+0000 7f67c6e00640 1 -- 172.21.15.107:0/2934324326 >> 172.21.15.107:0/2934324326 conn(0x7f67c0096a70 msgr2=0x7f67c0157e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:47.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.611+0000 7f67c6e00640 1 -- 172.21.15.107:0/2934324326 shutdown_connections 2024-08-17T02:27:47.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.611+0000 7f67c6e00640 1 -- 172.21.15.107:0/2934324326 wait complete. 2024-08-17T02:27:47.628 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:47.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.775+0000 7f7177e00640 1 Processor -- start 2024-08-17T02:27:47.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.775+0000 7f7177e00640 1 -- start start 2024-08-17T02:27:47.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.776+0000 7f7177e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f71780aed50 0x7f71780ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.776+0000 7f7177e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71780ce6d0 0x7f71780ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.776+0000 7f7177e00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71780cc890 con 0x7f71780cacf0 2024-08-17T02:27:47.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.776+0000 7f7177e00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71780ceb20 con 0x7f71780aed50 2024-08-17T02:27:47.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.776+0000 7f7177e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71780cb4c0 con 0x7f71780ce6d0 2024-08-17T02:27:47.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.777+0000 7f7176000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71780ce6d0 0x7f71780ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.777+0000 7f7176a00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f71780aed50 0x7f71780ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.777+0000 7f7177400640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f71780cacf0 0x7f71780c4c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:35232/0 (socket says 172.21.15.107:35232) 2024-08-17T02:27:47.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.777+0000 7f7177400640 1 -- 172.21.15.107:0/942304539 learned_addr learned my addr 172.21.15.107:0/942304539 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:27:47.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.777+0000 7f7176a00640 1 -- 172.21.15.107:0/942304539 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71780ce6d0 msgr2=0x7f71780ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:47.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.777+0000 7f7176a00640 1 --2- 172.21.15.107:0/942304539 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71780ce6d0 0x7f71780ca7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.777+0000 7f7176a00640 1 -- 172.21.15.107:0/942304539 >> v1:172.21.15.157:6789/0 conn(0x7f71780cacf0 legacy=0x7f71780c4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.777+0000 7f7176a00640 1 -- 172.21.15.107:0/942304539 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71780cb7a0 con 0x7f71780aed50 2024-08-17T02:27:47.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.777+0000 7f7175600640 1 -- 172.21.15.107:0/942304539 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2202815180 0 0) 0x7f71780cc890 con 0x7f71780cacf0 2024-08-17T02:27:47.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.777+0000 7f7176000640 1 --2- 172.21.15.107:0/942304539 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71780ce6d0 0x7f71780ca7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:47.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.778+0000 7f7176a00640 1 --2- 172.21.15.107:0/942304539 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71780aed50 0x7f71780ce190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7168009850 tx=0x7f71680090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecbfa4ca80bd0704 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.779+0000 7f7175600640 1 -- 172.21.15.107:0/942304539 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716802ad80 con 0x7f71780aed50 2024-08-17T02:27:47.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.779+0000 7f7175600640 1 -- 172.21.15.107:0/942304539 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7168032440 con 0x7f71780aed50 2024-08-17T02:27:47.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.779+0000 7f7175600640 1 -- 172.21.15.107:0/942304539 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71680327e0 con 0x7f71780aed50 2024-08-17T02:27:47.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.779+0000 7f7177e00640 1 -- 172.21.15.107:0/942304539 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71780aed50 msgr2=0x7f71780ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.779+0000 7f7177e00640 1 --2- 172.21.15.107:0/942304539 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71780aed50 0x7f71780ce190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7168009850 tx=0x7f71680090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.779+0000 7f7177e00640 1 -- 172.21.15.107:0/942304539 shutdown_connections 2024-08-17T02:27:47.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.779+0000 7f7177e00640 1 --2- 172.21.15.107:0/942304539 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71780ce6d0 0x7f71780ca7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.779+0000 7f7177e00640 1 --2- 172.21.15.107:0/942304539 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71780aed50 0x7f71780ce190 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.779+0000 7f7177e00640 1 -- 172.21.15.107:0/942304539 >> 172.21.15.107:0/942304539 conn(0x7f7178098e30 msgr2=0x7f717806eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:47.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.779+0000 7f7177e00640 1 -- 172.21.15.107:0/942304539 shutdown_connections 2024-08-17T02:27:47.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.779+0000 7f7177e00640 1 -- 172.21.15.107:0/942304539 wait complete. 2024-08-17T02:27:47.782 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.781+0000 7f7177e00640 1 Processor -- start 2024-08-17T02:27:47.782 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.781+0000 7f7177e00640 1 -- start start 2024-08-17T02:27:47.783 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.781+0000 7f7177e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71780aed50 0x7f71781693d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.783 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.782+0000 7f7177e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71780cacf0 0x7f71780c5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.783 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.782+0000 7f7177e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71780ce6d0 0x7f71780c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.783 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.782+0000 7f7177e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71780c8790 con 0x7f71780ce6d0 2024-08-17T02:27:47.783 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.782+0000 7f7177e00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71780b1fc0 con 0x7f71780aed50 2024-08-17T02:27:47.783 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.782+0000 7f7177e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7178169910 con 0x7f71780cacf0 2024-08-17T02:27:47.783 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.782+0000 7f7177400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71780ce6d0 0x7f71780c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.783 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.782+0000 7f7176a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71780aed50 0x7f71781693d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.784 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.782+0000 7f7177400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71780ce6d0 0x7f71780c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36348/0 (socket says 172.21.15.107:36348) 2024-08-17T02:27:47.784 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.782+0000 7f7177400640 1 -- 172.21.15.107:0/2664778176 learned_addr learned my addr 172.21.15.107:0/2664778176 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:47.784 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.782+0000 7f7176000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71780cacf0 0x7f71780c5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.782+0000 7f7177400640 1 -- 172.21.15.107:0/2664778176 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71780cacf0 msgr2=0x7f71780c5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.782+0000 7f7177400640 1 --2- 172.21.15.107:0/2664778176 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71780cacf0 0x7f71780c5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.782+0000 7f7177400640 1 -- 172.21.15.107:0/2664778176 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71780aed50 msgr2=0x7f71781693d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.782+0000 7f7177400640 1 --2- 172.21.15.107:0/2664778176 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71780aed50 0x7f71781693d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.782+0000 7f7177400640 1 -- 172.21.15.107:0/2664778176 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7164009390 con 0x7f71780ce6d0 2024-08-17T02:27:47.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.782+0000 7f7176a00640 1 --2- 172.21.15.107:0/2664778176 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71780aed50 0x7f71781693d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:47.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.783+0000 7f7177400640 1 --2- 172.21.15.107:0/2664778176 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71780ce6d0 0x7f71780c94c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f717000cbf0 tx=0x7f71700019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.783+0000 7f716e000640 1 -- 172.21.15.107:0/2664778176 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717000ce10 con 0x7f71780ce6d0 2024-08-17T02:27:47.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.783+0000 7f716e000640 1 -- 172.21.15.107:0/2664778176 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f717000a850 con 0x7f71780ce6d0 2024-08-17T02:27:47.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.783+0000 7f7177e00640 1 -- 172.21.15.107:0/2664778176 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7168009390 con 0x7f71780ce6d0 2024-08-17T02:27:47.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.783+0000 7f716e000640 1 -- 172.21.15.107:0/2664778176 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717000ac90 con 0x7f71780ce6d0 2024-08-17T02:27:47.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.783+0000 7f7177e00640 1 -- 172.21.15.107:0/2664778176 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71780c8a60 con 0x7f71780ce6d0 2024-08-17T02:27:47.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.784+0000 7f7177e00640 1 -- 172.21.15.107:0/2664778176 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7178071050 con 0x7f71780ce6d0 2024-08-17T02:27:47.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.785+0000 7f716e000640 1 -- 172.21.15.107:0/2664778176 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7170007300 con 0x7f71780ce6d0 2024-08-17T02:27:47.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.785+0000 7f716e000640 1 --2- 172.21.15.107:0/2664778176 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7158065150 0x7f7158067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.786+0000 7f716e000640 1 -- 172.21.15.107:0/2664778176 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f7170082470 con 0x7f71780ce6d0 2024-08-17T02:27:47.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.786+0000 7f7176a00640 1 --2- 172.21.15.107:0/2664778176 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7158065150 0x7f7158067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.786+0000 7f7176a00640 1 --2- 172.21.15.107:0/2664778176 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7158065150 0x7f7158067600 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7168034000 tx=0x7f7168032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.789+0000 7f716e000640 1 -- 172.21.15.107:0/2664778176 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f71700505e0 con 0x7f71780ce6d0 2024-08-17T02:27:47.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.998+0000 7f7177e00640 1 -- 172.21.15.107:0/2664778176 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7178070430 con 0x7f71780ce6d0 2024-08-17T02:27:48.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:47.999+0000 7f716e000640 1 -- 172.21.15.107:0/2664778176 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4621 (secure 0 0 0) 0x7f717000b0d0 con 0x7f71780ce6d0 2024-08-17T02:27:48.000 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:27:48.000 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4682,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/855770365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":855770365},{"type":"v1","addr":"172.21.15.107:6836","nonce":855770365}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4688,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6834/1749905502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1749905502},{"type":"v1","addr":"172.21.15.157:6834","nonce":1749905502}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4910,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/3701145841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6833","nonce":3701145841},{"type":"v1","addr":"172.21.15.157:6835","nonce":3701145841}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:35.757205+0000","modified":"2024-08-17T02:25:37.759836+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4914":{"gid":4914,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.107:6837/809431952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":809431952},{"type":"v1","addr":"172.21.15.107:6837","nonce":809431952}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000928569","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:27:48.000 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 23 2024-08-17T02:27:48.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.001+0000 7f7177e00640 1 -- 172.21.15.107:0/2664778176 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7158065150 msgr2=0x7f7158067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.001+0000 7f7177e00640 1 --2- 172.21.15.107:0/2664778176 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7158065150 0x7f7158067600 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7168034000 tx=0x7f7168032000 comp rx=0 tx=0).stop 2024-08-17T02:27:48.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.001+0000 7f7177e00640 1 -- 172.21.15.107:0/2664778176 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71780ce6d0 msgr2=0x7f71780c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.001+0000 7f7177e00640 1 --2- 172.21.15.107:0/2664778176 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71780ce6d0 0x7f71780c94c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f717000cbf0 tx=0x7f71700019b0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.001+0000 7f7177e00640 1 -- 172.21.15.107:0/2664778176 shutdown_connections 2024-08-17T02:27:48.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.001+0000 7f7177e00640 1 --2- 172.21.15.107:0/2664778176 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7158065150 0x7f7158067600 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.001+0000 7f7177e00640 1 --2- 172.21.15.107:0/2664778176 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71780ce6d0 0x7f71780c94c0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.001+0000 7f7177e00640 1 --2- 172.21.15.107:0/2664778176 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f71780cacf0 0x7f71780c5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.001+0000 7f7177e00640 1 --2- 172.21.15.107:0/2664778176 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71780aed50 0x7f71781693d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.001+0000 7f7177e00640 1 -- 172.21.15.107:0/2664778176 >> 172.21.15.107:0/2664778176 conn(0x7f7178098e30 msgr2=0x7f7178158580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:48.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.001+0000 7f7177e00640 1 -- 172.21.15.107:0/2664778176 shutdown_connections 2024-08-17T02:27:48.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.001+0000 7f7177e00640 1 -- 172.21.15.107:0/2664778176 wait complete. 2024-08-17T02:27:48.017 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:48.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.163+0000 7ffb65800640 1 Processor -- start 2024-08-17T02:27:48.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.163+0000 7ffb65800640 1 -- start start 2024-08-17T02:27:48.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.164+0000 7ffb65800640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ffb600cc010 0x7ffb600ab2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.164+0000 7ffb65800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ffb600a98e0 0x7ffb600afe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.164+0000 7ffb65800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb600b03d0 0x7ffb6015c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.164+0000 7ffb65800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb600ab950 con 0x7ffb600a98e0 2024-08-17T02:27:48.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.164+0000 7ffb65800640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb600abc30 con 0x7ffb600cc010 2024-08-17T02:27:48.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.164+0000 7ffb65800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb600abf10 con 0x7ffb600b03d0 2024-08-17T02:27:48.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.164+0000 7ffb57400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ffb600a98e0 0x7ffb600afe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.164+0000 7ffb57400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ffb600a98e0 0x7ffb600afe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36354/0 (socket says 172.21.15.107:36354) 2024-08-17T02:27:48.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.164+0000 7ffb57400640 1 -- 172.21.15.107:0/4036044339 learned_addr learned my addr 172.21.15.107:0/4036044339 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:48.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.164+0000 7ffb5fe00640 1 --2- 172.21.15.107:0/4036044339 >> v2:172.21.15.157:3300/0 conn(0x7ffb600cc010 0x7ffb600ab2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.167 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.165+0000 7ffb64e00640 1 --2- 172.21.15.107:0/4036044339 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb600b03d0 0x7ffb6015c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.167 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.165+0000 7ffb57400640 1 -- 172.21.15.107:0/4036044339 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb600b03d0 msgr2=0x7ffb6015c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:48.167 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.165+0000 7ffb57400640 1 --2- 172.21.15.107:0/4036044339 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb600b03d0 0x7ffb6015c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.167 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.165+0000 7ffb57400640 1 -- 172.21.15.107:0/4036044339 >> v2:172.21.15.157:3300/0 conn(0x7ffb600cc010 msgr2=0x7ffb600ab2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:48.167 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.165+0000 7ffb57400640 1 --2- 172.21.15.107:0/4036044339 >> v2:172.21.15.157:3300/0 conn(0x7ffb600cc010 0x7ffb600ab2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.167 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.165+0000 7ffb57400640 1 -- 172.21.15.107:0/4036044339 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb600af970 con 0x7ffb600a98e0 2024-08-17T02:27:48.168 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.166+0000 7ffb57400640 1 --2- 172.21.15.107:0/4036044339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb600a98e0 0x7ffb600afe90 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ffb60064c30 tx=0x7ffb480091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=551ee4edea1554b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:48.168 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.166+0000 7ffb5f400640 1 -- 172.21.15.107:0/4036044339 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4802ad40 con 0x7ffb600a98e0 2024-08-17T02:27:48.168 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.166+0000 7ffb5f400640 1 -- 172.21.15.107:0/4036044339 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb48032440 con 0x7ffb600a98e0 2024-08-17T02:27:48.168 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.166+0000 7ffb5f400640 1 -- 172.21.15.107:0/4036044339 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4802aea0 con 0x7ffb600a98e0 2024-08-17T02:27:48.168 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.167+0000 7ffb65800640 1 -- 172.21.15.107:0/4036044339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb600a98e0 msgr2=0x7ffb600afe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.168 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.167+0000 7ffb65800640 1 --2- 172.21.15.107:0/4036044339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb600a98e0 0x7ffb600afe90 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ffb60064c30 tx=0x7ffb480091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.168 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.167+0000 7ffb65800640 1 -- 172.21.15.107:0/4036044339 shutdown_connections 2024-08-17T02:27:48.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.167+0000 7ffb65800640 1 --2- 172.21.15.107:0/4036044339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb600a98e0 0x7ffb600afe90 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.167+0000 7ffb65800640 1 --2- 172.21.15.107:0/4036044339 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb600b03d0 0x7ffb6015c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.167+0000 7ffb65800640 1 --2- 172.21.15.107:0/4036044339 >> v2:172.21.15.157:3300/0 conn(0x7ffb600cc010 0x7ffb600ab2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.167+0000 7ffb65800640 1 -- 172.21.15.107:0/4036044339 >> 172.21.15.107:0/4036044339 conn(0x7ffb60067de0 msgr2=0x7ffb600681e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:48.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.167+0000 7ffb65800640 1 -- 172.21.15.107:0/4036044339 shutdown_connections 2024-08-17T02:27:48.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.167+0000 7ffb65800640 1 -- 172.21.15.107:0/4036044339 wait complete. 2024-08-17T02:27:48.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.168+0000 7ffb65800640 1 Processor -- start 2024-08-17T02:27:48.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.168+0000 7ffb65800640 1 -- start start 2024-08-17T02:27:48.171 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.169+0000 7ffb65800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb600a98e0 0x7ffb6014f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.171 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.169+0000 7ffb65800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb600b03d0 0x7ffb6015bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.171 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.169+0000 7ffb65800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb600cc010 0x7ffb601442a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.171 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.169+0000 7ffb65800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6015c0c0 con 0x7ffb600b03d0 2024-08-17T02:27:48.171 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.169+0000 7ffb65800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb60159230 con 0x7ffb600cc010 2024-08-17T02:27:48.171 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.169+0000 7ffb65800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb60159ad0 con 0x7ffb600a98e0 2024-08-17T02:27:48.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.169+0000 7ffb57400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb600b03d0 0x7ffb6015bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.169+0000 7ffb57400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb600b03d0 0x7ffb6015bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36366/0 (socket says 172.21.15.107:36366) 2024-08-17T02:27:48.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.170+0000 7ffb57400640 1 -- 172.21.15.107:0/3928724878 learned_addr learned my addr 172.21.15.107:0/3928724878 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:48.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.170+0000 7ffb5fe00640 1 --2- 172.21.15.107:0/3928724878 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb600a98e0 0x7ffb6014f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.170+0000 7ffb64e00640 1 --2- 172.21.15.107:0/3928724878 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb600cc010 0x7ffb601442a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.170+0000 7ffb57400640 1 -- 172.21.15.107:0/3928724878 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb600a98e0 msgr2=0x7ffb6014f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.170+0000 7ffb57400640 1 --2- 172.21.15.107:0/3928724878 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb600a98e0 0x7ffb6014f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.170+0000 7ffb57400640 1 -- 172.21.15.107:0/3928724878 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb600cc010 msgr2=0x7ffb601442a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.170+0000 7ffb57400640 1 --2- 172.21.15.107:0/3928724878 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb600cc010 0x7ffb601442a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.170+0000 7ffb57400640 1 -- 172.21.15.107:0/3928724878 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb48009450 con 0x7ffb600b03d0 2024-08-17T02:27:48.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.170+0000 7ffb57400640 1 --2- 172.21.15.107:0/3928724878 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb600b03d0 0x7ffb6015bb80 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ffb48009210 tx=0x7ffb48032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:48.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.170+0000 7ffb57e00640 1 -- 172.21.15.107:0/3928724878 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb48031730 con 0x7ffb600b03d0 2024-08-17T02:27:48.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.171+0000 7ffb57e00640 1 -- 172.21.15.107:0/3928724878 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb48031890 con 0x7ffb600b03d0 2024-08-17T02:27:48.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.171+0000 7ffb57e00640 1 -- 172.21.15.107:0/3928724878 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb48031c90 con 0x7ffb600b03d0 2024-08-17T02:27:48.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.171+0000 7ffb65800640 1 -- 172.21.15.107:0/3928724878 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb6015c2d0 con 0x7ffb600b03d0 2024-08-17T02:27:48.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.171+0000 7ffb65800640 1 -- 172.21.15.107:0/3928724878 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb60159760 con 0x7ffb600b03d0 2024-08-17T02:27:48.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.172+0000 7ffb65800640 1 -- 172.21.15.107:0/3928724878 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb60159c40 con 0x7ffb600b03d0 2024-08-17T02:27:48.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.172+0000 7ffb57e00640 1 -- 172.21.15.107:0/3928724878 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ffb48039040 con 0x7ffb600b03d0 2024-08-17T02:27:48.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.173+0000 7ffb57e00640 1 --2- 172.21.15.107:0/3928724878 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ffb3c065150 0x7ffb3c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.174+0000 7ffb57e00640 1 -- 172.21.15.107:0/3928724878 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7ffb480a1e20 con 0x7ffb600b03d0 2024-08-17T02:27:48.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.174+0000 7ffb5fe00640 1 --2- 172.21.15.107:0/3928724878 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ffb3c065150 0x7ffb3c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.174+0000 7ffb5fe00640 1 --2- 172.21.15.107:0/3928724878 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ffb3c065150 0x7ffb3c067600 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ffb50009c80 tx=0x7ffb500090f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:48.178 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.178+0000 7ffb57e00640 1 -- 172.21.15.107:0/3928724878 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ffb4806fe70 con 0x7ffb600b03d0 2024-08-17T02:27:48.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.349+0000 7ffb65800640 1 -- 172.21.15.107:0/3928724878 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb60071050 con 0x7ffb600b03d0 2024-08-17T02:27:48.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.350+0000 7ffb57e00640 1 -- 172.21.15.107:0/3928724878 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+15562 (secure 0 0 0) 0x7ffb48042020 con 0x7ffb600b03d0 2024-08-17T02:27:48.352 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:27:48.352 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":40,"fsid":"f207b4c0-329d-46b8-b83f-aaf30bdb6ce3","created":"2024-08-17T02:24:11.038049+0000","modified":"2024-08-17T02:27:46.174092+0000","last_up_change":"2024-08-17T02:24:22.047790+0000","last_in_change":"2024-08-17T02:24:13.892720+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:23.456166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000928569.meta","create_time":"2024-08-17T02:25:33.885385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000928569"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000928569.data","create_time":"2024-08-17T02:25:34.790701+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000928569"}}}],"osds":[{"osd":0,"uuid":"376363f3-b8bf-4f1e-b691-51cdd39171ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37302},{"type":"v1","addr":"172.21.15.107:6801","nonce":37302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37302},{"type":"v1","addr":"172.21.15.107:6803","nonce":37302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37302},{"type":"v1","addr":"172.21.15.107:6807","nonce":37302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37302},{"type":"v1","addr":"172.21.15.107:6805","nonce":37302}]},"public_addr":"172.21.15.107:6801/37302","cluster_addr":"172.21.15.107:6803/37302","heartbeat_back_addr":"172.21.15.107:6807/37302","heartbeat_front_addr":"172.21.15.107:6805/37302","state":["exists","up"]},{"osd":1,"uuid":"cc6624e3-2ad4-4db4-b377-05dfe57424e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37305},{"type":"v1","addr":"172.21.15.107:6824","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37305},{"type":"v1","addr":"172.21.15.107:6827","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37305},{"type":"v1","addr":"172.21.15.107:6831","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37305},{"type":"v1","addr":"172.21.15.107:6829","nonce":37305}]},"public_addr":"172.21.15.107:6824/37305","cluster_addr":"172.21.15.107:6827/37305","heartbeat_back_addr":"172.21.15.107:6831/37305","heartbeat_front_addr":"172.21.15.107:6829/37305","state":["exists","up"]},{"osd":2,"uuid":"25229542-29b5-4281-bcb0-798ae0930aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37307},{"type":"v1","addr":"172.21.15.107:6817","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37307},{"type":"v1","addr":"172.21.15.107:6819","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6823","nonce":37307},{"type":"v1","addr":"172.21.15.107:6825","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37307},{"type":"v1","addr":"172.21.15.107:6821","nonce":37307}]},"public_addr":"172.21.15.107:6817/37307","cluster_addr":"172.21.15.107:6819/37307","heartbeat_back_addr":"172.21.15.107:6825/37307","heartbeat_front_addr":"172.21.15.107:6821/37307","state":["exists","up"]},{"osd":3,"uuid":"5f16aee8-8950-4268-a61a-5cf6ebd670e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37306},{"type":"v1","addr":"172.21.15.107:6809","nonce":37306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37306},{"type":"v1","addr":"172.21.15.107:6811","nonce":37306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37306},{"type":"v1","addr":"172.21.15.107:6815","nonce":37306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37306},{"type":"v1","addr":"172.21.15.107:6813","nonce":37306}]},"public_addr":"172.21.15.107:6809/37306","cluster_addr":"172.21.15.107:6811/37306","heartbeat_back_addr":"172.21.15.107:6815/37306","heartbeat_front_addr":"172.21.15.107:6813/37306","state":["exists","up"]},{"osd":4,"uuid":"23232e28-e23b-4b4e-a531-4939246dbbde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":37329},{"type":"v1","addr":"172.21.15.157:6817","nonce":37329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":37329},{"type":"v1","addr":"172.21.15.157:6819","nonce":37329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":37329},{"type":"v1","addr":"172.21.15.157:6823","nonce":37329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":37329},{"type":"v1","addr":"172.21.15.157:6821","nonce":37329}]},"public_addr":"172.21.15.157:6817/37329","cluster_addr":"172.21.15.157:6819/37329","heartbeat_back_addr":"172.21.15.157:6823/37329","heartbeat_front_addr":"172.21.15.157:6821/37329","state":["exists","up"]},{"osd":5,"uuid":"f87ec331-3e59-4886-a317-6f7e26ec8e21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":37328},{"type":"v1","addr":"172.21.15.157:6804","nonce":37328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":37328},{"type":"v1","addr":"172.21.15.157:6808","nonce":37328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":37328},{"type":"v1","addr":"172.21.15.157:6815","nonce":37328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":37328},{"type":"v1","addr":"172.21.15.157:6812","nonce":37328}]},"public_addr":"172.21.15.157:6804/37328","cluster_addr":"172.21.15.157:6808/37328","heartbeat_back_addr":"172.21.15.157:6815/37328","heartbeat_front_addr":"172.21.15.157:6812/37328","state":["exists","up"]},{"osd":6,"uuid":"92852235-ce49-4d96-a940-6f18d97b13ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":37330},{"type":"v1","addr":"172.21.15.157:6801","nonce":37330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6803","nonce":37330},{"type":"v1","addr":"172.21.15.157:6805","nonce":37330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":37330},{"type":"v1","addr":"172.21.15.157:6813","nonce":37330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":37330},{"type":"v1","addr":"172.21.15.157:6809","nonce":37330}]},"public_addr":"172.21.15.157:6801/37330","cluster_addr":"172.21.15.157:6805/37330","heartbeat_back_addr":"172.21.15.157:6813/37330","heartbeat_front_addr":"172.21.15.157:6809/37330","state":["exists","up"]},{"osd":7,"uuid":"7484a061-723d-4663-b28f-b01766d62f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":37373},{"type":"v1","addr":"172.21.15.157:6825","nonce":37373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":37373},{"type":"v1","addr":"172.21.15.157:6827","nonce":37373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":37373},{"type":"v1","addr":"172.21.15.157:6831","nonce":37373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":37373},{"type":"v1","addr":"172.21.15.157:6829","nonce":37373}]},"public_addr":"172.21.15.157:6825/37373","cluster_addr":"172.21.15.157:6827/37373","heartbeat_back_addr":"172.21.15.157:6831/37373","heartbeat_front_addr":"172.21.15.157:6829/37373","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.110188+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.280265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.252119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.267996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.284582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.144420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.174764+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.308002+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.157:6835/1725535660":"2024-08-18T02:27:43.163351+0000","172.21.15.157:6833/1725535660":"2024-08-18T02:27:43.163351+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:48.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.352+0000 7ffb65800640 1 -- 172.21.15.107:0/3928724878 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ffb3c065150 msgr2=0x7ffb3c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.352+0000 7ffb65800640 1 --2- 172.21.15.107:0/3928724878 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ffb3c065150 0x7ffb3c067600 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ffb50009c80 tx=0x7ffb500090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.352+0000 7ffb65800640 1 -- 172.21.15.107:0/3928724878 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb600b03d0 msgr2=0x7ffb6015bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.352+0000 7ffb65800640 1 --2- 172.21.15.107:0/3928724878 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb600b03d0 0x7ffb6015bb80 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ffb48009210 tx=0x7ffb48032000 comp rx=0 tx=0).stop 2024-08-17T02:27:48.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.352+0000 7ffb65800640 1 -- 172.21.15.107:0/3928724878 shutdown_connections 2024-08-17T02:27:48.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.352+0000 7ffb65800640 1 --2- 172.21.15.107:0/3928724878 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ffb3c065150 0x7ffb3c067600 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.352+0000 7ffb65800640 1 --2- 172.21.15.107:0/3928724878 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb600cc010 0x7ffb601442a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.352+0000 7ffb65800640 1 --2- 172.21.15.107:0/3928724878 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb600b03d0 0x7ffb6015bb80 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.352+0000 7ffb65800640 1 --2- 172.21.15.107:0/3928724878 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb600a98e0 0x7ffb6014f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.352+0000 7ffb65800640 1 -- 172.21.15.107:0/3928724878 >> 172.21.15.107:0/3928724878 conn(0x7ffb60067de0 msgr2=0x7ffb600ac330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:48.355 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.353+0000 7ffb65800640 1 -- 172.21.15.107:0/3928724878 shutdown_connections 2024-08-17T02:27:48.355 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.353+0000 7ffb65800640 1 -- 172.21.15.107:0/3928724878 wait complete. 2024-08-17T02:27:48.368 INFO:tasks.cephfs.filesystem:Destroying file system volume_0000000000928569 and related pools 2024-08-17T02:27:48.369 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:48.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.514+0000 7f6894200640 1 Processor -- start 2024-08-17T02:27:48.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.514+0000 7f6894200640 1 -- start start 2024-08-17T02:27:48.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.515+0000 7f6894200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f688c1401b0 0x7f688c0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.515+0000 7f6894200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f688c0caa80 con 0x7f688c140580 2024-08-17T02:27:48.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.515+0000 7f6894200640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f688c0c9e70 con 0x7f688c0b1440 2024-08-17T02:27:48.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.515+0000 7f6894200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f688c0cb450 con 0x7f688c1401b0 2024-08-17T02:27:48.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.516+0000 7f6890e00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f688c140580 0x7f688c0b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:40856/0 (socket says 172.21.15.107:40856) 2024-08-17T02:27:48.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.516+0000 7f6890e00640 1 -- 172.21.15.107:0/2721459810 learned_addr learned my addr 172.21.15.107:0/2721459810 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:27:48.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.516+0000 7f6891800640 1 --2- 172.21.15.107:0/2721459810 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f688c1401b0 0x7f688c0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.516+0000 7f688be00640 1 -- 172.21.15.107:0/2721459810 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2648153681 0 0) 0x7f688c0caa80 con 0x7f688c140580 2024-08-17T02:27:48.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.516+0000 7f688be00640 1 -- 172.21.15.107:0/2721459810 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68740034e0 con 0x7f688c140580 2024-08-17T02:27:48.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.516+0000 7f688be00640 1 -- 172.21.15.107:0/2721459810 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3092224250 0 0) 0x7f68740034e0 con 0x7f688c140580 2024-08-17T02:27:48.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.516+0000 7f688be00640 1 -- 172.21.15.107:0/2721459810 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f688c1401b0 msgr2=0x7f688c0caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:48.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.516+0000 7f688be00640 1 --2- 172.21.15.107:0/2721459810 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f688c1401b0 0x7f688c0caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.516+0000 7f688be00640 1 -- 172.21.15.107:0/2721459810 >> v1:172.21.15.157:6789/0 conn(0x7f688c0b1440 legacy=0x7f688c0c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.516+0000 7f688be00640 1 -- 172.21.15.107:0/2721459810 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f688c0ca150 con 0x7f688c140580 2024-08-17T02:27:48.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.516+0000 7f688be00640 1 -- 172.21.15.107:0/2721459810 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 537989081 0 0) 0x7f6878001470 con 0x7f688c140580 2024-08-17T02:27:48.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.517+0000 7f688be00640 1 -- 172.21.15.107:0/2721459810 >> v1:172.21.15.107:6789/0 conn(0x7f688c140580 legacy=0x7f688c0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.517+0000 7f688be00640 1 --2- 172.21.15.107:0/2721459810 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6874003a00 0x7f6874003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.517+0000 7f688be00640 1 --2- 172.21.15.107:0/2721459810 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f688c1401b0 0x7f6874004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.517+0000 7f688be00640 1 --2- 172.21.15.107:0/2721459810 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6874004cc0 0x7f6874005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.517+0000 7f688be00640 1 -- 172.21.15.107:0/2721459810 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688c0cb450 con 0x7f6874003a00 2024-08-17T02:27:48.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.517+0000 7f688be00640 1 -- 172.21.15.107:0/2721459810 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687400bae0 con 0x7f6874004cc0 2024-08-17T02:27:48.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.517+0000 7f688be00640 1 -- 172.21.15.107:0/2721459810 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f687400bca0 con 0x7f688c1401b0 2024-08-17T02:27:48.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.517+0000 7f6891800640 1 --2- 172.21.15.107:0/2721459810 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6874003a00 0x7f6874003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.517+0000 7f6890e00640 1 --2- 172.21.15.107:0/2721459810 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f688c1401b0 0x7f6874004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.517+0000 7f6892200640 1 --2- 172.21.15.107:0/2721459810 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6874004cc0 0x7f6874005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.517+0000 7f6891800640 1 -- 172.21.15.107:0/2721459810 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f688c1401b0 msgr2=0x7f6874004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:48.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.517+0000 7f6891800640 1 --2- 172.21.15.107:0/2721459810 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f688c1401b0 0x7f6874004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.517+0000 7f6891800640 1 -- 172.21.15.107:0/2721459810 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6874004cc0 msgr2=0x7f6874005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:48.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.517+0000 7f6891800640 1 --2- 172.21.15.107:0/2721459810 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6874004cc0 0x7f6874005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.517+0000 7f6891800640 1 -- 172.21.15.107:0/2721459810 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68740034e0 con 0x7f6874003a00 2024-08-17T02:27:48.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.517+0000 7f6890e00640 1 --2- 172.21.15.107:0/2721459810 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f688c1401b0 0x7f6874004780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:48.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.518+0000 7f6891800640 1 --2- 172.21.15.107:0/2721459810 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6874003a00 0x7f6874003e10 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6880009b70 tx=0x7f68800090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af50da3b0d0e0713 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:48.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.518+0000 7f688be00640 1 -- 172.21.15.107:0/2721459810 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6880031400 con 0x7f6874003a00 2024-08-17T02:27:48.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.518+0000 7f688be00640 1 -- 172.21.15.107:0/2721459810 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688002d050 con 0x7f6874003a00 2024-08-17T02:27:48.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.518+0000 7f688be00640 1 -- 172.21.15.107:0/2721459810 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6880031790 con 0x7f6874003a00 2024-08-17T02:27:48.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.519+0000 7f6894200640 1 -- 172.21.15.107:0/2721459810 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6874003a00 msgr2=0x7f6874003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.519+0000 7f6894200640 1 --2- 172.21.15.107:0/2721459810 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6874003a00 0x7f6874003e10 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6880009b70 tx=0x7f68800090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.519+0000 7f6892200640 1 -- 172.21.15.107:0/2721459810 reap_dead start 2024-08-17T02:27:48.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.519+0000 7f6894200640 1 -- 172.21.15.107:0/2721459810 shutdown_connections 2024-08-17T02:27:48.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.519+0000 7f6894200640 1 -- 172.21.15.107:0/2721459810 >> 172.21.15.107:0/2721459810 conn(0x7f688c0cb9b0 msgr2=0x7f688c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:48.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.519+0000 7f6894200640 1 -- 172.21.15.107:0/2721459810 shutdown_connections 2024-08-17T02:27:48.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.519+0000 7f6894200640 1 -- 172.21.15.107:0/2721459810 wait complete. 2024-08-17T02:27:48.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.520+0000 7f6894200640 1 Processor -- start 2024-08-17T02:27:48.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.521+0000 7f6894200640 1 -- start start 2024-08-17T02:27:48.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.522+0000 7f6894200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6874003a00 0x7f688c13e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.522+0000 7f6894200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f688c13edd0 0x7f688c15b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.522+0000 7f6894200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f688c13f240 0x7f688c15b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.522+0000 7f6894200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688c0b08e0 con 0x7f6874003a00 2024-08-17T02:27:48.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.522+0000 7f6894200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688c0afcd0 con 0x7f688c13edd0 2024-08-17T02:27:48.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.522+0000 7f6894200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f688c0affb0 con 0x7f688c13f240 2024-08-17T02:27:48.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.522+0000 7f6891800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6874003a00 0x7f688c13e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.522+0000 7f6891800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6874003a00 0x7f688c13e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36384/0 (socket says 172.21.15.107:36384) 2024-08-17T02:27:48.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.522+0000 7f6891800640 1 -- 172.21.15.107:0/3239736880 learned_addr learned my addr 172.21.15.107:0/3239736880 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:48.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.522+0000 7f6890e00640 1 --2- 172.21.15.107:0/3239736880 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f688c13edd0 0x7f688c15b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.522+0000 7f6892200640 1 --2- 172.21.15.107:0/3239736880 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f688c13f240 0x7f688c15b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.522+0000 7f6891800640 1 -- 172.21.15.107:0/3239736880 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f688c13f240 msgr2=0x7f688c15b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.522+0000 7f6891800640 1 --2- 172.21.15.107:0/3239736880 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f688c13f240 0x7f688c15b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.522+0000 7f6891800640 1 -- 172.21.15.107:0/3239736880 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f688c13edd0 msgr2=0x7f688c15b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.522+0000 7f6891800640 1 --2- 172.21.15.107:0/3239736880 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f688c13edd0 0x7f688c15b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.522+0000 7f6891800640 1 -- 172.21.15.107:0/3239736880 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f688c0b0290 con 0x7f6874003a00 2024-08-17T02:27:48.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.523+0000 7f6891800640 1 --2- 172.21.15.107:0/3239736880 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6874003a00 0x7f688c13e450 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6880009b70 tx=0x7f6880035000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:48.526 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.523+0000 7f6888c00640 1 -- 172.21.15.107:0/3239736880 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688003c5c0 con 0x7f6874003a00 2024-08-17T02:27:48.526 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.523+0000 7f6888c00640 1 -- 172.21.15.107:0/3239736880 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6880040070 con 0x7f6874003a00 2024-08-17T02:27:48.526 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.523+0000 7f6894200640 1 -- 172.21.15.107:0/3239736880 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f688c0b0570 con 0x7f6874003a00 2024-08-17T02:27:48.526 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.523+0000 7f6888c00640 1 -- 172.21.15.107:0/3239736880 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688003c970 con 0x7f6874003a00 2024-08-17T02:27:48.526 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.523+0000 7f6894200640 1 -- 172.21.15.107:0/3239736880 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f688c0c7680 con 0x7f6874003a00 2024-08-17T02:27:48.527 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.524+0000 7f6894200640 1 -- 172.21.15.107:0/3239736880 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f688c064db0 con 0x7f6874003a00 2024-08-17T02:27:48.527 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.525+0000 7f6888c00640 1 -- 172.21.15.107:0/3239736880 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6880042030 con 0x7f6874003a00 2024-08-17T02:27:48.527 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.526+0000 7f6888c00640 1 --2- 172.21.15.107:0/3239736880 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f686c065150 0x7f686c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.527 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.526+0000 7f6888c00640 1 -- 172.21.15.107:0/3239736880 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f68800a34e0 con 0x7f6874003a00 2024-08-17T02:27:48.527 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.526+0000 7f6890e00640 1 --2- 172.21.15.107:0/3239736880 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f686c065150 0x7f686c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.528 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.527+0000 7f6890e00640 1 --2- 172.21.15.107:0/3239736880 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f686c065150 0x7f686c067600 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6878000fd0 tx=0x7f6878007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:48.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.530+0000 7f6888c00640 1 -- 172.21.15.107:0/3239736880 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f68800715f0 con 0x7f6874003a00 2024-08-17T02:27:48.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.735+0000 7f6894200640 1 -- 172.21.15.107:0/3239736880 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f688c0c9a60 con 0x7f6874003a00 2024-08-17T02:27:48.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.736+0000 7f6888c00640 1 -- 172.21.15.107:0/3239736880 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4621 (secure 0 0 0) 0x7f6880074c10 con 0x7f6874003a00 2024-08-17T02:27:48.737 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:27:48.737 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4682,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/855770365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":855770365},{"type":"v1","addr":"172.21.15.107:6836","nonce":855770365}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4688,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6834/1749905502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1749905502},{"type":"v1","addr":"172.21.15.157:6834","nonce":1749905502}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4910,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/3701145841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6833","nonce":3701145841},{"type":"v1","addr":"172.21.15.157:6835","nonce":3701145841}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:35.757205+0000","modified":"2024-08-17T02:25:37.759836+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4914":{"gid":4914,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.107:6837/809431952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":809431952},{"type":"v1","addr":"172.21.15.107:6837","nonce":809431952}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000928569","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:27:48.738 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 23 2024-08-17T02:27:48.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.738+0000 7f6894200640 1 -- 172.21.15.107:0/3239736880 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f686c065150 msgr2=0x7f686c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.738+0000 7f6894200640 1 --2- 172.21.15.107:0/3239736880 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f686c065150 0x7f686c067600 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6878000fd0 tx=0x7f6878007040 comp rx=0 tx=0).stop 2024-08-17T02:27:48.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.738+0000 7f6894200640 1 -- 172.21.15.107:0/3239736880 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6874003a00 msgr2=0x7f688c13e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.738+0000 7f6894200640 1 --2- 172.21.15.107:0/3239736880 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6874003a00 0x7f688c13e450 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6880009b70 tx=0x7f6880035000 comp rx=0 tx=0).stop 2024-08-17T02:27:48.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.738+0000 7f6894200640 1 -- 172.21.15.107:0/3239736880 shutdown_connections 2024-08-17T02:27:48.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.738+0000 7f6894200640 1 --2- 172.21.15.107:0/3239736880 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f686c065150 0x7f686c067600 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.738+0000 7f6894200640 1 --2- 172.21.15.107:0/3239736880 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f688c13f240 0x7f688c15b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.738+0000 7f6894200640 1 --2- 172.21.15.107:0/3239736880 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f688c13edd0 0x7f688c15b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.738+0000 7f6894200640 1 --2- 172.21.15.107:0/3239736880 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6874003a00 0x7f688c13e450 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.738+0000 7f6894200640 1 -- 172.21.15.107:0/3239736880 >> 172.21.15.107:0/3239736880 conn(0x7f688c0cb9b0 msgr2=0x7f688c15d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:48.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.738+0000 7f6894200640 1 -- 172.21.15.107:0/3239736880 shutdown_connections 2024-08-17T02:27:48.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.738+0000 7f6894200640 1 -- 172.21.15.107:0/3239736880 wait complete. 2024-08-17T02:27:48.755 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:48.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.900+0000 7f223f400640 1 Processor -- start 2024-08-17T02:27:48.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.900+0000 7f223f400640 1 -- start start 2024-08-17T02:27:48.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.901+0000 7f223f400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2238155a20 0x7f22380adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.902+0000 7f223f400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2238155df0 0x7f22380ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.902+0000 7f223f400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2238156670 con 0x7f223806d7f0 2024-08-17T02:27:48.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.902+0000 7f223f400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22380b0350 con 0x7f2238155df0 2024-08-17T02:27:48.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.902+0000 7f223f400640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f223806e5e0 con 0x7f2238155a20 2024-08-17T02:27:48.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.902+0000 7f222fe00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2238155df0 0x7f22380ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.902+0000 7f222fe00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2238155df0 0x7f22380ad9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36400/0 (socket says 172.21.15.107:36400) 2024-08-17T02:27:48.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.902+0000 7f222fe00640 1 -- 172.21.15.107:0/949513700 learned_addr learned my addr 172.21.15.107:0/949513700 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:48.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.902+0000 7f223ca00640 1 --2- 172.21.15.107:0/949513700 >> v2:172.21.15.157:3300/0 conn(0x7f2238155a20 0x7f22380adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.902+0000 7f222fe00640 1 -- 172.21.15.107:0/949513700 >> v2:172.21.15.157:3300/0 conn(0x7f2238155a20 msgr2=0x7f22380adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:48.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.902+0000 7f222fe00640 1 --2- 172.21.15.107:0/949513700 >> v2:172.21.15.157:3300/0 conn(0x7f2238155a20 0x7f22380adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.902+0000 7f222fe00640 1 -- 172.21.15.107:0/949513700 >> v1:172.21.15.107:6789/0 conn(0x7f223806d7f0 legacy=0x7f22380ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.902+0000 7f222fe00640 1 -- 172.21.15.107:0/949513700 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f223806e8c0 con 0x7f2238155df0 2024-08-17T02:27:48.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.902+0000 7f223ca00640 1 --2- 172.21.15.107:0/949513700 >> v2:172.21.15.157:3300/0 conn(0x7f2238155a20 0x7f22380adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:48.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.903+0000 7f222fe00640 1 --2- 172.21.15.107:0/949513700 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2238155df0 0x7f22380ad9b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f223806bc00 tx=0x7f22200091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d5489dd1cfd46cd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:48.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.904+0000 7f2237e00640 1 -- 172.21.15.107:0/949513700 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222002ae80 con 0x7f2238155df0 2024-08-17T02:27:48.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.904+0000 7f2237e00640 1 -- 172.21.15.107:0/949513700 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2220032440 con 0x7f2238155df0 2024-08-17T02:27:48.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.904+0000 7f2237e00640 1 -- 172.21.15.107:0/949513700 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2220032800 con 0x7f2238155df0 2024-08-17T02:27:48.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.904+0000 7f223f400640 1 -- 172.21.15.107:0/949513700 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2238155df0 msgr2=0x7f22380ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.904+0000 7f223f400640 1 --2- 172.21.15.107:0/949513700 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2238155df0 0x7f22380ad9b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f223806bc00 tx=0x7f22200091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.904+0000 7f223f400640 1 -- 172.21.15.107:0/949513700 shutdown_connections 2024-08-17T02:27:48.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.904+0000 7f223f400640 1 --2- 172.21.15.107:0/949513700 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2238155df0 0x7f22380ad9b0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.904+0000 7f223f400640 1 --2- 172.21.15.107:0/949513700 >> v2:172.21.15.157:3300/0 conn(0x7f2238155a20 0x7f22380adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.904+0000 7f223f400640 1 -- 172.21.15.107:0/949513700 >> 172.21.15.107:0/949513700 conn(0x7f22380cb9b0 msgr2=0x7f22380cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:48.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.904+0000 7f223f400640 1 -- 172.21.15.107:0/949513700 shutdown_connections 2024-08-17T02:27:48.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.904+0000 7f223f400640 1 -- 172.21.15.107:0/949513700 wait complete. 2024-08-17T02:27:48.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.906+0000 7f223f400640 1 Processor -- start 2024-08-17T02:27:48.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.906+0000 7f223f400640 1 -- start start 2024-08-17T02:27:48.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.907+0000 7f223f400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f223806d7f0 0x7f22380ab530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.907+0000 7f223f400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2238155a20 0x7f22380c2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.907+0000 7f223f400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2238155df0 0x7f22380c09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.907+0000 7f223f400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22380c2790 con 0x7f223806d7f0 2024-08-17T02:27:48.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.907+0000 7f223f400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22380c1dc0 con 0x7f2238155a20 2024-08-17T02:27:48.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.907+0000 7f223f400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22380c0ee0 con 0x7f2238155df0 2024-08-17T02:27:48.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.907+0000 7f223ca00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f223806d7f0 0x7f22380ab530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.907+0000 7f223ca00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f223806d7f0 0x7f22380ab530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36402/0 (socket says 172.21.15.107:36402) 2024-08-17T02:27:48.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.907+0000 7f223ca00640 1 -- 172.21.15.107:0/4091900348 learned_addr learned my addr 172.21.15.107:0/4091900348 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:48.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.907+0000 7f222fe00640 1 --2- 172.21.15.107:0/4091900348 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2238155a20 0x7f22380c2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.907+0000 7f223d400640 1 --2- 172.21.15.107:0/4091900348 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2238155df0 0x7f22380c09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.907+0000 7f223ca00640 1 -- 172.21.15.107:0/4091900348 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2238155df0 msgr2=0x7f22380c09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.907+0000 7f223ca00640 1 --2- 172.21.15.107:0/4091900348 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2238155df0 0x7f22380c09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.907+0000 7f223ca00640 1 -- 172.21.15.107:0/4091900348 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2238155a20 msgr2=0x7f22380c2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.907+0000 7f223ca00640 1 --2- 172.21.15.107:0/4091900348 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2238155a20 0x7f22380c2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.907+0000 7f223ca00640 1 -- 172.21.15.107:0/4091900348 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2220009450 con 0x7f223806d7f0 2024-08-17T02:27:48.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.907+0000 7f222fe00640 1 --2- 172.21.15.107:0/4091900348 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2238155a20 0x7f22380c2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:48.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.908+0000 7f223ca00640 1 --2- 172.21.15.107:0/4091900348 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f223806d7f0 0x7f22380ab530 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f222800d890 tx=0x7f2228008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:48.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.908+0000 7f2234c00640 1 -- 172.21.15.107:0/4091900348 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222800de80 con 0x7f223806d7f0 2024-08-17T02:27:48.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.908+0000 7f2234c00640 1 -- 172.21.15.107:0/4091900348 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f222800b8d0 con 0x7f223806d7f0 2024-08-17T02:27:48.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.908+0000 7f2234c00640 1 -- 172.21.15.107:0/4091900348 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222800bc90 con 0x7f223806d7f0 2024-08-17T02:27:48.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.908+0000 7f223f400640 1 -- 172.21.15.107:0/4091900348 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22380c11b0 con 0x7f223806d7f0 2024-08-17T02:27:48.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.908+0000 7f223f400640 1 -- 172.21.15.107:0/4091900348 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22380c1770 con 0x7f223806d7f0 2024-08-17T02:27:48.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.909+0000 7f223f400640 1 -- 172.21.15.107:0/4091900348 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2238064db0 con 0x7f223806d7f0 2024-08-17T02:27:48.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.910+0000 7f2234c00640 1 -- 172.21.15.107:0/4091900348 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f222801e460 con 0x7f223806d7f0 2024-08-17T02:27:48.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.911+0000 7f2234c00640 1 --2- 172.21.15.107:0/4091900348 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f2214065150 0x7f2214067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.911+0000 7f2234c00640 1 -- 172.21.15.107:0/4091900348 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f2228082ca0 con 0x7f223806d7f0 2024-08-17T02:27:48.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.911+0000 7f222fe00640 1 --2- 172.21.15.107:0/4091900348 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f2214065150 0x7f2214067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.912+0000 7f222fe00640 1 --2- 172.21.15.107:0/4091900348 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f2214065150 0x7f2214067600 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2220034000 tx=0x7f2220032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:48.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:48.915+0000 7f2234c00640 1 -- 172.21.15.107:0/4091900348 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2228050c40 con 0x7f223806d7f0 2024-08-17T02:27:49.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.121+0000 7f223f400640 1 -- 172.21.15.107:0/4091900348 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2238153300 con 0x7f223806d7f0 2024-08-17T02:27:49.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.122+0000 7f2234c00640 1 -- 172.21.15.107:0/4091900348 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4621 (secure 0 0 0) 0x7f2228054260 con 0x7f223806d7f0 2024-08-17T02:27:49.123 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:27:49.123 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4682,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/855770365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":855770365},{"type":"v1","addr":"172.21.15.107:6836","nonce":855770365}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4688,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6834/1749905502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1749905502},{"type":"v1","addr":"172.21.15.157:6834","nonce":1749905502}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4910,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/3701145841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6833","nonce":3701145841},{"type":"v1","addr":"172.21.15.157:6835","nonce":3701145841}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:35.757205+0000","modified":"2024-08-17T02:25:37.759836+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4914":{"gid":4914,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.107:6837/809431952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":809431952},{"type":"v1","addr":"172.21.15.107:6837","nonce":809431952}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000928569","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:27:49.124 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 23 2024-08-17T02:27:49.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.124+0000 7f223f400640 1 -- 172.21.15.107:0/4091900348 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f2214065150 msgr2=0x7f2214067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.124+0000 7f223f400640 1 --2- 172.21.15.107:0/4091900348 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f2214065150 0x7f2214067600 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2220034000 tx=0x7f2220032000 comp rx=0 tx=0).stop 2024-08-17T02:27:49.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.124+0000 7f223f400640 1 -- 172.21.15.107:0/4091900348 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f223806d7f0 msgr2=0x7f22380ab530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.124+0000 7f223f400640 1 --2- 172.21.15.107:0/4091900348 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f223806d7f0 0x7f22380ab530 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f222800d890 tx=0x7f2228008040 comp rx=0 tx=0).stop 2024-08-17T02:27:49.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.124+0000 7f223f400640 1 -- 172.21.15.107:0/4091900348 shutdown_connections 2024-08-17T02:27:49.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.124+0000 7f223f400640 1 --2- 172.21.15.107:0/4091900348 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f2214065150 0x7f2214067600 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.124+0000 7f223f400640 1 --2- 172.21.15.107:0/4091900348 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2238155df0 0x7f22380c09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.124+0000 7f223f400640 1 --2- 172.21.15.107:0/4091900348 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2238155a20 0x7f22380c2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.124+0000 7f223f400640 1 --2- 172.21.15.107:0/4091900348 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f223806d7f0 0x7f22380ab530 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.124+0000 7f223f400640 1 -- 172.21.15.107:0/4091900348 >> 172.21.15.107:0/4091900348 conn(0x7f22380cb9b0 msgr2=0x7f2238153b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:49.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.124+0000 7f223f400640 1 -- 172.21.15.107:0/4091900348 shutdown_connections 2024-08-17T02:27:49.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.124+0000 7f223f400640 1 -- 172.21.15.107:0/4091900348 wait complete. 2024-08-17T02:27:49.141 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:49.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.288+0000 7f4d3b200640 1 Processor -- start 2024-08-17T02:27:49.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.288+0000 7f4d3b200640 1 -- start start 2024-08-17T02:27:49.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.289+0000 7f4d3b200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4d3c0b0270 0x7f4d3c1563e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.289+0000 7f4d3b200640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4d3c158b30 0x7f4d3c0ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.289+0000 7f4d3b200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d3c157690 con 0x7f4d3c155900 2024-08-17T02:27:49.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.290+0000 7f4d3b200640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d3c156a80 con 0x7f4d3c158b30 2024-08-17T02:27:49.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.290+0000 7f4d3b200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c156d60 con 0x7f4d3c0b0270 2024-08-17T02:27:49.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.290+0000 7f4d39e00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f4d3c155900 0x7f4d3c155cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:40878/0 (socket says 172.21.15.107:40878) 2024-08-17T02:27:49.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.290+0000 7f4d39e00640 1 -- 172.21.15.107:0/2364802477 learned_addr learned my addr 172.21.15.107:0/2364802477 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:27:49.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.290+0000 7f4d3a800640 1 --2- 172.21.15.107:0/2364802477 >> v2:172.21.15.157:3300/0 conn(0x7f4d3c158b30 0x7f4d3c0ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.290+0000 7f4d38a00640 1 -- 172.21.15.107:0/2364802477 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4285968867 0 0) 0x7f4d3c157690 con 0x7f4d3c155900 2024-08-17T02:27:49.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.290+0000 7f4d39400640 1 --2- 172.21.15.107:0/2364802477 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4d3c0b0270 0x7f4d3c1563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.290+0000 7f4d38a00640 1 -- 172.21.15.107:0/2364802477 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d200034e0 con 0x7f4d3c155900 2024-08-17T02:27:49.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.291+0000 7f4d38a00640 1 -- 172.21.15.107:0/2364802477 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1019778945 0 0) 0x7f4d200034e0 con 0x7f4d3c155900 2024-08-17T02:27:49.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.291+0000 7f4d38a00640 1 -- 172.21.15.107:0/2364802477 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4d3c0b0270 msgr2=0x7f4d3c1563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:49.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.291+0000 7f4d38a00640 1 --2- 172.21.15.107:0/2364802477 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4d3c0b0270 0x7f4d3c1563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.291+0000 7f4d38a00640 1 -- 172.21.15.107:0/2364802477 >> v2:172.21.15.157:3300/0 conn(0x7f4d3c158b30 msgr2=0x7f4d3c0ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:49.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.291+0000 7f4d38a00640 1 --2- 172.21.15.107:0/2364802477 >> v2:172.21.15.157:3300/0 conn(0x7f4d3c158b30 0x7f4d3c0ae6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.291+0000 7f4d38a00640 1 -- 172.21.15.107:0/2364802477 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d3c157040 con 0x7f4d3c155900 2024-08-17T02:27:49.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.291+0000 7f4d38a00640 1 -- 172.21.15.107:0/2364802477 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 537989081 0 0) 0x7f4d2c001470 con 0x7f4d3c155900 2024-08-17T02:27:49.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.291+0000 7f4d38a00640 1 -- 172.21.15.107:0/2364802477 >> v1:172.21.15.107:6789/0 conn(0x7f4d3c155900 legacy=0x7f4d3c155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.291+0000 7f4d38a00640 1 --2- 172.21.15.107:0/2364802477 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d200039d0 0x7f4d20003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.291+0000 7f4d38a00640 1 --2- 172.21.15.107:0/2364802477 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4d3c0b0270 0x7f4d20004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.291+0000 7f4d38a00640 1 --2- 172.21.15.107:0/2364802477 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d20004cc0 0x7f4d20005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.291+0000 7f4d38a00640 1 -- 172.21.15.107:0/2364802477 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c156a80 con 0x7f4d200039d0 2024-08-17T02:27:49.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.291+0000 7f4d38a00640 1 -- 172.21.15.107:0/2364802477 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c156d60 con 0x7f4d20004cc0 2024-08-17T02:27:49.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.291+0000 7f4d38a00640 1 -- 172.21.15.107:0/2364802477 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2000dbe0 con 0x7f4d3c0b0270 2024-08-17T02:27:49.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.291+0000 7f4d39e00640 1 --2- 172.21.15.107:0/2364802477 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d200039d0 0x7f4d20003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.291+0000 7f4d39400640 1 --2- 172.21.15.107:0/2364802477 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4d3c0b0270 0x7f4d20004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.291+0000 7f4d3a800640 1 --2- 172.21.15.107:0/2364802477 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d20004cc0 0x7f4d20005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.291+0000 7f4d39e00640 1 -- 172.21.15.107:0/2364802477 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4d3c0b0270 msgr2=0x7f4d20004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:49.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.291+0000 7f4d39e00640 1 --2- 172.21.15.107:0/2364802477 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4d3c0b0270 0x7f4d20004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.291+0000 7f4d39e00640 1 -- 172.21.15.107:0/2364802477 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d20004cc0 msgr2=0x7f4d20005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:49.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.291+0000 7f4d39e00640 1 --2- 172.21.15.107:0/2364802477 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d20004cc0 0x7f4d20005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.291+0000 7f4d39e00640 1 -- 172.21.15.107:0/2364802477 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d200034e0 con 0x7f4d200039d0 2024-08-17T02:27:49.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.292+0000 7f4d39e00640 1 --2- 172.21.15.107:0/2364802477 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d200039d0 0x7f4d20003de0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c00c2a0 tx=0x7f4d3c157600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92fa7147245e75d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:49.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.293+0000 7f4d38a00640 1 -- 172.21.15.107:0/2364802477 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c005890 con 0x7f4d200039d0 2024-08-17T02:27:49.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.293+0000 7f4d38a00640 1 -- 172.21.15.107:0/2364802477 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2c005a30 con 0x7f4d200039d0 2024-08-17T02:27:49.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.293+0000 7f4d38a00640 1 -- 172.21.15.107:0/2364802477 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c005e30 con 0x7f4d200039d0 2024-08-17T02:27:49.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.293+0000 7f4d3b200640 1 -- 172.21.15.107:0/2364802477 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d200039d0 msgr2=0x7f4d20003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.293+0000 7f4d3b200640 1 --2- 172.21.15.107:0/2364802477 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d200039d0 0x7f4d20003de0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c00c2a0 tx=0x7f4d3c157600 comp rx=0 tx=0).stop 2024-08-17T02:27:49.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.293+0000 7f4d3a800640 1 -- 172.21.15.107:0/2364802477 reap_dead start 2024-08-17T02:27:49.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.293+0000 7f4d3b200640 1 -- 172.21.15.107:0/2364802477 shutdown_connections 2024-08-17T02:27:49.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.293+0000 7f4d3b200640 1 -- 172.21.15.107:0/2364802477 >> 172.21.15.107:0/2364802477 conn(0x7f4d3c067750 msgr2=0x7f4d3c0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:49.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.293+0000 7f4d3b200640 1 -- 172.21.15.107:0/2364802477 shutdown_connections 2024-08-17T02:27:49.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.293+0000 7f4d3b200640 1 -- 172.21.15.107:0/2364802477 wait complete. 2024-08-17T02:27:49.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.295+0000 7f4d3b200640 1 Processor -- start 2024-08-17T02:27:49.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.295+0000 7f4d3b200640 1 -- start start 2024-08-17T02:27:49.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.296+0000 7f4d3b200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d200039d0 0x7f4d3c1656e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.296+0000 7f4d3b200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4d3c1644e0 0x7f4d3c06dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.296+0000 7f4d3b200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d3c164950 0x7f4d3c06dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.296+0000 7f4d3b200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c165c20 con 0x7f4d200039d0 2024-08-17T02:27:49.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.296+0000 7f4d3b200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c168690 con 0x7f4d3c164950 2024-08-17T02:27:49.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.296+0000 7f4d3b200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c168970 con 0x7f4d3c1644e0 2024-08-17T02:27:49.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.296+0000 7f4d39e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d200039d0 0x7f4d3c1656e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.296+0000 7f4d39e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d200039d0 0x7f4d3c1656e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36428/0 (socket says 172.21.15.107:36428) 2024-08-17T02:27:49.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.296+0000 7f4d39e00640 1 -- 172.21.15.107:0/1795951819 learned_addr learned my addr 172.21.15.107:0/1795951819 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:49.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.296+0000 7f4d39400640 1 --2- 172.21.15.107:0/1795951819 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4d3c1644e0 0x7f4d3c06dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.296+0000 7f4d3a800640 1 --2- 172.21.15.107:0/1795951819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d3c164950 0x7f4d3c06dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.300 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.296+0000 7f4d39e00640 1 -- 172.21.15.107:0/1795951819 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4d3c1644e0 msgr2=0x7f4d3c06dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.300 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.296+0000 7f4d39e00640 1 --2- 172.21.15.107:0/1795951819 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4d3c1644e0 0x7f4d3c06dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.300 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.296+0000 7f4d39e00640 1 -- 172.21.15.107:0/1795951819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d3c164950 msgr2=0x7f4d3c06dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.300 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.296+0000 7f4d39e00640 1 --2- 172.21.15.107:0/1795951819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d3c164950 0x7f4d3c06dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.300 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.296+0000 7f4d39e00640 1 -- 172.21.15.107:0/1795951819 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d3c168c50 con 0x7f4d200039d0 2024-08-17T02:27:49.300 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.297+0000 7f4d39e00640 1 --2- 172.21.15.107:0/1795951819 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d200039d0 0x7f4d3c1656e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c02add0 tx=0x7f4d2c034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:49.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.297+0000 7f4d31600640 1 -- 172.21.15.107:0/1795951819 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c000fd0 con 0x7f4d200039d0 2024-08-17T02:27:49.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.297+0000 7f4d31600640 1 -- 172.21.15.107:0/1795951819 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2c001630 con 0x7f4d200039d0 2024-08-17T02:27:49.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.297+0000 7f4d31600640 1 -- 172.21.15.107:0/1795951819 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c007530 con 0x7f4d200039d0 2024-08-17T02:27:49.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.297+0000 7f4d3b200640 1 -- 172.21.15.107:0/1795951819 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d3c168f30 con 0x7f4d200039d0 2024-08-17T02:27:49.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.297+0000 7f4d3b200640 1 -- 172.21.15.107:0/1795951819 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d3c1682b0 con 0x7f4d200039d0 2024-08-17T02:27:49.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.298+0000 7f4d3b200640 1 -- 172.21.15.107:0/1795951819 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d3c071050 con 0x7f4d200039d0 2024-08-17T02:27:49.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.299+0000 7f4d31600640 1 -- 172.21.15.107:0/1795951819 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4d2c038030 con 0x7f4d200039d0 2024-08-17T02:27:49.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.300+0000 7f4d31600640 1 --2- 172.21.15.107:0/1795951819 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4d1c065150 0x7f4d1c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.300+0000 7f4d31600640 1 -- 172.21.15.107:0/1795951819 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f4d2c0a26c0 con 0x7f4d200039d0 2024-08-17T02:27:49.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.300+0000 7f4d39400640 1 --2- 172.21.15.107:0/1795951819 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4d1c065150 0x7f4d1c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.301+0000 7f4d39400640 1 --2- 172.21.15.107:0/1795951819 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4d1c065150 0x7f4d1c067600 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c168210 tx=0x7f4d280090f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:49.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.304+0000 7f4d31600640 1 -- 172.21.15.107:0/1795951819 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4d2c070710 con 0x7f4d200039d0 2024-08-17T02:27:49.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.477+0000 7f4d3b200640 1 -- 172.21.15.107:0/1795951819 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d3c165dc0 con 0x7f4d200039d0 2024-08-17T02:27:49.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.478+0000 7f4d31600640 1 -- 172.21.15.107:0/1795951819 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+15562 (secure 0 0 0) 0x7f4d2c073d30 con 0x7f4d200039d0 2024-08-17T02:27:49.479 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:27:49.480 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":40,"fsid":"f207b4c0-329d-46b8-b83f-aaf30bdb6ce3","created":"2024-08-17T02:24:11.038049+0000","modified":"2024-08-17T02:27:46.174092+0000","last_up_change":"2024-08-17T02:24:22.047790+0000","last_in_change":"2024-08-17T02:24:13.892720+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:23.456166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000928569.meta","create_time":"2024-08-17T02:25:33.885385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000928569"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000928569.data","create_time":"2024-08-17T02:25:34.790701+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000928569"}}}],"osds":[{"osd":0,"uuid":"376363f3-b8bf-4f1e-b691-51cdd39171ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37302},{"type":"v1","addr":"172.21.15.107:6801","nonce":37302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37302},{"type":"v1","addr":"172.21.15.107:6803","nonce":37302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37302},{"type":"v1","addr":"172.21.15.107:6807","nonce":37302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37302},{"type":"v1","addr":"172.21.15.107:6805","nonce":37302}]},"public_addr":"172.21.15.107:6801/37302","cluster_addr":"172.21.15.107:6803/37302","heartbeat_back_addr":"172.21.15.107:6807/37302","heartbeat_front_addr":"172.21.15.107:6805/37302","state":["exists","up"]},{"osd":1,"uuid":"cc6624e3-2ad4-4db4-b377-05dfe57424e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37305},{"type":"v1","addr":"172.21.15.107:6824","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37305},{"type":"v1","addr":"172.21.15.107:6827","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37305},{"type":"v1","addr":"172.21.15.107:6831","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37305},{"type":"v1","addr":"172.21.15.107:6829","nonce":37305}]},"public_addr":"172.21.15.107:6824/37305","cluster_addr":"172.21.15.107:6827/37305","heartbeat_back_addr":"172.21.15.107:6831/37305","heartbeat_front_addr":"172.21.15.107:6829/37305","state":["exists","up"]},{"osd":2,"uuid":"25229542-29b5-4281-bcb0-798ae0930aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37307},{"type":"v1","addr":"172.21.15.107:6817","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37307},{"type":"v1","addr":"172.21.15.107:6819","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6823","nonce":37307},{"type":"v1","addr":"172.21.15.107:6825","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37307},{"type":"v1","addr":"172.21.15.107:6821","nonce":37307}]},"public_addr":"172.21.15.107:6817/37307","cluster_addr":"172.21.15.107:6819/37307","heartbeat_back_addr":"172.21.15.107:6825/37307","heartbeat_front_addr":"172.21.15.107:6821/37307","state":["exists","up"]},{"osd":3,"uuid":"5f16aee8-8950-4268-a61a-5cf6ebd670e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37306},{"type":"v1","addr":"172.21.15.107:6809","nonce":37306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37306},{"type":"v1","addr":"172.21.15.107:6811","nonce":37306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37306},{"type":"v1","addr":"172.21.15.107:6815","nonce":37306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37306},{"type":"v1","addr":"172.21.15.107:6813","nonce":37306}]},"public_addr":"172.21.15.107:6809/37306","cluster_addr":"172.21.15.107:6811/37306","heartbeat_back_addr":"172.21.15.107:6815/37306","heartbeat_front_addr":"172.21.15.107:6813/37306","state":["exists","up"]},{"osd":4,"uuid":"23232e28-e23b-4b4e-a531-4939246dbbde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":37329},{"type":"v1","addr":"172.21.15.157:6817","nonce":37329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":37329},{"type":"v1","addr":"172.21.15.157:6819","nonce":37329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":37329},{"type":"v1","addr":"172.21.15.157:6823","nonce":37329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":37329},{"type":"v1","addr":"172.21.15.157:6821","nonce":37329}]},"public_addr":"172.21.15.157:6817/37329","cluster_addr":"172.21.15.157:6819/37329","heartbeat_back_addr":"172.21.15.157:6823/37329","heartbeat_front_addr":"172.21.15.157:6821/37329","state":["exists","up"]},{"osd":5,"uuid":"f87ec331-3e59-4886-a317-6f7e26ec8e21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":37328},{"type":"v1","addr":"172.21.15.157:6804","nonce":37328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":37328},{"type":"v1","addr":"172.21.15.157:6808","nonce":37328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":37328},{"type":"v1","addr":"172.21.15.157:6815","nonce":37328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":37328},{"type":"v1","addr":"172.21.15.157:6812","nonce":37328}]},"public_addr":"172.21.15.157:6804/37328","cluster_addr":"172.21.15.157:6808/37328","heartbeat_back_addr":"172.21.15.157:6815/37328","heartbeat_front_addr":"172.21.15.157:6812/37328","state":["exists","up"]},{"osd":6,"uuid":"92852235-ce49-4d96-a940-6f18d97b13ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":37330},{"type":"v1","addr":"172.21.15.157:6801","nonce":37330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6803","nonce":37330},{"type":"v1","addr":"172.21.15.157:6805","nonce":37330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":37330},{"type":"v1","addr":"172.21.15.157:6813","nonce":37330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":37330},{"type":"v1","addr":"172.21.15.157:6809","nonce":37330}]},"public_addr":"172.21.15.157:6801/37330","cluster_addr":"172.21.15.157:6805/37330","heartbeat_back_addr":"172.21.15.157:6813/37330","heartbeat_front_addr":"172.21.15.157:6809/37330","state":["exists","up"]},{"osd":7,"uuid":"7484a061-723d-4663-b28f-b01766d62f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":37373},{"type":"v1","addr":"172.21.15.157:6825","nonce":37373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":37373},{"type":"v1","addr":"172.21.15.157:6827","nonce":37373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":37373},{"type":"v1","addr":"172.21.15.157:6831","nonce":37373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":37373},{"type":"v1","addr":"172.21.15.157:6829","nonce":37373}]},"public_addr":"172.21.15.157:6825/37373","cluster_addr":"172.21.15.157:6827/37373","heartbeat_back_addr":"172.21.15.157:6831/37373","heartbeat_front_addr":"172.21.15.157:6829/37373","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.110188+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.280265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.252119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.267996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.284582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.144420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.174764+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.308002+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.157:6835/1725535660":"2024-08-18T02:27:43.163351+0000","172.21.15.157:6833/1725535660":"2024-08-18T02:27:43.163351+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:49.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.480+0000 7f4d3b200640 1 -- 172.21.15.107:0/1795951819 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4d1c065150 msgr2=0x7f4d1c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.480+0000 7f4d3b200640 1 --2- 172.21.15.107:0/1795951819 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4d1c065150 0x7f4d1c067600 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c168210 tx=0x7f4d280090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.480+0000 7f4d3b200640 1 -- 172.21.15.107:0/1795951819 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d200039d0 msgr2=0x7f4d3c1656e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.480+0000 7f4d3b200640 1 --2- 172.21.15.107:0/1795951819 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d200039d0 0x7f4d3c1656e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c02add0 tx=0x7f4d2c034000 comp rx=0 tx=0).stop 2024-08-17T02:27:49.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.480+0000 7f4d3b200640 1 -- 172.21.15.107:0/1795951819 shutdown_connections 2024-08-17T02:27:49.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.480+0000 7f4d3b200640 1 --2- 172.21.15.107:0/1795951819 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4d1c065150 0x7f4d1c067600 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.480+0000 7f4d3b200640 1 --2- 172.21.15.107:0/1795951819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d3c164950 0x7f4d3c06dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.480+0000 7f4d3b200640 1 --2- 172.21.15.107:0/1795951819 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4d3c1644e0 0x7f4d3c06dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.480+0000 7f4d3b200640 1 --2- 172.21.15.107:0/1795951819 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d200039d0 0x7f4d3c1656e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.480+0000 7f4d3b200640 1 -- 172.21.15.107:0/1795951819 >> 172.21.15.107:0/1795951819 conn(0x7f4d3c067750 msgr2=0x7f4d3c154410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:49.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.480+0000 7f4d3b200640 1 -- 172.21.15.107:0/1795951819 shutdown_connections 2024-08-17T02:27:49.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.480+0000 7f4d3b200640 1 -- 172.21.15.107:0/1795951819 wait complete. 2024-08-17T02:27:49.497 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail volume_0000000000928569 2024-08-17T02:27:49.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.644+0000 7f9292a00640 1 Processor -- start 2024-08-17T02:27:49.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.644+0000 7f9292a00640 1 -- start start 2024-08-17T02:27:49.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.645+0000 7f9292a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f928c0aa7d0 0x7f928c06ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.645+0000 7f9292a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f928c158fa0 0x7f928c0ab6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.645+0000 7f9292a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f928c0a9a10 con 0x7f928c06da20 2024-08-17T02:27:49.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.645+0000 7f9292a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f928c0ac400 con 0x7f928c158fa0 2024-08-17T02:27:49.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.645+0000 7f9292a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f928c0a9cf0 con 0x7f928c0aa7d0 2024-08-17T02:27:49.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.646+0000 7f928be00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f928c06da20 0x7f928c158890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:40894/0 (socket says 172.21.15.107:40894) 2024-08-17T02:27:49.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.646+0000 7f928be00640 1 -- 172.21.15.107:0/2270613623 learned_addr learned my addr 172.21.15.107:0/2270613623 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:27:49.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.646+0000 7f9290a00640 1 --2- 172.21.15.107:0/2270613623 >> v2:172.21.15.107:3300/0 conn(0x7f928c158fa0 0x7f928c0ab6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.646+0000 7f928b400640 1 --2- 172.21.15.107:0/2270613623 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f928c0aa7d0 0x7f928c06ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.646+0000 7f9290a00640 1 -- 172.21.15.107:0/2270613623 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f928c0aa7d0 msgr2=0x7f928c06ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:49.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.646+0000 7f9290a00640 1 --2- 172.21.15.107:0/2270613623 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f928c0aa7d0 0x7f928c06ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.646+0000 7f9290a00640 1 -- 172.21.15.107:0/2270613623 >> v1:172.21.15.107:6789/0 conn(0x7f928c06da20 legacy=0x7f928c158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.646+0000 7f9290a00640 1 -- 172.21.15.107:0/2270613623 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f928c0a9fd0 con 0x7f928c158fa0 2024-08-17T02:27:49.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.646+0000 7f928aa00640 1 -- 172.21.15.107:0/2270613623 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4276096669 0 0) 0x7f928c0a9a10 con 0x7f928c06da20 2024-08-17T02:27:49.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.647+0000 7f9290a00640 1 --2- 172.21.15.107:0/2270613623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f928c158fa0 0x7f928c0ab6d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9284009e60 tx=0x7f9284009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c83b78e050314b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:49.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.647+0000 7f928aa00640 1 -- 172.21.15.107:0/2270613623 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9284007550 con 0x7f928c158fa0 2024-08-17T02:27:49.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.647+0000 7f928aa00640 1 -- 172.21.15.107:0/2270613623 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f928402d050 con 0x7f928c158fa0 2024-08-17T02:27:49.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.647+0000 7f928aa00640 1 -- 172.21.15.107:0/2270613623 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92840078e0 con 0x7f928c158fa0 2024-08-17T02:27:49.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.648+0000 7f9292a00640 1 -- 172.21.15.107:0/2270613623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f928c158fa0 msgr2=0x7f928c0ab6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.648+0000 7f9292a00640 1 --2- 172.21.15.107:0/2270613623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f928c158fa0 0x7f928c0ab6d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9284009e60 tx=0x7f9284009780 comp rx=0 tx=0).stop 2024-08-17T02:27:49.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.648+0000 7f9292a00640 1 -- 172.21.15.107:0/2270613623 shutdown_connections 2024-08-17T02:27:49.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.648+0000 7f9292a00640 1 --2- 172.21.15.107:0/2270613623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f928c158fa0 0x7f928c0ab6d0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.648+0000 7f9292a00640 1 --2- 172.21.15.107:0/2270613623 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f928c0aa7d0 0x7f928c06ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.648+0000 7f9292a00640 1 -- 172.21.15.107:0/2270613623 >> 172.21.15.107:0/2270613623 conn(0x7f928c0cb9b0 msgr2=0x7f928c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:49.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.648+0000 7f9292a00640 1 -- 172.21.15.107:0/2270613623 shutdown_connections 2024-08-17T02:27:49.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.648+0000 7f9292a00640 1 -- 172.21.15.107:0/2270613623 wait complete. 2024-08-17T02:27:49.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.650+0000 7f9292a00640 1 Processor -- start 2024-08-17T02:27:49.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.650+0000 7f9292a00640 1 -- start start 2024-08-17T02:27:49.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.651+0000 7f9292a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f928c06da20 0x7f928c16cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.651+0000 7f9292a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f928c0aa7d0 0x7f928c1402b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.651+0000 7f9292a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f928c158fa0 0x7f928c154f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.651+0000 7f9292a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c16c960 con 0x7f928c0aa7d0 2024-08-17T02:27:49.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.651+0000 7f9292a00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c151130 con 0x7f928c158fa0 2024-08-17T02:27:49.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.651+0000 7f9292a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f928c16c350 con 0x7f928c06da20 2024-08-17T02:27:49.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.651+0000 7f928b400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f928c0aa7d0 0x7f928c1402b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.651+0000 7f928b400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f928c0aa7d0 0x7f928c1402b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36454/0 (socket says 172.21.15.107:36454) 2024-08-17T02:27:49.654 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.651+0000 7f928b400640 1 -- 172.21.15.107:0/1355692442 learned_addr learned my addr 172.21.15.107:0/1355692442 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:49.654 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.651+0000 7f928be00640 1 --2- 172.21.15.107:0/1355692442 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f928c06da20 0x7f928c16cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.654 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.651+0000 7f9290a00640 1 --2- 172.21.15.107:0/1355692442 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f928c158fa0 0x7f928c154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.654 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.651+0000 7f928b400640 1 -- 172.21.15.107:0/1355692442 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f928c06da20 msgr2=0x7f928c16cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.654 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.651+0000 7f928b400640 1 --2- 172.21.15.107:0/1355692442 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f928c06da20 0x7f928c16cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.654 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.651+0000 7f928b400640 1 -- 172.21.15.107:0/1355692442 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f928c158fa0 msgr2=0x7f928c154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.654 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.651+0000 7f928b400640 1 --2- 172.21.15.107:0/1355692442 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f928c158fa0 0x7f928c154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.654 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.651+0000 7f928b400640 1 -- 172.21.15.107:0/1355692442 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9284009a20 con 0x7f928c0aa7d0 2024-08-17T02:27:49.654 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.651+0000 7f928be00640 1 --2- 172.21.15.107:0/1355692442 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f928c06da20 0x7f928c16cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:49.654 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.651+0000 7f9290a00640 1 --2- 172.21.15.107:0/1355692442 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f928c158fa0 0x7f928c154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:49.654 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.652+0000 7f928b400640 1 --2- 172.21.15.107:0/1355692442 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f928c0aa7d0 0x7f928c1402b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9278009fd0 tx=0x7f92780090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:49.655 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.652+0000 7f9283400640 1 -- 172.21.15.107:0/1355692442 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927800c940 con 0x7f928c0aa7d0 2024-08-17T02:27:49.655 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.652+0000 7f9283400640 1 -- 172.21.15.107:0/1355692442 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f927800caa0 con 0x7f928c0aa7d0 2024-08-17T02:27:49.655 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.652+0000 7f9292a00640 1 -- 172.21.15.107:0/1355692442 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f928c155b00 con 0x7f928c0aa7d0 2024-08-17T02:27:49.655 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.652+0000 7f9283400640 1 -- 172.21.15.107:0/1355692442 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927800ce40 con 0x7f928c0aa7d0 2024-08-17T02:27:49.655 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.652+0000 7f9292a00640 1 -- 172.21.15.107:0/1355692442 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f928c155de0 con 0x7f928c0aa7d0 2024-08-17T02:27:49.656 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.653+0000 7f9292a00640 1 -- 172.21.15.107:0/1355692442 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f928c16cad0 con 0x7f928c0aa7d0 2024-08-17T02:27:49.656 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.654+0000 7f9283400640 1 -- 172.21.15.107:0/1355692442 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9278013680 con 0x7f928c0aa7d0 2024-08-17T02:27:49.656 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.654+0000 7f9283400640 1 --2- 172.21.15.107:0/1355692442 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f926c065150 0x7f926c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.656 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.655+0000 7f9283400640 1 -- 172.21.15.107:0/1355692442 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f92780827d0 con 0x7f928c0aa7d0 2024-08-17T02:27:49.656 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.655+0000 7f928be00640 1 --2- 172.21.15.107:0/1355692442 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f926c065150 0x7f926c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.656 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.655+0000 7f928be00640 1 --2- 172.21.15.107:0/1355692442 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f926c065150 0x7f926c067600 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f927c001840 tx=0x7f927c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:49.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.658+0000 7f9283400640 1 -- 172.21.15.107:0/1355692442 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f92780508d0 con 0x7f928c0aa7d0 2024-08-17T02:27:49.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.866+0000 7f9292a00640 1 -- 172.21.15.107:0/1355692442 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "volume_0000000000928569"} v 0) v1 -- 0x7f928c064db0 con 0x7f928c0aa7d0 2024-08-17T02:27:49.867 INFO:tasks.ceph.mon.a.smithi107.stderr:2024-08-17T02:27:49.867+0000 7ff651400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:27:49.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.872+0000 7f9283400640 1 -- 172.21.15.107:0/1355692442 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "volume_0000000000928569"}]=0 volume_0000000000928569 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) v1 ==== 195+0+0 (secure 0 0 0) 0x7f9278053ef0 con 0x7f928c0aa7d0 2024-08-17T02:27:49.873 INFO:teuthology.orchestra.run.smithi107.stderr:volume_0000000000928569 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:27:49.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.874+0000 7f9292a00640 1 -- 172.21.15.107:0/1355692442 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f926c065150 msgr2=0x7f926c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.874+0000 7f9292a00640 1 --2- 172.21.15.107:0/1355692442 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f926c065150 0x7f926c067600 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f927c001840 tx=0x7f927c009040 comp rx=0 tx=0).stop 2024-08-17T02:27:49.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.874+0000 7f9292a00640 1 -- 172.21.15.107:0/1355692442 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f928c0aa7d0 msgr2=0x7f928c1402b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.874+0000 7f9292a00640 1 --2- 172.21.15.107:0/1355692442 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f928c0aa7d0 0x7f928c1402b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9278009fd0 tx=0x7f92780090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.874+0000 7f9292a00640 1 -- 172.21.15.107:0/1355692442 shutdown_connections 2024-08-17T02:27:49.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.874+0000 7f9292a00640 1 --2- 172.21.15.107:0/1355692442 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f926c065150 0x7f926c067600 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.874+0000 7f9292a00640 1 --2- 172.21.15.107:0/1355692442 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f928c158fa0 0x7f928c154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.874+0000 7f9292a00640 1 --2- 172.21.15.107:0/1355692442 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f928c0aa7d0 0x7f928c1402b0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.874+0000 7f9292a00640 1 --2- 172.21.15.107:0/1355692442 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f928c06da20 0x7f928c16cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.874+0000 7f9292a00640 1 -- 172.21.15.107:0/1355692442 >> 172.21.15.107:0/1355692442 conn(0x7f928c0cb9b0 msgr2=0x7f928c06ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:49.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.874+0000 7f9292a00640 1 -- 172.21.15.107:0/1355692442 shutdown_connections 2024-08-17T02:27:49.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:49.874+0000 7f9292a00640 1 -- 172.21.15.107:0/1355692442 wait complete. 2024-08-17T02:27:49.879 INFO:tasks.ceph.mds.c.smithi107.stderr: -3105> 2024-08-17T02:25:41.641+0000 7f4027000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:27:49.891 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm volume_0000000000928569 --yes-i-really-mean-it 2024-08-17T02:27:49.920 INFO:tasks.ceph.mds.c.smithi107.stdout:starting mds.c at 2024-08-17T02:27:50.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.041+0000 7f09e9a00640 1 Processor -- start 2024-08-17T02:27:50.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.041+0000 7f09e9a00640 1 -- start start 2024-08-17T02:27:50.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.042+0000 7f09e9a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09e4159b90 0x7f09e40ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.042+0000 7f09e9a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f09e40ccca0 0x7f09e4162860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.042+0000 7f09e9a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09e40cadc0 con 0x7f09e40ca8a0 2024-08-17T02:27:50.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.042+0000 7f09e9a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09e40cb880 con 0x7f09e40ccca0 2024-08-17T02:27:50.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.042+0000 7f09e9a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e40cd6e0 con 0x7f09e4159b90 2024-08-17T02:27:50.044 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.042+0000 7f09e3400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f09e40ca8a0 0x7f09e40cc590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:40910/0 (socket says 172.21.15.107:40910) 2024-08-17T02:27:50.044 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.042+0000 7f09e3400640 1 -- 172.21.15.107:0/852632050 learned_addr learned my addr 172.21.15.107:0/852632050 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:27:50.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.042+0000 7f09e9000640 1 --2- 172.21.15.107:0/852632050 >> v2:172.21.15.107:3300/0 conn(0x7f09e40ccca0 0x7f09e4162860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.043+0000 7f09e3e00640 1 --2- 172.21.15.107:0/852632050 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09e4159b90 0x7f09e40ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.043+0000 7f09e2a00640 1 -- 172.21.15.107:0/852632050 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2785134371 0 0) 0x7f09e40cadc0 con 0x7f09e40ca8a0 2024-08-17T02:27:50.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.043+0000 7f09e2a00640 1 -- 172.21.15.107:0/852632050 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09c80034e0 con 0x7f09e40ca8a0 2024-08-17T02:27:50.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.043+0000 7f09e9000640 1 -- 172.21.15.107:0/852632050 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09e4159b90 msgr2=0x7f09e40ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:50.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.043+0000 7f09e9000640 1 --2- 172.21.15.107:0/852632050 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09e4159b90 0x7f09e40ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.043+0000 7f09e9000640 1 -- 172.21.15.107:0/852632050 >> v1:172.21.15.107:6789/0 conn(0x7f09e40ca8a0 legacy=0x7f09e40cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.043+0000 7f09e9000640 1 -- 172.21.15.107:0/852632050 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e40cb060 con 0x7f09e40ccca0 2024-08-17T02:27:50.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.044+0000 7f09e9000640 1 --2- 172.21.15.107:0/852632050 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09e40ccca0 0x7f09e4162860 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f09dc009e60 tx=0x7f09dc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=982931e410727f87 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:50.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.044+0000 7f09e2a00640 1 -- 172.21.15.107:0/852632050 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc007550 con 0x7f09e40ccca0 2024-08-17T02:27:50.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.044+0000 7f09e2a00640 1 -- 172.21.15.107:0/852632050 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09dc02d050 con 0x7f09e40ccca0 2024-08-17T02:27:50.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.044+0000 7f09e2a00640 1 -- 172.21.15.107:0/852632050 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc007920 con 0x7f09e40ccca0 2024-08-17T02:27:50.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.045+0000 7f09e9a00640 1 -- 172.21.15.107:0/852632050 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09e40ccca0 msgr2=0x7f09e4162860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.045+0000 7f09e9a00640 1 --2- 172.21.15.107:0/852632050 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09e40ccca0 0x7f09e4162860 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f09dc009e60 tx=0x7f09dc009780 comp rx=0 tx=0).stop 2024-08-17T02:27:50.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.045+0000 7f09e9a00640 1 -- 172.21.15.107:0/852632050 shutdown_connections 2024-08-17T02:27:50.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.045+0000 7f09e9a00640 1 --2- 172.21.15.107:0/852632050 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09e40ccca0 0x7f09e4162860 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.045+0000 7f09e9a00640 1 --2- 172.21.15.107:0/852632050 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09e4159b90 0x7f09e40ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.045+0000 7f09e9a00640 1 -- 172.21.15.107:0/852632050 >> 172.21.15.107:0/852632050 conn(0x7f09e4098e00 msgr2=0x7f09e406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:50.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.045+0000 7f09e9a00640 1 -- 172.21.15.107:0/852632050 shutdown_connections 2024-08-17T02:27:50.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.045+0000 7f09e9a00640 1 -- 172.21.15.107:0/852632050 wait complete. 2024-08-17T02:27:50.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.046+0000 7f09e9a00640 1 Processor -- start 2024-08-17T02:27:50.048 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.046+0000 7f09e9a00640 1 -- start start 2024-08-17T02:27:50.049 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.047+0000 7f09e9a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09e40ca8a0 0x7f09e40c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.049 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.047+0000 7f09e9a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09e40ccca0 0x7f09e41547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.049 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.047+0000 7f09e9a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09e4159b90 0x7f09e4154d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.049 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.047+0000 7f09e9a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e40c9730 con 0x7f09e4159b90 2024-08-17T02:27:50.049 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.047+0000 7f09e9a00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e40c7040 con 0x7f09e40ccca0 2024-08-17T02:27:50.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.047+0000 7f09e9a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e40c9f00 con 0x7f09e40ca8a0 2024-08-17T02:27:50.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.047+0000 7f09e9000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09e4159b90 0x7f09e4154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.048+0000 7f09e9000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09e4159b90 0x7f09e4154d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36482/0 (socket says 172.21.15.107:36482) 2024-08-17T02:27:50.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.048+0000 7f09e9000640 1 -- 172.21.15.107:0/3264136168 learned_addr learned my addr 172.21.15.107:0/3264136168 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:50.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.048+0000 7f09e3e00640 1 --2- 172.21.15.107:0/3264136168 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09e40ca8a0 0x7f09e40c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.048+0000 7f09e3400640 1 --2- 172.21.15.107:0/3264136168 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09e40ccca0 0x7f09e41547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.048+0000 7f09e9000640 1 -- 172.21.15.107:0/3264136168 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09e40ca8a0 msgr2=0x7f09e40c91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.048+0000 7f09e9000640 1 --2- 172.21.15.107:0/3264136168 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09e40ca8a0 0x7f09e40c91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.048+0000 7f09e9000640 1 -- 172.21.15.107:0/3264136168 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09e40ccca0 msgr2=0x7f09e41547c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.048+0000 7f09e9000640 1 --2- 172.21.15.107:0/3264136168 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09e40ccca0 0x7f09e41547c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.048+0000 7f09e9000640 1 -- 172.21.15.107:0/3264136168 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09dc009a20 con 0x7f09e4159b90 2024-08-17T02:27:50.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.048+0000 7f09e9000640 1 --2- 172.21.15.107:0/3264136168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09e4159b90 0x7f09e4154d00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f09dc009ec0 tx=0x7f09dc037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:50.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.048+0000 7f09db400640 1 -- 172.21.15.107:0/3264136168 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc031890 con 0x7f09e4159b90 2024-08-17T02:27:50.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.049+0000 7f09db400640 1 -- 172.21.15.107:0/3264136168 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09dc040070 con 0x7f09e4159b90 2024-08-17T02:27:50.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.049+0000 7f09e9a00640 1 -- 172.21.15.107:0/3264136168 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09e40c9940 con 0x7f09e4159b90 2024-08-17T02:27:50.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.049+0000 7f09db400640 1 -- 172.21.15.107:0/3264136168 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc031c20 con 0x7f09e4159b90 2024-08-17T02:27:50.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.049+0000 7f09e9a00640 1 -- 172.21.15.107:0/3264136168 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09e40c6cd0 con 0x7f09e4159b90 2024-08-17T02:27:50.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.050+0000 7f09e9a00640 1 -- 172.21.15.107:0/3264136168 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09e40c71d0 con 0x7f09e4159b90 2024-08-17T02:27:50.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.051+0000 7f09db400640 1 -- 172.21.15.107:0/3264136168 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f09dc042030 con 0x7f09e4159b90 2024-08-17T02:27:50.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.051+0000 7f09db400640 1 --2- 172.21.15.107:0/3264136168 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f09c4065180 0x7f09c4067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.051+0000 7f09db400640 1 -- 172.21.15.107:0/3264136168 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5923+0+0 (secure 0 0 0) 0x7f09dc0a3de0 con 0x7f09e4159b90 2024-08-17T02:27:50.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.051+0000 7f09e3e00640 1 --2- 172.21.15.107:0/3264136168 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f09c4065180 0x7f09c4067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.052+0000 7f09e3e00640 1 --2- 172.21.15.107:0/3264136168 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f09c4065180 0x7f09c4067630 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f09d4009c10 tx=0x7f09d4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:50.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.055+0000 7f09db400640 1 -- 172.21.15.107:0/3264136168 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f09dc071d20 con 0x7f09e4159b90 2024-08-17T02:27:50.268 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.267+0000 7f09e9a00640 1 -- 172.21.15.107:0/3264136168 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "volume_0000000000928569", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f09e4071050 con 0x7f09e4159b90 2024-08-17T02:27:50.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.873+0000 7f09db400640 1 -- 172.21.15.107:0/3264136168 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "volume_0000000000928569", "yes_i_really_mean_it": true}]=0 v25) v1 ==== 121+0+0 (secure 0 0 0) 0x7f09dc075340 con 0x7f09e4159b90 2024-08-17T02:27:50.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.875+0000 7f09e9a00640 1 -- 172.21.15.107:0/3264136168 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f09c4065180 msgr2=0x7f09c4067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.875+0000 7f09e9a00640 1 --2- 172.21.15.107:0/3264136168 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f09c4065180 0x7f09c4067630 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f09d4009c10 tx=0x7f09d4008040 comp rx=0 tx=0).stop 2024-08-17T02:27:50.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.875+0000 7f09e9a00640 1 -- 172.21.15.107:0/3264136168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09e4159b90 msgr2=0x7f09e4154d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.875+0000 7f09e9a00640 1 --2- 172.21.15.107:0/3264136168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09e4159b90 0x7f09e4154d00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f09dc009ec0 tx=0x7f09dc037000 comp rx=0 tx=0).stop 2024-08-17T02:27:50.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.875+0000 7f09e9a00640 1 -- 172.21.15.107:0/3264136168 shutdown_connections 2024-08-17T02:27:50.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.875+0000 7f09e9a00640 1 --2- 172.21.15.107:0/3264136168 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f09c4065180 0x7f09c4067630 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.875+0000 7f09e9a00640 1 --2- 172.21.15.107:0/3264136168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09e4159b90 0x7f09e4154d00 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.875+0000 7f09e9a00640 1 --2- 172.21.15.107:0/3264136168 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09e40ccca0 0x7f09e41547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.875+0000 7f09e9a00640 1 --2- 172.21.15.107:0/3264136168 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09e40ca8a0 0x7f09e40c91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.875+0000 7f09e9a00640 1 -- 172.21.15.107:0/3264136168 >> 172.21.15.107:0/3264136168 conn(0x7f09e4098e00 msgr2=0x7f09e4068b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:50.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.875+0000 7f09e9a00640 1 -- 172.21.15.107:0/3264136168 shutdown_connections 2024-08-17T02:27:50.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:50.875+0000 7f09e9a00640 1 -- 172.21.15.107:0/3264136168 wait complete. 2024-08-17T02:27:50.892 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000928569.meta cephfs.volume_0000000000928569.meta --yes-i-really-really-mean-it 2024-08-17T02:27:51.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.082+0000 7f0664c00640 1 Processor -- start 2024-08-17T02:27:51.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.082+0000 7f0664c00640 1 -- start start 2024-08-17T02:27:51.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.083+0000 7f0664c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0660156890 0x7f066006dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.084+0000 7f0664c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0660156c60 0x7f066006e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.084+0000 7f0664c00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06600ae9b0 con 0x7f06600c8130 2024-08-17T02:27:51.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.084+0000 7f0664c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06600aa730 con 0x7f0660156890 2024-08-17T02:27:51.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.084+0000 7f0664c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06600aa9f0 con 0x7f0660156c60 2024-08-17T02:27:51.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.084+0000 7f065de00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0660156890 0x7f066006dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.084+0000 7f065de00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0660156890 0x7f066006dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36496/0 (socket says 172.21.15.107:36496) 2024-08-17T02:27:51.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.084+0000 7f065de00640 1 -- 172.21.15.107:0/1941525759 learned_addr learned my addr 172.21.15.107:0/1941525759 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:51.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.084+0000 7f0657e00640 1 --2- 172.21.15.107:0/1941525759 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0660156c60 0x7f066006e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.084+0000 7f065de00640 1 -- 172.21.15.107:0/1941525759 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0660156c60 msgr2=0x7f066006e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:51.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.084+0000 7f065de00640 1 --2- 172.21.15.107:0/1941525759 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0660156c60 0x7f066006e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.084+0000 7f065de00640 1 -- 172.21.15.107:0/1941525759 >> v1:172.21.15.157:6789/0 conn(0x7f06600c8130 legacy=0x7f06600c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:51.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.084+0000 7f065de00640 1 -- 172.21.15.107:0/1941525759 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06600ab320 con 0x7f0660156890 2024-08-17T02:27:51.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.085+0000 7f065de00640 1 --2- 172.21.15.107:0/1941525759 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0660156890 0x7f066006dee0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f0650009910 tx=0x7f06500091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dcc4562048e8aba server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:51.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.086+0000 7f065d400640 1 -- 172.21.15.107:0/1941525759 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065002adb0 con 0x7f0660156890 2024-08-17T02:27:51.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.086+0000 7f065d400640 1 -- 172.21.15.107:0/1941525759 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0650032440 con 0x7f0660156890 2024-08-17T02:27:51.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.086+0000 7f065d400640 1 -- 172.21.15.107:0/1941525759 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0650032820 con 0x7f0660156890 2024-08-17T02:27:51.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.086+0000 7f0664c00640 1 -- 172.21.15.107:0/1941525759 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0660156890 msgr2=0x7f066006dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.086+0000 7f0664c00640 1 --2- 172.21.15.107:0/1941525759 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0660156890 0x7f066006dee0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f0650009910 tx=0x7f06500091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.086+0000 7f0664c00640 1 -- 172.21.15.107:0/1941525759 shutdown_connections 2024-08-17T02:27:51.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.086+0000 7f0664c00640 1 --2- 172.21.15.107:0/1941525759 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0660156c60 0x7f066006e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.086+0000 7f0664c00640 1 --2- 172.21.15.107:0/1941525759 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0660156890 0x7f066006dee0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.086+0000 7f0664c00640 1 -- 172.21.15.107:0/1941525759 >> 172.21.15.107:0/1941525759 conn(0x7f0660067750 msgr2=0x7f066006c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:51.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.086+0000 7f0664c00640 1 -- 172.21.15.107:0/1941525759 shutdown_connections 2024-08-17T02:27:51.089 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.087+0000 7f0664c00640 1 -- 172.21.15.107:0/1941525759 wait complete. 2024-08-17T02:27:51.089 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.088+0000 7f0664c00640 1 Processor -- start 2024-08-17T02:27:51.089 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.088+0000 7f0664c00640 1 -- start start 2024-08-17T02:27:51.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.089+0000 7f0664c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06600c8130 0x7f0660155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.089+0000 7f0664c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0660156890 0x7f06601558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.089+0000 7f0664c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0660156c60 0x7f06600ab610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.089+0000 7f0664c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066016a8b0 con 0x7f06600c8130 2024-08-17T02:27:51.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.089+0000 7f0664c00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06601597d0 con 0x7f0660156c60 2024-08-17T02:27:51.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.089+0000 7f0664c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f066016d6e0 con 0x7f0660156890 2024-08-17T02:27:51.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.089+0000 7f065de00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06600c8130 0x7f0660155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.089+0000 7f065de00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06600c8130 0x7f0660155360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36502/0 (socket says 172.21.15.107:36502) 2024-08-17T02:27:51.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.089+0000 7f065de00640 1 -- 172.21.15.107:0/837334330 learned_addr learned my addr 172.21.15.107:0/837334330 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:51.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.089+0000 7f065e800640 1 --2- 172.21.15.107:0/837334330 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0660156c60 0x7f06600ab610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.089+0000 7f0657e00640 1 --2- 172.21.15.107:0/837334330 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0660156890 0x7f06601558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.090+0000 7f065de00640 1 -- 172.21.15.107:0/837334330 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0660156890 msgr2=0x7f06601558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.090+0000 7f065de00640 1 --2- 172.21.15.107:0/837334330 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0660156890 0x7f06601558a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.090+0000 7f065de00640 1 -- 172.21.15.107:0/837334330 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0660156c60 msgr2=0x7f06600ab610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.090+0000 7f065de00640 1 --2- 172.21.15.107:0/837334330 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0660156c60 0x7f06600ab610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.090+0000 7f065de00640 1 -- 172.21.15.107:0/837334330 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0650009450 con 0x7f06600c8130 2024-08-17T02:27:51.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.090+0000 7f0657e00640 1 --2- 172.21.15.107:0/837334330 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0660156890 0x7f06601558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:51.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.090+0000 7f065e800640 1 --2- 172.21.15.107:0/837334330 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0660156c60 0x7f06600ab610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:51.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.090+0000 7f065de00640 1 --2- 172.21.15.107:0/837334330 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06600c8130 0x7f0660155360 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0650009970 tx=0x7f0650032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:51.093 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.090+0000 7f0655600640 1 -- 172.21.15.107:0/837334330 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0650031bb0 con 0x7f06600c8130 2024-08-17T02:27:51.093 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.090+0000 7f0655600640 1 -- 172.21.15.107:0/837334330 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0650031d30 con 0x7f06600c8130 2024-08-17T02:27:51.093 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.090+0000 7f0655600640 1 -- 172.21.15.107:0/837334330 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0650031ea0 con 0x7f06600c8130 2024-08-17T02:27:51.093 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.090+0000 7f0664c00640 1 -- 172.21.15.107:0/837334330 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f066016a5d0 con 0x7f06600c8130 2024-08-17T02:27:51.093 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.090+0000 7f0664c00640 1 -- 172.21.15.107:0/837334330 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f066016d370 con 0x7f06600c8130 2024-08-17T02:27:51.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.091+0000 7f0664c00640 1 -- 172.21.15.107:0/837334330 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f066015c700 con 0x7f06600c8130 2024-08-17T02:27:51.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.092+0000 7f0655600640 1 -- 172.21.15.107:0/837334330 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0650039040 con 0x7f06600c8130 2024-08-17T02:27:51.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.093+0000 7f0655600640 1 --2- 172.21.15.107:0/837334330 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f063c065150 0x7f063c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.093+0000 7f0655600640 1 -- 172.21.15.107:0/837334330 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5923+0+0 (secure 0 0 0) 0x7f06500a2500 con 0x7f06600c8130 2024-08-17T02:27:51.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.093+0000 7f0657e00640 1 --2- 172.21.15.107:0/837334330 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f063c065150 0x7f063c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.094+0000 7f0657e00640 1 --2- 172.21.15.107:0/837334330 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f063c065150 0x7f063c067600 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0660156030 tx=0x7f0648008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:51.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.097+0000 7f0655600640 1 -- 172.21.15.107:0/837334330 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0650070440 con 0x7f06600c8130 2024-08-17T02:27:51.271 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:51.270+0000 7f0664c00640 1 -- 172.21.15.107:0/837334330 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000928569.meta", "pool2": "cephfs.volume_0000000000928569.meta", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f066006e740 con 0x7f06600c8130 2024-08-17T02:27:52.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.207+0000 7f0655600640 1 -- 172.21.15.107:0/837334330 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000928569.meta", "pool2": "cephfs.volume_0000000000928569.meta", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000928569.meta' removed v42) v1 ==== 241+0+0 (secure 0 0 0) 0x7f0650073a60 con 0x7f06600c8130 2024-08-17T02:27:52.209 INFO:teuthology.orchestra.run.smithi107.stderr:pool 'cephfs.volume_0000000000928569.meta' removed 2024-08-17T02:27:52.212 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.211+0000 7f0664c00640 1 -- 172.21.15.107:0/837334330 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f063c065150 msgr2=0x7f063c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.212 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.211+0000 7f0664c00640 1 --2- 172.21.15.107:0/837334330 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f063c065150 0x7f063c067600 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0660156030 tx=0x7f0648008040 comp rx=0 tx=0).stop 2024-08-17T02:27:52.212 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.211+0000 7f0664c00640 1 -- 172.21.15.107:0/837334330 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06600c8130 msgr2=0x7f0660155360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.212 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.211+0000 7f0664c00640 1 --2- 172.21.15.107:0/837334330 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06600c8130 0x7f0660155360 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0650009970 tx=0x7f0650032000 comp rx=0 tx=0).stop 2024-08-17T02:27:52.213 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.211+0000 7f0664c00640 1 -- 172.21.15.107:0/837334330 shutdown_connections 2024-08-17T02:27:52.213 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.211+0000 7f0664c00640 1 --2- 172.21.15.107:0/837334330 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f063c065150 0x7f063c067600 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.213 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.211+0000 7f0664c00640 1 --2- 172.21.15.107:0/837334330 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0660156c60 0x7f06600ab610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.213 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.211+0000 7f0664c00640 1 --2- 172.21.15.107:0/837334330 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0660156890 0x7f06601558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.213 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.211+0000 7f0664c00640 1 --2- 172.21.15.107:0/837334330 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06600c8130 0x7f0660155360 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.213 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.211+0000 7f0664c00640 1 -- 172.21.15.107:0/837334330 >> 172.21.15.107:0/837334330 conn(0x7f0660067750 msgr2=0x7f06600686d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:52.213 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.211+0000 7f0664c00640 1 -- 172.21.15.107:0/837334330 shutdown_connections 2024-08-17T02:27:52.213 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.211+0000 7f0664c00640 1 -- 172.21.15.107:0/837334330 wait complete. 2024-08-17T02:27:52.231 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000928569.data cephfs.volume_0000000000928569.data --yes-i-really-really-mean-it 2024-08-17T02:27:52.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.386+0000 7f7d55600640 1 Processor -- start 2024-08-17T02:27:52.388 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.386+0000 7f7d55600640 1 -- start start 2024-08-17T02:27:52.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.387+0000 7f7d55600640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7d50150130 0x7f7d500aa730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.387+0000 7f7d55600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7d5006e5f0 0x7f7d500ab510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.387+0000 7f7d55600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d501568b0 con 0x7f7d50156d40 2024-08-17T02:27:52.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.387+0000 7f7d55600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d50150500 con 0x7f7d5006e5f0 2024-08-17T02:27:52.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.387+0000 7f7d55600640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d50155fc0 con 0x7f7d50150130 2024-08-17T02:27:52.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.388+0000 7f7d4e000640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f7d50156d40 0x7f7d5006dee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:40912/0 (socket says 172.21.15.107:40912) 2024-08-17T02:27:52.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.388+0000 7f7d4e000640 1 -- 172.21.15.107:0/2994118177 learned_addr learned my addr 172.21.15.107:0/2994118177 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:27:52.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.388+0000 7f7d4f400640 1 --2- 172.21.15.107:0/2994118177 >> v2:172.21.15.107:3300/0 conn(0x7f7d5006e5f0 0x7f7d500ab510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.388+0000 7f7d4ea00640 1 --2- 172.21.15.107:0/2994118177 >> v2:172.21.15.157:3300/0 conn(0x7f7d50150130 0x7f7d500aa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.388+0000 7f7d4d600640 1 -- 172.21.15.107:0/2994118177 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1625556732 0 0) 0x7f7d501568b0 con 0x7f7d50156d40 2024-08-17T02:27:52.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.388+0000 7f7d4d600640 1 -- 172.21.15.107:0/2994118177 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d340034e0 con 0x7f7d50156d40 2024-08-17T02:27:52.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.388+0000 7f7d4f400640 1 -- 172.21.15.107:0/2994118177 >> v2:172.21.15.157:3300/0 conn(0x7f7d50150130 msgr2=0x7f7d500aa730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:52.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.388+0000 7f7d4f400640 1 --2- 172.21.15.107:0/2994118177 >> v2:172.21.15.157:3300/0 conn(0x7f7d50150130 0x7f7d500aa730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.388+0000 7f7d4f400640 1 -- 172.21.15.107:0/2994118177 >> v1:172.21.15.107:6789/0 conn(0x7f7d50156d40 legacy=0x7f7d5006dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.388+0000 7f7d4f400640 1 -- 172.21.15.107:0/2994118177 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d500add60 con 0x7f7d5006e5f0 2024-08-17T02:27:52.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.389+0000 7f7d4f400640 1 --2- 172.21.15.107:0/2994118177 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d5006e5f0 0x7f7d500ab510 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f7d5006f670 tx=0x7f7d48009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2574cc1498322525 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:52.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.389+0000 7f7d4d600640 1 -- 172.21.15.107:0/2994118177 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d48007550 con 0x7f7d5006e5f0 2024-08-17T02:27:52.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.389+0000 7f7d4d600640 1 -- 172.21.15.107:0/2994118177 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4802d050 con 0x7f7d5006e5f0 2024-08-17T02:27:52.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.389+0000 7f7d4d600640 1 -- 172.21.15.107:0/2994118177 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d48007900 con 0x7f7d5006e5f0 2024-08-17T02:27:52.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.390+0000 7f7d55600640 1 -- 172.21.15.107:0/2994118177 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d5006e5f0 msgr2=0x7f7d500ab510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.390+0000 7f7d55600640 1 --2- 172.21.15.107:0/2994118177 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d5006e5f0 0x7f7d500ab510 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f7d5006f670 tx=0x7f7d48009780 comp rx=0 tx=0).stop 2024-08-17T02:27:52.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.390+0000 7f7d55600640 1 -- 172.21.15.107:0/2994118177 shutdown_connections 2024-08-17T02:27:52.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.390+0000 7f7d55600640 1 --2- 172.21.15.107:0/2994118177 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d5006e5f0 0x7f7d500ab510 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.390+0000 7f7d55600640 1 --2- 172.21.15.107:0/2994118177 >> v2:172.21.15.157:3300/0 conn(0x7f7d50150130 0x7f7d500aa730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.390+0000 7f7d55600640 1 -- 172.21.15.107:0/2994118177 >> 172.21.15.107:0/2994118177 conn(0x7f7d50067750 msgr2=0x7f7d5006c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:52.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.390+0000 7f7d55600640 1 -- 172.21.15.107:0/2994118177 shutdown_connections 2024-08-17T02:27:52.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.390+0000 7f7d55600640 1 -- 172.21.15.107:0/2994118177 wait complete. 2024-08-17T02:27:52.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.391+0000 7f7d55600640 1 Processor -- start 2024-08-17T02:27:52.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.392+0000 7f7d55600640 1 -- start start 2024-08-17T02:27:52.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.392+0000 7f7d55600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d5006e5f0 0x7f7d500a8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.392+0000 7f7d55600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7d50150130 0x7f7d501432a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.392+0000 7f7d55600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7d50156d40 0x7f7d5006c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.392+0000 7f7d55600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d500a8870 con 0x7f7d5006e5f0 2024-08-17T02:27:52.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.392+0000 7f7d55600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d500a8b50 con 0x7f7d50150130 2024-08-17T02:27:52.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.392+0000 7f7d55600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d500a8e30 con 0x7f7d50156d40 2024-08-17T02:27:52.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.393+0000 7f7d4ea00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d5006e5f0 0x7f7d500a8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.393+0000 7f7d4ea00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d5006e5f0 0x7f7d500a8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36528/0 (socket says 172.21.15.107:36528) 2024-08-17T02:27:52.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.393+0000 7f7d4ea00640 1 -- 172.21.15.107:0/346657362 learned_addr learned my addr 172.21.15.107:0/346657362 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:52.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.393+0000 7f7d4e000640 1 --2- 172.21.15.107:0/346657362 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7d50150130 0x7f7d501432a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.393+0000 7f7d4f400640 1 --2- 172.21.15.107:0/346657362 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7d50156d40 0x7f7d5006c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.393+0000 7f7d4ea00640 1 -- 172.21.15.107:0/346657362 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7d50156d40 msgr2=0x7f7d5006c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.393+0000 7f7d4ea00640 1 --2- 172.21.15.107:0/346657362 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7d50156d40 0x7f7d5006c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.393+0000 7f7d4ea00640 1 -- 172.21.15.107:0/346657362 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7d50150130 msgr2=0x7f7d501432a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.393+0000 7f7d4ea00640 1 --2- 172.21.15.107:0/346657362 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7d50150130 0x7f7d501432a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.393+0000 7f7d4ea00640 1 -- 172.21.15.107:0/346657362 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d48009a20 con 0x7f7d5006e5f0 2024-08-17T02:27:52.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.393+0000 7f7d4f400640 1 --2- 172.21.15.107:0/346657362 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7d50156d40 0x7f7d5006c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:52.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.394+0000 7f7d4ea00640 1 --2- 172.21.15.107:0/346657362 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d5006e5f0 0x7f7d500a8040 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f7d4000ea20 tx=0x7f7d400090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:52.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.394+0000 7f7d46000640 1 -- 172.21.15.107:0/346657362 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4000ca10 con 0x7f7d5006e5f0 2024-08-17T02:27:52.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.394+0000 7f7d46000640 1 -- 172.21.15.107:0/346657362 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4000cb70 con 0x7f7d5006e5f0 2024-08-17T02:27:52.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.394+0000 7f7d55600640 1 -- 172.21.15.107:0/346657362 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d500a9110 con 0x7f7d5006e5f0 2024-08-17T02:27:52.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.394+0000 7f7d46000640 1 -- 172.21.15.107:0/346657362 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d40013470 con 0x7f7d5006e5f0 2024-08-17T02:27:52.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.394+0000 7f7d55600640 1 -- 172.21.15.107:0/346657362 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d500a8580 con 0x7f7d5006e5f0 2024-08-17T02:27:52.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.395+0000 7f7d55600640 1 -- 172.21.15.107:0/346657362 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d500710c0 con 0x7f7d5006e5f0 2024-08-17T02:27:52.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.396+0000 7f7d46000640 1 -- 172.21.15.107:0/346657362 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7d40013860 con 0x7f7d5006e5f0 2024-08-17T02:27:52.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.396+0000 7f7d46000640 1 --2- 172.21.15.107:0/346657362 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7d30065150 0x7f7d30067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.397+0000 7f7d46000640 1 -- 172.21.15.107:0/346657362 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5448+0+0 (secure 0 0 0) 0x7f7d40082590 con 0x7f7d5006e5f0 2024-08-17T02:27:52.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.397+0000 7f7d4e000640 1 --2- 172.21.15.107:0/346657362 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7d30065150 0x7f7d30067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.397+0000 7f7d4e000640 1 --2- 172.21.15.107:0/346657362 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7d30065150 0x7f7d30067600 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7d50156c60 tx=0x7f7d3c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:52.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.401+0000 7f7d46000640 1 -- 172.21.15.107:0/346657362 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7d40050800 con 0x7f7d5006e5f0 2024-08-17T02:27:52.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:52.575+0000 7f7d55600640 1 -- 172.21.15.107:0/346657362 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000928569.data", "pool2": "cephfs.volume_0000000000928569.data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7d5006c7a0 con 0x7f7d5006e5f0 2024-08-17T02:27:53.210 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.208+0000 7f7d46000640 1 -- 172.21.15.107:0/346657362 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000928569.data", "pool2": "cephfs.volume_0000000000928569.data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000928569.data' removed v43) v1 ==== 241+0+0 (secure 0 0 0) 0x7f7d40053e20 con 0x7f7d5006e5f0 2024-08-17T02:27:53.210 INFO:teuthology.orchestra.run.smithi107.stderr:pool 'cephfs.volume_0000000000928569.data' removed 2024-08-17T02:27:53.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.213+0000 7f7d55600640 1 -- 172.21.15.107:0/346657362 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7d30065150 msgr2=0x7f7d30067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.213+0000 7f7d55600640 1 --2- 172.21.15.107:0/346657362 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7d30065150 0x7f7d30067600 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7d50156c60 tx=0x7f7d3c009040 comp rx=0 tx=0).stop 2024-08-17T02:27:53.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.213+0000 7f7d55600640 1 -- 172.21.15.107:0/346657362 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d5006e5f0 msgr2=0x7f7d500a8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.213+0000 7f7d55600640 1 --2- 172.21.15.107:0/346657362 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d5006e5f0 0x7f7d500a8040 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f7d4000ea20 tx=0x7f7d400090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.213+0000 7f7d55600640 1 -- 172.21.15.107:0/346657362 shutdown_connections 2024-08-17T02:27:53.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.213+0000 7f7d55600640 1 --2- 172.21.15.107:0/346657362 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7d30065150 0x7f7d30067600 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.213+0000 7f7d55600640 1 --2- 172.21.15.107:0/346657362 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7d50156d40 0x7f7d5006c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.213+0000 7f7d55600640 1 --2- 172.21.15.107:0/346657362 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7d50150130 0x7f7d501432a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.213+0000 7f7d55600640 1 --2- 172.21.15.107:0/346657362 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d5006e5f0 0x7f7d500a8040 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.213+0000 7f7d55600640 1 -- 172.21.15.107:0/346657362 >> 172.21.15.107:0/346657362 conn(0x7f7d50067750 msgr2=0x7f7d500cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:53.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.214+0000 7f7d55600640 1 -- 172.21.15.107:0/346657362 shutdown_connections 2024-08-17T02:27:53.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.214+0000 7f7d55600640 1 -- 172.21.15.107:0/346657362 wait complete. 2024-08-17T02:27:53.232 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-08-17T02:27:53.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.380+0000 7f498ce00640 1 Processor -- start 2024-08-17T02:27:53.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.380+0000 7f498ce00640 1 -- start start 2024-08-17T02:27:53.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.381+0000 7f498ce00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f498815ceb0 0x7f49880c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.381+0000 7f498ce00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f498806eaf0 0x7f498815d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.381+0000 7f498ce00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49880aa390 con 0x7f498815d7c0 2024-08-17T02:27:53.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.381+0000 7f498ce00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49880a9a60 con 0x7f498806eaf0 2024-08-17T02:27:53.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.381+0000 7f498ce00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49880a9d40 con 0x7f498815ceb0 2024-08-17T02:27:53.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.382+0000 7f497d400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f498806eaf0 0x7f498815d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.382+0000 7f4986800640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f498815d7c0 0x7f4988158b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:40916/0 (socket says 172.21.15.107:40916) 2024-08-17T02:27:53.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.382+0000 7f4986800640 1 -- 172.21.15.107:0/707701094 learned_addr learned my addr 172.21.15.107:0/707701094 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:27:53.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.382+0000 7f4985e00640 1 --2- 172.21.15.107:0/707701094 >> v2:172.21.15.157:3300/0 conn(0x7f498815ceb0 0x7f49880c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.382+0000 7f497d400640 1 -- 172.21.15.107:0/707701094 >> v2:172.21.15.157:3300/0 conn(0x7f498815ceb0 msgr2=0x7f49880c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:53.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.382+0000 7f497d400640 1 --2- 172.21.15.107:0/707701094 >> v2:172.21.15.157:3300/0 conn(0x7f498815ceb0 0x7f49880c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.382+0000 7f497d400640 1 -- 172.21.15.107:0/707701094 >> v1:172.21.15.107:6789/0 conn(0x7f498815d7c0 legacy=0x7f4988158b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.382+0000 7f497d400640 1 -- 172.21.15.107:0/707701094 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49880aa020 con 0x7f498806eaf0 2024-08-17T02:27:53.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.383+0000 7f497d400640 1 --2- 172.21.15.107:0/707701094 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f498806eaf0 0x7f498815d280 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f498806f670 tx=0x7f49700090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ea9205ee8756028 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:53.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.383+0000 7f4985400640 1 -- 172.21.15.107:0/707701094 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497002ae40 con 0x7f498806eaf0 2024-08-17T02:27:53.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.383+0000 7f4985400640 1 -- 172.21.15.107:0/707701094 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4970032440 con 0x7f498806eaf0 2024-08-17T02:27:53.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.383+0000 7f4985400640 1 -- 172.21.15.107:0/707701094 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4970032820 con 0x7f498806eaf0 2024-08-17T02:27:53.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.384+0000 7f498ce00640 1 -- 172.21.15.107:0/707701094 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f498806eaf0 msgr2=0x7f498815d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.384+0000 7f498ce00640 1 --2- 172.21.15.107:0/707701094 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f498806eaf0 0x7f498815d280 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f498806f670 tx=0x7f49700090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.384+0000 7f498ce00640 1 -- 172.21.15.107:0/707701094 shutdown_connections 2024-08-17T02:27:53.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.384+0000 7f498ce00640 1 --2- 172.21.15.107:0/707701094 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f498806eaf0 0x7f498815d280 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.384+0000 7f498ce00640 1 --2- 172.21.15.107:0/707701094 >> v2:172.21.15.157:3300/0 conn(0x7f498815ceb0 0x7f49880c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.384+0000 7f498ce00640 1 -- 172.21.15.107:0/707701094 >> 172.21.15.107:0/707701094 conn(0x7f49880677a0 msgr2=0x7f49880cbd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:53.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.384+0000 7f498ce00640 1 -- 172.21.15.107:0/707701094 shutdown_connections 2024-08-17T02:27:53.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.384+0000 7f498ce00640 1 -- 172.21.15.107:0/707701094 wait complete. 2024-08-17T02:27:53.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.385+0000 7f498ce00640 1 Processor -- start 2024-08-17T02:27:53.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.386+0000 7f498ce00640 1 -- start start 2024-08-17T02:27:53.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.386+0000 7f498ce00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f498806eaf0 0x7f49880ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.386+0000 7f498ce00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f498815ceb0 0x7f498806db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.386+0000 7f498ce00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f498815d7c0 0x7f498806e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.386+0000 7f498ce00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49880c8670 con 0x7f498815ceb0 2024-08-17T02:27:53.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.387+0000 7f498ce00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498815bc80 con 0x7f498806eaf0 2024-08-17T02:27:53.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.387+0000 7f498ce00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f498815bf60 con 0x7f498815d7c0 2024-08-17T02:27:53.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.387+0000 7f497d400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f498815ceb0 0x7f498806db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.387+0000 7f497d400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f498815ceb0 0x7f498806db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36546/0 (socket says 172.21.15.107:36546) 2024-08-17T02:27:53.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.387+0000 7f497d400640 1 -- 172.21.15.107:0/2993682788 learned_addr learned my addr 172.21.15.107:0/2993682788 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:53.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.387+0000 7f4985e00640 1 --2- 172.21.15.107:0/2993682788 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f498806eaf0 0x7f49880ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.387+0000 7f4986800640 1 --2- 172.21.15.107:0/2993682788 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f498815d7c0 0x7f498806e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.387+0000 7f497d400640 1 -- 172.21.15.107:0/2993682788 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f498815d7c0 msgr2=0x7f498806e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.387+0000 7f497d400640 1 --2- 172.21.15.107:0/2993682788 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f498815d7c0 0x7f498806e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.387+0000 7f497d400640 1 -- 172.21.15.107:0/2993682788 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f498806eaf0 msgr2=0x7f49880ca5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.387+0000 7f497d400640 1 --2- 172.21.15.107:0/2993682788 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f498806eaf0 0x7f49880ca5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.387+0000 7f497d400640 1 -- 172.21.15.107:0/2993682788 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4970009390 con 0x7f498815ceb0 2024-08-17T02:27:53.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.387+0000 7f4986800640 1 --2- 172.21.15.107:0/2993682788 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f498815d7c0 0x7f498806e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:53.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.388+0000 7f497d400640 1 --2- 172.21.15.107:0/2993682788 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f498815ceb0 0x7f498806db40 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4970009360 tx=0x7f4970032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:53.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.388+0000 7f497e000640 1 -- 172.21.15.107:0/2993682788 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4970031de0 con 0x7f498815ceb0 2024-08-17T02:27:53.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.388+0000 7f497e000640 1 -- 172.21.15.107:0/2993682788 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497003d420 con 0x7f498815ceb0 2024-08-17T02:27:53.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.388+0000 7f497e000640 1 -- 172.21.15.107:0/2993682788 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497003d7e0 con 0x7f498815ceb0 2024-08-17T02:27:53.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.388+0000 7f498ce00640 1 -- 172.21.15.107:0/2993682788 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f498815c240 con 0x7f498815ceb0 2024-08-17T02:27:53.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.388+0000 7f498ce00640 1 -- 172.21.15.107:0/2993682788 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49880cab10 con 0x7f498815ceb0 2024-08-17T02:27:53.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.389+0000 7f498ce00640 1 -- 172.21.15.107:0/2993682788 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49880c87e0 con 0x7f498815ceb0 2024-08-17T02:27:53.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.390+0000 7f497e000640 1 -- 172.21.15.107:0/2993682788 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4970039040 con 0x7f498815ceb0 2024-08-17T02:27:53.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.390+0000 7f497e000640 1 --2- 172.21.15.107:0/2993682788 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4964065150 0x7f4964067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.390+0000 7f497e000640 1 -- 172.21.15.107:0/2993682788 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f497002ae40 con 0x7f498815ceb0 2024-08-17T02:27:53.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.391+0000 7f4985e00640 1 --2- 172.21.15.107:0/2993682788 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4964065150 0x7f4964067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.391+0000 7f4985e00640 1 --2- 172.21.15.107:0/2993682788 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4964065150 0x7f4964067600 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4978007ba0 tx=0x7f4978008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:53.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.394+0000 7f497e000640 1 -- 172.21.15.107:0/2993682788 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4970070550 con 0x7f498815ceb0 2024-08-17T02:27:53.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.571+0000 7f498ce00640 1 -- 172.21.15.107:0/2993682788 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f4988071050 con 0x7f498815ceb0 2024-08-17T02:27:53.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.575+0000 7f497e000640 1 -- 172.21.15.107:0/2993682788 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4970073b70 con 0x7f498815ceb0 2024-08-17T02:27:53.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.577+0000 7f498ce00640 1 -- 172.21.15.107:0/2993682788 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4964065150 msgr2=0x7f4964067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.577+0000 7f498ce00640 1 --2- 172.21.15.107:0/2993682788 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4964065150 0x7f4964067600 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4978007ba0 tx=0x7f4978008040 comp rx=0 tx=0).stop 2024-08-17T02:27:53.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.577+0000 7f498ce00640 1 -- 172.21.15.107:0/2993682788 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f498815ceb0 msgr2=0x7f498806db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.577+0000 7f498ce00640 1 --2- 172.21.15.107:0/2993682788 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f498815ceb0 0x7f498806db40 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4970009360 tx=0x7f4970032000 comp rx=0 tx=0).stop 2024-08-17T02:27:53.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.577+0000 7f498ce00640 1 -- 172.21.15.107:0/2993682788 shutdown_connections 2024-08-17T02:27:53.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.577+0000 7f498ce00640 1 --2- 172.21.15.107:0/2993682788 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4964065150 0x7f4964067600 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.577+0000 7f498ce00640 1 --2- 172.21.15.107:0/2993682788 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f498815d7c0 0x7f498806e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.577+0000 7f498ce00640 1 --2- 172.21.15.107:0/2993682788 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f498815ceb0 0x7f498806db40 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.577+0000 7f498ce00640 1 --2- 172.21.15.107:0/2993682788 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f498806eaf0 0x7f49880ca5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.577+0000 7f498ce00640 1 -- 172.21.15.107:0/2993682788 >> 172.21.15.107:0/2993682788 conn(0x7f49880677a0 msgr2=0x7f4988156a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:53.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.578+0000 7f498ce00640 1 -- 172.21.15.107:0/2993682788 shutdown_connections 2024-08-17T02:27:53.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.578+0000 7f498ce00640 1 -- 172.21.15.107:0/2993682788 wait complete. 2024-08-17T02:27:53.594 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-08-17T02:27:53.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.739+0000 7fdf65400640 1 Processor -- start 2024-08-17T02:27:53.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.739+0000 7fdf65400640 1 -- start start 2024-08-17T02:27:53.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.741+0000 7fdf65400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdf60155550 0x7fdf600aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.741+0000 7fdf65400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fdf6006e080 0x7fdf6006e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.741+0000 7fdf65400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf600afc10 con 0x7fdf60155180 2024-08-17T02:27:53.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.741+0000 7fdf65400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf6006ea00 con 0x7fdf6006e080 2024-08-17T02:27:53.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.741+0000 7fdf65400640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf600af000 con 0x7fdf60155550 2024-08-17T02:27:53.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.741+0000 7fdf5f200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fdf6006e080 0x7fdf6006e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.741+0000 7fdf5e800640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fdf60155180 0x7fdf600ae070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:40924/0 (socket says 172.21.15.107:40924) 2024-08-17T02:27:53.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.741+0000 7fdf5e800640 1 -- 172.21.15.107:0/3320755691 learned_addr learned my addr 172.21.15.107:0/3320755691 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:27:53.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.741+0000 7fdf5f200640 1 -- 172.21.15.107:0/3320755691 >> v2:172.21.15.157:3300/0 conn(0x7fdf60155550 msgr2=0x7fdf600aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:53.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.741+0000 7fdf55e00640 1 --2- 172.21.15.107:0/3320755691 >> v2:172.21.15.157:3300/0 conn(0x7fdf60155550 0x7fdf600aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.741+0000 7fdf5f200640 1 --2- 172.21.15.107:0/3320755691 >> v2:172.21.15.157:3300/0 conn(0x7fdf60155550 0x7fdf600aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.741+0000 7fdf5f200640 1 -- 172.21.15.107:0/3320755691 >> v1:172.21.15.107:6789/0 conn(0x7fdf60155180 legacy=0x7fdf600ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.744 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.741+0000 7fdf5de00640 1 -- 172.21.15.107:0/3320755691 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1989911832 0 0) 0x7fdf600afc10 con 0x7fdf60155180 2024-08-17T02:27:53.744 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.741+0000 7fdf5f200640 1 -- 172.21.15.107:0/3320755691 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf600af2e0 con 0x7fdf6006e080 2024-08-17T02:27:53.744 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.742+0000 7fdf55e00640 1 --2- 172.21.15.107:0/3320755691 >> v2:172.21.15.157:3300/0 conn(0x7fdf60155550 0x7fdf600aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:53.745 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.742+0000 7fdf5f200640 1 --2- 172.21.15.107:0/3320755691 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf6006e080 0x7fdf6006e4c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fdf6006c770 tx=0x7fdf58009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=104cac51f2581813 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:53.745 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.743+0000 7fdf5de00640 1 -- 172.21.15.107:0/3320755691 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf58007550 con 0x7fdf6006e080 2024-08-17T02:27:53.745 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.743+0000 7fdf5de00640 1 -- 172.21.15.107:0/3320755691 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf5802d050 con 0x7fdf6006e080 2024-08-17T02:27:53.745 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.743+0000 7fdf5de00640 1 -- 172.21.15.107:0/3320755691 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf580078e0 con 0x7fdf6006e080 2024-08-17T02:27:53.745 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.743+0000 7fdf65400640 1 -- 172.21.15.107:0/3320755691 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf6006e080 msgr2=0x7fdf6006e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.745 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.743+0000 7fdf65400640 1 --2- 172.21.15.107:0/3320755691 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf6006e080 0x7fdf6006e4c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fdf6006c770 tx=0x7fdf58009780 comp rx=0 tx=0).stop 2024-08-17T02:27:53.745 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.743+0000 7fdf65400640 1 -- 172.21.15.107:0/3320755691 shutdown_connections 2024-08-17T02:27:53.745 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.743+0000 7fdf65400640 1 --2- 172.21.15.107:0/3320755691 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf6006e080 0x7fdf6006e4c0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.745 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.743+0000 7fdf65400640 1 --2- 172.21.15.107:0/3320755691 >> v2:172.21.15.157:3300/0 conn(0x7fdf60155550 0x7fdf600aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.745 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.743+0000 7fdf65400640 1 -- 172.21.15.107:0/3320755691 >> 172.21.15.107:0/3320755691 conn(0x7fdf600cb9b0 msgr2=0x7fdf600cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:53.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.743+0000 7fdf65400640 1 -- 172.21.15.107:0/3320755691 shutdown_connections 2024-08-17T02:27:53.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.743+0000 7fdf65400640 1 -- 172.21.15.107:0/3320755691 wait complete. 2024-08-17T02:27:53.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.745+0000 7fdf65400640 1 Processor -- start 2024-08-17T02:27:53.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.745+0000 7fdf65400640 1 -- start start 2024-08-17T02:27:53.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.746+0000 7fdf65400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf6006e080 0x7fdf60168bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.746+0000 7fdf65400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf60155180 0x7fdf600c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.746+0000 7fdf65400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdf60155550 0x7fdf60151790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.746+0000 7fdf65400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf600c0f90 con 0x7fdf60155180 2024-08-17T02:27:53.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.746+0000 7fdf65400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf60169b70 con 0x7fdf6006e080 2024-08-17T02:27:53.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.746+0000 7fdf65400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf60157440 con 0x7fdf60155550 2024-08-17T02:27:53.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.746+0000 7fdf55e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf60155180 0x7fdf600c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.746+0000 7fdf55e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf60155180 0x7fdf600c0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36570/0 (socket says 172.21.15.107:36570) 2024-08-17T02:27:53.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.746+0000 7fdf55e00640 1 -- 172.21.15.107:0/4048948114 learned_addr learned my addr 172.21.15.107:0/4048948114 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:53.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.746+0000 7fdf5f200640 1 --2- 172.21.15.107:0/4048948114 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdf60155550 0x7fdf60151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.746+0000 7fdf5e800640 1 --2- 172.21.15.107:0/4048948114 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf6006e080 0x7fdf60168bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.746+0000 7fdf55e00640 1 -- 172.21.15.107:0/4048948114 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdf60155550 msgr2=0x7fdf60151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.746+0000 7fdf55e00640 1 --2- 172.21.15.107:0/4048948114 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdf60155550 0x7fdf60151790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.746+0000 7fdf55e00640 1 -- 172.21.15.107:0/4048948114 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf6006e080 msgr2=0x7fdf60168bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.746+0000 7fdf55e00640 1 --2- 172.21.15.107:0/4048948114 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf6006e080 0x7fdf60168bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.747+0000 7fdf55e00640 1 -- 172.21.15.107:0/4048948114 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf58009a20 con 0x7fdf60155180 2024-08-17T02:27:53.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.747+0000 7fdf55e00640 1 --2- 172.21.15.107:0/4048948114 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf60155180 0x7fdf600c0a50 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fdf4800c8b0 tx=0x7fdf48008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:53.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.747+0000 7fdf56a00640 1 -- 172.21.15.107:0/4048948114 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4800ce40 con 0x7fdf60155180 2024-08-17T02:27:53.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.747+0000 7fdf56a00640 1 -- 172.21.15.107:0/4048948114 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf48007830 con 0x7fdf60155180 2024-08-17T02:27:53.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.747+0000 7fdf65400640 1 -- 172.21.15.107:0/4048948114 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf601692d0 con 0x7fdf60155180 2024-08-17T02:27:53.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.747+0000 7fdf56a00640 1 -- 172.21.15.107:0/4048948114 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf48007bd0 con 0x7fdf60155180 2024-08-17T02:27:53.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.747+0000 7fdf65400640 1 -- 172.21.15.107:0/4048948114 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf60169890 con 0x7fdf60155180 2024-08-17T02:27:53.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.748+0000 7fdf65400640 1 -- 172.21.15.107:0/4048948114 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf60064db0 con 0x7fdf60155180 2024-08-17T02:27:53.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.749+0000 7fdf56a00640 1 -- 172.21.15.107:0/4048948114 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fdf480113f0 con 0x7fdf60155180 2024-08-17T02:27:53.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.750+0000 7fdf56a00640 1 --2- 172.21.15.107:0/4048948114 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fdf3c065180 0x7fdf3c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.750+0000 7fdf56a00640 1 -- 172.21.15.107:0/4048948114 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fdf48082150 con 0x7fdf60155180 2024-08-17T02:27:53.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.750+0000 7fdf5e800640 1 --2- 172.21.15.107:0/4048948114 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fdf3c065180 0x7fdf3c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.751+0000 7fdf5e800640 1 --2- 172.21.15.107:0/4048948114 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fdf3c065180 0x7fdf3c067630 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdf60069d00 tx=0x7fdf50007ca0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:53.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.754+0000 7fdf56a00640 1 -- 172.21.15.107:0/4048948114 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fdf48050580 con 0x7fdf60155180 2024-08-17T02:27:53.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:53.988+0000 7fdf65400640 1 -- 172.21.15.107:0/4048948114 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7fdf60157580 con 0x7fdf60155180 2024-08-17T02:27:54.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:54.218+0000 7fdf56a00640 1 -- 172.21.15.107:0/4048948114 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v159) v1 ==== 135+0+0 (secure 0 0 0) 0x7fdf48053ba0 con 0x7fdf60155180 2024-08-17T02:27:54.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:54.221+0000 7fdf65400640 1 -- 172.21.15.107:0/4048948114 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fdf3c065180 msgr2=0x7fdf3c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:54.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:54.221+0000 7fdf65400640 1 --2- 172.21.15.107:0/4048948114 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fdf3c065180 0x7fdf3c067630 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdf60069d00 tx=0x7fdf50007ca0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:54.221+0000 7fdf65400640 1 -- 172.21.15.107:0/4048948114 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf60155180 msgr2=0x7fdf600c0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:54.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:54.221+0000 7fdf65400640 1 --2- 172.21.15.107:0/4048948114 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf60155180 0x7fdf600c0a50 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fdf4800c8b0 tx=0x7fdf48008040 comp rx=0 tx=0).stop 2024-08-17T02:27:54.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:54.221+0000 7fdf65400640 1 -- 172.21.15.107:0/4048948114 shutdown_connections 2024-08-17T02:27:54.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:54.221+0000 7fdf65400640 1 --2- 172.21.15.107:0/4048948114 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fdf3c065180 0x7fdf3c067630 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:54.221+0000 7fdf65400640 1 --2- 172.21.15.107:0/4048948114 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdf60155550 0x7fdf60151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:54.221+0000 7fdf65400640 1 --2- 172.21.15.107:0/4048948114 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf60155180 0x7fdf600c0a50 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:54.221+0000 7fdf65400640 1 --2- 172.21.15.107:0/4048948114 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf6006e080 0x7fdf60168bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:54.221+0000 7fdf65400640 1 -- 172.21.15.107:0/4048948114 >> 172.21.15.107:0/4048948114 conn(0x7fdf600cb9b0 msgr2=0x7fdf600b10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:54.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:54.221+0000 7fdf65400640 1 -- 172.21.15.107:0/4048948114 shutdown_connections 2024-08-17T02:27:54.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:54.221+0000 7fdf65400640 1 -- 172.21.15.107:0/4048948114 wait complete. 2024-08-17T02:27:54.241 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up ... ERROR 2024-08-17T02:27:54.241 INFO:tasks.cephfs_test_runner: 2024-08-17T02:27:54.241 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-17T02:27:54.241 INFO:tasks.cephfs_test_runner:ERROR: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:27:54.241 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up 2024-08-17T02:27:54.242 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:27:54.242 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-17T02:27:54.242 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 459, in test_volume_create 2024-08-17T02:27:54.242 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", volname, "--yes-i-really-mean-it") 2024-08-17T02:27:54.242 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2024-08-17T02:27:54.242 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-08-17T02:27:54.242 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-08-17T02:27:54.242 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-08-17T02:27:54.242 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-08-17T02:27:54.242 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-08-17T02:27:54.242 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_manager.py", line 1631, in run_cluster_cmd 2024-08-17T02:27:54.242 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-08-17T02:27:54.242 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-17T02:27:54.242 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-17T02:27:54.242 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-17T02:27:54.242 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-17T02:27:54.243 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-17T02:27:54.243 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-17T02:27:54.243 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-17T02:27:54.243 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-17T02:27:54.243 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi107 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000928569 --yes-i-really-mean-it' 2024-08-17T02:27:54.243 INFO:tasks.cephfs_test_runner: 2024-08-17T02:27:54.243 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:27:54.243 INFO:tasks.cephfs_test_runner:Ran 1 test in 174.355s 2024-08-17T02:27:54.243 INFO:tasks.cephfs_test_runner: 2024-08-17T02:27:54.243 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-08-17T02:27:54.243 INFO:tasks.cephfs_test_runner: 2024-08-17T02:27:54.243 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-17T02:27:54.243 INFO:tasks.cephfs_test_runner:ERROR: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:27:54.244 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up 2024-08-17T02:27:54.244 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:27:54.244 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-17T02:27:54.244 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 459, in test_volume_create 2024-08-17T02:27:54.244 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", volname, "--yes-i-really-mean-it") 2024-08-17T02:27:54.244 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2024-08-17T02:27:54.244 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-08-17T02:27:54.244 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-08-17T02:27:54.244 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-08-17T02:27:54.244 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-08-17T02:27:54.244 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-08-17T02:27:54.244 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_manager.py", line 1631, in run_cluster_cmd 2024-08-17T02:27:54.244 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-08-17T02:27:54.244 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-17T02:27:54.244 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-17T02:27:54.244 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-17T02:27:54.244 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-17T02:27:54.245 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-17T02:27:54.245 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-17T02:27:54.245 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-17T02:27:54.245 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-17T02:27:54.245 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi107 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000928569 --yes-i-really-mean-it' 2024-08-17T02:27:54.245 INFO:tasks.cephfs_test_runner: 2024-08-17T02:27:54.245 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:27:54.476 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=3b4b8decc3d14579b96431cf3dd8cae6 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:27:54.477 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-08-17T02:27:54.485 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-08-17T02:27:54.493 INFO:tasks.kclient:Unmounting kernel clients... 2024-08-17T02:27:54.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:54.493 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-08-17T02:27:54.531 INFO:teuthology.orchestra.run.smithi107.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:27:54.531 INFO:teuthology.orchestra.run.smithi107.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-17T02:27:54.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:54.532 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:27:54.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:54.630 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:27:54.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:54.879 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link delete ceph-brx 2024-08-17T02:27:55.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:55.182 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-08-17T02:27:55.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:55.218 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link delete ceph-brx 2024-08-17T02:27:55.317 INFO:teuthology.orchestra.run.smithi107.stderr:Cannot find device "ceph-brx" 2024-08-17T02:27:55.319 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:27:55.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:55.320 DEBUG:teuthology.orchestra.run.smithi157:> ip netns list 2024-08-17T02:27:55.360 INFO:teuthology.orchestra.run.smithi157.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:27:55.361 INFO:teuthology.orchestra.run.smithi157.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-17T02:27:55.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:55.361 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:27:55.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:55.462 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:27:55.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:55.725 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link delete ceph-brx 2024-08-17T02:27:56.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:56.009 DEBUG:teuthology.orchestra.run.smithi157:> ip netns list 2024-08-17T02:27:56.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:56.045 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link delete ceph-brx 2024-08-17T02:27:56.145 INFO:teuthology.orchestra.run.smithi157.stderr:Cannot find device "ceph-brx" 2024-08-17T02:27:56.147 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:27:56.148 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-08-17T02:27:56.157 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2024-08-17T02:27:56.157 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:56.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.312+0000 7fe84bc00640 1 Processor -- start 2024-08-17T02:27:56.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.312+0000 7fe84bc00640 1 -- start start 2024-08-17T02:27:56.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.313+0000 7fe84bc00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe844155a20 0x7fe8440adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.313+0000 7fe84bc00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe84406df00 0x7fe8440ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.313+0000 7fe84bc00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe844156670 con 0x7fe844155df0 2024-08-17T02:27:56.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.313+0000 7fe84bc00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8440b0350 con 0x7fe844155a20 2024-08-17T02:27:56.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.313+0000 7fe84bc00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe84406e5e0 con 0x7fe84406df00 2024-08-17T02:27:56.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.314+0000 7fe843e00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fe844155df0 0x7fe84406d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:40940/0 (socket says 172.21.15.107:40940) 2024-08-17T02:27:56.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.314+0000 7fe843e00640 1 -- 172.21.15.107:0/4223095069 learned_addr learned my addr 172.21.15.107:0/4223095069 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:27:56.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.314+0000 7fe849200640 1 --2- 172.21.15.107:0/4223095069 >> v2:172.21.15.157:3300/0 conn(0x7fe844155a20 0x7fe8440adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.314+0000 7fe849c00640 1 --2- 172.21.15.107:0/4223095069 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe84406df00 0x7fe8440ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.314+0000 7fe843400640 1 -- 172.21.15.107:0/4223095069 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4042580877 0 0) 0x7fe844156670 con 0x7fe844155df0 2024-08-17T02:27:56.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.314+0000 7fe843400640 1 -- 172.21.15.107:0/4223095069 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe82c0034e0 con 0x7fe844155df0 2024-08-17T02:27:56.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.314+0000 7fe849c00640 1 -- 172.21.15.107:0/4223095069 >> v2:172.21.15.157:3300/0 conn(0x7fe844155a20 msgr2=0x7fe8440adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:56.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.314+0000 7fe849c00640 1 --2- 172.21.15.107:0/4223095069 >> v2:172.21.15.157:3300/0 conn(0x7fe844155a20 0x7fe8440adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.314+0000 7fe849c00640 1 -- 172.21.15.107:0/4223095069 >> v1:172.21.15.107:6789/0 conn(0x7fe844155df0 legacy=0x7fe84406d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.314+0000 7fe849c00640 1 -- 172.21.15.107:0/4223095069 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe84406e8c0 con 0x7fe84406df00 2024-08-17T02:27:56.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.314+0000 7fe849200640 1 --2- 172.21.15.107:0/4223095069 >> v2:172.21.15.157:3300/0 conn(0x7fe844155a20 0x7fe8440adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:56.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.315+0000 7fe849c00640 1 --2- 172.21.15.107:0/4223095069 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe84406df00 0x7fe8440ad9b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe83c009e60 tx=0x7fe83c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=834a8fc29b2067f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:56.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.315+0000 7fe843400640 1 -- 172.21.15.107:0/4223095069 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83c007550 con 0x7fe84406df00 2024-08-17T02:27:56.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.315+0000 7fe843400640 1 -- 172.21.15.107:0/4223095069 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83c02d050 con 0x7fe84406df00 2024-08-17T02:27:56.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.316+0000 7fe843400640 1 -- 172.21.15.107:0/4223095069 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83c007920 con 0x7fe84406df00 2024-08-17T02:27:56.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.316+0000 7fe84bc00640 1 -- 172.21.15.107:0/4223095069 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe84406df00 msgr2=0x7fe8440ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.316+0000 7fe84bc00640 1 --2- 172.21.15.107:0/4223095069 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe84406df00 0x7fe8440ad9b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe83c009e60 tx=0x7fe83c009780 comp rx=0 tx=0).stop 2024-08-17T02:27:56.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.316+0000 7fe84bc00640 1 -- 172.21.15.107:0/4223095069 shutdown_connections 2024-08-17T02:27:56.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.316+0000 7fe84bc00640 1 --2- 172.21.15.107:0/4223095069 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe84406df00 0x7fe8440ad9b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.322 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.316+0000 7fe84bc00640 1 --2- 172.21.15.107:0/4223095069 >> v2:172.21.15.157:3300/0 conn(0x7fe844155a20 0x7fe8440adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.322 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.316+0000 7fe84bc00640 1 -- 172.21.15.107:0/4223095069 >> 172.21.15.107:0/4223095069 conn(0x7fe8440cb9b0 msgr2=0x7fe8440cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:56.322 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.316+0000 7fe84bc00640 1 -- 172.21.15.107:0/4223095069 shutdown_connections 2024-08-17T02:27:56.322 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.316+0000 7fe84bc00640 1 -- 172.21.15.107:0/4223095069 wait complete. 2024-08-17T02:27:56.322 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.318+0000 7fe84bc00640 1 Processor -- start 2024-08-17T02:27:56.322 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.318+0000 7fe84bc00640 1 -- start start 2024-08-17T02:27:56.322 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.318+0000 7fe84bc00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe84406df00 0x7fe84406c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.323 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.318+0000 7fe84bc00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe844155a20 0x7fe844167ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.323 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.318+0000 7fe84bc00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe844155df0 0x7fe84414f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.323 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.318+0000 7fe84bc00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8440a6910 con 0x7fe84406df00 2024-08-17T02:27:56.323 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.318+0000 7fe84bc00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe844168940 con 0x7fe844155a20 2024-08-17T02:27:56.323 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.318+0000 7fe84bc00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe844168c20 con 0x7fe844155df0 2024-08-17T02:27:56.323 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.319+0000 7fe849200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe84406df00 0x7fe84406c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.323 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.319+0000 7fe849200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe84406df00 0x7fe84406c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36574/0 (socket says 172.21.15.107:36574) 2024-08-17T02:27:56.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.319+0000 7fe849200640 1 -- 172.21.15.107:0/2635302823 learned_addr learned my addr 172.21.15.107:0/2635302823 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:56.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.319+0000 7fe849c00640 1 --2- 172.21.15.107:0/2635302823 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe844155df0 0x7fe84414f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.319+0000 7fe843e00640 1 --2- 172.21.15.107:0/2635302823 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe844155a20 0x7fe844167ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.319+0000 7fe849200640 1 -- 172.21.15.107:0/2635302823 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe844155df0 msgr2=0x7fe84414f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.319+0000 7fe849200640 1 --2- 172.21.15.107:0/2635302823 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe844155df0 0x7fe84414f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.319+0000 7fe849200640 1 -- 172.21.15.107:0/2635302823 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe844155a20 msgr2=0x7fe844167ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.319+0000 7fe849200640 1 --2- 172.21.15.107:0/2635302823 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe844155a20 0x7fe844167ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.319+0000 7fe849200640 1 -- 172.21.15.107:0/2635302823 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe838009390 con 0x7fe84406df00 2024-08-17T02:27:56.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.319+0000 7fe849c00640 1 --2- 172.21.15.107:0/2635302823 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe844155df0 0x7fe84414f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:56.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.320+0000 7fe849200640 1 --2- 172.21.15.107:0/2635302823 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe84406df00 0x7fe84406c910 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe83800ec80 tx=0x7fe8380090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:56.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.320+0000 7fe837e00640 1 -- 172.21.15.107:0/2635302823 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83800eec0 con 0x7fe84406df00 2024-08-17T02:27:56.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.320+0000 7fe837e00640 1 -- 172.21.15.107:0/2635302823 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83800cbc0 con 0x7fe84406df00 2024-08-17T02:27:56.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.320+0000 7fe837e00640 1 -- 172.21.15.107:0/2635302823 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe838013470 con 0x7fe84406df00 2024-08-17T02:27:56.327 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.320+0000 7fe84bc00640 1 -- 172.21.15.107:0/2635302823 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe83c009a20 con 0x7fe84406df00 2024-08-17T02:27:56.327 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.320+0000 7fe84bc00640 1 -- 172.21.15.107:0/2635302823 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8440a5eb0 con 0x7fe84406df00 2024-08-17T02:27:56.327 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.321+0000 7fe84bc00640 1 -- 172.21.15.107:0/2635302823 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe844064db0 con 0x7fe84406df00 2024-08-17T02:27:56.327 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.322+0000 7fe837e00640 1 -- 172.21.15.107:0/2635302823 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe8380137e0 con 0x7fe84406df00 2024-08-17T02:27:56.327 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.322+0000 7fe837e00640 1 --2- 172.21.15.107:0/2635302823 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe824065150 0x7fe824067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.327 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.323+0000 7fe837e00640 1 -- 172.21.15.107:0/2635302823 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fe8380825a0 con 0x7fe84406df00 2024-08-17T02:27:56.327 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.323+0000 7fe843e00640 1 --2- 172.21.15.107:0/2635302823 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe824065150 0x7fe824067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.323+0000 7fe843e00640 1 --2- 172.21.15.107:0/2635302823 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe824065150 0x7fe824067600 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe844167e20 tx=0x7fe830009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:56.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.327+0000 7fe837e00640 1 -- 172.21.15.107:0/2635302823 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe838050910 con 0x7fe84406df00 2024-08-17T02:27:56.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.501+0000 7fe84bc00640 1 -- 172.21.15.107:0/2635302823 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe844168de0 con 0x7fe84406df00 2024-08-17T02:27:56.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.502+0000 7fe837e00640 1 -- 172.21.15.107:0/2635302823 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+12443 (secure 0 0 0) 0x7fe838053f30 con 0x7fe84406df00 2024-08-17T02:27:56.503 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:27:56.503 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":43,"fsid":"f207b4c0-329d-46b8-b83f-aaf30bdb6ce3","created":"2024-08-17T02:24:11.038049+0000","modified":"2024-08-17T02:27:53.205725+0000","last_up_change":"2024-08-17T02:24:22.047790+0000","last_in_change":"2024-08-17T02:24:13.892720+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:23.456166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"376363f3-b8bf-4f1e-b691-51cdd39171ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37302},{"type":"v1","addr":"172.21.15.107:6801","nonce":37302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37302},{"type":"v1","addr":"172.21.15.107:6803","nonce":37302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37302},{"type":"v1","addr":"172.21.15.107:6807","nonce":37302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37302},{"type":"v1","addr":"172.21.15.107:6805","nonce":37302}]},"public_addr":"172.21.15.107:6801/37302","cluster_addr":"172.21.15.107:6803/37302","heartbeat_back_addr":"172.21.15.107:6807/37302","heartbeat_front_addr":"172.21.15.107:6805/37302","state":["exists","up"]},{"osd":1,"uuid":"cc6624e3-2ad4-4db4-b377-05dfe57424e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37305},{"type":"v1","addr":"172.21.15.107:6824","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37305},{"type":"v1","addr":"172.21.15.107:6827","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37305},{"type":"v1","addr":"172.21.15.107:6831","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37305},{"type":"v1","addr":"172.21.15.107:6829","nonce":37305}]},"public_addr":"172.21.15.107:6824/37305","cluster_addr":"172.21.15.107:6827/37305","heartbeat_back_addr":"172.21.15.107:6831/37305","heartbeat_front_addr":"172.21.15.107:6829/37305","state":["exists","up"]},{"osd":2,"uuid":"25229542-29b5-4281-bcb0-798ae0930aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37307},{"type":"v1","addr":"172.21.15.107:6817","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37307},{"type":"v1","addr":"172.21.15.107:6819","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6823","nonce":37307},{"type":"v1","addr":"172.21.15.107:6825","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37307},{"type":"v1","addr":"172.21.15.107:6821","nonce":37307}]},"public_addr":"172.21.15.107:6817/37307","cluster_addr":"172.21.15.107:6819/37307","heartbeat_back_addr":"172.21.15.107:6825/37307","heartbeat_front_addr":"172.21.15.107:6821/37307","state":["exists","up"]},{"osd":3,"uuid":"5f16aee8-8950-4268-a61a-5cf6ebd670e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37306},{"type":"v1","addr":"172.21.15.107:6809","nonce":37306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37306},{"type":"v1","addr":"172.21.15.107:6811","nonce":37306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37306},{"type":"v1","addr":"172.21.15.107:6815","nonce":37306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37306},{"type":"v1","addr":"172.21.15.107:6813","nonce":37306}]},"public_addr":"172.21.15.107:6809/37306","cluster_addr":"172.21.15.107:6811/37306","heartbeat_back_addr":"172.21.15.107:6815/37306","heartbeat_front_addr":"172.21.15.107:6813/37306","state":["exists","up"]},{"osd":4,"uuid":"23232e28-e23b-4b4e-a531-4939246dbbde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":37329},{"type":"v1","addr":"172.21.15.157:6817","nonce":37329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":37329},{"type":"v1","addr":"172.21.15.157:6819","nonce":37329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":37329},{"type":"v1","addr":"172.21.15.157:6823","nonce":37329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":37329},{"type":"v1","addr":"172.21.15.157:6821","nonce":37329}]},"public_addr":"172.21.15.157:6817/37329","cluster_addr":"172.21.15.157:6819/37329","heartbeat_back_addr":"172.21.15.157:6823/37329","heartbeat_front_addr":"172.21.15.157:6821/37329","state":["exists","up"]},{"osd":5,"uuid":"f87ec331-3e59-4886-a317-6f7e26ec8e21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":37328},{"type":"v1","addr":"172.21.15.157:6804","nonce":37328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":37328},{"type":"v1","addr":"172.21.15.157:6808","nonce":37328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":37328},{"type":"v1","addr":"172.21.15.157:6815","nonce":37328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":37328},{"type":"v1","addr":"172.21.15.157:6812","nonce":37328}]},"public_addr":"172.21.15.157:6804/37328","cluster_addr":"172.21.15.157:6808/37328","heartbeat_back_addr":"172.21.15.157:6815/37328","heartbeat_front_addr":"172.21.15.157:6812/37328","state":["exists","up"]},{"osd":6,"uuid":"92852235-ce49-4d96-a940-6f18d97b13ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":37330},{"type":"v1","addr":"172.21.15.157:6801","nonce":37330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6803","nonce":37330},{"type":"v1","addr":"172.21.15.157:6805","nonce":37330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":37330},{"type":"v1","addr":"172.21.15.157:6813","nonce":37330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":37330},{"type":"v1","addr":"172.21.15.157:6809","nonce":37330}]},"public_addr":"172.21.15.157:6801/37330","cluster_addr":"172.21.15.157:6805/37330","heartbeat_back_addr":"172.21.15.157:6813/37330","heartbeat_front_addr":"172.21.15.157:6809/37330","state":["exists","up"]},{"osd":7,"uuid":"7484a061-723d-4663-b28f-b01766d62f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":37373},{"type":"v1","addr":"172.21.15.157:6825","nonce":37373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":37373},{"type":"v1","addr":"172.21.15.157:6827","nonce":37373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":37373},{"type":"v1","addr":"172.21.15.157:6831","nonce":37373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":37373},{"type":"v1","addr":"172.21.15.157:6829","nonce":37373}]},"public_addr":"172.21.15.157:6825/37373","cluster_addr":"172.21.15.157:6827/37373","heartbeat_back_addr":"172.21.15.157:6831/37373","heartbeat_front_addr":"172.21.15.157:6829/37373","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.110188+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.280265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.252119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.267996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.284582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.144420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.174764+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.308002+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:6837/809431952":"2024-08-18T02:27:49.868281+0000","172.21.15.107:6835/809431952":"2024-08-18T02:27:49.868281+0000","172.21.15.157:6835/1725535660":"2024-08-18T02:27:43.163351+0000","172.21.15.157:6833/1725535660":"2024-08-18T02:27:43.163351+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:56.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.504+0000 7fe84bc00640 1 -- 172.21.15.107:0/2635302823 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe824065150 msgr2=0x7fe824067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.504+0000 7fe84bc00640 1 --2- 172.21.15.107:0/2635302823 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe824065150 0x7fe824067600 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe844167e20 tx=0x7fe830009040 comp rx=0 tx=0).stop 2024-08-17T02:27:56.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.504+0000 7fe84bc00640 1 -- 172.21.15.107:0/2635302823 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe84406df00 msgr2=0x7fe84406c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.504+0000 7fe84bc00640 1 --2- 172.21.15.107:0/2635302823 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe84406df00 0x7fe84406c910 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe83800ec80 tx=0x7fe8380090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.504+0000 7fe84bc00640 1 -- 172.21.15.107:0/2635302823 shutdown_connections 2024-08-17T02:27:56.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.504+0000 7fe84bc00640 1 --2- 172.21.15.107:0/2635302823 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fe824065150 0x7fe824067600 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.504+0000 7fe84bc00640 1 --2- 172.21.15.107:0/2635302823 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe844155df0 0x7fe84414f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.504+0000 7fe84bc00640 1 --2- 172.21.15.107:0/2635302823 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe844155a20 0x7fe844167ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.504+0000 7fe84bc00640 1 --2- 172.21.15.107:0/2635302823 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe84406df00 0x7fe84406c910 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.504+0000 7fe84bc00640 1 -- 172.21.15.107:0/2635302823 >> 172.21.15.107:0/2635302823 conn(0x7fe8440cb9b0 msgr2=0x7fe844158580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:56.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.504+0000 7fe84bc00640 1 -- 172.21.15.107:0/2635302823 shutdown_connections 2024-08-17T02:27:56.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.504+0000 7fe84bc00640 1 -- 172.21.15.107:0/2635302823 wait complete. 2024-08-17T02:27:56.520 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-17T02:27:56.520 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:27:56.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.665+0000 7fa99e000640 1 Processor -- start 2024-08-17T02:27:56.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.665+0000 7fa99e000640 1 -- start start 2024-08-17T02:27:56.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.666+0000 7fa99e000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa998159350 0x7fa9980ad550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.666+0000 7fa99e000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9980cb560 con 0x7fa998158f80 2024-08-17T02:27:56.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.666+0000 7fa99e000640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9980cf7e0 con 0x7fa9980caa40 2024-08-17T02:27:56.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.666+0000 7fa99e000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9980cfac0 con 0x7fa998159350 2024-08-17T02:27:56.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.666+0000 7fa997400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fa998158f80 0x7fa9980ca330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:40948/0 (socket says 172.21.15.107:40948) 2024-08-17T02:27:56.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.666+0000 7fa997400640 1 -- 172.21.15.107:0/3546146772 learned_addr learned my addr 172.21.15.107:0/3546146772 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:27:56.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.667+0000 7fa997e00640 1 --2- 172.21.15.107:0/3546146772 >> v2:172.21.15.107:3300/0 conn(0x7fa998159350 0x7fa9980ad550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.667+0000 7fa996a00640 1 -- 172.21.15.107:0/3546146772 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 283546759 0 0) 0x7fa9980cb560 con 0x7fa998158f80 2024-08-17T02:27:56.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.667+0000 7fa996a00640 1 -- 172.21.15.107:0/3546146772 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa97c0034e0 con 0x7fa998158f80 2024-08-17T02:27:56.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.667+0000 7fa997e00640 1 -- 172.21.15.107:0/3546146772 >> v1:172.21.15.157:6789/0 conn(0x7fa9980caa40 legacy=0x7fa9980ace40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.667+0000 7fa997e00640 1 -- 172.21.15.107:0/3546146772 >> v1:172.21.15.107:6789/0 conn(0x7fa998158f80 legacy=0x7fa9980ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.667+0000 7fa997e00640 1 -- 172.21.15.107:0/3546146772 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9980caf10 con 0x7fa998159350 2024-08-17T02:27:56.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.668+0000 7fa997e00640 1 --2- 172.21.15.107:0/3546146772 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa998159350 0x7fa9980ad550 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa990009850 tx=0x7fa9900090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=333fa9696418acdd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:56.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.668+0000 7fa996a00640 1 -- 172.21.15.107:0/3546146772 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99002ae20 con 0x7fa998159350 2024-08-17T02:27:56.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.668+0000 7fa996a00640 1 -- 172.21.15.107:0/3546146772 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa990032440 con 0x7fa998159350 2024-08-17T02:27:56.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.668+0000 7fa996a00640 1 -- 172.21.15.107:0/3546146772 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9900327e0 con 0x7fa998159350 2024-08-17T02:27:56.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.669+0000 7fa99e000640 1 -- 172.21.15.107:0/3546146772 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa998159350 msgr2=0x7fa9980ad550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.669+0000 7fa99e000640 1 --2- 172.21.15.107:0/3546146772 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa998159350 0x7fa9980ad550 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa990009850 tx=0x7fa9900090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.669+0000 7fa99e000640 1 -- 172.21.15.107:0/3546146772 shutdown_connections 2024-08-17T02:27:56.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.669+0000 7fa99e000640 1 --2- 172.21.15.107:0/3546146772 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa998159350 0x7fa9980ad550 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.669+0000 7fa99e000640 1 -- 172.21.15.107:0/3546146772 >> 172.21.15.107:0/3546146772 conn(0x7fa9980cfd90 msgr2=0x7fa9980d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:56.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.669+0000 7fa99e000640 1 -- 172.21.15.107:0/3546146772 shutdown_connections 2024-08-17T02:27:56.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.669+0000 7fa99e000640 1 -- 172.21.15.107:0/3546146772 wait complete. 2024-08-17T02:27:56.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.670+0000 7fa99e000640 1 Processor -- start 2024-08-17T02:27:56.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.670+0000 7fa99e000640 1 -- start start 2024-08-17T02:27:56.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.671+0000 7fa99e000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9980caa40 0x7fa998154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.671+0000 7fa99e000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa998158f80 0x7fa99815f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.671+0000 7fa99e000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa998159350 0x7fa998156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.671+0000 7fa99e000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9980b4a10 con 0x7fa998159350 2024-08-17T02:27:56.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.671+0000 7fa99e000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9980b4cf0 con 0x7fa998158f80 2024-08-17T02:27:56.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.671+0000 7fa99e000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9980b4fd0 con 0x7fa9980caa40 2024-08-17T02:27:56.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.672+0000 7fa997e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa998159350 0x7fa998156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.672+0000 7fa997400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9980caa40 0x7fa998154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.672+0000 7fa997400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9980caa40 0x7fa998154fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:51822/0 (socket says 172.21.15.107:51822) 2024-08-17T02:27:56.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.672+0000 7fa98ea00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa998158f80 0x7fa99815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.672+0000 7fa997400640 1 -- 172.21.15.107:0/1972892760 learned_addr learned my addr 172.21.15.107:0/1972892760 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:56.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.672+0000 7fa997e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa998159350 0x7fa998156960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36592/0 (socket says 172.21.15.107:36592) 2024-08-17T02:27:56.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.672+0000 7fa997e00640 1 -- 172.21.15.107:0/1972892760 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9980caa40 msgr2=0x7fa998154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.672+0000 7fa997e00640 1 --2- 172.21.15.107:0/1972892760 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9980caa40 0x7fa998154fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.672+0000 7fa997e00640 1 -- 172.21.15.107:0/1972892760 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa998158f80 msgr2=0x7fa99815f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.672+0000 7fa997e00640 1 --2- 172.21.15.107:0/1972892760 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa998158f80 0x7fa99815f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.672+0000 7fa997e00640 1 -- 172.21.15.107:0/1972892760 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa990009390 con 0x7fa998159350 2024-08-17T02:27:56.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.672+0000 7fa997e00640 1 --2- 172.21.15.107:0/1972892760 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa998159350 0x7fa998156960 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa990031000 tx=0x7fa990032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:56.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.673+0000 7fa98f400640 1 -- 172.21.15.107:0/1972892760 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99003d420 con 0x7fa998159350 2024-08-17T02:27:56.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.673+0000 7fa98f400640 1 -- 172.21.15.107:0/1972892760 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa99003d5c0 con 0x7fa998159350 2024-08-17T02:27:56.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.673+0000 7fa99e000640 1 -- 172.21.15.107:0/1972892760 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9980b52b0 con 0x7fa998159350 2024-08-17T02:27:56.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.673+0000 7fa98f400640 1 -- 172.21.15.107:0/1972892760 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99003d980 con 0x7fa998159350 2024-08-17T02:27:56.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.673+0000 7fa99e000640 1 -- 172.21.15.107:0/1972892760 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9980b46c0 con 0x7fa998159350 2024-08-17T02:27:56.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.674+0000 7fa99e000640 1 -- 172.21.15.107:0/1972892760 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa998064db0 con 0x7fa998159350 2024-08-17T02:27:56.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.675+0000 7fa98f400640 1 -- 172.21.15.107:0/1972892760 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa990039040 con 0x7fa998159350 2024-08-17T02:27:56.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.675+0000 7fa98f400640 1 --2- 172.21.15.107:0/1972892760 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fa974065150 0x7fa974067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.675+0000 7fa98f400640 1 -- 172.21.15.107:0/1972892760 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fa9900a26d0 con 0x7fa998159350 2024-08-17T02:27:56.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.676+0000 7fa997400640 1 --2- 172.21.15.107:0/1972892760 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fa974065150 0x7fa974067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.676+0000 7fa997400640 1 --2- 172.21.15.107:0/1972892760 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fa974065150 0x7fa974067600 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa988007fd0 tx=0x7fa988009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:56.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.680+0000 7fa98f400640 1 -- 172.21.15.107:0/1972892760 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa990070a40 con 0x7fa998159350 2024-08-17T02:27:56.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.850+0000 7fa99e000640 1 -- 172.21.15.107:0/1972892760 --> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa9980b5730 con 0x7fa974065150 2024-08-17T02:27:56.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.852+0000 7fa98f400640 1 -- 172.21.15.107:0/1972892760 <== mgr.4110 v2:172.21.15.107:6832/37039 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50810 (secure 0 0 0) 0x7fa9980b5730 con 0x7fa974065150 2024-08-17T02:27:56.854 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:27:56.854 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-08-17T02:27:56.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.854+0000 7fa99e000640 1 -- 172.21.15.107:0/1972892760 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fa974065150 msgr2=0x7fa974067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.854+0000 7fa99e000640 1 --2- 172.21.15.107:0/1972892760 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fa974065150 0x7fa974067600 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa988007fd0 tx=0x7fa988009040 comp rx=0 tx=0).stop 2024-08-17T02:27:56.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.854+0000 7fa99e000640 1 -- 172.21.15.107:0/1972892760 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa998159350 msgr2=0x7fa998156960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.854+0000 7fa99e000640 1 --2- 172.21.15.107:0/1972892760 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa998159350 0x7fa998156960 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa990031000 tx=0x7fa990032000 comp rx=0 tx=0).stop 2024-08-17T02:27:56.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.854+0000 7fa99e000640 1 -- 172.21.15.107:0/1972892760 shutdown_connections 2024-08-17T02:27:56.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.854+0000 7fa99e000640 1 --2- 172.21.15.107:0/1972892760 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fa974065150 0x7fa974067600 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.854+0000 7fa99e000640 1 --2- 172.21.15.107:0/1972892760 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa998159350 0x7fa998156960 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.854+0000 7fa99e000640 1 --2- 172.21.15.107:0/1972892760 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa998158f80 0x7fa99815f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.854+0000 7fa99e000640 1 --2- 172.21.15.107:0/1972892760 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9980caa40 0x7fa998154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.854+0000 7fa99e000640 1 -- 172.21.15.107:0/1972892760 >> 172.21.15.107:0/1972892760 conn(0x7fa9980cfd90 msgr2=0x7fa998068e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:56.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.854+0000 7fa99e000640 1 -- 172.21.15.107:0/1972892760 shutdown_connections 2024-08-17T02:27:56.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:56.854+0000 7fa99e000640 1 -- 172.21.15.107:0/1972892760 wait complete. 2024-08-17T02:27:56.871 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":143,"stamp":"2024-08-17T02:27:55.457129+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2400476,"kb_used_data":4988,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752574244,"statfs":{"total":773094113280,"available":770636025856,"internally_reserved":0,"allocated":5107712,"data_stored":2807061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000902"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":180,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-08-17T02:27:46.588092+0000","last_change":"2024-08-17T02:24:25.092772+0000","last_active":"2024-08-17T02:27:46.588092+0000","last_peered":"2024-08-17T02:27:46.588092+0000","last_clean":"2024-08-17T02:27:46.588092+0000","last_became_active":"2024-08-17T02:24:25.091788+0000","last_became_peered":"2024-08-17T02:24:25.091788+0000","last_unstale":"2024-08-17T02:27:46.588092+0000","last_undegraded":"2024-08-17T02:27:46.588092+0000","last_fullsized":"2024-08-17T02:27:46.588092+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:24.051996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:24.051996+0000","last_clean_scrub_stamp":"2024-08-17T02:24:24.051996+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:31:45.454480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302568,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069272,"statfs":{"total":96636764160,"available":96326934528,"internally_reserved":0,"allocated":1077248,"data_stored":791156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.60999999999999999,"15min":0.59399999999999997},"min":{"1min":0.50900000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.82499999999999996,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.63800000000000001,"15min":0.625},"min":{"1min":0.51500000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.93000000000000005,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.54300000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.66400000000000003,"15min":0.64200000000000002},"min":{"1min":0.51200000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.67900000000000005,"15min":0.66100000000000003},"min":{"1min":0.61099999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.90200000000000002,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.72399999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.66300000000000003,"15min":0.64200000000000002},"min":{"1min":0.56000000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.85599999999999998,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.69099999999999995,"15min":0.66300000000000003},"min":{"1min":0.628,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85399999999999998,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.62}]},{"osd":3,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68999999999999995,"15min":0.67600000000000005},"min":{"1min":0.53300000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.85699999999999998,"5min":1.105,"15min":1.105},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.72699999999999998,"15min":0.71899999999999997},"min":{"1min":0.625,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.88900000000000001,"5min":0.995,"15min":0.995},"last":0.66100000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.56299999999999994,"15min":0.57799999999999996},"min":{"1min":0.377,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.70199999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.59199999999999997,"15min":0.60299999999999998},"min":{"1min":0.43099999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.72799999999999998,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.68999999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.66400000000000003,"15min":0.68999999999999995},"min":{"1min":0.45200000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.751},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.72999999999999998,"15min":0.748},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.86599999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.77100000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.67800000000000005,"15min":0.69199999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.80500000000000005,"5min":0.88,"15min":0.88},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.67100000000000004,"15min":0.68899999999999995},"min":{"1min":0.42699999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82499999999999996,"5min":1.149,"15min":1.149},"last":0.73499999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302000,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069840,"statfs":{"total":96636764160,"available":96327516160,"internally_reserved":0,"allocated":495616,"data_stored":206821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:28 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.84199999999999997,"15min":0.90000000000000002},"min":{"1min":0.58799999999999997,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.85099999999999998,"5min":4.7380000000000004,"15min":4.7380000000000004},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.83999999999999997,"15min":0.89000000000000001},"min":{"1min":0.64000000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.85199999999999998,"5min":3.2839999999999998,"15min":3.2839999999999998},"last":0.71999999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:27:28 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.67800000000000005,"15min":0.64900000000000002},"min":{"1min":0.59999999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.90200000000000002,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.82699999999999996,"15min":0.86899999999999999},"min":{"1min":0.65700000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.91800000000000004,"5min":2.524,"15min":2.524},"last":0.65300000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:27:28 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.79300000000000004,"15min":0.82299999999999995},"min":{"1min":0.63300000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.82999999999999996,"5min":3.3199999999999998,"15min":3.3199999999999998},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.753,"15min":0.749},"min":{"1min":0.60699999999999998,"5min":0.502,"15min":0.502},"max":{"1min":0.93899999999999995,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.77400000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:27:28 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77800000000000002,"15min":0.78700000000000003},"min":{"1min":0.623,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.91700000000000004,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.81799999999999995,"15min":0.83599999999999997},"min":{"1min":0.627,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.88300000000000001,"5min":3.3610000000000002,"15min":3.3610000000000002},"last":0.75900000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:27:28 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.72199999999999998,"15min":0.77800000000000002},"min":{"1min":0.45100000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.83399999999999996,"5min":3.3999999999999999,"15min":3.3999999999999999},"last":0.75},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.752,"15min":0.82099999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.72399999999999998,"5min":3.4670000000000001,"15min":3.4670000000000001},"last":0.79500000000000004}]},{"osd":5,"last update":"Sat Aug 17 02:27:28 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.67800000000000005,"15min":0.70999999999999996},"min":{"1min":0.46100000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.82199999999999995,"5min":1.73,"15min":1.73},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.78700000000000003,"15min":0.84099999999999997},"min":{"1min":0.47399999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.90500000000000003,"5min":3.3410000000000002,"15min":3.3410000000000002},"last":0.82099999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:27:28 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.81499999999999995,"15min":0.86899999999999999},"min":{"1min":0.52500000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.90000000000000002,"5min":3.23,"15min":3.23},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.75700000000000001,"15min":0.79100000000000004},"min":{"1min":0.51300000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.86699999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.85699999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301988,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069852,"statfs":{"total":96636764160,"available":96327528448,"internally_reserved":0,"allocated":483328,"data_stored":200768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.65100000000000002,"15min":0.629},"min":{"1min":0.48599999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.72799999999999998,"15min":0.73199999999999998},"min":{"1min":0.52300000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.046,"5min":3.1440000000000001,"15min":3.1440000000000001},"last":0.69999999999999996}]},{"osd":1,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.73099999999999998,"15min":0.71399999999999997},"min":{"1min":0.624,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0740000000000001,"5min":1.119,"15min":1.119},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.70399999999999996,"15min":0.68400000000000005},"min":{"1min":0.56799999999999995,"5min":0.443,"15min":0.443},"max":{"1min":1.0229999999999999,"5min":1.153,"15min":1.153},"last":0.72599999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75,"15min":0.75600000000000001},"min":{"1min":0.55100000000000005,"5min":0.433,"15min":0.433},"max":{"1min":0.90500000000000003,"5min":3.2559999999999998,"15min":3.2559999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.68200000000000005,"15min":0.66400000000000003},"min":{"1min":0.58899999999999997,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.749}]},{"osd":3,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.80300000000000005,"15min":0.81200000000000006},"min":{"1min":0.67500000000000004,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.042,"5min":3.2229999999999999,"15min":3.2229999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.82999999999999996,"15min":0.84399999999999997},"min":{"1min":0.62,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0629999999999999,"5min":3.1859999999999999,"15min":3.1859999999999999},"last":0.76500000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.432,"5min":0.317,"15min":0.317},"max":{"1min":0.80500000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64600000000000002,"15min":0.65400000000000003},"min":{"1min":0.47499999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.93000000000000005,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.86699999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.505,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.95599999999999996,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.67300000000000004,"15min":0.67000000000000004},"min":{"1min":0.51700000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.91200000000000003,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.71799999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.72099999999999997,"15min":0.72799999999999998},"min":{"1min":0.48199999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.97299999999999998,"5min":1.02,"15min":1.02},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.73699999999999999,"15min":0.73599999999999999},"min":{"1min":0.55100000000000005,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.018,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.78800000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574892,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301996,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069844,"statfs":{"total":96636764160,"available":96327520256,"internally_reserved":0,"allocated":491520,"data_stored":202250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.62,"15min":0.58599999999999997},"min":{"1min":0.53000000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.86299999999999999,"5min":0.999,"15min":0.999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.65400000000000003,"15min":0.63400000000000001},"min":{"1min":0.56299999999999994,"5min":0.437,"15min":0.437},"max":{"1min":0.83299999999999996,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.749}]},{"osd":1,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.70099999999999996,"15min":0.68100000000000005},"min":{"1min":0.50600000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.89800000000000002,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.68899999999999995,"15min":0.66700000000000004},"min":{"1min":0.53400000000000003,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.88400000000000001,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.52900000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.70799999999999996,"15min":0.69399999999999995},"min":{"1min":0.56899999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.92500000000000004,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69699999999999995,"15min":0.68200000000000005},"min":{"1min":0.52800000000000002,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.91100000000000003,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.66200000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.68400000000000005,"15min":0.65800000000000003},"min":{"1min":0.58099999999999996,"5min":0.432,"15min":0.432},"max":{"1min":0.86499999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73999999999999999,"15min":0.73499999999999999},"min":{"1min":0.59399999999999997,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.875,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.68899999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.56899999999999995,"15min":0.58799999999999997},"min":{"1min":0.39400000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.749,"5min":0.752,"15min":0.752},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.63300000000000001,"15min":0.66900000000000004},"min":{"1min":0.434,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.68700000000000006,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.83199999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.64500000000000002,"15min":0.68400000000000005},"min":{"1min":0.44,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77500000000000002,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.628},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.65300000000000002,"15min":0.68100000000000005},"min":{"1min":0.47999999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.748,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.72199999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69599999999999995,"15min":0.71199999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.88500000000000001,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.875},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.75800000000000001,"15min":0.78500000000000003},"min":{"1min":0.51700000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.86499999999999999,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.77600000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297836,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074004,"statfs":{"total":96636764160,"available":96331780096,"internally_reserved":0,"allocated":491520,"data_stored":201324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.438,"15min":0.44},"min":{"1min":0.308,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.45500000000000002,"15min":0.439},"min":{"1min":0.36399999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.65400000000000003,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.36799999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47499999999999998,"15min":0.47699999999999998},"min":{"1min":0.35599999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68300000000000005,"5min":1.458,"15min":1.458},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.501,"15min":0.497},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.57599999999999996,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.40100000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.44800000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.72599999999999998,"5min":1.492,"15min":1.492},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.55100000000000005,"15min":0.53900000000000003},"min":{"1min":0.44500000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.74099999999999999,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.46300000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72699999999999998,"15min":0.72499999999999998},"min":{"1min":0.48899999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0069999999999999,"5min":1.01,"15min":1.01},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.75800000000000001,"15min":0.755},"min":{"1min":0.55500000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.97299999999999998,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.56299999999999994}]},{"osd":5,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.746,"15min":0.74299999999999999},"min":{"1min":0.58799999999999997,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.01,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.77000000000000002,"15min":0.77400000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.96099999999999997,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.60699999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.77100000000000002,"15min":0.77200000000000002},"min":{"1min":0.59499999999999997,"5min":0.504,"15min":0.504},"max":{"1min":0.98099999999999998,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79100000000000004,"15min":0.79300000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.91100000000000003,"5min":1.077,"15min":1.077},"last":0.63900000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.78000000000000003,"15min":0.79000000000000004},"min":{"1min":0.55400000000000005,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.90000000000000002,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.79400000000000004,"15min":0.79200000000000004},"min":{"1min":0.59799999999999998,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0309999999999999,"5min":1.421,"15min":1.421},"last":0.67900000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297840,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074000,"statfs":{"total":96636764160,"available":96331776000,"internally_reserved":0,"allocated":495616,"data_stored":206821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.40200000000000002,"15min":0.39200000000000002},"min":{"1min":0.315,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.443,"5min":0.53700000000000003,"15min":0.57899999999999996},"min":{"1min":0.34300000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.55200000000000005,"5min":3.9060000000000001,"15min":3.9060000000000001},"last":0.39900000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.34699999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.58699999999999997,"5min":0.746,"15min":0.746},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.505,"15min":0.48899999999999999},"min":{"1min":0.436,"5min":0.372,"15min":0.372},"max":{"1min":0.64600000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.56499999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.53200000000000003,"15min":0.52300000000000002},"min":{"1min":0.42399999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.65800000000000003,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.56200000000000006,"15min":0.54900000000000004},"min":{"1min":0.496,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.745,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.49099999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.81799999999999995,"15min":0.84199999999999997},"min":{"1min":0.56599999999999995,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.997,"5min":4.1509999999999998,"15min":4.1509999999999998},"last":0.621},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.73899999999999999,"15min":0.73499999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0880000000000001,"5min":1.381,"15min":1.381},"last":0.71999999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.72999999999999998,"15min":0.70599999999999996},"min":{"1min":0.60299999999999998,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.82799999999999996,"15min":0.85199999999999998},"min":{"1min":0.60399999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.125,"5min":4.1079999999999997,"15min":4.1079999999999997},"last":0.69299999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.75,"15min":0.73399999999999999},"min":{"1min":0.629,"5min":0.505,"15min":0.505},"max":{"1min":1.0469999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.74299999999999999,"15min":0.72899999999999998},"min":{"1min":0.64600000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.63300000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.84699999999999998,"15min":0.874},"min":{"1min":0.64600000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.97199999999999998,"5min":4.1879999999999997,"15min":4.1879999999999997},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.76800000000000002,"15min":0.752},"min":{"1min":0.58599999999999997,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.157,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.67100000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297840,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074000,"statfs":{"total":96636764160,"available":96331776000,"internally_reserved":0,"allocated":495616,"data_stored":206821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:25 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.33000000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.432,"15min":0.41999999999999998},"min":{"1min":0.379,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.39300000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:27:25 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.44400000000000001,"15min":0.439},"min":{"1min":0.38,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.41399999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.65000000000000002,"5min":0.746,"15min":0.746},"last":0.65000000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:27:25 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.55700000000000005,"15min":0.54400000000000004},"min":{"1min":0.51700000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.68200000000000005,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.502,"15min":0.48999999999999999},"min":{"1min":0.38800000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.79000000000000004,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.54700000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:27:25 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.71099999999999997,"15min":0.69899999999999995},"min":{"1min":0.55100000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.022,"5min":1.115,"15min":1.115},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.69899999999999995,"15min":0.68899999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.90900000000000003,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.91800000000000004}]},{"osd":5,"last update":"Sat Aug 17 02:27:25 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.72599999999999998,"15min":0.72199999999999998},"min":{"1min":0.59799999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.99199999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.68500000000000005,"15min":0.66500000000000004},"min":{"1min":0.57299999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.94999999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.89400000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:27:25 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.73699999999999999,"15min":0.73099999999999998},"min":{"1min":0.60499999999999998,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.94399999999999995,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.71699999999999997,"15min":0.70799999999999996},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.93300000000000005,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.93000000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:27:25 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.746,"15min":0.74199999999999999},"min":{"1min":0.64300000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.002,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.64000000000000001,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.93100000000000005,"5min":1.143,"15min":1.143},"last":1.032}]}]},{"osd":0,"up_from":13,"seq":55834574892,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298408,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073432,"statfs":{"total":96636764160,"available":96331194368,"internally_reserved":0,"allocated":1077248,"data_stored":791100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.41299999999999998,"15min":0.40899999999999997},"min":{"1min":0.34999999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.53600000000000003,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.46600000000000003,"15min":0.45700000000000002},"min":{"1min":0.34999999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.67500000000000004,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.72199999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.48499999999999999,"15min":0.48999999999999999},"min":{"1min":0.35699999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.59399999999999997,"5min":1.169,"15min":1.169},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.52100000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.81100000000000005,"5min":1.262,"15min":1.262},"last":0.68100000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.48699999999999999,"15min":0.47499999999999998},"min":{"1min":0.42999999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67900000000000005,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57599999999999996,"15min":0.59399999999999997},"min":{"1min":0.41999999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.67100000000000004,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":0.40899999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.76800000000000002,"15min":0.76100000000000001},"min":{"1min":0.65600000000000003,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.0449999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.82999999999999996,"15min":0.86299999999999999},"min":{"1min":0.57799999999999996,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.03,"5min":3.2160000000000002,"15min":3.2160000000000002},"last":0.78900000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.80700000000000005,"15min":0.82699999999999996},"min":{"1min":0.53500000000000003,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.96999999999999997,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.755,"15min":0.751},"min":{"1min":0.65800000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0109999999999999,"5min":1.383,"15min":1.383},"last":0.70099999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.749,"15min":0.74099999999999999},"min":{"1min":0.59799999999999998,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.119,"5min":1.411,"15min":1.411},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.78200000000000003,"15min":0.77300000000000002},"min":{"1min":0.70999999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.101,"5min":1.343,"15min":1.343},"last":0.97599999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.80700000000000005,"15min":0.79700000000000004},"min":{"1min":0.69299999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1459999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.88400000000000001,"15min":0.91000000000000003},"min":{"1min":0.65500000000000003,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.081,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":0.66700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:27:56.872 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:27:57.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.018+0000 7f95e7c00640 1 Processor -- start 2024-08-17T02:27:57.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.018+0000 7f95e7c00640 1 -- start start 2024-08-17T02:27:57.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.019+0000 7f95e7c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f95e0155a20 0x7f95e00adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.019+0000 7f95e7c00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f95e0155df0 0x7f95e00ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.019+0000 7f95e7c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95e0156670 con 0x7f95e006d7f0 2024-08-17T02:27:57.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.019+0000 7f95e7c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95e00b0350 con 0x7f95e0155a20 2024-08-17T02:27:57.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.019+0000 7f95e7c00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95e006e5e0 con 0x7f95e0155df0 2024-08-17T02:27:57.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.020+0000 7f95e5200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f95e0155a20 0x7f95e00adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.020+0000 7f95e5c00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f95e006d7f0 0x7f95e00ac790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:46934/0 (socket says 172.21.15.107:46934) 2024-08-17T02:27:57.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.020+0000 7f95e5c00640 1 -- 172.21.15.107:0/2258990877 learned_addr learned my addr 172.21.15.107:0/2258990877 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:27:57.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.020+0000 7f95d7e00640 1 --2- 172.21.15.107:0/2258990877 >> v2:172.21.15.157:3300/0 conn(0x7f95e0155df0 0x7f95e00ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.020+0000 7f95dfe00640 1 -- 172.21.15.107:0/2258990877 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1839697097 0 0) 0x7f95e0156670 con 0x7f95e006d7f0 2024-08-17T02:27:57.023 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.020+0000 7f95dfe00640 1 -- 172.21.15.107:0/2258990877 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95c40034e0 con 0x7f95e006d7f0 2024-08-17T02:27:57.023 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.020+0000 7f95d7e00640 1 -- 172.21.15.107:0/2258990877 >> v2:172.21.15.107:3300/0 conn(0x7f95e0155a20 msgr2=0x7f95e00adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:57.023 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.020+0000 7f95d7e00640 1 --2- 172.21.15.107:0/2258990877 >> v2:172.21.15.107:3300/0 conn(0x7f95e0155a20 0x7f95e00adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.023 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.020+0000 7f95d7e00640 1 -- 172.21.15.107:0/2258990877 >> v1:172.21.15.107:6789/0 conn(0x7f95e006d7f0 legacy=0x7f95e00ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.023 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.020+0000 7f95d7e00640 1 -- 172.21.15.107:0/2258990877 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e006e8c0 con 0x7f95e0155df0 2024-08-17T02:27:57.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.022+0000 7f95d7e00640 1 --2- 172.21.15.107:0/2258990877 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95e0155df0 0x7f95e00ad9b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f95e006aa10 tx=0x7f95c80090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8ff59f4a4db2ac6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.022+0000 7f95dfe00640 1 -- 172.21.15.107:0/2258990877 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c802adb0 con 0x7f95e0155df0 2024-08-17T02:27:57.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.022+0000 7f95dfe00640 1 -- 172.21.15.107:0/2258990877 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c8032440 con 0x7f95e0155df0 2024-08-17T02:27:57.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.022+0000 7f95dfe00640 1 -- 172.21.15.107:0/2258990877 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c8032820 con 0x7f95e0155df0 2024-08-17T02:27:57.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.022+0000 7f95e7c00640 1 -- 172.21.15.107:0/2258990877 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95e0155df0 msgr2=0x7f95e00ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.022+0000 7f95e7c00640 1 --2- 172.21.15.107:0/2258990877 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95e0155df0 0x7f95e00ad9b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f95e006aa10 tx=0x7f95c80090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.022+0000 7f95e7c00640 1 -- 172.21.15.107:0/2258990877 shutdown_connections 2024-08-17T02:27:57.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.022+0000 7f95e7c00640 1 --2- 172.21.15.107:0/2258990877 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95e0155df0 0x7f95e00ad9b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.022+0000 7f95e7c00640 1 --2- 172.21.15.107:0/2258990877 >> v2:172.21.15.107:3300/0 conn(0x7f95e0155a20 0x7f95e00adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.022+0000 7f95e7c00640 1 -- 172.21.15.107:0/2258990877 >> 172.21.15.107:0/2258990877 conn(0x7f95e00cb9b0 msgr2=0x7f95e00cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:57.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.022+0000 7f95e7c00640 1 -- 172.21.15.107:0/2258990877 shutdown_connections 2024-08-17T02:27:57.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.023+0000 7f95e7c00640 1 -- 172.21.15.107:0/2258990877 wait complete. 2024-08-17T02:27:57.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.024+0000 7f95e7c00640 1 Processor -- start 2024-08-17T02:27:57.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.024+0000 7f95e7c00640 1 -- start start 2024-08-17T02:27:57.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.025+0000 7f95e7c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95e006d7f0 0x7f95e00ac850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.025+0000 7f95e7c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f95e0155a20 0x7f95e00acd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.025+0000 7f95e7c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95e0155df0 0x7f95e00a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.025+0000 7f95e7c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e00ae1d0 con 0x7f95e0155df0 2024-08-17T02:27:57.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.025+0000 7f95e7c00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e00ad5c0 con 0x7f95e006d7f0 2024-08-17T02:27:57.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.025+0000 7f95e7c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e00ad8a0 con 0x7f95e0155a20 2024-08-17T02:27:57.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.025+0000 7f95e5c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95e0155df0 0x7f95e00a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.025+0000 7f95e5c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95e0155df0 0x7f95e00a54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47000/0 (socket says 172.21.15.107:47000) 2024-08-17T02:27:57.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.025+0000 7f95e5c00640 1 -- 172.21.15.107:0/1183072343 learned_addr learned my addr 172.21.15.107:0/1183072343 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:57.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.025+0000 7f95d7e00640 1 --2- 172.21.15.107:0/1183072343 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f95e0155a20 0x7f95e00acd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.025+0000 7f95e5200640 1 --2- 172.21.15.107:0/1183072343 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95e006d7f0 0x7f95e00ac850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.026+0000 7f95e5c00640 1 -- 172.21.15.107:0/1183072343 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f95e0155a20 msgr2=0x7f95e00acd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.026+0000 7f95e5c00640 1 --2- 172.21.15.107:0/1183072343 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f95e0155a20 0x7f95e00acd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.026+0000 7f95e5c00640 1 -- 172.21.15.107:0/1183072343 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95e006d7f0 msgr2=0x7f95e00ac850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.026+0000 7f95e5c00640 1 --2- 172.21.15.107:0/1183072343 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95e006d7f0 0x7f95e00ac850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.026+0000 7f95e5c00640 1 -- 172.21.15.107:0/1183072343 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c8009390 con 0x7f95e0155df0 2024-08-17T02:27:57.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.026+0000 7f95d7e00640 1 --2- 172.21.15.107:0/1183072343 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f95e0155a20 0x7f95e00acd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:57.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.026+0000 7f95e5200640 1 --2- 172.21.15.107:0/1183072343 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95e006d7f0 0x7f95e00ac850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:57.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.026+0000 7f95e5c00640 1 --2- 172.21.15.107:0/1183072343 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95e0155df0 0x7f95e00a54d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f95d80010e0 tx=0x7f95d8007d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.031 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.026+0000 7f95dcc00640 1 -- 172.21.15.107:0/1183072343 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d8005aa0 con 0x7f95e0155df0 2024-08-17T02:27:57.031 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.026+0000 7f95dcc00640 1 -- 172.21.15.107:0/1183072343 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d8005c00 con 0x7f95e0155df0 2024-08-17T02:27:57.031 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.026+0000 7f95dcc00640 1 -- 172.21.15.107:0/1183072343 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d80070d0 con 0x7f95e0155df0 2024-08-17T02:27:57.031 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.026+0000 7f95e7c00640 1 -- 172.21.15.107:0/1183072343 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95e00adb80 con 0x7f95e0155df0 2024-08-17T02:27:57.031 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.026+0000 7f95e7c00640 1 -- 172.21.15.107:0/1183072343 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e00ad2d0 con 0x7f95e0155df0 2024-08-17T02:27:57.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.027+0000 7f95e7c00640 1 -- 172.21.15.107:0/1183072343 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95e00ae340 con 0x7f95e0155df0 2024-08-17T02:27:57.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.028+0000 7f95dcc00640 1 -- 172.21.15.107:0/1183072343 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f95d8007500 con 0x7f95e0155df0 2024-08-17T02:27:57.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.029+0000 7f95dcc00640 1 --2- 172.21.15.107:0/1183072343 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f95bc065150 0x7f95bc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.029+0000 7f95dcc00640 1 -- 172.21.15.107:0/1183072343 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f95d8081640 con 0x7f95e0155df0 2024-08-17T02:27:57.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.029+0000 7f95e5200640 1 --2- 172.21.15.107:0/1183072343 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f95bc065150 0x7f95bc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.030+0000 7f95e5200640 1 --2- 172.21.15.107:0/1183072343 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f95bc065150 0x7f95bc067600 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f95d00076c0 tx=0x7f95d000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.033+0000 7f95dcc00640 1 -- 172.21.15.107:0/1183072343 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f95d804be40 con 0x7f95e0155df0 2024-08-17T02:27:57.203 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.202+0000 7f95e7c00640 1 -- 172.21.15.107:0/1183072343 --> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f95e00a8550 con 0x7f95bc065150 2024-08-17T02:27:57.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.204+0000 7f95dcc00640 1 -- 172.21.15.107:0/1183072343 <== mgr.4110 v2:172.21.15.107:6832/37039 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50810 (secure 0 0 0) 0x7f95d000f050 con 0x7f95bc065150 2024-08-17T02:27:57.206 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:27:57.207 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-08-17T02:27:57.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.207+0000 7f95e7c00640 1 -- 172.21.15.107:0/1183072343 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f95bc065150 msgr2=0x7f95bc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.207+0000 7f95e7c00640 1 --2- 172.21.15.107:0/1183072343 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f95bc065150 0x7f95bc067600 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f95d00076c0 tx=0x7f95d000b040 comp rx=0 tx=0).stop 2024-08-17T02:27:57.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.207+0000 7f95e7c00640 1 -- 172.21.15.107:0/1183072343 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95e0155df0 msgr2=0x7f95e00a54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.207+0000 7f95e7c00640 1 --2- 172.21.15.107:0/1183072343 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95e0155df0 0x7f95e00a54d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f95d80010e0 tx=0x7f95d8007d40 comp rx=0 tx=0).stop 2024-08-17T02:27:57.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.207+0000 7f95e7c00640 1 -- 172.21.15.107:0/1183072343 shutdown_connections 2024-08-17T02:27:57.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.207+0000 7f95e7c00640 1 --2- 172.21.15.107:0/1183072343 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f95bc065150 0x7f95bc067600 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.207+0000 7f95e7c00640 1 --2- 172.21.15.107:0/1183072343 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95e0155df0 0x7f95e00a54d0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.207+0000 7f95e7c00640 1 --2- 172.21.15.107:0/1183072343 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f95e0155a20 0x7f95e00acd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.207+0000 7f95e7c00640 1 --2- 172.21.15.107:0/1183072343 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95e006d7f0 0x7f95e00ac850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.207+0000 7f95e7c00640 1 -- 172.21.15.107:0/1183072343 >> 172.21.15.107:0/1183072343 conn(0x7f95e00cb9b0 msgr2=0x7f95e0150d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:57.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.207+0000 7f95e7c00640 1 -- 172.21.15.107:0/1183072343 shutdown_connections 2024-08-17T02:27:57.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.207+0000 7f95e7c00640 1 -- 172.21.15.107:0/1183072343 wait complete. 2024-08-17T02:27:57.223 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":143,"stamp":"2024-08-17T02:27:55.457129+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2400476,"kb_used_data":4988,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752574244,"statfs":{"total":773094113280,"available":770636025856,"internally_reserved":0,"allocated":5107712,"data_stored":2807061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000902"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":180,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-08-17T02:27:46.588092+0000","last_change":"2024-08-17T02:24:25.092772+0000","last_active":"2024-08-17T02:27:46.588092+0000","last_peered":"2024-08-17T02:27:46.588092+0000","last_clean":"2024-08-17T02:27:46.588092+0000","last_became_active":"2024-08-17T02:24:25.091788+0000","last_became_peered":"2024-08-17T02:24:25.091788+0000","last_unstale":"2024-08-17T02:27:46.588092+0000","last_undegraded":"2024-08-17T02:27:46.588092+0000","last_fullsized":"2024-08-17T02:27:46.588092+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:24.051996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:24.051996+0000","last_clean_scrub_stamp":"2024-08-17T02:24:24.051996+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:31:45.454480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302568,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069272,"statfs":{"total":96636764160,"available":96326934528,"internally_reserved":0,"allocated":1077248,"data_stored":791156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.60999999999999999,"15min":0.59399999999999997},"min":{"1min":0.50900000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.82499999999999996,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.63800000000000001,"15min":0.625},"min":{"1min":0.51500000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.93000000000000005,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.54300000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.66400000000000003,"15min":0.64200000000000002},"min":{"1min":0.51200000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.67900000000000005,"15min":0.66100000000000003},"min":{"1min":0.61099999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.90200000000000002,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.72399999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.66300000000000003,"15min":0.64200000000000002},"min":{"1min":0.56000000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.85599999999999998,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.69099999999999995,"15min":0.66300000000000003},"min":{"1min":0.628,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85399999999999998,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.62}]},{"osd":3,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68999999999999995,"15min":0.67600000000000005},"min":{"1min":0.53300000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.85699999999999998,"5min":1.105,"15min":1.105},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.72699999999999998,"15min":0.71899999999999997},"min":{"1min":0.625,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.88900000000000001,"5min":0.995,"15min":0.995},"last":0.66100000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.56299999999999994,"15min":0.57799999999999996},"min":{"1min":0.377,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.70199999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.59199999999999997,"15min":0.60299999999999998},"min":{"1min":0.43099999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.72799999999999998,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.68999999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.66400000000000003,"15min":0.68999999999999995},"min":{"1min":0.45200000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.751},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.72999999999999998,"15min":0.748},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.86599999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.77100000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.67800000000000005,"15min":0.69199999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.80500000000000005,"5min":0.88,"15min":0.88},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.67100000000000004,"15min":0.68899999999999995},"min":{"1min":0.42699999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82499999999999996,"5min":1.149,"15min":1.149},"last":0.73499999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302000,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069840,"statfs":{"total":96636764160,"available":96327516160,"internally_reserved":0,"allocated":495616,"data_stored":206821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:28 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.84199999999999997,"15min":0.90000000000000002},"min":{"1min":0.58799999999999997,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.85099999999999998,"5min":4.7380000000000004,"15min":4.7380000000000004},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.83999999999999997,"15min":0.89000000000000001},"min":{"1min":0.64000000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.85199999999999998,"5min":3.2839999999999998,"15min":3.2839999999999998},"last":0.71999999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:27:28 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.67800000000000005,"15min":0.64900000000000002},"min":{"1min":0.59999999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.90200000000000002,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.82699999999999996,"15min":0.86899999999999999},"min":{"1min":0.65700000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.91800000000000004,"5min":2.524,"15min":2.524},"last":0.65300000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:27:28 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.79300000000000004,"15min":0.82299999999999995},"min":{"1min":0.63300000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.82999999999999996,"5min":3.3199999999999998,"15min":3.3199999999999998},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.753,"15min":0.749},"min":{"1min":0.60699999999999998,"5min":0.502,"15min":0.502},"max":{"1min":0.93899999999999995,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.77400000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:27:28 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77800000000000002,"15min":0.78700000000000003},"min":{"1min":0.623,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.91700000000000004,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.81799999999999995,"15min":0.83599999999999997},"min":{"1min":0.627,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.88300000000000001,"5min":3.3610000000000002,"15min":3.3610000000000002},"last":0.75900000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:27:28 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.72199999999999998,"15min":0.77800000000000002},"min":{"1min":0.45100000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.83399999999999996,"5min":3.3999999999999999,"15min":3.3999999999999999},"last":0.75},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.752,"15min":0.82099999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.72399999999999998,"5min":3.4670000000000001,"15min":3.4670000000000001},"last":0.79500000000000004}]},{"osd":5,"last update":"Sat Aug 17 02:27:28 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.67800000000000005,"15min":0.70999999999999996},"min":{"1min":0.46100000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.82199999999999995,"5min":1.73,"15min":1.73},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.78700000000000003,"15min":0.84099999999999997},"min":{"1min":0.47399999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.90500000000000003,"5min":3.3410000000000002,"15min":3.3410000000000002},"last":0.82099999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:27:28 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.81499999999999995,"15min":0.86899999999999999},"min":{"1min":0.52500000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.90000000000000002,"5min":3.23,"15min":3.23},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.75700000000000001,"15min":0.79100000000000004},"min":{"1min":0.51300000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.86699999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.85699999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301988,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069852,"statfs":{"total":96636764160,"available":96327528448,"internally_reserved":0,"allocated":483328,"data_stored":200768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.65100000000000002,"15min":0.629},"min":{"1min":0.48599999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.72799999999999998,"15min":0.73199999999999998},"min":{"1min":0.52300000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.046,"5min":3.1440000000000001,"15min":3.1440000000000001},"last":0.69999999999999996}]},{"osd":1,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.73099999999999998,"15min":0.71399999999999997},"min":{"1min":0.624,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0740000000000001,"5min":1.119,"15min":1.119},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.70399999999999996,"15min":0.68400000000000005},"min":{"1min":0.56799999999999995,"5min":0.443,"15min":0.443},"max":{"1min":1.0229999999999999,"5min":1.153,"15min":1.153},"last":0.72599999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75,"15min":0.75600000000000001},"min":{"1min":0.55100000000000005,"5min":0.433,"15min":0.433},"max":{"1min":0.90500000000000003,"5min":3.2559999999999998,"15min":3.2559999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.68200000000000005,"15min":0.66400000000000003},"min":{"1min":0.58899999999999997,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.749}]},{"osd":3,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.80300000000000005,"15min":0.81200000000000006},"min":{"1min":0.67500000000000004,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.042,"5min":3.2229999999999999,"15min":3.2229999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.82999999999999996,"15min":0.84399999999999997},"min":{"1min":0.62,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0629999999999999,"5min":3.1859999999999999,"15min":3.1859999999999999},"last":0.76500000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.432,"5min":0.317,"15min":0.317},"max":{"1min":0.80500000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64600000000000002,"15min":0.65400000000000003},"min":{"1min":0.47499999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.93000000000000005,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.86699999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.505,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.95599999999999996,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.67300000000000004,"15min":0.67000000000000004},"min":{"1min":0.51700000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.91200000000000003,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.71799999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.72099999999999997,"15min":0.72799999999999998},"min":{"1min":0.48199999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.97299999999999998,"5min":1.02,"15min":1.02},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.73699999999999999,"15min":0.73599999999999999},"min":{"1min":0.55100000000000005,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.018,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.78800000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574892,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301996,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069844,"statfs":{"total":96636764160,"available":96327520256,"internally_reserved":0,"allocated":491520,"data_stored":202250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.62,"15min":0.58599999999999997},"min":{"1min":0.53000000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.86299999999999999,"5min":0.999,"15min":0.999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.65400000000000003,"15min":0.63400000000000001},"min":{"1min":0.56299999999999994,"5min":0.437,"15min":0.437},"max":{"1min":0.83299999999999996,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.749}]},{"osd":1,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.70099999999999996,"15min":0.68100000000000005},"min":{"1min":0.50600000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.89800000000000002,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.68899999999999995,"15min":0.66700000000000004},"min":{"1min":0.53400000000000003,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.88400000000000001,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.52900000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.70799999999999996,"15min":0.69399999999999995},"min":{"1min":0.56899999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.92500000000000004,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69699999999999995,"15min":0.68200000000000005},"min":{"1min":0.52800000000000002,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.91100000000000003,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.66200000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.68400000000000005,"15min":0.65800000000000003},"min":{"1min":0.58099999999999996,"5min":0.432,"15min":0.432},"max":{"1min":0.86499999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73999999999999999,"15min":0.73499999999999999},"min":{"1min":0.59399999999999997,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.875,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.68899999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.56899999999999995,"15min":0.58799999999999997},"min":{"1min":0.39400000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.749,"5min":0.752,"15min":0.752},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.63300000000000001,"15min":0.66900000000000004},"min":{"1min":0.434,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.68700000000000006,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.83199999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.64500000000000002,"15min":0.68400000000000005},"min":{"1min":0.44,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77500000000000002,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.628},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.65300000000000002,"15min":0.68100000000000005},"min":{"1min":0.47999999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.748,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.72199999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69599999999999995,"15min":0.71199999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.88500000000000001,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.875},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.75800000000000001,"15min":0.78500000000000003},"min":{"1min":0.51700000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.86499999999999999,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.77600000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297836,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074004,"statfs":{"total":96636764160,"available":96331780096,"internally_reserved":0,"allocated":491520,"data_stored":201324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.438,"15min":0.44},"min":{"1min":0.308,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.45500000000000002,"15min":0.439},"min":{"1min":0.36399999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.65400000000000003,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.36799999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47499999999999998,"15min":0.47699999999999998},"min":{"1min":0.35599999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68300000000000005,"5min":1.458,"15min":1.458},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.501,"15min":0.497},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.57599999999999996,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.40100000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.44800000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.72599999999999998,"5min":1.492,"15min":1.492},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.55100000000000005,"15min":0.53900000000000003},"min":{"1min":0.44500000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.74099999999999999,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.46300000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72699999999999998,"15min":0.72499999999999998},"min":{"1min":0.48899999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0069999999999999,"5min":1.01,"15min":1.01},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.75800000000000001,"15min":0.755},"min":{"1min":0.55500000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.97299999999999998,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.56299999999999994}]},{"osd":5,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.746,"15min":0.74299999999999999},"min":{"1min":0.58799999999999997,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.01,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.77000000000000002,"15min":0.77400000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.96099999999999997,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.60699999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.77100000000000002,"15min":0.77200000000000002},"min":{"1min":0.59499999999999997,"5min":0.504,"15min":0.504},"max":{"1min":0.98099999999999998,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79100000000000004,"15min":0.79300000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.91100000000000003,"5min":1.077,"15min":1.077},"last":0.63900000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.78000000000000003,"15min":0.79000000000000004},"min":{"1min":0.55400000000000005,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.90000000000000002,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.79400000000000004,"15min":0.79200000000000004},"min":{"1min":0.59799999999999998,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0309999999999999,"5min":1.421,"15min":1.421},"last":0.67900000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297840,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074000,"statfs":{"total":96636764160,"available":96331776000,"internally_reserved":0,"allocated":495616,"data_stored":206821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.40200000000000002,"15min":0.39200000000000002},"min":{"1min":0.315,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.443,"5min":0.53700000000000003,"15min":0.57899999999999996},"min":{"1min":0.34300000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.55200000000000005,"5min":3.9060000000000001,"15min":3.9060000000000001},"last":0.39900000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.34699999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.58699999999999997,"5min":0.746,"15min":0.746},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.505,"15min":0.48899999999999999},"min":{"1min":0.436,"5min":0.372,"15min":0.372},"max":{"1min":0.64600000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.56499999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.53200000000000003,"15min":0.52300000000000002},"min":{"1min":0.42399999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.65800000000000003,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.56200000000000006,"15min":0.54900000000000004},"min":{"1min":0.496,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.745,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.49099999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.81799999999999995,"15min":0.84199999999999997},"min":{"1min":0.56599999999999995,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.997,"5min":4.1509999999999998,"15min":4.1509999999999998},"last":0.621},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.73899999999999999,"15min":0.73499999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0880000000000001,"5min":1.381,"15min":1.381},"last":0.71999999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.72999999999999998,"15min":0.70599999999999996},"min":{"1min":0.60299999999999998,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.82799999999999996,"15min":0.85199999999999998},"min":{"1min":0.60399999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.125,"5min":4.1079999999999997,"15min":4.1079999999999997},"last":0.69299999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.75,"15min":0.73399999999999999},"min":{"1min":0.629,"5min":0.505,"15min":0.505},"max":{"1min":1.0469999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.74299999999999999,"15min":0.72899999999999998},"min":{"1min":0.64600000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.63300000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.84699999999999998,"15min":0.874},"min":{"1min":0.64600000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.97199999999999998,"5min":4.1879999999999997,"15min":4.1879999999999997},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.76800000000000002,"15min":0.752},"min":{"1min":0.58599999999999997,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.157,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.67100000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297840,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074000,"statfs":{"total":96636764160,"available":96331776000,"internally_reserved":0,"allocated":495616,"data_stored":206821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:25 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.33000000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.432,"15min":0.41999999999999998},"min":{"1min":0.379,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.39300000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:27:25 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.44400000000000001,"15min":0.439},"min":{"1min":0.38,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.41399999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.65000000000000002,"5min":0.746,"15min":0.746},"last":0.65000000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:27:25 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.55700000000000005,"15min":0.54400000000000004},"min":{"1min":0.51700000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.68200000000000005,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.502,"15min":0.48999999999999999},"min":{"1min":0.38800000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.79000000000000004,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.54700000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:27:25 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.71099999999999997,"15min":0.69899999999999995},"min":{"1min":0.55100000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.022,"5min":1.115,"15min":1.115},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.69899999999999995,"15min":0.68899999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.90900000000000003,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.91800000000000004}]},{"osd":5,"last update":"Sat Aug 17 02:27:25 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.72599999999999998,"15min":0.72199999999999998},"min":{"1min":0.59799999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.99199999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.68500000000000005,"15min":0.66500000000000004},"min":{"1min":0.57299999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.94999999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.89400000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:27:25 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.73699999999999999,"15min":0.73099999999999998},"min":{"1min":0.60499999999999998,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.94399999999999995,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.71699999999999997,"15min":0.70799999999999996},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.93300000000000005,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.93000000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:27:25 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.746,"15min":0.74199999999999999},"min":{"1min":0.64300000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.002,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.64000000000000001,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.93100000000000005,"5min":1.143,"15min":1.143},"last":1.032}]}]},{"osd":0,"up_from":13,"seq":55834574892,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298408,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073432,"statfs":{"total":96636764160,"available":96331194368,"internally_reserved":0,"allocated":1077248,"data_stored":791100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.41299999999999998,"15min":0.40899999999999997},"min":{"1min":0.34999999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.53600000000000003,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.46600000000000003,"15min":0.45700000000000002},"min":{"1min":0.34999999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.67500000000000004,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.72199999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.48499999999999999,"15min":0.48999999999999999},"min":{"1min":0.35699999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.59399999999999997,"5min":1.169,"15min":1.169},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.52100000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.81100000000000005,"5min":1.262,"15min":1.262},"last":0.68100000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.48699999999999999,"15min":0.47499999999999998},"min":{"1min":0.42999999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67900000000000005,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57599999999999996,"15min":0.59399999999999997},"min":{"1min":0.41999999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.67100000000000004,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":0.40899999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.76800000000000002,"15min":0.76100000000000001},"min":{"1min":0.65600000000000003,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.0449999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.82999999999999996,"15min":0.86299999999999999},"min":{"1min":0.57799999999999996,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.03,"5min":3.2160000000000002,"15min":3.2160000000000002},"last":0.78900000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.80700000000000005,"15min":0.82699999999999996},"min":{"1min":0.53500000000000003,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.96999999999999997,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.755,"15min":0.751},"min":{"1min":0.65800000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0109999999999999,"5min":1.383,"15min":1.383},"last":0.70099999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.749,"15min":0.74099999999999999},"min":{"1min":0.59799999999999998,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.119,"5min":1.411,"15min":1.411},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.78200000000000003,"15min":0.77300000000000002},"min":{"1min":0.70999999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.101,"5min":1.343,"15min":1.343},"last":0.97599999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.80700000000000005,"15min":0.79700000000000004},"min":{"1min":0.69299999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1459999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.88400000000000001,"15min":0.91000000000000003},"min":{"1min":0.65500000000000003,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.081,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":0.66700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:27:57.224 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-17T02:27:57.224 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:27:57.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.370+0000 7f1a67000640 1 Processor -- start 2024-08-17T02:27:57.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.371+0000 7f1a67000640 1 -- start start 2024-08-17T02:27:57.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.372+0000 7f1a67000640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1a6015cfe0 0x7f1a600695c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.372+0000 7f1a67000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a60069b00 con 0x7f1a60069170 2024-08-17T02:27:57.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.372+0000 7f1a67000640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a6006d0b0 con 0x7f1a60068510 2024-08-17T02:27:57.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.372+0000 7f1a67000640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a600688e0 con 0x7f1a6015cfe0 2024-08-17T02:27:57.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.372+0000 7f1a65200640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f1a60069170 0x7f1a6015c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:46938/0 (socket says 172.21.15.107:46938) 2024-08-17T02:27:57.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.372+0000 7f1a65200640 1 -- 172.21.15.107:0/2580874114 learned_addr learned my addr 172.21.15.107:0/2580874114 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:27:57.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.372+0000 7f1a66600640 1 --2- 172.21.15.107:0/2580874114 >> v2:172.21.15.157:3300/0 conn(0x7f1a6015cfe0 0x7f1a600695c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.373+0000 7f1a5fe00640 1 -- 172.21.15.107:0/2580874114 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2953070520 0 0) 0x7f1a60069b00 con 0x7f1a60069170 2024-08-17T02:27:57.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.373+0000 7f1a5fe00640 1 -- 172.21.15.107:0/2580874114 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a480034e0 con 0x7f1a60069170 2024-08-17T02:27:57.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.373+0000 7f1a5fe00640 1 -- 172.21.15.107:0/2580874114 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1694518023 0 0) 0x7f1a6006d0b0 con 0x7f1a60068510 2024-08-17T02:27:57.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.373+0000 7f1a5fe00640 1 -- 172.21.15.107:0/2580874114 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a60069b00 con 0x7f1a60068510 2024-08-17T02:27:57.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.373+0000 7f1a66600640 1 -- 172.21.15.107:0/2580874114 >> v1:172.21.15.157:6789/0 conn(0x7f1a60068510 legacy=0x7f1a6006de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.373+0000 7f1a66600640 1 -- 172.21.15.107:0/2580874114 >> v1:172.21.15.107:6789/0 conn(0x7f1a60069170 legacy=0x7f1a6015c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.373+0000 7f1a66600640 1 -- 172.21.15.107:0/2580874114 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a6015d5c0 con 0x7f1a6015cfe0 2024-08-17T02:27:57.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.374+0000 7f1a66600640 1 --2- 172.21.15.107:0/2580874114 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a6015cfe0 0x7f1a600695c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1a58009e60 tx=0x7f1a58009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bccb661aa80e23a7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.374+0000 7f1a5fe00640 1 -- 172.21.15.107:0/2580874114 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a58007550 con 0x7f1a6015cfe0 2024-08-17T02:27:57.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.374+0000 7f1a5fe00640 1 -- 172.21.15.107:0/2580874114 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5802d050 con 0x7f1a6015cfe0 2024-08-17T02:27:57.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.374+0000 7f1a5fe00640 1 -- 172.21.15.107:0/2580874114 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a58007900 con 0x7f1a6015cfe0 2024-08-17T02:27:57.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.375+0000 7f1a67000640 1 -- 172.21.15.107:0/2580874114 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a6015cfe0 msgr2=0x7f1a600695c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.375+0000 7f1a67000640 1 --2- 172.21.15.107:0/2580874114 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a6015cfe0 0x7f1a600695c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1a58009e60 tx=0x7f1a58009780 comp rx=0 tx=0).stop 2024-08-17T02:27:57.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.375+0000 7f1a67000640 1 -- 172.21.15.107:0/2580874114 shutdown_connections 2024-08-17T02:27:57.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.375+0000 7f1a67000640 1 --2- 172.21.15.107:0/2580874114 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a6015cfe0 0x7f1a600695c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.375+0000 7f1a67000640 1 -- 172.21.15.107:0/2580874114 >> 172.21.15.107:0/2580874114 conn(0x7f1a600cc040 msgr2=0x7f1a600cc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:57.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.375+0000 7f1a67000640 1 -- 172.21.15.107:0/2580874114 shutdown_connections 2024-08-17T02:27:57.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.375+0000 7f1a67000640 1 -- 172.21.15.107:0/2580874114 wait complete. 2024-08-17T02:27:57.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.376+0000 7f1a67000640 1 Processor -- start 2024-08-17T02:27:57.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.377+0000 7f1a67000640 1 -- start start 2024-08-17T02:27:57.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.377+0000 7f1a67000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a60068510 0x7f1a6015c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.377+0000 7f1a67000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a60069170 0x7f1a60145670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.377+0000 7f1a67000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1a6015cfe0 0x7f1a600abb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.377+0000 7f1a67000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6006e540 con 0x7f1a60068510 2024-08-17T02:27:57.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.377+0000 7f1a67000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6015d8a0 con 0x7f1a60069170 2024-08-17T02:27:57.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.377+0000 7f1a67000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6015c6c0 con 0x7f1a6015cfe0 2024-08-17T02:27:57.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.378+0000 7f1a65c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a60068510 0x7f1a6015c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.378+0000 7f1a65c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a60068510 0x7f1a6015c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47004/0 (socket says 172.21.15.107:47004) 2024-08-17T02:27:57.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.378+0000 7f1a65c00640 1 -- 172.21.15.107:0/2549009299 learned_addr learned my addr 172.21.15.107:0/2549009299 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:57.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.378+0000 7f1a66600640 1 --2- 172.21.15.107:0/2549009299 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1a6015cfe0 0x7f1a600abb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.378+0000 7f1a65200640 1 --2- 172.21.15.107:0/2549009299 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a60069170 0x7f1a60145670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.378+0000 7f1a65c00640 1 -- 172.21.15.107:0/2549009299 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1a6015cfe0 msgr2=0x7f1a600abb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.378+0000 7f1a65c00640 1 --2- 172.21.15.107:0/2549009299 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1a6015cfe0 0x7f1a600abb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.378+0000 7f1a65c00640 1 -- 172.21.15.107:0/2549009299 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a60069170 msgr2=0x7f1a60145670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.378+0000 7f1a65c00640 1 --2- 172.21.15.107:0/2549009299 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a60069170 0x7f1a60145670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.378+0000 7f1a65c00640 1 -- 172.21.15.107:0/2549009299 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a58009a20 con 0x7f1a60068510 2024-08-17T02:27:57.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.378+0000 7f1a65200640 1 --2- 172.21.15.107:0/2549009299 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a60069170 0x7f1a60145670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:57.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.378+0000 7f1a65c00640 1 --2- 172.21.15.107:0/2549009299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a60068510 0x7f1a6015c850 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f1a5400c590 tx=0x7f1a54007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.379+0000 7f1a5cc00640 1 -- 172.21.15.107:0/2549009299 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a54012630 con 0x7f1a60068510 2024-08-17T02:27:57.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.379+0000 7f1a5cc00640 1 -- 172.21.15.107:0/2549009299 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a540127b0 con 0x7f1a60068510 2024-08-17T02:27:57.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.379+0000 7f1a5cc00640 1 -- 172.21.15.107:0/2549009299 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a54012bb0 con 0x7f1a60068510 2024-08-17T02:27:57.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.379+0000 7f1a67000640 1 -- 172.21.15.107:0/2549009299 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a600ac080 con 0x7f1a60068510 2024-08-17T02:27:57.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.379+0000 7f1a67000640 1 -- 172.21.15.107:0/2549009299 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a600ac2c0 con 0x7f1a60068510 2024-08-17T02:27:57.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.380+0000 7f1a67000640 1 -- 172.21.15.107:0/2549009299 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a60071050 con 0x7f1a60068510 2024-08-17T02:27:57.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.381+0000 7f1a5cc00640 1 -- 172.21.15.107:0/2549009299 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1a5401a3b0 con 0x7f1a60068510 2024-08-17T02:27:57.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.381+0000 7f1a5cc00640 1 --2- 172.21.15.107:0/2549009299 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f1a40065150 0x7f1a40067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.381+0000 7f1a5cc00640 1 -- 172.21.15.107:0/2549009299 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f1a54081f80 con 0x7f1a60068510 2024-08-17T02:27:57.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.382+0000 7f1a65200640 1 --2- 172.21.15.107:0/2549009299 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f1a40065150 0x7f1a40067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.382+0000 7f1a65200640 1 --2- 172.21.15.107:0/2549009299 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f1a40065150 0x7f1a40067600 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1a6015cd90 tx=0x7f1a4c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.385+0000 7f1a5cc00640 1 -- 172.21.15.107:0/2549009299 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1a54050240 con 0x7f1a60068510 2024-08-17T02:27:57.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.556+0000 7f1a67000640 1 -- 172.21.15.107:0/2549009299 --> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1a600ac080 con 0x7f1a40065150 2024-08-17T02:27:57.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.558+0000 7f1a5cc00640 1 -- 172.21.15.107:0/2549009299 <== mgr.4110 v2:172.21.15.107:6832/37039 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50802 (secure 0 0 0) 0x7f1a600ac080 con 0x7f1a40065150 2024-08-17T02:27:57.560 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:27:57.560 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-08-17T02:27:57.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.560+0000 7f1a67000640 1 -- 172.21.15.107:0/2549009299 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f1a40065150 msgr2=0x7f1a40067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.560+0000 7f1a67000640 1 --2- 172.21.15.107:0/2549009299 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f1a40065150 0x7f1a40067600 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1a6015cd90 tx=0x7f1a4c009040 comp rx=0 tx=0).stop 2024-08-17T02:27:57.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.560+0000 7f1a67000640 1 -- 172.21.15.107:0/2549009299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a60068510 msgr2=0x7f1a6015c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.560+0000 7f1a67000640 1 --2- 172.21.15.107:0/2549009299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a60068510 0x7f1a6015c850 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f1a5400c590 tx=0x7f1a54007d80 comp rx=0 tx=0).stop 2024-08-17T02:27:57.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.560+0000 7f1a67000640 1 -- 172.21.15.107:0/2549009299 shutdown_connections 2024-08-17T02:27:57.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.560+0000 7f1a67000640 1 --2- 172.21.15.107:0/2549009299 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f1a40065150 0x7f1a40067600 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.561+0000 7f1a67000640 1 --2- 172.21.15.107:0/2549009299 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1a6015cfe0 0x7f1a600abb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.561+0000 7f1a67000640 1 --2- 172.21.15.107:0/2549009299 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a60069170 0x7f1a60145670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.561+0000 7f1a67000640 1 --2- 172.21.15.107:0/2549009299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a60068510 0x7f1a6015c850 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.561+0000 7f1a67000640 1 -- 172.21.15.107:0/2549009299 >> 172.21.15.107:0/2549009299 conn(0x7f1a600cc040 msgr2=0x7f1a60157e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:57.564 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.561+0000 7f1a67000640 1 -- 172.21.15.107:0/2549009299 shutdown_connections 2024-08-17T02:27:57.564 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.561+0000 7f1a67000640 1 -- 172.21.15.107:0/2549009299 wait complete. 2024-08-17T02:27:57.576 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":144,"stamp":"2024-08-17T02:27:57.457406+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2404840,"kb_used_data":5160,"kb_used_omap":13,"kb_used_meta":2399538,"kb_avail":752569880,"statfs":{"total":773094113280,"available":770631557120,"internally_reserved":0,"allocated":5283840,"data_stored":2880488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2457127616},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.585877"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":182,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-08-17T02:27:52.527213+0000","last_change":"2024-08-17T02:24:25.092772+0000","last_active":"2024-08-17T02:27:52.527213+0000","last_peered":"2024-08-17T02:27:52.527213+0000","last_clean":"2024-08-17T02:27:52.527213+0000","last_became_active":"2024-08-17T02:24:25.091788+0000","last_became_peered":"2024-08-17T02:24:25.091788+0000","last_unstale":"2024-08-17T02:27:52.527213+0000","last_undegraded":"2024-08-17T02:27:52.527213+0000","last_fullsized":"2024-08-17T02:27:52.527213+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:24.051996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:24.051996+0000","last_clean_scrub_stamp":"2024-08-17T02:24:24.051996+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:31:45.454480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574894,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1105920,"data_stored":802837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.60999999999999999,"15min":0.59399999999999997},"min":{"1min":0.50900000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.82499999999999996,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.63800000000000001,"15min":0.625},"min":{"1min":0.51500000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.93000000000000005,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.65500000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.66400000000000003,"15min":0.64200000000000002},"min":{"1min":0.51200000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.67900000000000005,"15min":0.66100000000000003},"min":{"1min":0.61099999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.90200000000000002,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.68799999999999994}]},{"osd":2,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.66300000000000003,"15min":0.64200000000000002},"min":{"1min":0.56000000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.85599999999999998,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.69099999999999995,"15min":0.66300000000000003},"min":{"1min":0.628,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85399999999999998,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.72299999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68999999999999995,"15min":0.67600000000000005},"min":{"1min":0.53300000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.85699999999999998,"5min":1.105,"15min":1.105},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.72699999999999998,"15min":0.71899999999999997},"min":{"1min":0.625,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.88900000000000001,"5min":0.995,"15min":0.995},"last":0.75800000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.56299999999999994,"15min":0.57799999999999996},"min":{"1min":0.377,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.70199999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.59199999999999997,"15min":0.60299999999999998},"min":{"1min":0.43099999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.72799999999999998,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.59299999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.66400000000000003,"15min":0.68999999999999995},"min":{"1min":0.45200000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.72999999999999998,"15min":0.748},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.86599999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.73399999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.67800000000000005,"15min":0.69199999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.80500000000000005,"5min":0.88,"15min":0.88},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.67100000000000004,"15min":0.68899999999999995},"min":{"1min":0.42699999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82499999999999996,"5min":1.149,"15min":1.149},"last":0.74299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302020,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069820,"statfs":{"total":96636764160,"available":96327495680,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:28 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.84199999999999997,"15min":0.90000000000000002},"min":{"1min":0.58799999999999997,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.85099999999999998,"5min":4.7380000000000004,"15min":4.7380000000000004},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.83999999999999997,"15min":0.89000000000000001},"min":{"1min":0.64000000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.85199999999999998,"5min":3.2839999999999998,"15min":3.2839999999999998},"last":0.68700000000000006}]},{"osd":1,"last update":"Sat Aug 17 02:27:28 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.67800000000000005,"15min":0.64900000000000002},"min":{"1min":0.59999999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.90200000000000002,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.82699999999999996,"15min":0.86899999999999999},"min":{"1min":0.65700000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.91800000000000004,"5min":2.524,"15min":2.524},"last":0.66700000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:27:28 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.79300000000000004,"15min":0.82299999999999995},"min":{"1min":0.63300000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.82999999999999996,"5min":3.3199999999999998,"15min":3.3199999999999998},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.753,"15min":0.749},"min":{"1min":0.60699999999999998,"5min":0.502,"15min":0.502},"max":{"1min":0.93899999999999995,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.64900000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:27:28 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77800000000000002,"15min":0.78700000000000003},"min":{"1min":0.623,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.91700000000000004,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.81799999999999995,"15min":0.83599999999999997},"min":{"1min":0.627,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.88300000000000001,"5min":3.3610000000000002,"15min":3.3610000000000002},"last":0.57999999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:27:28 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.72199999999999998,"15min":0.77800000000000002},"min":{"1min":0.45100000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.83399999999999996,"5min":3.3999999999999999,"15min":3.3999999999999999},"last":0.621},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.752,"15min":0.82099999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.72399999999999998,"5min":3.4670000000000001,"15min":3.4670000000000001},"last":0.47499999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:27:28 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.67800000000000005,"15min":0.70999999999999996},"min":{"1min":0.46100000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.82199999999999995,"5min":1.73,"15min":1.73},"last":0.497},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.78700000000000003,"15min":0.84099999999999997},"min":{"1min":0.47399999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.90500000000000003,"5min":3.3410000000000002,"15min":3.3410000000000002},"last":0.71199999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:27:28 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.81499999999999995,"15min":0.86899999999999999},"min":{"1min":0.52500000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.90000000000000002,"5min":3.23,"15min":3.23},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.75700000000000001,"15min":0.79100000000000004},"min":{"1min":0.51300000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.86699999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.54700000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302020,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069820,"statfs":{"total":96636764160,"available":96327495680,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.65100000000000002,"15min":0.629},"min":{"1min":0.48599999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.72799999999999998,"15min":0.73199999999999998},"min":{"1min":0.52300000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.046,"5min":3.1440000000000001,"15min":3.1440000000000001},"last":0.66600000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.73099999999999998,"15min":0.71399999999999997},"min":{"1min":0.624,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0740000000000001,"5min":1.119,"15min":1.119},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.70399999999999996,"15min":0.68400000000000005},"min":{"1min":0.56799999999999995,"5min":0.443,"15min":0.443},"max":{"1min":1.0229999999999999,"5min":1.153,"15min":1.153},"last":0.55700000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75,"15min":0.75600000000000001},"min":{"1min":0.55100000000000005,"5min":0.433,"15min":0.433},"max":{"1min":0.90500000000000003,"5min":3.2559999999999998,"15min":3.2559999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.75,"5min":0.68200000000000005,"15min":0.66400000000000003},"min":{"1min":0.58899999999999997,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.57399999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.80300000000000005,"15min":0.81200000000000006},"min":{"1min":0.67500000000000004,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.042,"5min":3.2229999999999999,"15min":3.2229999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.82999999999999996,"15min":0.84399999999999997},"min":{"1min":0.62,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0629999999999999,"5min":3.1859999999999999,"15min":3.1859999999999999},"last":0.64000000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.432,"5min":0.317,"15min":0.317},"max":{"1min":0.80500000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.502},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64600000000000002,"15min":0.65400000000000003},"min":{"1min":0.47499999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.93000000000000005,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.623}]},{"osd":6,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.505,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.95599999999999996,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.67300000000000004,"15min":0.67000000000000004},"min":{"1min":0.51700000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.91200000000000003,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.60099999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.72099999999999997,"15min":0.72799999999999998},"min":{"1min":0.48199999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.97299999999999998,"5min":1.02,"15min":1.02},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.73699999999999999,"15min":0.73599999999999999},"min":{"1min":0.55100000000000005,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.018,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.61499999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302020,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069820,"statfs":{"total":96636764160,"available":96327495680,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.62,"15min":0.58599999999999997},"min":{"1min":0.53000000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.86299999999999999,"5min":0.999,"15min":0.999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.65400000000000003,"15min":0.63400000000000001},"min":{"1min":0.56299999999999994,"5min":0.437,"15min":0.437},"max":{"1min":0.83299999999999996,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.67900000000000005}]},{"osd":1,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.70099999999999996,"15min":0.68100000000000005},"min":{"1min":0.50600000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.89800000000000002,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.68899999999999995,"15min":0.66700000000000004},"min":{"1min":0.53400000000000003,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.88400000000000001,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.84499999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.70799999999999996,"15min":0.69399999999999995},"min":{"1min":0.56899999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.92500000000000004,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69699999999999995,"15min":0.68200000000000005},"min":{"1min":0.52800000000000002,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.91100000000000003,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.70699999999999996}]},{"osd":3,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.68400000000000005,"15min":0.65800000000000003},"min":{"1min":0.58099999999999996,"5min":0.432,"15min":0.432},"max":{"1min":0.86499999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73999999999999999,"15min":0.73499999999999999},"min":{"1min":0.59399999999999997,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.875,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.80100000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.56899999999999995,"15min":0.58799999999999997},"min":{"1min":0.39400000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.749,"5min":0.752,"15min":0.752},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.63300000000000001,"15min":0.66900000000000004},"min":{"1min":0.434,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.68700000000000006,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.95699999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.64500000000000002,"15min":0.68400000000000005},"min":{"1min":0.44,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77500000000000002,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.65300000000000002,"15min":0.68100000000000005},"min":{"1min":0.47999999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.748,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.56799999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69599999999999995,"15min":0.71199999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.88500000000000001,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.75800000000000001,"15min":0.78500000000000003},"min":{"1min":0.51700000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.86499999999999999,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":1.111}]}]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.438,"15min":0.44},"min":{"1min":0.308,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.45500000000000002,"15min":0.439},"min":{"1min":0.36399999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.65400000000000003,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.34300000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47499999999999998,"15min":0.47699999999999998},"min":{"1min":0.35599999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68300000000000005,"5min":1.458,"15min":1.458},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.501,"15min":0.497},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.57599999999999996,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.40899999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.44800000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.72599999999999998,"5min":1.492,"15min":1.492},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.55100000000000005,"15min":0.53900000000000003},"min":{"1min":0.44500000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.74099999999999999,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.45100000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72699999999999998,"15min":0.72499999999999998},"min":{"1min":0.48899999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0069999999999999,"5min":1.01,"15min":1.01},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.75800000000000001,"15min":0.755},"min":{"1min":0.55500000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.97299999999999998,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.51900000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.746,"15min":0.74299999999999999},"min":{"1min":0.58799999999999997,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.01,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.77000000000000002,"15min":0.77400000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.96099999999999997,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.55500000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.77100000000000002,"15min":0.77200000000000002},"min":{"1min":0.59499999999999997,"5min":0.504,"15min":0.504},"max":{"1min":0.98099999999999998,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79100000000000004,"15min":0.79300000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.91100000000000003,"5min":1.077,"15min":1.077},"last":0.70599999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.78000000000000003,"15min":0.79000000000000004},"min":{"1min":0.55400000000000005,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.90000000000000002,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.79400000000000004,"15min":0.79200000000000004},"min":{"1min":0.59799999999999998,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0309999999999999,"5min":1.421,"15min":1.421},"last":0.54200000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574893,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.40200000000000002,"15min":0.39200000000000002},"min":{"1min":0.315,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.443,"5min":0.53700000000000003,"15min":0.57899999999999996},"min":{"1min":0.34300000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.55200000000000005,"5min":3.9060000000000001,"15min":3.9060000000000001},"last":0.34599999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.34699999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.58699999999999997,"5min":0.746,"15min":0.746},"last":0.308},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.505,"15min":0.48899999999999999},"min":{"1min":0.436,"5min":0.372,"15min":0.372},"max":{"1min":0.64600000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.38200000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.53200000000000003,"15min":0.52300000000000002},"min":{"1min":0.42399999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.65800000000000003,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.44},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.56200000000000006,"15min":0.54900000000000004},"min":{"1min":0.496,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.745,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.47599999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.81799999999999995,"15min":0.84199999999999997},"min":{"1min":0.56599999999999995,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.997,"5min":4.1509999999999998,"15min":4.1509999999999998},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.73899999999999999,"15min":0.73499999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0880000000000001,"5min":1.381,"15min":1.381},"last":0.76800000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.72999999999999998,"15min":0.70599999999999996},"min":{"1min":0.60299999999999998,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.82799999999999996,"15min":0.85199999999999998},"min":{"1min":0.60399999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.125,"5min":4.1079999999999997,"15min":4.1079999999999997},"last":0.84299999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.75,"15min":0.73399999999999999},"min":{"1min":0.629,"5min":0.505,"15min":0.505},"max":{"1min":1.0469999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.74299999999999999,"15min":0.72899999999999998},"min":{"1min":0.64600000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.80800000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.84699999999999998,"15min":0.874},"min":{"1min":0.64600000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.97199999999999998,"5min":4.1879999999999997,"15min":4.1879999999999997},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.76800000000000002,"15min":0.752},"min":{"1min":0.58599999999999997,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.157,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.82199999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:25 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.33000000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.432,"15min":0.41999999999999998},"min":{"1min":0.379,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.47699999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:27:25 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.44400000000000001,"15min":0.439},"min":{"1min":0.38,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.41399999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.65000000000000002,"5min":0.746,"15min":0.746},"last":0.498}]},{"osd":3,"last update":"Sat Aug 17 02:27:25 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.55700000000000005,"15min":0.54400000000000004},"min":{"1min":0.51700000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.68200000000000005,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.502,"15min":0.48999999999999999},"min":{"1min":0.38800000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.79000000000000004,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.42799999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:27:25 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.71099999999999997,"15min":0.69899999999999995},"min":{"1min":0.55100000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.022,"5min":1.115,"15min":1.115},"last":0.622},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.69899999999999995,"15min":0.68899999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.90900000000000003,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.54600000000000004}]},{"osd":5,"last update":"Sat Aug 17 02:27:25 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.72599999999999998,"15min":0.72199999999999998},"min":{"1min":0.59799999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.99199999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.68500000000000005,"15min":0.66500000000000004},"min":{"1min":0.57299999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.94999999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.64800000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:27:25 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.73699999999999999,"15min":0.73099999999999998},"min":{"1min":0.60499999999999998,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.94399999999999995,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.71699999999999997,"15min":0.70799999999999996},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.93300000000000005,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.55200000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:27:25 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.746,"15min":0.74199999999999999},"min":{"1min":0.64300000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.002,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.64000000000000001,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.93100000000000005,"5min":1.143,"15min":1.143},"last":0.61099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1105920,"data_stored":802837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.41299999999999998,"15min":0.40899999999999997},"min":{"1min":0.34999999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.53600000000000003,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.46600000000000003,"15min":0.45700000000000002},"min":{"1min":0.34999999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.67500000000000004,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.72199999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.48499999999999999,"15min":0.48999999999999999},"min":{"1min":0.35699999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.59399999999999997,"5min":1.169,"15min":1.169},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.52100000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.81100000000000005,"5min":1.262,"15min":1.262},"last":0.68100000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.48699999999999999,"15min":0.47499999999999998},"min":{"1min":0.42999999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67900000000000005,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57599999999999996,"15min":0.59399999999999997},"min":{"1min":0.41999999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.67100000000000004,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":0.40899999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.76800000000000002,"15min":0.76100000000000001},"min":{"1min":0.65600000000000003,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.0449999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.82999999999999996,"15min":0.86299999999999999},"min":{"1min":0.57799999999999996,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.03,"5min":3.2160000000000002,"15min":3.2160000000000002},"last":0.78900000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.80700000000000005,"15min":0.82699999999999996},"min":{"1min":0.53500000000000003,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.96999999999999997,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.755,"15min":0.751},"min":{"1min":0.65800000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0109999999999999,"5min":1.383,"15min":1.383},"last":0.70099999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.749,"15min":0.74099999999999999},"min":{"1min":0.59799999999999998,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.119,"5min":1.411,"15min":1.411},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.78200000000000003,"15min":0.77300000000000002},"min":{"1min":0.70999999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.101,"5min":1.343,"15min":1.343},"last":0.97599999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.80700000000000005,"15min":0.79700000000000004},"min":{"1min":0.69299999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1459999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.88400000000000001,"15min":0.91000000000000003},"min":{"1min":0.65500000000000003,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.081,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":0.66700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:27:57.578 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:57.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.723+0000 7f7e37e00640 1 Processor -- start 2024-08-17T02:27:57.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.723+0000 7f7e37e00640 1 -- start start 2024-08-17T02:27:57.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.724+0000 7f7e37e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e38159ca0 0x7f7e380ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.724+0000 7f7e37e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e380cadc0 con 0x7f7e380ca8a0 2024-08-17T02:27:57.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.724+0000 7f7e37e00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e380cb060 con 0x7f7e380ccca0 2024-08-17T02:27:57.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.724+0000 7f7e37e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e380cd6e0 con 0x7f7e38159ca0 2024-08-17T02:27:57.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.724+0000 7f7e2e000640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f7e380ca8a0 0x7f7e380cc590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:46950/0 (socket says 172.21.15.107:46950) 2024-08-17T02:27:57.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.724+0000 7f7e2e000640 1 -- 172.21.15.107:0/1046475573 learned_addr learned my addr 172.21.15.107:0/1046475573 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:27:57.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.725+0000 7f7e36a00640 1 --2- 172.21.15.107:0/1046475573 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e38159ca0 0x7f7e380ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.725+0000 7f7e36000640 1 -- 172.21.15.107:0/1046475573 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3028597689 0 0) 0x7f7e380cadc0 con 0x7f7e380ca8a0 2024-08-17T02:27:57.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.725+0000 7f7e36000640 1 -- 172.21.15.107:0/1046475573 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e1c0034e0 con 0x7f7e380ca8a0 2024-08-17T02:27:57.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.725+0000 7f7e36000640 1 -- 172.21.15.107:0/1046475573 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3294009904 0 0) 0x7f7e1c0034e0 con 0x7f7e380ca8a0 2024-08-17T02:27:57.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.725+0000 7f7e36000640 1 -- 172.21.15.107:0/1046475573 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e38159ca0 msgr2=0x7f7e380ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:57.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.725+0000 7f7e36000640 1 --2- 172.21.15.107:0/1046475573 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e38159ca0 0x7f7e380ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.725+0000 7f7e36000640 1 -- 172.21.15.107:0/1046475573 >> v1:172.21.15.157:6789/0 conn(0x7f7e380ccca0 legacy=0x7f7e38162860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.725+0000 7f7e36000640 1 -- 172.21.15.107:0/1046475573 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e380cb300 con 0x7f7e380ca8a0 2024-08-17T02:27:57.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.725+0000 7f7e36000640 1 -- 172.21.15.107:0/1046475573 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 537989081 0 0) 0x7f7e20001470 con 0x7f7e380ca8a0 2024-08-17T02:27:57.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.725+0000 7f7e36000640 1 -- 172.21.15.107:0/1046475573 >> v1:172.21.15.107:6789/0 conn(0x7f7e380ca8a0 legacy=0x7f7e380cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.725+0000 7f7e36000640 1 --2- 172.21.15.107:0/1046475573 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e1c003a00 0x7f7e1c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.725+0000 7f7e36000640 1 --2- 172.21.15.107:0/1046475573 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e1c004780 0x7f7e1c004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.725+0000 7f7e36000640 1 --2- 172.21.15.107:0/1046475573 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e38159ca0 0x7f7e1c005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.725+0000 7f7e36000640 1 -- 172.21.15.107:0/1046475573 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e380cd6e0 con 0x7f7e1c003a00 2024-08-17T02:27:57.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.725+0000 7f7e36000640 1 -- 172.21.15.107:0/1046475573 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c00bab0 con 0x7f7e1c004780 2024-08-17T02:27:57.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.725+0000 7f7e36000640 1 -- 172.21.15.107:0/1046475573 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c00bc70 con 0x7f7e38159ca0 2024-08-17T02:27:57.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.725+0000 7f7e36a00640 1 --2- 172.21.15.107:0/1046475573 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e1c003a00 0x7f7e1c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.726+0000 7f7e2e000640 1 --2- 172.21.15.107:0/1046475573 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e1c004780 0x7f7e1c004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.726+0000 7f7e37400640 1 --2- 172.21.15.107:0/1046475573 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e38159ca0 0x7f7e1c005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.726+0000 7f7e36a00640 1 -- 172.21.15.107:0/1046475573 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e38159ca0 msgr2=0x7f7e1c005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:57.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.726+0000 7f7e36a00640 1 --2- 172.21.15.107:0/1046475573 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e38159ca0 0x7f7e1c005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.726+0000 7f7e36a00640 1 -- 172.21.15.107:0/1046475573 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e1c004780 msgr2=0x7f7e1c004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:57.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.726+0000 7f7e36a00640 1 --2- 172.21.15.107:0/1046475573 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e1c004780 0x7f7e1c004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.726+0000 7f7e36a00640 1 -- 172.21.15.107:0/1046475573 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1c0034e0 con 0x7f7e1c003a00 2024-08-17T02:27:57.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.726+0000 7f7e37400640 1 --2- 172.21.15.107:0/1046475573 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e38159ca0 0x7f7e1c005130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:57.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.727+0000 7f7e36a00640 1 --2- 172.21.15.107:0/1046475573 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e1c003a00 0x7f7e1c003df0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7e28009b70 tx=0x7f7e280090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8663c69567783d1c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.727+0000 7f7e36000640 1 -- 172.21.15.107:0/1046475573 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e28031400 con 0x7f7e1c003a00 2024-08-17T02:27:57.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.727+0000 7f7e36000640 1 -- 172.21.15.107:0/1046475573 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e2802d050 con 0x7f7e1c003a00 2024-08-17T02:27:57.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.727+0000 7f7e36000640 1 -- 172.21.15.107:0/1046475573 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e28031790 con 0x7f7e1c003a00 2024-08-17T02:27:57.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.728+0000 7f7e37e00640 1 -- 172.21.15.107:0/1046475573 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e1c003a00 msgr2=0x7f7e1c003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.728+0000 7f7e37e00640 1 --2- 172.21.15.107:0/1046475573 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e1c003a00 0x7f7e1c003df0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7e28009b70 tx=0x7f7e280090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.728+0000 7f7e37400640 1 -- 172.21.15.107:0/1046475573 reap_dead start 2024-08-17T02:27:57.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.728+0000 7f7e37e00640 1 -- 172.21.15.107:0/1046475573 shutdown_connections 2024-08-17T02:27:57.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.728+0000 7f7e37e00640 1 -- 172.21.15.107:0/1046475573 >> 172.21.15.107:0/1046475573 conn(0x7f7e38098e00 msgr2=0x7f7e3806eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:57.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.728+0000 7f7e37e00640 1 -- 172.21.15.107:0/1046475573 shutdown_connections 2024-08-17T02:27:57.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.728+0000 7f7e37e00640 1 -- 172.21.15.107:0/1046475573 wait complete. 2024-08-17T02:27:57.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.729+0000 7f7e37e00640 1 Processor -- start 2024-08-17T02:27:57.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.729+0000 7f7e37e00640 1 -- start start 2024-08-17T02:27:57.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.730+0000 7f7e37e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e1c003a00 0x7f7e380c60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.730+0000 7f7e37e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e380c77a0 0x7f7e3816bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.730+0000 7f7e37e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e3816c0b0 0x7f7e3816c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.730+0000 7f7e37e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e380c7d60 con 0x7f7e3816c0b0 2024-08-17T02:27:57.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.730+0000 7f7e37e00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e380c8040 con 0x7f7e1c003a00 2024-08-17T02:27:57.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.730+0000 7f7e37e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e380c8320 con 0x7f7e380c77a0 2024-08-17T02:27:57.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.731+0000 7f7e37400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e3816c0b0 0x7f7e3816c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.731+0000 7f7e37400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e3816c0b0 0x7f7e3816c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47010/0 (socket says 172.21.15.107:47010) 2024-08-17T02:27:57.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.731+0000 7f7e37400640 1 -- 172.21.15.107:0/1543728186 learned_addr learned my addr 172.21.15.107:0/1543728186 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:57.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.731+0000 7f7e2e000640 1 --2- 172.21.15.107:0/1543728186 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e380c77a0 0x7f7e3816bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.731+0000 7f7e36a00640 1 --2- 172.21.15.107:0/1543728186 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e1c003a00 0x7f7e380c60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.731+0000 7f7e37400640 1 -- 172.21.15.107:0/1543728186 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e380c77a0 msgr2=0x7f7e3816bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.731+0000 7f7e37400640 1 --2- 172.21.15.107:0/1543728186 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e380c77a0 0x7f7e3816bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.731+0000 7f7e37400640 1 -- 172.21.15.107:0/1543728186 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e1c003a00 msgr2=0x7f7e380c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.731+0000 7f7e37400640 1 --2- 172.21.15.107:0/1543728186 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e1c003a00 0x7f7e380c60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.731+0000 7f7e37400640 1 -- 172.21.15.107:0/1543728186 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e380c8600 con 0x7f7e3816c0b0 2024-08-17T02:27:57.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.731+0000 7f7e36a00640 1 --2- 172.21.15.107:0/1543728186 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e1c003a00 0x7f7e380c60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:57.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.731+0000 7f7e37400640 1 --2- 172.21.15.107:0/1543728186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e3816c0b0 0x7f7e3816c580 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f7e380897a0 tx=0x7f7e30009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.731+0000 7f7e2ea00640 1 -- 172.21.15.107:0/1543728186 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3000ed30 con 0x7f7e3816c0b0 2024-08-17T02:27:57.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.732+0000 7f7e2ea00640 1 -- 172.21.15.107:0/1543728186 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3000ee90 con 0x7f7e3816c0b0 2024-08-17T02:27:57.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.732+0000 7f7e2ea00640 1 -- 172.21.15.107:0/1543728186 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e30013670 con 0x7f7e3816c0b0 2024-08-17T02:27:57.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.732+0000 7f7e37e00640 1 -- 172.21.15.107:0/1543728186 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e380c6610 con 0x7f7e3816c0b0 2024-08-17T02:27:57.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.732+0000 7f7e37e00640 1 -- 172.21.15.107:0/1543728186 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e3816cce0 con 0x7f7e3816c0b0 2024-08-17T02:27:57.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.733+0000 7f7e37e00640 1 -- 172.21.15.107:0/1543728186 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e3816ced0 con 0x7f7e3816c0b0 2024-08-17T02:27:57.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.733+0000 7f7e2ea00640 1 -- 172.21.15.107:0/1543728186 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7e30003030 con 0x7f7e3816c0b0 2024-08-17T02:27:57.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.734+0000 7f7e2ea00640 1 --2- 172.21.15.107:0/1543728186 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7e14065150 0x7f7e14067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.734+0000 7f7e2ea00640 1 -- 172.21.15.107:0/1543728186 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f7e30081a30 con 0x7f7e3816c0b0 2024-08-17T02:27:57.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.734+0000 7f7e36a00640 1 --2- 172.21.15.107:0/1543728186 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7e14065150 0x7f7e14067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.735+0000 7f7e36a00640 1 --2- 172.21.15.107:0/1543728186 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7e14065150 0x7f7e14067600 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7e28034000 tx=0x7f7e28035000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.738+0000 7f7e2ea00640 1 -- 172.21.15.107:0/1543728186 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7e3004fcf0 con 0x7f7e3816c0b0 2024-08-17T02:27:57.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.911+0000 7f7e37e00640 1 -- 172.21.15.107:0/1543728186 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e38071050 con 0x7f7e3816c0b0 2024-08-17T02:27:57.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.912+0000 7f7e2ea00640 1 -- 172.21.15.107:0/1543728186 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+12443 (secure 0 0 0) 0x7f7e30053310 con 0x7f7e3816c0b0 2024-08-17T02:27:57.914 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:27:57.914 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":43,"fsid":"f207b4c0-329d-46b8-b83f-aaf30bdb6ce3","created":"2024-08-17T02:24:11.038049+0000","modified":"2024-08-17T02:27:53.205725+0000","last_up_change":"2024-08-17T02:24:22.047790+0000","last_in_change":"2024-08-17T02:24:13.892720+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:23.456166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"376363f3-b8bf-4f1e-b691-51cdd39171ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37302},{"type":"v1","addr":"172.21.15.107:6801","nonce":37302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37302},{"type":"v1","addr":"172.21.15.107:6803","nonce":37302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37302},{"type":"v1","addr":"172.21.15.107:6807","nonce":37302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37302},{"type":"v1","addr":"172.21.15.107:6805","nonce":37302}]},"public_addr":"172.21.15.107:6801/37302","cluster_addr":"172.21.15.107:6803/37302","heartbeat_back_addr":"172.21.15.107:6807/37302","heartbeat_front_addr":"172.21.15.107:6805/37302","state":["exists","up"]},{"osd":1,"uuid":"cc6624e3-2ad4-4db4-b377-05dfe57424e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37305},{"type":"v1","addr":"172.21.15.107:6824","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37305},{"type":"v1","addr":"172.21.15.107:6827","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37305},{"type":"v1","addr":"172.21.15.107:6831","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37305},{"type":"v1","addr":"172.21.15.107:6829","nonce":37305}]},"public_addr":"172.21.15.107:6824/37305","cluster_addr":"172.21.15.107:6827/37305","heartbeat_back_addr":"172.21.15.107:6831/37305","heartbeat_front_addr":"172.21.15.107:6829/37305","state":["exists","up"]},{"osd":2,"uuid":"25229542-29b5-4281-bcb0-798ae0930aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37307},{"type":"v1","addr":"172.21.15.107:6817","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37307},{"type":"v1","addr":"172.21.15.107:6819","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6823","nonce":37307},{"type":"v1","addr":"172.21.15.107:6825","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37307},{"type":"v1","addr":"172.21.15.107:6821","nonce":37307}]},"public_addr":"172.21.15.107:6817/37307","cluster_addr":"172.21.15.107:6819/37307","heartbeat_back_addr":"172.21.15.107:6825/37307","heartbeat_front_addr":"172.21.15.107:6821/37307","state":["exists","up"]},{"osd":3,"uuid":"5f16aee8-8950-4268-a61a-5cf6ebd670e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37306},{"type":"v1","addr":"172.21.15.107:6809","nonce":37306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37306},{"type":"v1","addr":"172.21.15.107:6811","nonce":37306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37306},{"type":"v1","addr":"172.21.15.107:6815","nonce":37306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37306},{"type":"v1","addr":"172.21.15.107:6813","nonce":37306}]},"public_addr":"172.21.15.107:6809/37306","cluster_addr":"172.21.15.107:6811/37306","heartbeat_back_addr":"172.21.15.107:6815/37306","heartbeat_front_addr":"172.21.15.107:6813/37306","state":["exists","up"]},{"osd":4,"uuid":"23232e28-e23b-4b4e-a531-4939246dbbde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":37329},{"type":"v1","addr":"172.21.15.157:6817","nonce":37329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":37329},{"type":"v1","addr":"172.21.15.157:6819","nonce":37329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":37329},{"type":"v1","addr":"172.21.15.157:6823","nonce":37329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":37329},{"type":"v1","addr":"172.21.15.157:6821","nonce":37329}]},"public_addr":"172.21.15.157:6817/37329","cluster_addr":"172.21.15.157:6819/37329","heartbeat_back_addr":"172.21.15.157:6823/37329","heartbeat_front_addr":"172.21.15.157:6821/37329","state":["exists","up"]},{"osd":5,"uuid":"f87ec331-3e59-4886-a317-6f7e26ec8e21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":37328},{"type":"v1","addr":"172.21.15.157:6804","nonce":37328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":37328},{"type":"v1","addr":"172.21.15.157:6808","nonce":37328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":37328},{"type":"v1","addr":"172.21.15.157:6815","nonce":37328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":37328},{"type":"v1","addr":"172.21.15.157:6812","nonce":37328}]},"public_addr":"172.21.15.157:6804/37328","cluster_addr":"172.21.15.157:6808/37328","heartbeat_back_addr":"172.21.15.157:6815/37328","heartbeat_front_addr":"172.21.15.157:6812/37328","state":["exists","up"]},{"osd":6,"uuid":"92852235-ce49-4d96-a940-6f18d97b13ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":37330},{"type":"v1","addr":"172.21.15.157:6801","nonce":37330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6803","nonce":37330},{"type":"v1","addr":"172.21.15.157:6805","nonce":37330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6811","nonce":37330},{"type":"v1","addr":"172.21.15.157:6813","nonce":37330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":37330},{"type":"v1","addr":"172.21.15.157:6809","nonce":37330}]},"public_addr":"172.21.15.157:6801/37330","cluster_addr":"172.21.15.157:6805/37330","heartbeat_back_addr":"172.21.15.157:6813/37330","heartbeat_front_addr":"172.21.15.157:6809/37330","state":["exists","up"]},{"osd":7,"uuid":"7484a061-723d-4663-b28f-b01766d62f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":37373},{"type":"v1","addr":"172.21.15.157:6825","nonce":37373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":37373},{"type":"v1","addr":"172.21.15.157:6827","nonce":37373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":37373},{"type":"v1","addr":"172.21.15.157:6831","nonce":37373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":37373},{"type":"v1","addr":"172.21.15.157:6829","nonce":37373}]},"public_addr":"172.21.15.157:6825/37373","cluster_addr":"172.21.15.157:6827/37373","heartbeat_back_addr":"172.21.15.157:6831/37373","heartbeat_front_addr":"172.21.15.157:6829/37373","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.110188+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.280265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.252119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.267996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.284582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.144420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.174764+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:19.308002+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:6837/809431952":"2024-08-18T02:27:49.868281+0000","172.21.15.107:6835/809431952":"2024-08-18T02:27:49.868281+0000","172.21.15.157:6835/1725535660":"2024-08-18T02:27:43.163351+0000","172.21.15.157:6833/1725535660":"2024-08-18T02:27:43.163351+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:57.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.914+0000 7f7e37e00640 1 -- 172.21.15.107:0/1543728186 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7e14065150 msgr2=0x7f7e14067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.914+0000 7f7e37e00640 1 --2- 172.21.15.107:0/1543728186 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7e14065150 0x7f7e14067600 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7e28034000 tx=0x7f7e28035000 comp rx=0 tx=0).stop 2024-08-17T02:27:57.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.914+0000 7f7e37e00640 1 -- 172.21.15.107:0/1543728186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e3816c0b0 msgr2=0x7f7e3816c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.914+0000 7f7e37e00640 1 --2- 172.21.15.107:0/1543728186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e3816c0b0 0x7f7e3816c580 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f7e380897a0 tx=0x7f7e30009040 comp rx=0 tx=0).stop 2024-08-17T02:27:57.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.914+0000 7f7e37e00640 1 -- 172.21.15.107:0/1543728186 shutdown_connections 2024-08-17T02:27:57.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.914+0000 7f7e37e00640 1 --2- 172.21.15.107:0/1543728186 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7e14065150 0x7f7e14067600 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.914+0000 7f7e37e00640 1 --2- 172.21.15.107:0/1543728186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e3816c0b0 0x7f7e3816c580 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.914+0000 7f7e37e00640 1 --2- 172.21.15.107:0/1543728186 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e380c77a0 0x7f7e3816bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.914+0000 7f7e37e00640 1 --2- 172.21.15.107:0/1543728186 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e1c003a00 0x7f7e380c60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.914+0000 7f7e37e00640 1 -- 172.21.15.107:0/1543728186 >> 172.21.15.107:0/1543728186 conn(0x7f7e38098e00 msgr2=0x7f7e38156d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:57.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.915+0000 7f7e37e00640 1 -- 172.21.15.107:0/1543728186 shutdown_connections 2024-08-17T02:27:57.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:57.915+0000 7f7e37e00640 1 -- 172.21.15.107:0/1543728186 wait complete. 2024-08-17T02:27:58.932 INFO:tasks.ceph:Scrubbing osd.0 2024-08-17T02:27:58.932 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:27:59.090 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.088+0000 7f5d3da00640 1 Processor -- start 2024-08-17T02:27:59.090 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.089+0000 7f5d3da00640 1 -- start start 2024-08-17T02:27:59.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.090+0000 7f5d3da00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d380b2bb0 0x7f5d380b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.090+0000 7f5d3da00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5d3815c4b0 0x7f5d380aac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.090+0000 7f5d3da00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d380d0a80 con 0x7f5d380b5740 2024-08-17T02:27:59.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.090+0000 7f5d3da00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d380b2130 con 0x7f5d3815c4b0 2024-08-17T02:27:59.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.090+0000 7f5d3da00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d380b23f0 con 0x7f5d380b2bb0 2024-08-17T02:27:59.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.090+0000 7f5d37400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f5d380b5740 0x7f5d3815bda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:46956/0 (socket says 172.21.15.107:46956) 2024-08-17T02:27:59.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.090+0000 7f5d37400640 1 -- 172.21.15.107:0/3815406375 learned_addr learned my addr 172.21.15.107:0/3815406375 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:27:59.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.090+0000 7f5d37e00640 1 --2- 172.21.15.107:0/3815406375 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d380b2bb0 0x7f5d380b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.090+0000 7f5d3d000640 1 --2- 172.21.15.107:0/3815406375 >> v2:172.21.15.157:3300/0 conn(0x7f5d3815c4b0 0x7f5d380aac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.090+0000 7f5d36a00640 1 -- 172.21.15.107:0/3815406375 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1200055045 0 0) 0x7f5d380d0a80 con 0x7f5d380b5740 2024-08-17T02:27:59.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.090+0000 7f5d36a00640 1 -- 172.21.15.107:0/3815406375 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d1c0034e0 con 0x7f5d380b5740 2024-08-17T02:27:59.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.091+0000 7f5d36a00640 1 -- 172.21.15.107:0/3815406375 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 103863879 0 0) 0x7f5d1c0034e0 con 0x7f5d380b5740 2024-08-17T02:27:59.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.091+0000 7f5d36a00640 1 -- 172.21.15.107:0/3815406375 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d380b2bb0 msgr2=0x7f5d380b2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:59.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.091+0000 7f5d36a00640 1 --2- 172.21.15.107:0/3815406375 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d380b2bb0 0x7f5d380b2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.091+0000 7f5d36a00640 1 -- 172.21.15.107:0/3815406375 >> v2:172.21.15.157:3300/0 conn(0x7f5d3815c4b0 msgr2=0x7f5d380aac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:59.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.091+0000 7f5d36a00640 1 --2- 172.21.15.107:0/3815406375 >> v2:172.21.15.157:3300/0 conn(0x7f5d3815c4b0 0x7f5d380aac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.091+0000 7f5d36a00640 1 -- 172.21.15.107:0/3815406375 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d380b37a0 con 0x7f5d380b5740 2024-08-17T02:27:59.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.091+0000 7f5d36a00640 1 -- 172.21.15.107:0/3815406375 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 537989081 0 0) 0x7f5d24001470 con 0x7f5d380b5740 2024-08-17T02:27:59.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.091+0000 7f5d36a00640 1 -- 172.21.15.107:0/3815406375 >> v1:172.21.15.107:6789/0 conn(0x7f5d380b5740 legacy=0x7f5d3815bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.091+0000 7f5d36a00640 1 --2- 172.21.15.107:0/3815406375 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d1c003a50 0x7f5d1c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.091+0000 7f5d36a00640 1 --2- 172.21.15.107:0/3815406375 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d380b2bb0 0x7f5d1c004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.091+0000 7f5d36a00640 1 --2- 172.21.15.107:0/3815406375 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5d1c004cc0 0x7f5d1c005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.091+0000 7f5d36a00640 1 -- 172.21.15.107:0/3815406375 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d380b2130 con 0x7f5d1c003a50 2024-08-17T02:27:59.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.091+0000 7f5d36a00640 1 -- 172.21.15.107:0/3815406375 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d380b23f0 con 0x7f5d1c004cc0 2024-08-17T02:27:59.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.091+0000 7f5d36a00640 1 -- 172.21.15.107:0/3815406375 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1c00ba80 con 0x7f5d380b2bb0 2024-08-17T02:27:59.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.091+0000 7f5d37e00640 1 --2- 172.21.15.107:0/3815406375 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d1c003a50 0x7f5d1c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.091+0000 7f5d37400640 1 --2- 172.21.15.107:0/3815406375 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d380b2bb0 0x7f5d1c004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.091+0000 7f5d3d000640 1 --2- 172.21.15.107:0/3815406375 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5d1c004cc0 0x7f5d1c005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.091+0000 7f5d37e00640 1 -- 172.21.15.107:0/3815406375 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d380b2bb0 msgr2=0x7f5d1c004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:59.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.091+0000 7f5d37e00640 1 --2- 172.21.15.107:0/3815406375 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d380b2bb0 0x7f5d1c004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.091+0000 7f5d37e00640 1 -- 172.21.15.107:0/3815406375 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5d1c004cc0 msgr2=0x7f5d1c005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:59.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.091+0000 7f5d37e00640 1 --2- 172.21.15.107:0/3815406375 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5d1c004cc0 0x7f5d1c005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.091+0000 7f5d37e00640 1 -- 172.21.15.107:0/3815406375 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d1c0034e0 con 0x7f5d1c003a50 2024-08-17T02:27:59.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.091+0000 7f5d3d000640 1 --2- 172.21.15.107:0/3815406375 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5d1c004cc0 0x7f5d1c005130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:59.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.091+0000 7f5d37400640 1 --2- 172.21.15.107:0/3815406375 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d380b2bb0 0x7f5d1c004780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:59.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.092+0000 7f5d37e00640 1 --2- 172.21.15.107:0/3815406375 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d1c003a50 0x7f5d1c003e60 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f5d28009ba0 tx=0x7f5d280090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56a89827d299d30d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.093+0000 7f5d36a00640 1 -- 172.21.15.107:0/3815406375 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d28031400 con 0x7f5d1c003a50 2024-08-17T02:27:59.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.093+0000 7f5d36a00640 1 -- 172.21.15.107:0/3815406375 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2802d050 con 0x7f5d1c003a50 2024-08-17T02:27:59.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.093+0000 7f5d36a00640 1 -- 172.21.15.107:0/3815406375 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d28031790 con 0x7f5d1c003a50 2024-08-17T02:27:59.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.093+0000 7f5d3da00640 1 -- 172.21.15.107:0/3815406375 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d1c003a50 msgr2=0x7f5d1c003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.093+0000 7f5d3da00640 1 --2- 172.21.15.107:0/3815406375 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d1c003a50 0x7f5d1c003e60 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f5d28009ba0 tx=0x7f5d280090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.093+0000 7f5d3d000640 1 -- 172.21.15.107:0/3815406375 reap_dead start 2024-08-17T02:27:59.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.093+0000 7f5d3da00640 1 -- 172.21.15.107:0/3815406375 shutdown_connections 2024-08-17T02:27:59.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.093+0000 7f5d3da00640 1 -- 172.21.15.107:0/3815406375 >> 172.21.15.107:0/3815406375 conn(0x7f5d380cfbc0 msgr2=0x7f5d380cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:59.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.093+0000 7f5d3da00640 1 -- 172.21.15.107:0/3815406375 shutdown_connections 2024-08-17T02:27:59.101 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.093+0000 7f5d3da00640 1 -- 172.21.15.107:0/3815406375 wait complete. 2024-08-17T02:27:59.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.095+0000 7f5d3da00640 1 Processor -- start 2024-08-17T02:27:59.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.095+0000 7f5d3da00640 1 -- start start 2024-08-17T02:27:59.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.096+0000 7f5d3da00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d1c003a50 0x7f5d38145fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.096+0000 7f5d3da00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d3809b810 0x7f5d3809bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.096+0000 7f5d3da00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5d380adda0 0x7f5d380ae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.096+0000 7f5d3da00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d381464e0 con 0x7f5d1c003a50 2024-08-17T02:27:59.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.096+0000 7f5d3da00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d380ae730 con 0x7f5d380adda0 2024-08-17T02:27:59.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.096+0000 7f5d3da00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3809c2d0 con 0x7f5d3809b810 2024-08-17T02:27:59.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.096+0000 7f5d37e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d1c003a50 0x7f5d38145fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.096+0000 7f5d37e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d1c003a50 0x7f5d38145fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47030/0 (socket says 172.21.15.107:47030) 2024-08-17T02:27:59.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.096+0000 7f5d37e00640 1 -- 172.21.15.107:0/4289859543 learned_addr learned my addr 172.21.15.107:0/4289859543 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:59.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.096+0000 7f5d37400640 1 --2- 172.21.15.107:0/4289859543 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d3809b810 0x7f5d3809bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.106 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.096+0000 7f5d3d000640 1 --2- 172.21.15.107:0/4289859543 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5d380adda0 0x7f5d380ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.106 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.096+0000 7f5d37e00640 1 -- 172.21.15.107:0/4289859543 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d3809b810 msgr2=0x7f5d3809bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.106 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.096+0000 7f5d37e00640 1 --2- 172.21.15.107:0/4289859543 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5d3809b810 0x7f5d3809bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.106 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.096+0000 7f5d37e00640 1 -- 172.21.15.107:0/4289859543 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5d380adda0 msgr2=0x7f5d380ae1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.106 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.096+0000 7f5d37e00640 1 --2- 172.21.15.107:0/4289859543 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5d380adda0 0x7f5d380ae1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.106 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.096+0000 7f5d37e00640 1 -- 172.21.15.107:0/4289859543 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d3809c5b0 con 0x7f5d1c003a50 2024-08-17T02:27:59.106 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.096+0000 7f5d3d000640 1 --2- 172.21.15.107:0/4289859543 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5d380adda0 0x7f5d380ae1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:59.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.097+0000 7f5d37e00640 1 --2- 172.21.15.107:0/4289859543 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d1c003a50 0x7f5d38145fa0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f5d28009c00 tx=0x7f5d28035000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.097+0000 7f5d2f400640 1 -- 172.21.15.107:0/4289859543 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2803c700 con 0x7f5d1c003a50 2024-08-17T02:27:59.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.097+0000 7f5d2f400640 1 -- 172.21.15.107:0/4289859543 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2803c860 con 0x7f5d1c003a50 2024-08-17T02:27:59.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.097+0000 7f5d2f400640 1 -- 172.21.15.107:0/4289859543 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2803cc20 con 0x7f5d1c003a50 2024-08-17T02:27:59.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.097+0000 7f5d3da00640 1 -- 172.21.15.107:0/4289859543 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d3809c890 con 0x7f5d1c003a50 2024-08-17T02:27:59.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.097+0000 7f5d3da00640 1 -- 172.21.15.107:0/4289859543 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d38156b90 con 0x7f5d1c003a50 2024-08-17T02:27:59.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.098+0000 7f5d3da00640 1 -- 172.21.15.107:0/4289859543 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5d38071050 con 0x7f5d1c003a50 2024-08-17T02:27:59.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.099+0000 7f5d2f400640 1 -- 172.21.15.107:0/4289859543 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5d28045460 con 0x7f5d1c003a50 2024-08-17T02:27:59.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.099+0000 7f5d2f400640 1 --2- 172.21.15.107:0/4289859543 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f5d18065180 0x7f5d18067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.099+0000 7f5d2f400640 1 -- 172.21.15.107:0/4289859543 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f5d280a3550 con 0x7f5d1c003a50 2024-08-17T02:27:59.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.100+0000 7f5d37400640 1 --2- 172.21.15.107:0/4289859543 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f5d18065180 0x7f5d18067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.100+0000 7f5d2f400640 1 --2- 172.21.15.107:0/4289859543 >> [v2:172.21.15.107:6800/37302,v1:172.21.15.107:6801/37302] conn(0x7f5d1806b070 0x7f5d1806d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.100+0000 7f5d2f400640 1 -- 172.21.15.107:0/4289859543 --> [v2:172.21.15.107:6800/37302,v1:172.21.15.107:6801/37302] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5d1806db30 con 0x7f5d1806b070 2024-08-17T02:27:59.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.100+0000 7f5d2f400640 1 -- 172.21.15.107:0/4289859543 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d280a5a50 con 0x7f5d1c003a50 2024-08-17T02:27:59.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.100+0000 7f5d3d000640 1 --2- 172.21.15.107:0/4289859543 >> [v2:172.21.15.107:6800/37302,v1:172.21.15.107:6801/37302] conn(0x7f5d1806b070 0x7f5d1806d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.100+0000 7f5d37400640 1 --2- 172.21.15.107:0/4289859543 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f5d18065180 0x7f5d18067630 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5d24001ed0 tx=0x7f5d24007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.100+0000 7f5d3d000640 1 --2- 172.21.15.107:0/4289859543 >> [v2:172.21.15.107:6800/37302,v1:172.21.15.107:6801/37302] conn(0x7f5d1806b070 0x7f5d1806d480 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.101+0000 7f5d2f400640 1 -- 172.21.15.107:0/4289859543 <== osd.0 v2:172.21.15.107:6800/37302 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f5d1806db30 con 0x7f5d1806b070 2024-08-17T02:27:59.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.114+0000 7f5d3da00640 1 -- 172.21.15.107:0/4289859543 --> [v2:172.21.15.107:6800/37302,v1:172.21.15.107:6801/37302] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5d38066ee0 con 0x7f5d1806b070 2024-08-17T02:27:59.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.114+0000 7f5d2f400640 1 -- 172.21.15.107:0/4289859543 <== osd.0 v2:172.21.15.107:6800/37302 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f5d38066ee0 con 0x7f5d1806b070 2024-08-17T02:27:59.115 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-08-17T02:27:59.116 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:27:59.116 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-08-17T02:27:59.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.114+0000 7f5d3da00640 1 -- 172.21.15.107:0/4289859543 >> [v2:172.21.15.107:6800/37302,v1:172.21.15.107:6801/37302] conn(0x7f5d1806b070 msgr2=0x7f5d1806d480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.114+0000 7f5d3da00640 1 --2- 172.21.15.107:0/4289859543 >> [v2:172.21.15.107:6800/37302,v1:172.21.15.107:6801/37302] conn(0x7f5d1806b070 0x7f5d1806d480 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.114+0000 7f5d3da00640 1 -- 172.21.15.107:0/4289859543 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f5d18065180 msgr2=0x7f5d18067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.114+0000 7f5d3da00640 1 --2- 172.21.15.107:0/4289859543 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f5d18065180 0x7f5d18067630 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5d24001ed0 tx=0x7f5d24007040 comp rx=0 tx=0).stop 2024-08-17T02:27:59.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.114+0000 7f5d3da00640 1 -- 172.21.15.107:0/4289859543 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d1c003a50 msgr2=0x7f5d38145fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.114+0000 7f5d3da00640 1 --2- 172.21.15.107:0/4289859543 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d1c003a50 0x7f5d38145fa0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f5d28009c00 tx=0x7f5d28035000 comp rx=0 tx=0).stop 2024-08-17T02:27:59.118 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.114+0000 7f5d3d000640 1 -- 172.21.15.107:0/4289859543 reap_dead start 2024-08-17T02:27:59.118 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.114+0000 7f5d3da00640 1 -- 172.21.15.107:0/4289859543 shutdown_connections 2024-08-17T02:27:59.118 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.114+0000 7f5d3da00640 1 -- 172.21.15.107:0/4289859543 >> 172.21.15.107:0/4289859543 conn(0x7f5d380cfbc0 msgr2=0x7f5d380aee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:59.118 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.115+0000 7f5d3da00640 1 -- 172.21.15.107:0/4289859543 shutdown_connections 2024-08-17T02:27:59.118 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.115+0000 7f5d3da00640 1 -- 172.21.15.107:0/4289859543 wait complete. 2024-08-17T02:27:59.130 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-08-17T02:27:59.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.279+0000 7f5929e00640 1 Processor -- start 2024-08-17T02:27:59.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.279+0000 7f5929e00640 1 -- start start 2024-08-17T02:27:59.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.280+0000 7f5929e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5924155a20 0x7f59240adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.280+0000 7f5929e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f592406df00 0x7f59240ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.280+0000 7f5929e00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5924156670 con 0x7f5924155df0 2024-08-17T02:27:59.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.280+0000 7f5929e00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59240b0350 con 0x7f592406df00 2024-08-17T02:27:59.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.280+0000 7f5929e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f592406e5e0 con 0x7f5924155a20 2024-08-17T02:27:59.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.281+0000 7f5922a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5924155a20 0x7f59240adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.281+0000 7f5922a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5924155a20 0x7f59240adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:52560/0 (socket says 172.21.15.107:52560) 2024-08-17T02:27:59.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.281+0000 7f5922a00640 1 -- 172.21.15.107:0/4269451064 learned_addr learned my addr 172.21.15.107:0/4269451064 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:59.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.281+0000 7f5923400640 1 --2- 172.21.15.107:0/4269451064 >> v2:172.21.15.157:3300/0 conn(0x7f592406df00 0x7f59240ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.281+0000 7f5922a00640 1 -- 172.21.15.107:0/4269451064 >> v2:172.21.15.157:3300/0 conn(0x7f592406df00 msgr2=0x7f59240ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:59.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.281+0000 7f5922a00640 1 --2- 172.21.15.107:0/4269451064 >> v2:172.21.15.157:3300/0 conn(0x7f592406df00 0x7f59240ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.281+0000 7f5922a00640 1 -- 172.21.15.107:0/4269451064 >> v1:172.21.15.157:6789/0 conn(0x7f5924155df0 legacy=0x7f592406d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.281+0000 7f5922a00640 1 -- 172.21.15.107:0/4269451064 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592406e8c0 con 0x7f5924155a20 2024-08-17T02:27:59.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.281+0000 7f5921600640 1 -- 172.21.15.107:0/4269451064 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1523336822 0 0) 0x7f5924156670 con 0x7f5924155df0 2024-08-17T02:27:59.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.282+0000 7f5922a00640 1 --2- 172.21.15.107:0/4269451064 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5924155a20 0x7f59240adf10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f591400bbc0 tx=0x7f591400b460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efc0270e218b3c1b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.283+0000 7f5921600640 1 -- 172.21.15.107:0/4269451064 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5914031610 con 0x7f5924155a20 2024-08-17T02:27:59.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.283+0000 7f5921600640 1 -- 172.21.15.107:0/4269451064 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5914031770 con 0x7f5924155a20 2024-08-17T02:27:59.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.283+0000 7f5921600640 1 -- 172.21.15.107:0/4269451064 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5914031b10 con 0x7f5924155a20 2024-08-17T02:27:59.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.283+0000 7f5929e00640 1 -- 172.21.15.107:0/4269451064 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5924155a20 msgr2=0x7f59240adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.283+0000 7f5929e00640 1 --2- 172.21.15.107:0/4269451064 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5924155a20 0x7f59240adf10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f591400bbc0 tx=0x7f591400b460 comp rx=0 tx=0).stop 2024-08-17T02:27:59.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.283+0000 7f5929e00640 1 -- 172.21.15.107:0/4269451064 shutdown_connections 2024-08-17T02:27:59.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.283+0000 7f5929e00640 1 --2- 172.21.15.107:0/4269451064 >> v2:172.21.15.157:3300/0 conn(0x7f592406df00 0x7f59240ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.283+0000 7f5929e00640 1 --2- 172.21.15.107:0/4269451064 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5924155a20 0x7f59240adf10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.283+0000 7f5929e00640 1 -- 172.21.15.107:0/4269451064 >> 172.21.15.107:0/4269451064 conn(0x7f59240cb9b0 msgr2=0x7f59240cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:59.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.283+0000 7f5929e00640 1 -- 172.21.15.107:0/4269451064 shutdown_connections 2024-08-17T02:27:59.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.283+0000 7f5929e00640 1 -- 172.21.15.107:0/4269451064 wait complete. 2024-08-17T02:27:59.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.285+0000 7f5929e00640 1 Processor -- start 2024-08-17T02:27:59.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.285+0000 7f5929e00640 1 -- start start 2024-08-17T02:27:59.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.286+0000 7f5929e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f592406df00 0x7f592414f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.286+0000 7f5929e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5924155a20 0x7f59240abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.286+0000 7f5929e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5924155df0 0x7f59241523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.286+0000 7f5929e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592414fba0 con 0x7f5924155df0 2024-08-17T02:27:59.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.286+0000 7f5929e00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592414f6e0 con 0x7f592406df00 2024-08-17T02:27:59.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.286+0000 7f5929e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59240c1690 con 0x7f5924155a20 2024-08-17T02:27:59.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.286+0000 7f5923400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5924155df0 0x7f59241523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.286+0000 7f5923400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5924155df0 0x7f59241523b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47044/0 (socket says 172.21.15.107:47044) 2024-08-17T02:27:59.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.286+0000 7f5923400640 1 -- 172.21.15.107:0/3808104574 learned_addr learned my addr 172.21.15.107:0/3808104574 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:59.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.286+0000 7f5922000640 1 --2- 172.21.15.107:0/3808104574 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5924155a20 0x7f59240abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.286+0000 7f5922a00640 1 --2- 172.21.15.107:0/3808104574 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f592406df00 0x7f592414f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.286+0000 7f5923400640 1 -- 172.21.15.107:0/3808104574 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5924155a20 msgr2=0x7f59240abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.286+0000 7f5923400640 1 --2- 172.21.15.107:0/3808104574 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5924155a20 0x7f59240abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.287+0000 7f5923400640 1 -- 172.21.15.107:0/3808104574 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f592406df00 msgr2=0x7f592414f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.287+0000 7f5923400640 1 --2- 172.21.15.107:0/3808104574 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f592406df00 0x7f592414f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.287+0000 7f5923400640 1 -- 172.21.15.107:0/3808104574 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f591400b700 con 0x7f5924155df0 2024-08-17T02:27:59.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.287+0000 7f5923400640 1 --2- 172.21.15.107:0/3808104574 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5924155df0 0x7f59241523b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f591c009ec0 tx=0x7f591c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.287+0000 7f591a000640 1 -- 172.21.15.107:0/3808104574 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591c00ce10 con 0x7f5924155df0 2024-08-17T02:27:59.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.287+0000 7f591a000640 1 -- 172.21.15.107:0/3808104574 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591c00f040 con 0x7f5924155df0 2024-08-17T02:27:59.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.287+0000 7f5929e00640 1 -- 172.21.15.107:0/3808104574 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59240c1970 con 0x7f5924155df0 2024-08-17T02:27:59.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.287+0000 7f591a000640 1 -- 172.21.15.107:0/3808104574 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591c0146d0 con 0x7f5924155df0 2024-08-17T02:27:59.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.287+0000 7f5929e00640 1 -- 172.21.15.107:0/3808104574 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59240c1f30 con 0x7f5924155df0 2024-08-17T02:27:59.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.288+0000 7f5929e00640 1 -- 172.21.15.107:0/3808104574 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59240c2450 con 0x7f5924155df0 2024-08-17T02:27:59.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.289+0000 7f591a000640 1 -- 172.21.15.107:0/3808104574 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f591c014a40 con 0x7f5924155df0 2024-08-17T02:27:59.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.290+0000 7f591a000640 1 --2- 172.21.15.107:0/3808104574 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f5904065150 0x7f5904067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.290+0000 7f591a000640 1 -- 172.21.15.107:0/3808104574 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f591c082ec0 con 0x7f5924155df0 2024-08-17T02:27:59.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.290+0000 7f5922a00640 1 --2- 172.21.15.107:0/3808104574 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f5904065150 0x7f5904067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.291+0000 7f5922a00640 1 --2- 172.21.15.107:0/3808104574 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f5904065150 0x7f5904067600 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5914037000 tx=0x7f591403a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.294+0000 7f591a000640 1 -- 172.21.15.107:0/3808104574 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f59240c2450 con 0x7f5924155df0 2024-08-17T02:27:59.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.465+0000 7f5929e00640 1 -- 172.21.15.107:0/3808104574 --> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f59240c2450 con 0x7f5904065150 2024-08-17T02:27:59.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.465+0000 7f591a000640 1 -- 172.21.15.107:0/3808104574 <== mgr.4110 v2:172.21.15.107:6832/37039 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f59240c2450 con 0x7f5904065150 2024-08-17T02:27:59.467 INFO:teuthology.orchestra.run.smithi107.stderr:instructed osd(s) 0 to deep-scrub 2024-08-17T02:27:59.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.467+0000 7f5929e00640 1 -- 172.21.15.107:0/3808104574 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f5904065150 msgr2=0x7f5904067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.467+0000 7f5929e00640 1 --2- 172.21.15.107:0/3808104574 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f5904065150 0x7f5904067600 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5914037000 tx=0x7f591403a000 comp rx=0 tx=0).stop 2024-08-17T02:27:59.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.467+0000 7f5929e00640 1 -- 172.21.15.107:0/3808104574 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5924155df0 msgr2=0x7f59241523b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.467+0000 7f5929e00640 1 --2- 172.21.15.107:0/3808104574 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5924155df0 0x7f59241523b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f591c009ec0 tx=0x7f591c00b040 comp rx=0 tx=0).stop 2024-08-17T02:27:59.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.467+0000 7f5929e00640 1 -- 172.21.15.107:0/3808104574 shutdown_connections 2024-08-17T02:27:59.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.467+0000 7f5929e00640 1 --2- 172.21.15.107:0/3808104574 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f5904065150 0x7f5904067600 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.467+0000 7f5929e00640 1 --2- 172.21.15.107:0/3808104574 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5924155df0 0x7f59241523b0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.467+0000 7f5929e00640 1 --2- 172.21.15.107:0/3808104574 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5924155a20 0x7f59240abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.467+0000 7f5929e00640 1 --2- 172.21.15.107:0/3808104574 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f592406df00 0x7f592414f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.467+0000 7f5929e00640 1 -- 172.21.15.107:0/3808104574 >> 172.21.15.107:0/3808104574 conn(0x7f59240cb9b0 msgr2=0x7f5924154ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:59.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.467+0000 7f5929e00640 1 -- 172.21.15.107:0/3808104574 shutdown_connections 2024-08-17T02:27:59.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.467+0000 7f5929e00640 1 -- 172.21.15.107:0/3808104574 wait complete. 2024-08-17T02:27:59.484 INFO:tasks.ceph:Scrubbing osd.1 2024-08-17T02:27:59.484 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:27:59.636 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.635+0000 7f6cb4a00640 1 Processor -- start 2024-08-17T02:27:59.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.635+0000 7f6cb4a00640 1 -- start start 2024-08-17T02:27:59.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.636+0000 7f6cb4a00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6cb0156890 0x7f6cb006dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.636+0000 7f6cb4a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cb00ae9b0 con 0x7f6cb00c8840 2024-08-17T02:27:59.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.636+0000 7f6cb4a00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cb00ab320 con 0x7f6cb0156c60 2024-08-17T02:27:59.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.636+0000 7f6cb4a00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cb00aa730 con 0x7f6cb0156890 2024-08-17T02:27:59.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.637+0000 7f6cae800640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f6cb00c8840 0x7f6cb00ca3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:46958/0 (socket says 172.21.15.107:46958) 2024-08-17T02:27:59.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.637+0000 7f6cae800640 1 -- 172.21.15.107:0/3412669193 learned_addr learned my addr 172.21.15.107:0/3412669193 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:27:59.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.637+0000 7f6cade00640 1 --2- 172.21.15.107:0/3412669193 >> v2:172.21.15.157:3300/0 conn(0x7f6cb0156890 0x7f6cb006dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.637+0000 7f6caca00640 1 -- 172.21.15.107:0/3412669193 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3240755974 0 0) 0x7f6cb00ae9b0 con 0x7f6cb00c8840 2024-08-17T02:27:59.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.637+0000 7f6caca00640 1 -- 172.21.15.107:0/3412669193 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c940034e0 con 0x7f6cb00c8840 2024-08-17T02:27:59.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.637+0000 7f6caca00640 1 -- 172.21.15.107:0/3412669193 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2486988528 0 0) 0x7f6c940034e0 con 0x7f6cb00c8840 2024-08-17T02:27:59.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.637+0000 7f6caca00640 1 -- 172.21.15.107:0/3412669193 >> v2:172.21.15.157:3300/0 conn(0x7f6cb0156890 msgr2=0x7f6cb006dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:59.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.637+0000 7f6caca00640 1 --2- 172.21.15.107:0/3412669193 >> v2:172.21.15.157:3300/0 conn(0x7f6cb0156890 0x7f6cb006dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.637+0000 7f6caca00640 1 -- 172.21.15.107:0/3412669193 >> v1:172.21.15.157:6789/0 conn(0x7f6cb0156c60 legacy=0x7f6cb00c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.637+0000 7f6caca00640 1 -- 172.21.15.107:0/3412669193 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb00aa9f0 con 0x7f6cb00c8840 2024-08-17T02:27:59.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.637+0000 7f6caca00640 1 -- 172.21.15.107:0/3412669193 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 537989081 0 0) 0x7f6ca80017f0 con 0x7f6cb00c8840 2024-08-17T02:27:59.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.637+0000 7f6caca00640 1 -- 172.21.15.107:0/3412669193 >> v1:172.21.15.107:6789/0 conn(0x7f6cb00c8840 legacy=0x7f6cb00ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.637+0000 7f6caca00640 1 --2- 172.21.15.107:0/3412669193 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c940039d0 0x7f6c94003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.637+0000 7f6caca00640 1 --2- 172.21.15.107:0/3412669193 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c94004780 0x7f6c94004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.637+0000 7f6caca00640 1 --2- 172.21.15.107:0/3412669193 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c94005130 0x7f6c9400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.637+0000 7f6caca00640 1 -- 172.21.15.107:0/3412669193 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb00aa730 con 0x7f6c94005130 2024-08-17T02:27:59.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.637+0000 7f6caca00640 1 -- 172.21.15.107:0/3412669193 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9400c0a0 con 0x7f6c94004780 2024-08-17T02:27:59.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.637+0000 7f6caca00640 1 -- 172.21.15.107:0/3412669193 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9400c260 con 0x7f6c940039d0 2024-08-17T02:27:59.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.638+0000 7f6cae800640 1 --2- 172.21.15.107:0/3412669193 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c94005130 0x7f6c9400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.638+0000 7f6cade00640 1 --2- 172.21.15.107:0/3412669193 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c940039d0 0x7f6c94003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.638+0000 7f6cad400640 1 --2- 172.21.15.107:0/3412669193 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c94004780 0x7f6c94004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.638+0000 7f6cae800640 1 -- 172.21.15.107:0/3412669193 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c940039d0 msgr2=0x7f6c94003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:59.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.638+0000 7f6cae800640 1 --2- 172.21.15.107:0/3412669193 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c940039d0 0x7f6c94003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.638+0000 7f6cae800640 1 -- 172.21.15.107:0/3412669193 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c94004780 msgr2=0x7f6c94004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:59.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.638+0000 7f6cae800640 1 --2- 172.21.15.107:0/3412669193 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c94004780 0x7f6c94004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.638+0000 7f6cae800640 1 -- 172.21.15.107:0/3412669193 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c940034e0 con 0x7f6c94005130 2024-08-17T02:27:59.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.638+0000 7f6cad400640 1 --2- 172.21.15.107:0/3412669193 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c94004780 0x7f6c94004bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:59.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.639+0000 7f6cae800640 1 -- 172.21.15.107:0/3412669193 reap_dead start 2024-08-17T02:27:59.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.639+0000 7f6cae800640 1 --2- 172.21.15.107:0/3412669193 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c94005130 0x7f6c9400b9d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f6ca800a850 tx=0x7f6ca8002120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53ab62ee632c00dd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.639+0000 7f6caca00640 1 -- 172.21.15.107:0/3412669193 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca80070f0 con 0x7f6c94005130 2024-08-17T02:27:59.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.639+0000 7f6caca00640 1 -- 172.21.15.107:0/3412669193 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca8007290 con 0x7f6c94005130 2024-08-17T02:27:59.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.639+0000 7f6caca00640 1 -- 172.21.15.107:0/3412669193 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca8007650 con 0x7f6c94005130 2024-08-17T02:27:59.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.640+0000 7f6cb4a00640 1 -- 172.21.15.107:0/3412669193 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c94005130 msgr2=0x7f6c9400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.640+0000 7f6cb4a00640 1 --2- 172.21.15.107:0/3412669193 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c94005130 0x7f6c9400b9d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f6ca800a850 tx=0x7f6ca8002120 comp rx=0 tx=0).stop 2024-08-17T02:27:59.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.640+0000 7f6cb4a00640 1 -- 172.21.15.107:0/3412669193 shutdown_connections 2024-08-17T02:27:59.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.640+0000 7f6cb4a00640 1 --2- 172.21.15.107:0/3412669193 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c94005130 0x7f6c9400b9d0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.640+0000 7f6cb4a00640 1 -- 172.21.15.107:0/3412669193 >> 172.21.15.107:0/3412669193 conn(0x7f6cb0067750 msgr2=0x7f6cb006c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:59.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.640+0000 7f6cb4a00640 1 -- 172.21.15.107:0/3412669193 shutdown_connections 2024-08-17T02:27:59.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.640+0000 7f6cb4a00640 1 -- 172.21.15.107:0/3412669193 wait complete. 2024-08-17T02:27:59.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.641+0000 7f6cb4a00640 1 Processor -- start 2024-08-17T02:27:59.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.641+0000 7f6cb4a00640 1 -- start start 2024-08-17T02:27:59.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.642+0000 7f6cb4a00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c94005130 0x7f6cb015a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.642+0000 7f6cb4a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cb00c1500 0x7f6cb0168790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.642+0000 7f6cb4a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cb0168cd0 0x7f6cb00c1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.642+0000 7f6cb4a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb01572f0 con 0x7f6cb0168cd0 2024-08-17T02:27:59.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.642+0000 7f6cb4a00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb01575d0 con 0x7f6cb00c1500 2024-08-17T02:27:59.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.642+0000 7f6cb4a00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb01578b0 con 0x7f6c94005130 2024-08-17T02:27:59.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.643+0000 7f6cae800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cb0168cd0 0x7f6cb00c1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.643+0000 7f6cae800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cb0168cd0 0x7f6cb00c1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47066/0 (socket says 172.21.15.107:47066) 2024-08-17T02:27:59.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.643+0000 7f6cae800640 1 -- 172.21.15.107:0/1836126590 learned_addr learned my addr 172.21.15.107:0/1836126590 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:59.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.643+0000 7f6cade00640 1 --2- 172.21.15.107:0/1836126590 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c94005130 0x7f6cb015a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.643+0000 7f6cad400640 1 --2- 172.21.15.107:0/1836126590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cb00c1500 0x7f6cb0168790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.643+0000 7f6cae800640 1 -- 172.21.15.107:0/1836126590 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c94005130 msgr2=0x7f6cb015a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.643+0000 7f6cae800640 1 --2- 172.21.15.107:0/1836126590 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6c94005130 0x7f6cb015a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.643+0000 7f6cae800640 1 -- 172.21.15.107:0/1836126590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cb00c1500 msgr2=0x7f6cb0168790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.643+0000 7f6cae800640 1 --2- 172.21.15.107:0/1836126590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cb00c1500 0x7f6cb0168790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.643+0000 7f6cae800640 1 -- 172.21.15.107:0/1836126590 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb0157b90 con 0x7f6cb0168cd0 2024-08-17T02:27:59.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.643+0000 7f6cad400640 1 --2- 172.21.15.107:0/1836126590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cb00c1500 0x7f6cb0168790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:59.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.643+0000 7f6cae800640 1 --2- 172.21.15.107:0/1836126590 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cb0168cd0 0x7f6cb00c1bf0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6ca800a300 tx=0x7f6ca8034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.644+0000 7f6ca5600640 1 -- 172.21.15.107:0/1836126590 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca803e070 con 0x7f6cb0168cd0 2024-08-17T02:27:59.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.644+0000 7f6ca5600640 1 -- 172.21.15.107:0/1836126590 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca8007070 con 0x7f6cb0168cd0 2024-08-17T02:27:59.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.644+0000 7f6cb4a00640 1 -- 172.21.15.107:0/1836126590 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb015a630 con 0x7f6cb0168cd0 2024-08-17T02:27:59.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.644+0000 7f6ca5600640 1 -- 172.21.15.107:0/1836126590 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca8007400 con 0x7f6cb0168cd0 2024-08-17T02:27:59.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.644+0000 7f6cb4a00640 1 -- 172.21.15.107:0/1836126590 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb00c2350 con 0x7f6cb0168cd0 2024-08-17T02:27:59.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.645+0000 7f6cb4a00640 1 -- 172.21.15.107:0/1836126590 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6cb0157460 con 0x7f6cb0168cd0 2024-08-17T02:27:59.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.646+0000 7f6ca5600640 1 -- 172.21.15.107:0/1836126590 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6ca8041070 con 0x7f6cb0168cd0 2024-08-17T02:27:59.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.646+0000 7f6ca5600640 1 --2- 172.21.15.107:0/1836126590 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6c90065150 0x7f6c90067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.646+0000 7f6ca5600640 1 -- 172.21.15.107:0/1836126590 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f6ca80a27f0 con 0x7f6cb0168cd0 2024-08-17T02:27:59.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.647+0000 7f6cade00640 1 --2- 172.21.15.107:0/1836126590 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6c90065150 0x7f6c90067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.647+0000 7f6ca5600640 1 --2- 172.21.15.107:0/1836126590 >> [v2:172.21.15.107:6822/37305,v1:172.21.15.107:6824/37305] conn(0x7f6c9006b040 0x7f6c9006d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.647+0000 7f6ca5600640 1 -- 172.21.15.107:0/1836126590 --> [v2:172.21.15.107:6822/37305,v1:172.21.15.107:6824/37305] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6c9006db00 con 0x7f6c9006b040 2024-08-17T02:27:59.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.647+0000 7f6ca5600640 1 -- 172.21.15.107:0/1836126590 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ca80a7240 con 0x7f6cb0168cd0 2024-08-17T02:27:59.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.647+0000 7f6cad400640 1 --2- 172.21.15.107:0/1836126590 >> [v2:172.21.15.107:6822/37305,v1:172.21.15.107:6824/37305] conn(0x7f6c9006b040 0x7f6c9006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.647+0000 7f6cade00640 1 --2- 172.21.15.107:0/1836126590 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6c90065150 0x7f6c90067600 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0006e70 tx=0x7f6ca00090f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.647+0000 7f6cad400640 1 --2- 172.21.15.107:0/1836126590 >> [v2:172.21.15.107:6822/37305,v1:172.21.15.107:6824/37305] conn(0x7f6c9006b040 0x7f6c9006d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.648+0000 7f6ca5600640 1 -- 172.21.15.107:0/1836126590 <== osd.1 v2:172.21.15.107:6822/37305 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f6c9006db00 con 0x7f6c9006b040 2024-08-17T02:27:59.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.661+0000 7f6cb4a00640 1 -- 172.21.15.107:0/1836126590 --> [v2:172.21.15.107:6822/37305,v1:172.21.15.107:6824/37305] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6cb00710c0 con 0x7f6c9006b040 2024-08-17T02:27:59.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.661+0000 7f6ca5600640 1 -- 172.21.15.107:0/1836126590 <== osd.1 v2:172.21.15.107:6822/37305 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f6cb00710c0 con 0x7f6c9006b040 2024-08-17T02:27:59.663 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-08-17T02:27:59.663 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:27:59.663 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-08-17T02:27:59.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.661+0000 7f6cb4a00640 1 -- 172.21.15.107:0/1836126590 >> [v2:172.21.15.107:6822/37305,v1:172.21.15.107:6824/37305] conn(0x7f6c9006b040 msgr2=0x7f6c9006d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.661+0000 7f6cb4a00640 1 --2- 172.21.15.107:0/1836126590 >> [v2:172.21.15.107:6822/37305,v1:172.21.15.107:6824/37305] conn(0x7f6c9006b040 0x7f6c9006d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.662+0000 7f6cb4a00640 1 -- 172.21.15.107:0/1836126590 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6c90065150 msgr2=0x7f6c90067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.662+0000 7f6cb4a00640 1 --2- 172.21.15.107:0/1836126590 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f6c90065150 0x7f6c90067600 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0006e70 tx=0x7f6ca00090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.662+0000 7f6cb4a00640 1 -- 172.21.15.107:0/1836126590 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cb0168cd0 msgr2=0x7f6cb00c1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.662+0000 7f6cb4a00640 1 --2- 172.21.15.107:0/1836126590 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cb0168cd0 0x7f6cb00c1bf0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6ca800a300 tx=0x7f6ca8034000 comp rx=0 tx=0).stop 2024-08-17T02:27:59.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.662+0000 7f6cae800640 1 -- 172.21.15.107:0/1836126590 reap_dead start 2024-08-17T02:27:59.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.662+0000 7f6cb4a00640 1 -- 172.21.15.107:0/1836126590 shutdown_connections 2024-08-17T02:27:59.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.662+0000 7f6cb4a00640 1 -- 172.21.15.107:0/1836126590 >> 172.21.15.107:0/1836126590 conn(0x7f6cb0067750 msgr2=0x7f6cb0155b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:59.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.662+0000 7f6cb4a00640 1 -- 172.21.15.107:0/1836126590 shutdown_connections 2024-08-17T02:27:59.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.662+0000 7f6cb4a00640 1 -- 172.21.15.107:0/1836126590 wait complete. 2024-08-17T02:27:59.676 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-08-17T02:27:59.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.825+0000 7f0a41c00640 1 Processor -- start 2024-08-17T02:27:59.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.825+0000 7f0a41c00640 1 -- start start 2024-08-17T02:27:59.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.826+0000 7f0a41c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a3c1401b0 0x7f0a3c0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.826+0000 7f0a41c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0a3c140580 0x7f0a3c0b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.826+0000 7f0a41c00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a3c0b16d0 con 0x7f0a3c0b1270 2024-08-17T02:27:59.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.826+0000 7f0a41c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a3c0cb450 con 0x7f0a3c140580 2024-08-17T02:27:59.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.826+0000 7f0a41c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c0caa80 con 0x7f0a3c1401b0 2024-08-17T02:27:59.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.827+0000 7f0a3a000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0a3c140580 0x7f0a3c0b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.827+0000 7f0a3a000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0a3c140580 0x7f0a3c0b0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47080/0 (socket says 172.21.15.107:47080) 2024-08-17T02:27:59.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.827+0000 7f0a3a000640 1 -- 172.21.15.107:0/2145660777 learned_addr learned my addr 172.21.15.107:0/2145660777 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:59.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.827+0000 7f0a3aa00640 1 --2- 172.21.15.107:0/2145660777 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a3c1401b0 0x7f0a3c0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.827+0000 7f0a3a000640 1 -- 172.21.15.107:0/2145660777 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a3c1401b0 msgr2=0x7f0a3c0caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:59.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.827+0000 7f0a3a000640 1 --2- 172.21.15.107:0/2145660777 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a3c1401b0 0x7f0a3c0caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.827+0000 7f0a3a000640 1 -- 172.21.15.107:0/2145660777 >> v1:172.21.15.157:6789/0 conn(0x7f0a3c0b1270 legacy=0x7f0a3c0c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.827+0000 7f0a3a000640 1 -- 172.21.15.107:0/2145660777 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a3c0c9e70 con 0x7f0a3c140580 2024-08-17T02:27:59.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.828+0000 7f0a3a000640 1 --2- 172.21.15.107:0/2145660777 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a3c140580 0x7f0a3c0b0d30 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0a28009910 tx=0x7f0a280091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b5c6d7294d2263 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.828+0000 7f0a39600640 1 -- 172.21.15.107:0/2145660777 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2802adb0 con 0x7f0a3c140580 2024-08-17T02:27:59.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.828+0000 7f0a39600640 1 -- 172.21.15.107:0/2145660777 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a28032440 con 0x7f0a3c140580 2024-08-17T02:27:59.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.828+0000 7f0a39600640 1 -- 172.21.15.107:0/2145660777 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a28032820 con 0x7f0a3c140580 2024-08-17T02:27:59.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.829+0000 7f0a41c00640 1 -- 172.21.15.107:0/2145660777 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a3c140580 msgr2=0x7f0a3c0b0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.829+0000 7f0a41c00640 1 --2- 172.21.15.107:0/2145660777 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a3c140580 0x7f0a3c0b0d30 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0a28009910 tx=0x7f0a280091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.829+0000 7f0a41c00640 1 -- 172.21.15.107:0/2145660777 shutdown_connections 2024-08-17T02:27:59.832 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.829+0000 7f0a41c00640 1 --2- 172.21.15.107:0/2145660777 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a3c140580 0x7f0a3c0b0d30 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.832 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.829+0000 7f0a41c00640 1 --2- 172.21.15.107:0/2145660777 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a3c1401b0 0x7f0a3c0caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.832 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.829+0000 7f0a41c00640 1 -- 172.21.15.107:0/2145660777 >> 172.21.15.107:0/2145660777 conn(0x7f0a3c0cb9b0 msgr2=0x7f0a3c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:59.832 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.829+0000 7f0a41c00640 1 -- 172.21.15.107:0/2145660777 shutdown_connections 2024-08-17T02:27:59.832 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.829+0000 7f0a41c00640 1 -- 172.21.15.107:0/2145660777 wait complete. 2024-08-17T02:27:59.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.830+0000 7f0a41c00640 1 Processor -- start 2024-08-17T02:27:59.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.831+0000 7f0a41c00640 1 -- start start 2024-08-17T02:27:59.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.831+0000 7f0a41c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a3c0b1270 0x7f0a3c0b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.831+0000 7f0a41c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a3c1401b0 0x7f0a3c0aa970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.831+0000 7f0a41c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a3c140580 0x7f0a3c156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.831+0000 7f0a41c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c169c90 con 0x7f0a3c140580 2024-08-17T02:27:59.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.832+0000 7f0a41c00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c169110 con 0x7f0a3c1401b0 2024-08-17T02:27:59.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.832+0000 7f0a41c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c1693f0 con 0x7f0a3c0b1270 2024-08-17T02:27:59.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.832+0000 7f0a3b400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a3c140580 0x7f0a3c156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.832+0000 7f0a3b400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a3c140580 0x7f0a3c156520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47088/0 (socket says 172.21.15.107:47088) 2024-08-17T02:27:59.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.832+0000 7f0a3b400640 1 -- 172.21.15.107:0/413816688 learned_addr learned my addr 172.21.15.107:0/413816688 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:27:59.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.832+0000 7f0a3aa00640 1 --2- 172.21.15.107:0/413816688 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a3c0b1270 0x7f0a3c0b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.832+0000 7f0a3a000640 1 --2- 172.21.15.107:0/413816688 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a3c1401b0 0x7f0a3c0aa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.832+0000 7f0a3b400640 1 -- 172.21.15.107:0/413816688 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a3c0b1270 msgr2=0x7f0a3c0b06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.832+0000 7f0a3b400640 1 --2- 172.21.15.107:0/413816688 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a3c0b1270 0x7f0a3c0b06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.832+0000 7f0a3b400640 1 -- 172.21.15.107:0/413816688 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a3c1401b0 msgr2=0x7f0a3c0aa970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.832+0000 7f0a3b400640 1 --2- 172.21.15.107:0/413816688 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a3c1401b0 0x7f0a3c0aa970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.832+0000 7f0a3b400640 1 -- 172.21.15.107:0/413816688 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a28009450 con 0x7f0a3c140580 2024-08-17T02:27:59.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.833+0000 7f0a3b400640 1 --2- 172.21.15.107:0/413816688 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a3c140580 0x7f0a3c156520 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0a3400c7c0 tx=0x7f0a340015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.833+0000 7f0a32000640 1 -- 172.21.15.107:0/413816688 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3400a640 con 0x7f0a3c140580 2024-08-17T02:27:59.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.833+0000 7f0a32000640 1 -- 172.21.15.107:0/413816688 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3400a7c0 con 0x7f0a3c140580 2024-08-17T02:27:59.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.833+0000 7f0a32000640 1 -- 172.21.15.107:0/413816688 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3400ab80 con 0x7f0a3c140580 2024-08-17T02:27:59.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.833+0000 7f0a41c00640 1 -- 172.21.15.107:0/413816688 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a3c1696d0 con 0x7f0a3c140580 2024-08-17T02:27:59.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.833+0000 7f0a41c00640 1 -- 172.21.15.107:0/413816688 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a3c156a60 con 0x7f0a3c140580 2024-08-17T02:27:59.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.834+0000 7f0a41c00640 1 -- 172.21.15.107:0/413816688 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a3c064db0 con 0x7f0a3c140580 2024-08-17T02:27:59.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.835+0000 7f0a32000640 1 -- 172.21.15.107:0/413816688 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0a34003030 con 0x7f0a3c140580 2024-08-17T02:27:59.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.836+0000 7f0a32000640 1 --2- 172.21.15.107:0/413816688 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f0a1c065150 0x7f0a1c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.836+0000 7f0a32000640 1 -- 172.21.15.107:0/413816688 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f0a34081e90 con 0x7f0a3c140580 2024-08-17T02:27:59.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.836+0000 7f0a3aa00640 1 --2- 172.21.15.107:0/413816688 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f0a1c065150 0x7f0a1c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.837+0000 7f0a3aa00640 1 --2- 172.21.15.107:0/413816688 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f0a1c065150 0x7f0a1c067600 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c009c80 tx=0x7f0a2c0090f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:27:59.840+0000 7f0a32000640 1 -- 172.21.15.107:0/413816688 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0a34050200 con 0x7f0a3c140580 2024-08-17T02:28:00.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.012+0000 7f0a41c00640 1 -- 172.21.15.107:0/413816688 --> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a3c0b16d0 con 0x7f0a1c065150 2024-08-17T02:28:00.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.013+0000 7f0a32000640 1 -- 172.21.15.107:0/413816688 <== mgr.4110 v2:172.21.15.107:6832/37039 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0a3c0b16d0 con 0x7f0a1c065150 2024-08-17T02:28:00.014 INFO:teuthology.orchestra.run.smithi107.stderr:instructed osd(s) 1 to deep-scrub 2024-08-17T02:28:00.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.015+0000 7f0a41c00640 1 -- 172.21.15.107:0/413816688 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f0a1c065150 msgr2=0x7f0a1c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.015+0000 7f0a41c00640 1 --2- 172.21.15.107:0/413816688 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f0a1c065150 0x7f0a1c067600 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c009c80 tx=0x7f0a2c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.015+0000 7f0a41c00640 1 -- 172.21.15.107:0/413816688 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a3c140580 msgr2=0x7f0a3c156520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.015+0000 7f0a41c00640 1 --2- 172.21.15.107:0/413816688 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a3c140580 0x7f0a3c156520 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0a3400c7c0 tx=0x7f0a340015f0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.015+0000 7f0a41c00640 1 -- 172.21.15.107:0/413816688 shutdown_connections 2024-08-17T02:28:00.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.015+0000 7f0a41c00640 1 --2- 172.21.15.107:0/413816688 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f0a1c065150 0x7f0a1c067600 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.015+0000 7f0a41c00640 1 --2- 172.21.15.107:0/413816688 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a3c140580 0x7f0a3c156520 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.015+0000 7f0a41c00640 1 --2- 172.21.15.107:0/413816688 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a3c1401b0 0x7f0a3c0aa970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.015+0000 7f0a41c00640 1 --2- 172.21.15.107:0/413816688 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a3c0b1270 0x7f0a3c0b06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.015+0000 7f0a41c00640 1 -- 172.21.15.107:0/413816688 >> 172.21.15.107:0/413816688 conn(0x7f0a3c0cb9b0 msgr2=0x7f0a3c13f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:00.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.015+0000 7f0a41c00640 1 -- 172.21.15.107:0/413816688 shutdown_connections 2024-08-17T02:28:00.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.015+0000 7f0a41c00640 1 -- 172.21.15.107:0/413816688 wait complete. 2024-08-17T02:28:00.030 INFO:tasks.ceph:Scrubbing osd.2 2024-08-17T02:28:00.031 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:28:00.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.180+0000 7f360e600640 1 Processor -- start 2024-08-17T02:28:00.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.180+0000 7f360e600640 1 -- start start 2024-08-17T02:28:00.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.181+0000 7f360e600640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3608156c60 0x7f36081617d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.181+0000 7f360e600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36080ae9b0 con 0x7f3608156890 2024-08-17T02:28:00.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.181+0000 7f360e600640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36080ab320 con 0x7f360806e5f0 2024-08-17T02:28:00.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.181+0000 7f360e600640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36080aa730 con 0x7f3608156c60 2024-08-17T02:28:00.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.182+0000 7f3607400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f3608156890 0x7f360806dee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:46966/0 (socket says 172.21.15.107:46966) 2024-08-17T02:28:00.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.182+0000 7f3607400640 1 -- 172.21.15.107:0/947844127 learned_addr learned my addr 172.21.15.107:0/947844127 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:28:00.185 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.182+0000 7f3606000640 1 -- 172.21.15.107:0/947844127 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2680022131 0 0) 0x7f36080ae9b0 con 0x7f3608156890 2024-08-17T02:28:00.185 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.182+0000 7f3607e00640 1 --2- 172.21.15.107:0/947844127 >> v2:172.21.15.157:3300/0 conn(0x7f3608156c60 0x7f36081617d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.185 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.182+0000 7f3606000640 1 -- 172.21.15.107:0/947844127 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35ec0034e0 con 0x7f3608156890 2024-08-17T02:28:00.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.182+0000 7f3606000640 1 -- 172.21.15.107:0/947844127 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4207315879 0 0) 0x7f35ec0034e0 con 0x7f3608156890 2024-08-17T02:28:00.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.182+0000 7f3606000640 1 -- 172.21.15.107:0/947844127 >> v2:172.21.15.157:3300/0 conn(0x7f3608156c60 msgr2=0x7f36081617d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:00.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.182+0000 7f3606000640 1 --2- 172.21.15.107:0/947844127 >> v2:172.21.15.157:3300/0 conn(0x7f3608156c60 0x7f36081617d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.182+0000 7f3606000640 1 -- 172.21.15.107:0/947844127 >> v1:172.21.15.157:6789/0 conn(0x7f360806e5f0 legacy=0x7f36080c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.182+0000 7f3606000640 1 -- 172.21.15.107:0/947844127 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36080aa9f0 con 0x7f3608156890 2024-08-17T02:28:00.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.182+0000 7f3606000640 1 -- 172.21.15.107:0/947844127 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 537989081 0 0) 0x7f35f8001470 con 0x7f3608156890 2024-08-17T02:28:00.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.182+0000 7f3606000640 1 -- 172.21.15.107:0/947844127 >> v1:172.21.15.107:6789/0 conn(0x7f3608156890 legacy=0x7f360806dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.182+0000 7f3606000640 1 --2- 172.21.15.107:0/947844127 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f35ec0039d0 0x7f35ec003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.182+0000 7f3606000640 1 --2- 172.21.15.107:0/947844127 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35ec004780 0x7f35ec004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.182+0000 7f3606000640 1 --2- 172.21.15.107:0/947844127 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f35ec005130 0x7f35ec00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.183+0000 7f3606000640 1 -- 172.21.15.107:0/947844127 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36080aa730 con 0x7f35ec004780 2024-08-17T02:28:00.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.183+0000 7f3606000640 1 -- 172.21.15.107:0/947844127 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec00c0d0 con 0x7f35ec0039d0 2024-08-17T02:28:00.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.183+0000 7f3606000640 1 -- 172.21.15.107:0/947844127 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec00c290 con 0x7f35ec005130 2024-08-17T02:28:00.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.183+0000 7f3606a00640 1 --2- 172.21.15.107:0/947844127 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35ec004780 0x7f35ec004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.183+0000 7f3607400640 1 --2- 172.21.15.107:0/947844127 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f35ec0039d0 0x7f35ec003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.183+0000 7f3607e00640 1 --2- 172.21.15.107:0/947844127 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f35ec005130 0x7f35ec00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.183+0000 7f3606a00640 1 -- 172.21.15.107:0/947844127 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f35ec005130 msgr2=0x7f35ec00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:00.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.183+0000 7f3606a00640 1 --2- 172.21.15.107:0/947844127 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f35ec005130 0x7f35ec00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.183+0000 7f3606a00640 1 -- 172.21.15.107:0/947844127 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f35ec0039d0 msgr2=0x7f35ec003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:00.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.183+0000 7f3606a00640 1 --2- 172.21.15.107:0/947844127 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f35ec0039d0 0x7f35ec003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.183+0000 7f3606a00640 1 -- 172.21.15.107:0/947844127 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ec0034e0 con 0x7f35ec004780 2024-08-17T02:28:00.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.183+0000 7f3607e00640 1 -- 172.21.15.107:0/947844127 reap_dead start 2024-08-17T02:28:00.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.184+0000 7f3606a00640 1 --2- 172.21.15.107:0/947844127 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35ec004780 0x7f35ec004bf0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f360806e9f0 tx=0x7f35f4007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67a4cc30ca218a13 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:00.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.184+0000 7f3606000640 1 -- 172.21.15.107:0/947844127 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f402a8b0 con 0x7f35ec004780 2024-08-17T02:28:00.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.184+0000 7f3606000640 1 -- 172.21.15.107:0/947844127 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f402aa30 con 0x7f35ec004780 2024-08-17T02:28:00.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.184+0000 7f3606000640 1 -- 172.21.15.107:0/947844127 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f402adf0 con 0x7f35ec004780 2024-08-17T02:28:00.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.185+0000 7f360e600640 1 -- 172.21.15.107:0/947844127 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35ec004780 msgr2=0x7f35ec004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.185+0000 7f360e600640 1 --2- 172.21.15.107:0/947844127 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35ec004780 0x7f35ec004bf0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f360806e9f0 tx=0x7f35f4007ca0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.185+0000 7f360e600640 1 -- 172.21.15.107:0/947844127 shutdown_connections 2024-08-17T02:28:00.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.185+0000 7f360e600640 1 --2- 172.21.15.107:0/947844127 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35ec004780 0x7f35ec004bf0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.185+0000 7f360e600640 1 -- 172.21.15.107:0/947844127 >> 172.21.15.107:0/947844127 conn(0x7f3608067750 msgr2=0x7f360806c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:00.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.185+0000 7f360e600640 1 -- 172.21.15.107:0/947844127 shutdown_connections 2024-08-17T02:28:00.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.185+0000 7f360e600640 1 -- 172.21.15.107:0/947844127 wait complete. 2024-08-17T02:28:00.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.186+0000 7f360e600640 1 Processor -- start 2024-08-17T02:28:00.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.187+0000 7f360e600640 1 -- start start 2024-08-17T02:28:00.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.187+0000 7f360e600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35ec004780 0x7f360815b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.187+0000 7f360e600640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36081500b0 0x7f3608159460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.187+0000 7f360e600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36081599a0 0x7f360813d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.187+0000 7f360e600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3608159e40 con 0x7f35ec004780 2024-08-17T02:28:00.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.187+0000 7f360e600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36081583d0 con 0x7f36081599a0 2024-08-17T02:28:00.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.187+0000 7f360e600640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f360815a020 con 0x7f36081500b0 2024-08-17T02:28:00.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.188+0000 7f3607400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35ec004780 0x7f360815b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.188+0000 7f3607400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35ec004780 0x7f360815b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47106/0 (socket says 172.21.15.107:47106) 2024-08-17T02:28:00.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.188+0000 7f3607400640 1 -- 172.21.15.107:0/3614789947 learned_addr learned my addr 172.21.15.107:0/3614789947 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:28:00.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.188+0000 7f3607e00640 1 --2- 172.21.15.107:0/3614789947 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36081599a0 0x7f360813d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.188+0000 7f3606a00640 1 --2- 172.21.15.107:0/3614789947 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36081500b0 0x7f3608159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.188+0000 7f3607400640 1 -- 172.21.15.107:0/3614789947 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36081500b0 msgr2=0x7f3608159460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.188+0000 7f3607400640 1 --2- 172.21.15.107:0/3614789947 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36081500b0 0x7f3608159460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.188+0000 7f3607400640 1 -- 172.21.15.107:0/3614789947 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36081599a0 msgr2=0x7f360813d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.188+0000 7f3607400640 1 --2- 172.21.15.107:0/3614789947 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36081599a0 0x7f360813d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.188+0000 7f3607400640 1 -- 172.21.15.107:0/3614789947 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f360815a300 con 0x7f35ec004780 2024-08-17T02:28:00.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.188+0000 7f3606a00640 1 --2- 172.21.15.107:0/3614789947 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36081500b0 0x7f3608159460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:00.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.188+0000 7f3607400640 1 --2- 172.21.15.107:0/3614789947 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35ec004780 0x7f360815b0c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f35f8004ad0 tx=0x7f35f8001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:00.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.188+0000 7f35fea00640 1 -- 172.21.15.107:0/3614789947 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f8012560 con 0x7f35ec004780 2024-08-17T02:28:00.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.189+0000 7f35fea00640 1 -- 172.21.15.107:0/3614789947 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f80126c0 con 0x7f35ec004780 2024-08-17T02:28:00.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.189+0000 7f360e600640 1 -- 172.21.15.107:0/3614789947 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f360815a5e0 con 0x7f35ec004780 2024-08-17T02:28:00.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.189+0000 7f35fea00640 1 -- 172.21.15.107:0/3614789947 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f8012a80 con 0x7f35ec004780 2024-08-17T02:28:00.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.189+0000 7f360e600640 1 -- 172.21.15.107:0/3614789947 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f360815aba0 con 0x7f35ec004780 2024-08-17T02:28:00.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.190+0000 7f360e600640 1 -- 172.21.15.107:0/3614789947 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f36080710c0 con 0x7f35ec004780 2024-08-17T02:28:00.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.190+0000 7f35fea00640 1 -- 172.21.15.107:0/3614789947 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f35f801d460 con 0x7f35ec004780 2024-08-17T02:28:00.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.191+0000 7f35fea00640 1 --2- 172.21.15.107:0/3614789947 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f35e8065150 0x7f35e8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.191+0000 7f35fea00640 1 -- 172.21.15.107:0/3614789947 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f35f8081fb0 con 0x7f35ec004780 2024-08-17T02:28:00.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.191+0000 7f3606a00640 1 --2- 172.21.15.107:0/3614789947 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f35e8065150 0x7f35e8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.192+0000 7f35fea00640 1 --2- 172.21.15.107:0/3614789947 >> [v2:172.21.15.107:6816/37307,v1:172.21.15.107:6817/37307] conn(0x7f35e806b040 0x7f35e806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.192+0000 7f35fea00640 1 -- 172.21.15.107:0/3614789947 --> [v2:172.21.15.107:6816/37307,v1:172.21.15.107:6817/37307] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f35e806db00 con 0x7f35e806b040 2024-08-17T02:28:00.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.192+0000 7f35fea00640 1 -- 172.21.15.107:0/3614789947 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35f8084510 con 0x7f35ec004780 2024-08-17T02:28:00.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.192+0000 7f3607e00640 1 --2- 172.21.15.107:0/3614789947 >> [v2:172.21.15.107:6816/37307,v1:172.21.15.107:6817/37307] conn(0x7f35e806b040 0x7f35e806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.192+0000 7f3606a00640 1 --2- 172.21.15.107:0/3614789947 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f35e8065150 0x7f35e8067600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f35f4032000 tx=0x7f35f4003000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:00.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.192+0000 7f3607e00640 1 --2- 172.21.15.107:0/3614789947 >> [v2:172.21.15.107:6816/37307,v1:172.21.15.107:6817/37307] conn(0x7f35e806b040 0x7f35e806d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:00.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.193+0000 7f35fea00640 1 -- 172.21.15.107:0/3614789947 <== osd.2 v2:172.21.15.107:6816/37307 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f35e806db00 con 0x7f35e806b040 2024-08-17T02:28:00.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.206+0000 7f360e600640 1 -- 172.21.15.107:0/3614789947 --> [v2:172.21.15.107:6816/37307,v1:172.21.15.107:6817/37307] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f36080c89b0 con 0x7f35e806b040 2024-08-17T02:28:00.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.206+0000 7f35fea00640 1 -- 172.21.15.107:0/3614789947 <== osd.2 v2:172.21.15.107:6816/37307 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f36080c89b0 con 0x7f35e806b040 2024-08-17T02:28:00.208 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-08-17T02:28:00.208 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:28:00.208 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-08-17T02:28:00.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.207+0000 7f360e600640 1 -- 172.21.15.107:0/3614789947 >> [v2:172.21.15.107:6816/37307,v1:172.21.15.107:6817/37307] conn(0x7f35e806b040 msgr2=0x7f35e806d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.207+0000 7f360e600640 1 --2- 172.21.15.107:0/3614789947 >> [v2:172.21.15.107:6816/37307,v1:172.21.15.107:6817/37307] conn(0x7f35e806b040 0x7f35e806d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.207+0000 7f360e600640 1 -- 172.21.15.107:0/3614789947 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f35e8065150 msgr2=0x7f35e8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.207+0000 7f360e600640 1 --2- 172.21.15.107:0/3614789947 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f35e8065150 0x7f35e8067600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f35f4032000 tx=0x7f35f4003000 comp rx=0 tx=0).stop 2024-08-17T02:28:00.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.207+0000 7f360e600640 1 -- 172.21.15.107:0/3614789947 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35ec004780 msgr2=0x7f360815b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.210 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.207+0000 7f360e600640 1 --2- 172.21.15.107:0/3614789947 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35ec004780 0x7f360815b0c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f35f8004ad0 tx=0x7f35f8001e50 comp rx=0 tx=0).stop 2024-08-17T02:28:00.210 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.207+0000 7f3607e00640 1 -- 172.21.15.107:0/3614789947 reap_dead start 2024-08-17T02:28:00.210 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.207+0000 7f360e600640 1 -- 172.21.15.107:0/3614789947 shutdown_connections 2024-08-17T02:28:00.210 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.207+0000 7f360e600640 1 -- 172.21.15.107:0/3614789947 >> 172.21.15.107:0/3614789947 conn(0x7f3608067750 msgr2=0x7f3608068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:00.210 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.207+0000 7f360e600640 1 -- 172.21.15.107:0/3614789947 shutdown_connections 2024-08-17T02:28:00.210 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.207+0000 7f360e600640 1 -- 172.21.15.107:0/3614789947 wait complete. 2024-08-17T02:28:00.221 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-08-17T02:28:00.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.368+0000 7fc486200640 1 Processor -- start 2024-08-17T02:28:00.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.369+0000 7fc486200640 1 -- start start 2024-08-17T02:28:00.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.370+0000 7fc486200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc480155900 0x7fc480155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.370+0000 7fc486200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc4800b0270 0x7fc480156210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.370+0000 7fc486200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc480157690 con 0x7fc480157b20 2024-08-17T02:28:00.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.370+0000 7fc486200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc480156a80 con 0x7fc480155900 2024-08-17T02:28:00.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.370+0000 7fc486200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc480156d60 con 0x7fc4800b0270 2024-08-17T02:28:00.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.370+0000 7fc484e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc480155900 0x7fc480155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.370+0000 7fc485800640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fc480157b20 0x7fc480157fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:46972/0 (socket says 172.21.15.107:46972) 2024-08-17T02:28:00.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.370+0000 7fc485800640 1 -- 172.21.15.107:0/2767340476 learned_addr learned my addr 172.21.15.107:0/2767340476 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:28:00.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.371+0000 7fc477e00640 1 --2- 172.21.15.107:0/2767340476 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc4800b0270 0x7fc480156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.371+0000 7fc484e00640 1 -- 172.21.15.107:0/2767340476 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc4800b0270 msgr2=0x7fc480156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:00.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.371+0000 7fc484e00640 1 --2- 172.21.15.107:0/2767340476 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc4800b0270 0x7fc480156210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.371+0000 7fc484e00640 1 -- 172.21.15.107:0/2767340476 >> v1:172.21.15.107:6789/0 conn(0x7fc480157b20 legacy=0x7fc480157fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.371+0000 7fc484e00640 1 -- 172.21.15.107:0/2767340476 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc480157040 con 0x7fc480155900 2024-08-17T02:28:00.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.371+0000 7fc47fe00640 1 -- 172.21.15.107:0/2767340476 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 121475865 0 0) 0x7fc480157690 con 0x7fc480157b20 2024-08-17T02:28:00.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.372+0000 7fc484e00640 1 --2- 172.21.15.107:0/2767340476 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc480155900 0x7fc480155cd0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc470009850 tx=0x7fc4700090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0162feaa0f18aaf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:00.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.372+0000 7fc47fe00640 1 -- 172.21.15.107:0/2767340476 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47002ad00 con 0x7fc480155900 2024-08-17T02:28:00.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.372+0000 7fc47fe00640 1 -- 172.21.15.107:0/2767340476 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47002ae60 con 0x7fc480155900 2024-08-17T02:28:00.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.372+0000 7fc47fe00640 1 -- 172.21.15.107:0/2767340476 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc470032670 con 0x7fc480155900 2024-08-17T02:28:00.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.372+0000 7fc486200640 1 -- 172.21.15.107:0/2767340476 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc480155900 msgr2=0x7fc480155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.372+0000 7fc486200640 1 --2- 172.21.15.107:0/2767340476 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc480155900 0x7fc480155cd0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc470009850 tx=0x7fc4700090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.372+0000 7fc486200640 1 -- 172.21.15.107:0/2767340476 shutdown_connections 2024-08-17T02:28:00.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.372+0000 7fc486200640 1 --2- 172.21.15.107:0/2767340476 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc4800b0270 0x7fc480156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.372+0000 7fc486200640 1 --2- 172.21.15.107:0/2767340476 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc480155900 0x7fc480155cd0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.373+0000 7fc486200640 1 -- 172.21.15.107:0/2767340476 >> 172.21.15.107:0/2767340476 conn(0x7fc480067750 msgr2=0x7fc4800cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:00.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.373+0000 7fc486200640 1 -- 172.21.15.107:0/2767340476 shutdown_connections 2024-08-17T02:28:00.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.373+0000 7fc486200640 1 -- 172.21.15.107:0/2767340476 wait complete. 2024-08-17T02:28:00.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.374+0000 7fc486200640 1 Processor -- start 2024-08-17T02:28:00.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.374+0000 7fc486200640 1 -- start start 2024-08-17T02:28:00.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.375+0000 7fc486200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4800b0270 0x7fc4800aa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.375+0000 7fc486200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc480155900 0x7fc4800c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.375+0000 7fc486200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc480157b20 0x7fc480153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.375+0000 7fc486200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48014ada0 con 0x7fc480157b20 2024-08-17T02:28:00.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.375+0000 7fc486200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc480154800 con 0x7fc4800b0270 2024-08-17T02:28:00.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.375+0000 7fc486200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc48014f9b0 con 0x7fc480155900 2024-08-17T02:28:00.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.375+0000 7fc485800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc480157b20 0x7fc480153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.375+0000 7fc485800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc480157b20 0x7fc480153730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47124/0 (socket says 172.21.15.107:47124) 2024-08-17T02:28:00.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.375+0000 7fc485800640 1 -- 172.21.15.107:0/2032580484 learned_addr learned my addr 172.21.15.107:0/2032580484 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:28:00.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.375+0000 7fc484e00640 1 --2- 172.21.15.107:0/2032580484 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4800b0270 0x7fc4800aa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.375+0000 7fc477e00640 1 --2- 172.21.15.107:0/2032580484 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc480155900 0x7fc4800c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.376+0000 7fc485800640 1 -- 172.21.15.107:0/2032580484 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc480155900 msgr2=0x7fc4800c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.376+0000 7fc485800640 1 --2- 172.21.15.107:0/2032580484 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc480155900 0x7fc4800c9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.376+0000 7fc485800640 1 -- 172.21.15.107:0/2032580484 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4800b0270 msgr2=0x7fc4800aa7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.376+0000 7fc485800640 1 --2- 172.21.15.107:0/2032580484 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4800b0270 0x7fc4800aa7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.376+0000 7fc485800640 1 -- 172.21.15.107:0/2032580484 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc470009390 con 0x7fc480157b20 2024-08-17T02:28:00.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.376+0000 7fc477e00640 1 --2- 172.21.15.107:0/2032580484 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc480155900 0x7fc4800c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:00.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.376+0000 7fc485800640 1 --2- 172.21.15.107:0/2032580484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc480157b20 0x7fc480153730 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc47800cc10 tx=0x7fc478001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:00.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.376+0000 7fc47cc00640 1 -- 172.21.15.107:0/2032580484 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47800ce30 con 0x7fc480157b20 2024-08-17T02:28:00.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.376+0000 7fc47cc00640 1 -- 172.21.15.107:0/2032580484 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47800a7f0 con 0x7fc480157b20 2024-08-17T02:28:00.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.376+0000 7fc47cc00640 1 -- 172.21.15.107:0/2032580484 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47800abf0 con 0x7fc480157b20 2024-08-17T02:28:00.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.376+0000 7fc486200640 1 -- 172.21.15.107:0/2032580484 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc480153f60 con 0x7fc480157b20 2024-08-17T02:28:00.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.376+0000 7fc486200640 1 -- 172.21.15.107:0/2032580484 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc480154520 con 0x7fc480157b20 2024-08-17T02:28:00.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.377+0000 7fc486200640 1 -- 172.21.15.107:0/2032580484 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc48014fb60 con 0x7fc480157b20 2024-08-17T02:28:00.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.378+0000 7fc47cc00640 1 -- 172.21.15.107:0/2032580484 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc47800ad50 con 0x7fc480157b20 2024-08-17T02:28:00.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.379+0000 7fc47cc00640 1 --2- 172.21.15.107:0/2032580484 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fc45c065150 0x7fc45c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.380+0000 7fc47cc00640 1 -- 172.21.15.107:0/2032580484 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fc478082240 con 0x7fc480157b20 2024-08-17T02:28:00.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.380+0000 7fc484e00640 1 --2- 172.21.15.107:0/2032580484 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fc45c065150 0x7fc45c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.380+0000 7fc484e00640 1 --2- 172.21.15.107:0/2032580484 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fc45c065150 0x7fc45c067600 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc470034000 tx=0x7fc470032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:00.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.383+0000 7fc47cc00640 1 -- 172.21.15.107:0/2032580484 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc48014fb60 con 0x7fc480157b20 2024-08-17T02:28:00.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.556+0000 7fc486200640 1 -- 172.21.15.107:0/2032580484 --> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fc48014fb20 con 0x7fc45c065150 2024-08-17T02:28:00.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.556+0000 7fc47cc00640 1 -- 172.21.15.107:0/2032580484 <== mgr.4110 v2:172.21.15.107:6832/37039 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc48014fb20 con 0x7fc45c065150 2024-08-17T02:28:00.558 INFO:teuthology.orchestra.run.smithi107.stderr:instructed osd(s) 2 to deep-scrub 2024-08-17T02:28:00.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.558+0000 7fc486200640 1 -- 172.21.15.107:0/2032580484 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fc45c065150 msgr2=0x7fc45c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.558+0000 7fc486200640 1 --2- 172.21.15.107:0/2032580484 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fc45c065150 0x7fc45c067600 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc470034000 tx=0x7fc470032000 comp rx=0 tx=0).stop 2024-08-17T02:28:00.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.559+0000 7fc486200640 1 -- 172.21.15.107:0/2032580484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc480157b20 msgr2=0x7fc480153730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.559+0000 7fc486200640 1 --2- 172.21.15.107:0/2032580484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc480157b20 0x7fc480153730 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc47800cc10 tx=0x7fc478001970 comp rx=0 tx=0).stop 2024-08-17T02:28:00.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.559+0000 7fc486200640 1 -- 172.21.15.107:0/2032580484 shutdown_connections 2024-08-17T02:28:00.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.559+0000 7fc486200640 1 --2- 172.21.15.107:0/2032580484 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fc45c065150 0x7fc45c067600 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.559+0000 7fc486200640 1 --2- 172.21.15.107:0/2032580484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc480157b20 0x7fc480153730 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.559+0000 7fc486200640 1 --2- 172.21.15.107:0/2032580484 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc480155900 0x7fc4800c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.559+0000 7fc486200640 1 --2- 172.21.15.107:0/2032580484 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4800b0270 0x7fc4800aa7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.559+0000 7fc486200640 1 -- 172.21.15.107:0/2032580484 >> 172.21.15.107:0/2032580484 conn(0x7fc480067750 msgr2=0x7fc480068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:00.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.559+0000 7fc486200640 1 -- 172.21.15.107:0/2032580484 shutdown_connections 2024-08-17T02:28:00.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.559+0000 7fc486200640 1 -- 172.21.15.107:0/2032580484 wait complete. 2024-08-17T02:28:00.575 INFO:tasks.ceph:Scrubbing osd.3 2024-08-17T02:28:00.575 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:28:00.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.725+0000 7fd343e00640 1 Processor -- start 2024-08-17T02:28:00.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.725+0000 7fd343e00640 1 -- start start 2024-08-17T02:28:00.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.727+0000 7fd343e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd3440ad210 0x7fd3440cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.727+0000 7fd343e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd34406dc80 0x7fd3440ab7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.727+0000 7fd343e00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3440ab350 con 0x7fd3440ad5e0 2024-08-17T02:28:00.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.727+0000 7fd343e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd34415d640 con 0x7fd3440ad210 2024-08-17T02:28:00.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.727+0000 7fd343e00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3440b1750 con 0x7fd34406dc80 2024-08-17T02:28:00.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.727+0000 7fd342a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd3440ad210 0x7fd3440cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.727+0000 7fd342a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd3440ad210 0x7fd3440cc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47126/0 (socket says 172.21.15.107:47126) 2024-08-17T02:28:00.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.727+0000 7fd342a00640 1 -- 172.21.15.107:0/2370378346 learned_addr learned my addr 172.21.15.107:0/2370378346 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:28:00.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.727+0000 7fd343400640 1 --2- 172.21.15.107:0/2370378346 >> v2:172.21.15.157:3300/0 conn(0x7fd34406dc80 0x7fd3440ab7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.727+0000 7fd342a00640 1 -- 172.21.15.107:0/2370378346 >> v2:172.21.15.157:3300/0 conn(0x7fd34406dc80 msgr2=0x7fd3440ab7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:00.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.727+0000 7fd342a00640 1 --2- 172.21.15.107:0/2370378346 >> v2:172.21.15.157:3300/0 conn(0x7fd34406dc80 0x7fd3440ab7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.727+0000 7fd342a00640 1 -- 172.21.15.107:0/2370378346 >> v1:172.21.15.157:6789/0 conn(0x7fd3440ad5e0 legacy=0x7fd34406d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:00.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.727+0000 7fd342a00640 1 -- 172.21.15.107:0/2370378346 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3440b0c10 con 0x7fd3440ad210 2024-08-17T02:28:00.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.728+0000 7fd342a00640 1 --2- 172.21.15.107:0/2370378346 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3440ad210 0x7fd3440cc0c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd34406e6b0 tx=0x7fd3340091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=348539f95b2e27cb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:00.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.729+0000 7fd342000640 1 -- 172.21.15.107:0/2370378346 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33402adf0 con 0x7fd3440ad210 2024-08-17T02:28:00.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.729+0000 7fd342000640 1 -- 172.21.15.107:0/2370378346 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd334032440 con 0x7fd3440ad210 2024-08-17T02:28:00.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.729+0000 7fd342000640 1 -- 172.21.15.107:0/2370378346 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd334032820 con 0x7fd3440ad210 2024-08-17T02:28:00.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.729+0000 7fd343e00640 1 -- 172.21.15.107:0/2370378346 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3440ad210 msgr2=0x7fd3440cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.729+0000 7fd343e00640 1 --2- 172.21.15.107:0/2370378346 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3440ad210 0x7fd3440cc0c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd34406e6b0 tx=0x7fd3340091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.729+0000 7fd343e00640 1 -- 172.21.15.107:0/2370378346 shutdown_connections 2024-08-17T02:28:00.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.729+0000 7fd343e00640 1 --2- 172.21.15.107:0/2370378346 >> v2:172.21.15.157:3300/0 conn(0x7fd34406dc80 0x7fd3440ab7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.729+0000 7fd343e00640 1 --2- 172.21.15.107:0/2370378346 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3440ad210 0x7fd3440cc0c0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.729+0000 7fd343e00640 1 -- 172.21.15.107:0/2370378346 >> 172.21.15.107:0/2370378346 conn(0x7fd344067750 msgr2=0x7fd3440cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:00.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.729+0000 7fd343e00640 1 -- 172.21.15.107:0/2370378346 shutdown_connections 2024-08-17T02:28:00.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.730+0000 7fd343e00640 1 -- 172.21.15.107:0/2370378346 wait complete. 2024-08-17T02:28:00.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.731+0000 7fd343e00640 1 Processor -- start 2024-08-17T02:28:00.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.731+0000 7fd343e00640 1 -- start start 2024-08-17T02:28:00.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.732+0000 7fd343e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd34406dc80 0x7fd34415ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.732+0000 7fd343e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3440ad210 0x7fd344151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.732+0000 7fd343e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3440ad5e0 0x7fd34415a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.732+0000 7fd343e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34415e990 con 0x7fd3440ad210 2024-08-17T02:28:00.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.732+0000 7fd343e00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34415dd80 con 0x7fd3440ad5e0 2024-08-17T02:28:00.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.732+0000 7fd343e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd34415e060 con 0x7fd34406dc80 2024-08-17T02:28:00.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.732+0000 7fd33be00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3440ad210 0x7fd344151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.732+0000 7fd33be00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3440ad210 0x7fd344151180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47132/0 (socket says 172.21.15.107:47132) 2024-08-17T02:28:00.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.732+0000 7fd33be00640 1 -- 172.21.15.107:0/3310993322 learned_addr learned my addr 172.21.15.107:0/3310993322 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:28:00.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.732+0000 7fd343400640 1 --2- 172.21.15.107:0/3310993322 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3440ad5e0 0x7fd34415a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.732+0000 7fd342a00640 1 --2- 172.21.15.107:0/3310993322 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd34406dc80 0x7fd34415ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.733+0000 7fd33be00640 1 -- 172.21.15.107:0/3310993322 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd34406dc80 msgr2=0x7fd34415ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.733+0000 7fd33be00640 1 --2- 172.21.15.107:0/3310993322 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd34406dc80 0x7fd34415ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.733+0000 7fd33be00640 1 -- 172.21.15.107:0/3310993322 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3440ad5e0 msgr2=0x7fd34415a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.733+0000 7fd33be00640 1 --2- 172.21.15.107:0/3310993322 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3440ad5e0 0x7fd34415a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.733+0000 7fd33be00640 1 -- 172.21.15.107:0/3310993322 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd334009450 con 0x7fd3440ad210 2024-08-17T02:28:00.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.733+0000 7fd342a00640 1 --2- 172.21.15.107:0/3310993322 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd34406dc80 0x7fd34415ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:00.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.733+0000 7fd33be00640 1 --2- 172.21.15.107:0/3310993322 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3440ad210 0x7fd344151180 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd32c00c4c0 tx=0x7fd32c007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:00.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.733+0000 7fd33a000640 1 -- 172.21.15.107:0/3310993322 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32c011590 con 0x7fd3440ad210 2024-08-17T02:28:00.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.733+0000 7fd33a000640 1 -- 172.21.15.107:0/3310993322 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32c011710 con 0x7fd3440ad210 2024-08-17T02:28:00.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.733+0000 7fd343e00640 1 -- 172.21.15.107:0/3310993322 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd34415e340 con 0x7fd3440ad210 2024-08-17T02:28:00.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.733+0000 7fd33a000640 1 -- 172.21.15.107:0/3310993322 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32c011ad0 con 0x7fd3440ad210 2024-08-17T02:28:00.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.733+0000 7fd343e00640 1 -- 172.21.15.107:0/3310993322 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd34415f360 con 0x7fd3440ad210 2024-08-17T02:28:00.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.734+0000 7fd343e00640 1 -- 172.21.15.107:0/3310993322 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd344071050 con 0x7fd3440ad210 2024-08-17T02:28:00.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.735+0000 7fd33a000640 1 -- 172.21.15.107:0/3310993322 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd32c01b3b0 con 0x7fd3440ad210 2024-08-17T02:28:00.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.736+0000 7fd33a000640 1 --2- 172.21.15.107:0/3310993322 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd320065150 0x7fd320067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.736+0000 7fd33a000640 1 -- 172.21.15.107:0/3310993322 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fd32c081670 con 0x7fd3440ad210 2024-08-17T02:28:00.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.736+0000 7fd342a00640 1 --2- 172.21.15.107:0/3310993322 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd320065150 0x7fd320067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.736+0000 7fd33a000640 1 --2- 172.21.15.107:0/3310993322 >> [v2:172.21.15.107:6808/37306,v1:172.21.15.107:6809/37306] conn(0x7fd32006af70 0x7fd32006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.736+0000 7fd33a000640 1 -- 172.21.15.107:0/3310993322 --> [v2:172.21.15.107:6808/37306,v1:172.21.15.107:6809/37306] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd32006da30 con 0x7fd32006af70 2024-08-17T02:28:00.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.736+0000 7fd33a000640 1 -- 172.21.15.107:0/3310993322 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd32c083bd0 con 0x7fd3440ad210 2024-08-17T02:28:00.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.736+0000 7fd343400640 1 --2- 172.21.15.107:0/3310993322 >> [v2:172.21.15.107:6808/37306,v1:172.21.15.107:6809/37306] conn(0x7fd32006af70 0x7fd32006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.737+0000 7fd342a00640 1 --2- 172.21.15.107:0/3310993322 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd320065150 0x7fd320067600 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd334034000 tx=0x7fd334032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:00.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.737+0000 7fd343400640 1 --2- 172.21.15.107:0/3310993322 >> [v2:172.21.15.107:6808/37306,v1:172.21.15.107:6809/37306] conn(0x7fd32006af70 0x7fd32006d380 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:00.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.738+0000 7fd33a000640 1 -- 172.21.15.107:0/3310993322 <== osd.3 v2:172.21.15.107:6808/37306 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fd32006da30 con 0x7fd32006af70 2024-08-17T02:28:00.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.750+0000 7fd343e00640 1 -- 172.21.15.107:0/3310993322 --> [v2:172.21.15.107:6808/37306,v1:172.21.15.107:6809/37306] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd34415e7c0 con 0x7fd32006af70 2024-08-17T02:28:00.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.750+0000 7fd33a000640 1 -- 172.21.15.107:0/3310993322 <== osd.3 v2:172.21.15.107:6808/37306 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd33c007670 con 0x7fd32006af70 2024-08-17T02:28:00.752 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-08-17T02:28:00.752 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:28:00.752 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-08-17T02:28:00.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.751+0000 7fd343e00640 1 -- 172.21.15.107:0/3310993322 >> [v2:172.21.15.107:6808/37306,v1:172.21.15.107:6809/37306] conn(0x7fd32006af70 msgr2=0x7fd32006d380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.751+0000 7fd343e00640 1 --2- 172.21.15.107:0/3310993322 >> [v2:172.21.15.107:6808/37306,v1:172.21.15.107:6809/37306] conn(0x7fd32006af70 0x7fd32006d380 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.751+0000 7fd343e00640 1 -- 172.21.15.107:0/3310993322 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd320065150 msgr2=0x7fd320067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.751+0000 7fd343e00640 1 --2- 172.21.15.107:0/3310993322 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fd320065150 0x7fd320067600 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd334034000 tx=0x7fd334032000 comp rx=0 tx=0).stop 2024-08-17T02:28:00.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.751+0000 7fd343e00640 1 -- 172.21.15.107:0/3310993322 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3440ad210 msgr2=0x7fd344151180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.751+0000 7fd343e00640 1 --2- 172.21.15.107:0/3310993322 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3440ad210 0x7fd344151180 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd32c00c4c0 tx=0x7fd32c007ef0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.751+0000 7fd343400640 1 -- 172.21.15.107:0/3310993322 reap_dead start 2024-08-17T02:28:00.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.751+0000 7fd343e00640 1 -- 172.21.15.107:0/3310993322 shutdown_connections 2024-08-17T02:28:00.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.751+0000 7fd343e00640 1 -- 172.21.15.107:0/3310993322 >> 172.21.15.107:0/3310993322 conn(0x7fd344067750 msgr2=0x7fd34415c860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:00.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.751+0000 7fd343e00640 1 -- 172.21.15.107:0/3310993322 shutdown_connections 2024-08-17T02:28:00.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.751+0000 7fd343e00640 1 -- 172.21.15.107:0/3310993322 wait complete. 2024-08-17T02:28:00.766 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-08-17T02:28:00.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.914+0000 7f1ef2400640 1 Processor -- start 2024-08-17T02:28:00.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.914+0000 7f1ef2400640 1 -- start start 2024-08-17T02:28:00.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.915+0000 7f1ef2400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1eec158c80 0x7f1eec0ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.915+0000 7f1ef2400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1eec0cd700 0x7f1eec0cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.915+0000 7f1ef2400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1eec0cc800 0x7f1eec0ca380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.915+0000 7f1ef2400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eec0cf9d0 con 0x7f1eec158c80 2024-08-17T02:28:00.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.915+0000 7f1ef2400640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eec0ceb60 con 0x7f1eec0cd700 2024-08-17T02:28:00.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.915+0000 7f1ef2400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec0cedc0 con 0x7f1eec0cc800 2024-08-17T02:28:00.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.915+0000 7f1ef1000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1eec158c80 0x7f1eec0ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.915+0000 7f1ef1000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1eec158c80 0x7f1eec0ce620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47140/0 (socket says 172.21.15.107:47140) 2024-08-17T02:28:00.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.915+0000 7f1ef1000640 1 -- 172.21.15.107:0/3587542030 learned_addr learned my addr 172.21.15.107:0/3587542030 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:28:00.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.915+0000 7f1ef1a00640 1 --2- 172.21.15.107:0/3587542030 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1eec0cc800 0x7f1eec0ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.915+0000 7f1ee3e00640 1 --2- 172.21.15.107:0/3587542030 >> v2:172.21.15.157:3300/0 conn(0x7f1eec0cd700 0x7f1eec0cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.916+0000 7f1ef1000640 1 -- 172.21.15.107:0/3587542030 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1eec0cc800 msgr2=0x7f1eec0ca380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:00.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.916+0000 7f1ef1000640 1 --2- 172.21.15.107:0/3587542030 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1eec0cc800 0x7f1eec0ca380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.916+0000 7f1ef1000640 1 -- 172.21.15.107:0/3587542030 >> v2:172.21.15.157:3300/0 conn(0x7f1eec0cd700 msgr2=0x7f1eec0cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:00.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.916+0000 7f1ef1000640 1 --2- 172.21.15.107:0/3587542030 >> v2:172.21.15.157:3300/0 conn(0x7f1eec0cd700 0x7f1eec0cc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.916+0000 7f1ef1000640 1 -- 172.21.15.107:0/3587542030 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eec0cf0a0 con 0x7f1eec158c80 2024-08-17T02:28:00.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.917+0000 7f1ef1000640 1 --2- 172.21.15.107:0/3587542030 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1eec158c80 0x7f1eec0ce620 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f1eec0b2720 tx=0x7f1edc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=536290ce8a98e352 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:00.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.917+0000 7f1eebe00640 1 -- 172.21.15.107:0/3587542030 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1edc02ad40 con 0x7f1eec158c80 2024-08-17T02:28:00.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.917+0000 7f1eebe00640 1 -- 172.21.15.107:0/3587542030 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1edc032440 con 0x7f1eec158c80 2024-08-17T02:28:00.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.917+0000 7f1eebe00640 1 -- 172.21.15.107:0/3587542030 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1edc02aea0 con 0x7f1eec158c80 2024-08-17T02:28:00.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.917+0000 7f1ef2400640 1 -- 172.21.15.107:0/3587542030 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1eec158c80 msgr2=0x7f1eec0ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.917+0000 7f1ef2400640 1 --2- 172.21.15.107:0/3587542030 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1eec158c80 0x7f1eec0ce620 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f1eec0b2720 tx=0x7f1edc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.917+0000 7f1ef2400640 1 -- 172.21.15.107:0/3587542030 shutdown_connections 2024-08-17T02:28:00.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.917+0000 7f1ef2400640 1 --2- 172.21.15.107:0/3587542030 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1eec0cc800 0x7f1eec0ca380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.917+0000 7f1ef2400640 1 --2- 172.21.15.107:0/3587542030 >> v2:172.21.15.157:3300/0 conn(0x7f1eec0cd700 0x7f1eec0cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.917+0000 7f1ef2400640 1 --2- 172.21.15.107:0/3587542030 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1eec158c80 0x7f1eec0ce620 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.917+0000 7f1ef2400640 1 -- 172.21.15.107:0/3587542030 >> 172.21.15.107:0/3587542030 conn(0x7f1eec098e30 msgr2=0x7f1eec06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:00.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.918+0000 7f1ef2400640 1 -- 172.21.15.107:0/3587542030 shutdown_connections 2024-08-17T02:28:00.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.918+0000 7f1ef2400640 1 -- 172.21.15.107:0/3587542030 wait complete. 2024-08-17T02:28:00.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.919+0000 7f1ef2400640 1 Processor -- start 2024-08-17T02:28:00.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.919+0000 7f1ef2400640 1 -- start start 2024-08-17T02:28:00.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.920+0000 7f1ef2400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1eec0cc800 0x7f1eec0c3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.920+0000 7f1ef2400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1eec0cd700 0x7f1eec0c6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.920+0000 7f1ef2400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1eec158c80 0x7f1eec151060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.920+0000 7f1ef2400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec0b4850 con 0x7f1eec158c80 2024-08-17T02:28:00.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.920+0000 7f1ef2400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec0c68d0 con 0x7f1eec0cc800 2024-08-17T02:28:00.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.920+0000 7f1ef2400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec0b4040 con 0x7f1eec0cd700 2024-08-17T02:28:00.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.920+0000 7f1ef1a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1eec158c80 0x7f1eec151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.920+0000 7f1ef1a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1eec158c80 0x7f1eec151060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47148/0 (socket says 172.21.15.107:47148) 2024-08-17T02:28:00.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.920+0000 7f1ef1a00640 1 -- 172.21.15.107:0/2774713295 learned_addr learned my addr 172.21.15.107:0/2774713295 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:28:00.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.920+0000 7f1ee3e00640 1 --2- 172.21.15.107:0/2774713295 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1eec0cd700 0x7f1eec0c6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.920+0000 7f1ef1000640 1 --2- 172.21.15.107:0/2774713295 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1eec0cc800 0x7f1eec0c3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.921+0000 7f1ef1a00640 1 -- 172.21.15.107:0/2774713295 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1eec0cd700 msgr2=0x7f1eec0c6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.921+0000 7f1ef1a00640 1 --2- 172.21.15.107:0/2774713295 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1eec0cd700 0x7f1eec0c6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.921+0000 7f1ef1a00640 1 -- 172.21.15.107:0/2774713295 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1eec0cc800 msgr2=0x7f1eec0c3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.921+0000 7f1ef1a00640 1 --2- 172.21.15.107:0/2774713295 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1eec0cc800 0x7f1eec0c3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.921+0000 7f1ef1a00640 1 -- 172.21.15.107:0/2774713295 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1edc009450 con 0x7f1eec158c80 2024-08-17T02:28:00.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.921+0000 7f1ef1a00640 1 --2- 172.21.15.107:0/2774713295 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1eec158c80 0x7f1eec151060 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4007f20 tx=0x7f1ee4009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:00.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.921+0000 7f1ee8c00640 1 -- 172.21.15.107:0/2774713295 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee400ee30 con 0x7f1eec158c80 2024-08-17T02:28:00.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.921+0000 7f1ee8c00640 1 -- 172.21.15.107:0/2774713295 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee4014420 con 0x7f1eec158c80 2024-08-17T02:28:00.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.921+0000 7f1ee8c00640 1 -- 172.21.15.107:0/2774713295 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee40147e0 con 0x7f1eec158c80 2024-08-17T02:28:00.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.921+0000 7f1ef2400640 1 -- 172.21.15.107:0/2774713295 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eec0b4290 con 0x7f1eec158c80 2024-08-17T02:28:00.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.921+0000 7f1ef2400640 1 -- 172.21.15.107:0/2774713295 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eec0b4b50 con 0x7f1eec158c80 2024-08-17T02:28:00.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.922+0000 7f1ef2400640 1 -- 172.21.15.107:0/2774713295 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eec0b49b0 con 0x7f1eec158c80 2024-08-17T02:28:00.928 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.923+0000 7f1ee8c00640 1 -- 172.21.15.107:0/2774713295 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1ee4014b50 con 0x7f1eec158c80 2024-08-17T02:28:00.928 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.925+0000 7f1ee8c00640 1 --2- 172.21.15.107:0/2774713295 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f1ec8065150 0x7f1ec8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.929 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.925+0000 7f1ee8c00640 1 -- 172.21.15.107:0/2774713295 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f1ee40827b0 con 0x7f1eec158c80 2024-08-17T02:28:00.929 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.925+0000 7f1ef1000640 1 --2- 172.21.15.107:0/2774713295 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f1ec8065150 0x7f1ec8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.929 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.925+0000 7f1ef1000640 1 --2- 172.21.15.107:0/2774713295 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f1ec8065150 0x7f1ec8067600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1edc034000 tx=0x7f1edc032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:00.930 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:00.930+0000 7f1ee8c00640 1 -- 172.21.15.107:0/2774713295 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1eec0b49b0 con 0x7f1eec158c80 2024-08-17T02:28:01.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.101+0000 7f1ef2400640 1 -- 172.21.15.107:0/2774713295 --> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f1eec0b49b0 con 0x7f1ec8065150 2024-08-17T02:28:01.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.101+0000 7f1ee8c00640 1 -- 172.21.15.107:0/2774713295 <== mgr.4110 v2:172.21.15.107:6832/37039 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1eec0b49b0 con 0x7f1ec8065150 2024-08-17T02:28:01.102 INFO:teuthology.orchestra.run.smithi107.stderr:instructed osd(s) 3 to deep-scrub 2024-08-17T02:28:01.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.103+0000 7f1ef2400640 1 -- 172.21.15.107:0/2774713295 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f1ec8065150 msgr2=0x7f1ec8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.103+0000 7f1ef2400640 1 --2- 172.21.15.107:0/2774713295 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f1ec8065150 0x7f1ec8067600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1edc034000 tx=0x7f1edc032000 comp rx=0 tx=0).stop 2024-08-17T02:28:01.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.103+0000 7f1ef2400640 1 -- 172.21.15.107:0/2774713295 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1eec158c80 msgr2=0x7f1eec151060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.103+0000 7f1ef2400640 1 --2- 172.21.15.107:0/2774713295 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1eec158c80 0x7f1eec151060 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4007f20 tx=0x7f1ee4009860 comp rx=0 tx=0).stop 2024-08-17T02:28:01.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.103+0000 7f1ef2400640 1 -- 172.21.15.107:0/2774713295 shutdown_connections 2024-08-17T02:28:01.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.103+0000 7f1ef2400640 1 --2- 172.21.15.107:0/2774713295 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f1ec8065150 0x7f1ec8067600 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.106 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.103+0000 7f1ef2400640 1 --2- 172.21.15.107:0/2774713295 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1eec158c80 0x7f1eec151060 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.106 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.103+0000 7f1ef2400640 1 --2- 172.21.15.107:0/2774713295 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1eec0cd700 0x7f1eec0c6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.106 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.103+0000 7f1ef2400640 1 --2- 172.21.15.107:0/2774713295 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1eec0cc800 0x7f1eec0c3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.106 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.103+0000 7f1ef2400640 1 -- 172.21.15.107:0/2774713295 >> 172.21.15.107:0/2774713295 conn(0x7f1eec098e30 msgr2=0x7f1eec06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:01.106 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.103+0000 7f1ef2400640 1 -- 172.21.15.107:0/2774713295 shutdown_connections 2024-08-17T02:28:01.106 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.104+0000 7f1ef2400640 1 -- 172.21.15.107:0/2774713295 wait complete. 2024-08-17T02:28:01.119 INFO:tasks.ceph:Scrubbing osd.4 2024-08-17T02:28:01.119 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:28:01.271 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.271+0000 7fb390c00640 1 Processor -- start 2024-08-17T02:28:01.271 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.271+0000 7fb390c00640 1 -- start start 2024-08-17T02:28:01.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.271+0000 7fb390c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb38c0673e0 0x7fb38c0cd590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.271+0000 7fb390c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb38c0c9480 0x7fb38c06aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.271+0000 7fb390c00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb38c06a2c0 con 0x7fb38c158c10 2024-08-17T02:28:01.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.271+0000 7fb390c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb38c0a9d30 con 0x7fb38c0c9480 2024-08-17T02:28:01.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.271+0000 7fb390c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c06a510 con 0x7fb38c0673e0 2024-08-17T02:28:01.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.271+0000 7fb38a800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb38c0c9480 0x7fb38c06aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.271+0000 7fb38a800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb38c0c9480 0x7fb38c06aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47154/0 (socket says 172.21.15.107:47154) 2024-08-17T02:28:01.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.271+0000 7fb38a800640 1 -- 172.21.15.107:0/3464828691 learned_addr learned my addr 172.21.15.107:0/3464828691 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:28:01.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.272+0000 7fb389400640 1 --2- 172.21.15.107:0/3464828691 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb38c0673e0 0x7fb38c0cd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.272+0000 7fb38a800640 1 -- 172.21.15.107:0/3464828691 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb38c0673e0 msgr2=0x7fb38c0cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:01.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.272+0000 7fb38a800640 1 --2- 172.21.15.107:0/3464828691 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb38c0673e0 0x7fb38c0cd590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.272+0000 7fb38a800640 1 -- 172.21.15.107:0/3464828691 >> v1:172.21.15.157:6789/0 conn(0x7fb38c158c10 legacy=0x7fb38c066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.272+0000 7fb38a800640 1 -- 172.21.15.107:0/3464828691 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb38c06a7f0 con 0x7fb38c0c9480 2024-08-17T02:28:01.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.273+0000 7fb38a800640 1 --2- 172.21.15.107:0/3464828691 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb38c0c9480 0x7fb38c06aff0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb384009f20 tx=0x7fb384009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28ea2736a5c0e685 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:01.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.273+0000 7fb388a00640 1 -- 172.21.15.107:0/3464828691 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb384031400 con 0x7fb38c0c9480 2024-08-17T02:28:01.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.273+0000 7fb388a00640 1 -- 172.21.15.107:0/3464828691 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb38402d050 con 0x7fb38c0c9480 2024-08-17T02:28:01.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.273+0000 7fb388a00640 1 -- 172.21.15.107:0/3464828691 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3840317d0 con 0x7fb38c0c9480 2024-08-17T02:28:01.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.274+0000 7fb390c00640 1 -- 172.21.15.107:0/3464828691 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb38c0c9480 msgr2=0x7fb38c06aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.274+0000 7fb390c00640 1 --2- 172.21.15.107:0/3464828691 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb38c0c9480 0x7fb38c06aff0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb384009f20 tx=0x7fb384009840 comp rx=0 tx=0).stop 2024-08-17T02:28:01.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.274+0000 7fb390c00640 1 -- 172.21.15.107:0/3464828691 shutdown_connections 2024-08-17T02:28:01.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.274+0000 7fb390c00640 1 --2- 172.21.15.107:0/3464828691 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb38c0c9480 0x7fb38c06aff0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.274+0000 7fb390c00640 1 --2- 172.21.15.107:0/3464828691 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb38c0673e0 0x7fb38c0cd590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.274+0000 7fb390c00640 1 -- 172.21.15.107:0/3464828691 >> 172.21.15.107:0/3464828691 conn(0x7fb38c0cca80 msgr2=0x7fb38c0cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:01.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.274+0000 7fb390c00640 1 -- 172.21.15.107:0/3464828691 shutdown_connections 2024-08-17T02:28:01.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.274+0000 7fb390c00640 1 -- 172.21.15.107:0/3464828691 wait complete. 2024-08-17T02:28:01.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.275+0000 7fb390c00640 1 Processor -- start 2024-08-17T02:28:01.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.275+0000 7fb390c00640 1 -- start start 2024-08-17T02:28:01.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.276+0000 7fb390c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb38c0673e0 0x7fb38c0ae010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.276+0000 7fb390c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb38c0c9480 0x7fb38c06dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.276+0000 7fb390c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb38c158c10 0x7fb38c154020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.276+0000 7fb390c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c0c35a0 con 0x7fb38c158c10 2024-08-17T02:28:01.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.276+0000 7fb390c00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c0c3880 con 0x7fb38c0c9480 2024-08-17T02:28:01.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.276+0000 7fb390c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c0c3b60 con 0x7fb38c0673e0 2024-08-17T02:28:01.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.277+0000 7fb38a800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb38c158c10 0x7fb38c154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.277+0000 7fb38a800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb38c158c10 0x7fb38c154020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47160/0 (socket says 172.21.15.107:47160) 2024-08-17T02:28:01.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.277+0000 7fb38a800640 1 -- 172.21.15.107:0/2366509117 learned_addr learned my addr 172.21.15.107:0/2366509117 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:28:01.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.277+0000 7fb389e00640 1 --2- 172.21.15.107:0/2366509117 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb38c0673e0 0x7fb38c0ae010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.277+0000 7fb389400640 1 --2- 172.21.15.107:0/2366509117 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb38c0c9480 0x7fb38c06dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.277+0000 7fb38a800640 1 -- 172.21.15.107:0/2366509117 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb38c0673e0 msgr2=0x7fb38c0ae010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.277+0000 7fb38a800640 1 --2- 172.21.15.107:0/2366509117 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb38c0673e0 0x7fb38c0ae010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.277+0000 7fb38a800640 1 -- 172.21.15.107:0/2366509117 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb38c0c9480 msgr2=0x7fb38c06dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.277+0000 7fb38a800640 1 --2- 172.21.15.107:0/2366509117 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb38c0c9480 0x7fb38c06dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.277+0000 7fb38a800640 1 -- 172.21.15.107:0/2366509117 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb384009ae0 con 0x7fb38c158c10 2024-08-17T02:28:01.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.278+0000 7fb38a800640 1 --2- 172.21.15.107:0/2366509117 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb38c158c10 0x7fb38c154020 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb384009f80 tx=0x7fb384036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:01.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.278+0000 7fb381600640 1 -- 172.21.15.107:0/2366509117 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb384008e50 con 0x7fb38c158c10 2024-08-17T02:28:01.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.278+0000 7fb381600640 1 -- 172.21.15.107:0/2366509117 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb38403b410 con 0x7fb38c158c10 2024-08-17T02:28:01.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.278+0000 7fb390c00640 1 -- 172.21.15.107:0/2366509117 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb38c0c3e40 con 0x7fb38c158c10 2024-08-17T02:28:01.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.278+0000 7fb381600640 1 -- 172.21.15.107:0/2366509117 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38403b7d0 con 0x7fb38c158c10 2024-08-17T02:28:01.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.278+0000 7fb390c00640 1 -- 172.21.15.107:0/2366509117 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb38c06e010 con 0x7fb38c158c10 2024-08-17T02:28:01.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.279+0000 7fb390c00640 1 -- 172.21.15.107:0/2366509117 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb38c06e200 con 0x7fb38c158c10 2024-08-17T02:28:01.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.280+0000 7fb381600640 1 -- 172.21.15.107:0/2366509117 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb384038050 con 0x7fb38c158c10 2024-08-17T02:28:01.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.280+0000 7fb381600640 1 --2- 172.21.15.107:0/2366509117 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fb36c065150 0x7fb36c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.281+0000 7fb381600640 1 -- 172.21.15.107:0/2366509117 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fb3840a2db0 con 0x7fb38c158c10 2024-08-17T02:28:01.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.281+0000 7fb389e00640 1 --2- 172.21.15.107:0/2366509117 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fb36c065150 0x7fb36c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.281+0000 7fb381600640 1 --2- 172.21.15.107:0/2366509117 >> [v2:172.21.15.157:6816/37329,v1:172.21.15.157:6817/37329] conn(0x7fb36c06b040 0x7fb36c06d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.281+0000 7fb381600640 1 -- 172.21.15.107:0/2366509117 --> [v2:172.21.15.157:6816/37329,v1:172.21.15.157:6817/37329] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb36c06db00 con 0x7fb36c06b040 2024-08-17T02:28:01.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.281+0000 7fb381600640 1 -- 172.21.15.107:0/2366509117 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb3840a53f0 con 0x7fb38c158c10 2024-08-17T02:28:01.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.281+0000 7fb389400640 1 --2- 172.21.15.107:0/2366509117 >> [v2:172.21.15.157:6816/37329,v1:172.21.15.157:6817/37329] conn(0x7fb36c06b040 0x7fb36c06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.281+0000 7fb389e00640 1 --2- 172.21.15.107:0/2366509117 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fb36c065150 0x7fb36c067600 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb37c007fd0 tx=0x7fb37c007e30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:01.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.282+0000 7fb389400640 1 --2- 172.21.15.107:0/2366509117 >> [v2:172.21.15.157:6816/37329,v1:172.21.15.157:6817/37329] conn(0x7fb36c06b040 0x7fb36c06d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:01.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.283+0000 7fb381600640 1 -- 172.21.15.107:0/2366509117 <== osd.4 v2:172.21.15.157:6816/37329 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fb36c06db00 con 0x7fb36c06b040 2024-08-17T02:28:01.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.296+0000 7fb390c00640 1 -- 172.21.15.107:0/2366509117 --> [v2:172.21.15.157:6816/37329,v1:172.21.15.157:6817/37329] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb38c0710c0 con 0x7fb36c06b040 2024-08-17T02:28:01.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.296+0000 7fb381600640 1 -- 172.21.15.107:0/2366509117 <== osd.4 v2:172.21.15.157:6816/37329 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb38c0710c0 con 0x7fb36c06b040 2024-08-17T02:28:01.297 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-08-17T02:28:01.297 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:28:01.297 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-08-17T02:28:01.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.296+0000 7fb390c00640 1 -- 172.21.15.107:0/2366509117 >> [v2:172.21.15.157:6816/37329,v1:172.21.15.157:6817/37329] conn(0x7fb36c06b040 msgr2=0x7fb36c06d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.296+0000 7fb390c00640 1 --2- 172.21.15.107:0/2366509117 >> [v2:172.21.15.157:6816/37329,v1:172.21.15.157:6817/37329] conn(0x7fb36c06b040 0x7fb36c06d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.296+0000 7fb390c00640 1 -- 172.21.15.107:0/2366509117 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fb36c065150 msgr2=0x7fb36c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.296+0000 7fb390c00640 1 --2- 172.21.15.107:0/2366509117 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fb36c065150 0x7fb36c067600 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb37c007fd0 tx=0x7fb37c007e30 comp rx=0 tx=0).stop 2024-08-17T02:28:01.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.296+0000 7fb390c00640 1 -- 172.21.15.107:0/2366509117 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb38c158c10 msgr2=0x7fb38c154020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.296+0000 7fb390c00640 1 --2- 172.21.15.107:0/2366509117 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb38c158c10 0x7fb38c154020 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb384009f80 tx=0x7fb384036000 comp rx=0 tx=0).stop 2024-08-17T02:28:01.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.296+0000 7fb38a800640 1 -- 172.21.15.107:0/2366509117 reap_dead start 2024-08-17T02:28:01.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.297+0000 7fb390c00640 1 -- 172.21.15.107:0/2366509117 shutdown_connections 2024-08-17T02:28:01.300 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.297+0000 7fb390c00640 1 -- 172.21.15.107:0/2366509117 >> 172.21.15.107:0/2366509117 conn(0x7fb38c0cca80 msgr2=0x7fb38c0af9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:01.300 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.297+0000 7fb390c00640 1 -- 172.21.15.107:0/2366509117 shutdown_connections 2024-08-17T02:28:01.300 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.297+0000 7fb390c00640 1 -- 172.21.15.107:0/2366509117 wait complete. 2024-08-17T02:28:01.312 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-08-17T02:28:01.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.461+0000 7f74c7800640 1 Processor -- start 2024-08-17T02:28:01.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.461+0000 7f74c7800640 1 -- start start 2024-08-17T02:28:01.463 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.462+0000 7f74c7800640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f74c00d08d0 0x7f74c00c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.463 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.462+0000 7f74c7800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f74c00cb340 0x7f74c01590b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.463 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.462+0000 7f74c7800640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74c00cb7c0 con 0x7f74c0158ce0 2024-08-17T02:28:01.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.462+0000 7f74c7800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74c00cf0c0 con 0x7f74c00cb340 2024-08-17T02:28:01.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.462+0000 7f74c7800640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74c0089000 con 0x7f74c00d08d0 2024-08-17T02:28:01.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.462+0000 7f74c5800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f74c00cb340 0x7f74c01590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.462+0000 7f74c5800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f74c00cb340 0x7f74c01590b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47174/0 (socket says 172.21.15.107:47174) 2024-08-17T02:28:01.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.462+0000 7f74c5800640 1 -- 172.21.15.107:0/1992671957 learned_addr learned my addr 172.21.15.107:0/1992671957 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:28:01.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.463+0000 7f74c5800640 1 -- 172.21.15.107:0/1992671957 >> v2:172.21.15.157:3300/0 conn(0x7f74c00d08d0 msgr2=0x7f74c00c68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:01.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.463+0000 7f74bfe00640 1 --2- 172.21.15.107:0/1992671957 >> v2:172.21.15.157:3300/0 conn(0x7f74c00d08d0 0x7f74c00c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.463+0000 7f74c5800640 1 --2- 172.21.15.107:0/1992671957 >> v2:172.21.15.157:3300/0 conn(0x7f74c00d08d0 0x7f74c00c68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.463+0000 7f74c5800640 1 -- 172.21.15.107:0/1992671957 >> v1:172.21.15.157:6789/0 conn(0x7f74c0158ce0 legacy=0x7f74c00cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:01.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.463+0000 7f74c5800640 1 -- 172.21.15.107:0/1992671957 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c00ceb20 con 0x7f74c00cb340 2024-08-17T02:28:01.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.463+0000 7f74bfe00640 1 --2- 172.21.15.107:0/1992671957 >> v2:172.21.15.157:3300/0 conn(0x7f74c00d08d0 0x7f74c00c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:01.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.464+0000 7f74c5800640 1 --2- 172.21.15.107:0/1992671957 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74c00cb340 0x7f74c01590b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f74c00ca0a0 tx=0x7f74b8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=519e5f11a26ec9e0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:01.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.464+0000 7f74bf400640 1 -- 172.21.15.107:0/1992671957 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b8007400 con 0x7f74c00cb340 2024-08-17T02:28:01.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.464+0000 7f74bf400640 1 -- 172.21.15.107:0/1992671957 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b8007560 con 0x7f74c00cb340 2024-08-17T02:28:01.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.464+0000 7f74bf400640 1 -- 172.21.15.107:0/1992671957 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b8007940 con 0x7f74c00cb340 2024-08-17T02:28:01.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.464+0000 7f74c7800640 1 -- 172.21.15.107:0/1992671957 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74c00cb340 msgr2=0x7f74c01590b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.464+0000 7f74c7800640 1 --2- 172.21.15.107:0/1992671957 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74c00cb340 0x7f74c01590b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f74c00ca0a0 tx=0x7f74b8009840 comp rx=0 tx=0).stop 2024-08-17T02:28:01.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.465+0000 7f74c7800640 1 -- 172.21.15.107:0/1992671957 shutdown_connections 2024-08-17T02:28:01.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.465+0000 7f74c7800640 1 --2- 172.21.15.107:0/1992671957 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74c00cb340 0x7f74c01590b0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.465+0000 7f74c7800640 1 --2- 172.21.15.107:0/1992671957 >> v2:172.21.15.157:3300/0 conn(0x7f74c00d08d0 0x7f74c00c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.465+0000 7f74c7800640 1 -- 172.21.15.107:0/1992671957 >> 172.21.15.107:0/1992671957 conn(0x7f74c00cfdc0 msgr2=0x7f74c00d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:01.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.465+0000 7f74c7800640 1 -- 172.21.15.107:0/1992671957 shutdown_connections 2024-08-17T02:28:01.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.465+0000 7f74c7800640 1 -- 172.21.15.107:0/1992671957 wait complete. 2024-08-17T02:28:01.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.466+0000 7f74c7800640 1 Processor -- start 2024-08-17T02:28:01.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.466+0000 7f74c7800640 1 -- start start 2024-08-17T02:28:01.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.467+0000 7f74c7800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f74c00cb340 0x7f74c00c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.467+0000 7f74c7800640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f74c00d08d0 0x7f74c00c7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.467+0000 7f74c7800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74c0158ce0 0x7f74c01538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.467+0000 7f74c7800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c00c7c50 con 0x7f74c0158ce0 2024-08-17T02:28:01.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.467+0000 7f74c7800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c01591e0 con 0x7f74c00cb340 2024-08-17T02:28:01.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.467+0000 7f74c7800640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c0159480 con 0x7f74c00d08d0 2024-08-17T02:28:01.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.467+0000 7f74c5800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74c0158ce0 0x7f74c01538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.468+0000 7f74c5800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74c0158ce0 0x7f74c01538f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47176/0 (socket says 172.21.15.107:47176) 2024-08-17T02:28:01.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.468+0000 7f74c5800640 1 -- 172.21.15.107:0/3932421454 learned_addr learned my addr 172.21.15.107:0/3932421454 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:28:01.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.468+0000 7f74bfe00640 1 --2- 172.21.15.107:0/3932421454 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f74c00d08d0 0x7f74c00c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.468+0000 7f74c4e00640 1 --2- 172.21.15.107:0/3932421454 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f74c00cb340 0x7f74c00c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.468+0000 7f74c5800640 1 -- 172.21.15.107:0/3932421454 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f74c00d08d0 msgr2=0x7f74c00c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.468+0000 7f74c5800640 1 --2- 172.21.15.107:0/3932421454 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f74c00d08d0 0x7f74c00c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.468+0000 7f74c5800640 1 -- 172.21.15.107:0/3932421454 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f74c00cb340 msgr2=0x7f74c00c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.468+0000 7f74c5800640 1 --2- 172.21.15.107:0/3932421454 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f74c00cb340 0x7f74c00c9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.468+0000 7f74c5800640 1 -- 172.21.15.107:0/3932421454 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b8009ae0 con 0x7f74c0158ce0 2024-08-17T02:28:01.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.468+0000 7f74c5800640 1 --2- 172.21.15.107:0/3932421454 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74c0158ce0 0x7f74c01538f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f74b8009f50 tx=0x7f74b8034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:01.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.469+0000 7f74b3e00640 1 -- 172.21.15.107:0/3932421454 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b8032e10 con 0x7f74c0158ce0 2024-08-17T02:28:01.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.469+0000 7f74b3e00640 1 -- 172.21.15.107:0/3932421454 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b803d430 con 0x7f74c0158ce0 2024-08-17T02:28:01.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.469+0000 7f74b3e00640 1 -- 172.21.15.107:0/3932421454 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b803d7f0 con 0x7f74c0158ce0 2024-08-17T02:28:01.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.469+0000 7f74c7800640 1 -- 172.21.15.107:0/3932421454 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74c0159760 con 0x7f74c0158ce0 2024-08-17T02:28:01.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.469+0000 7f74c7800640 1 -- 172.21.15.107:0/3932421454 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c00c7e60 con 0x7f74c0158ce0 2024-08-17T02:28:01.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.470+0000 7f74c7800640 1 -- 172.21.15.107:0/3932421454 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74c0064db0 con 0x7f74c0158ce0 2024-08-17T02:28:01.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.471+0000 7f74b3e00640 1 -- 172.21.15.107:0/3932421454 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f74b803dc20 con 0x7f74c0158ce0 2024-08-17T02:28:01.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.472+0000 7f74b3e00640 1 --2- 172.21.15.107:0/3932421454 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f74a0065150 0x7f74a0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.472+0000 7f74b3e00640 1 -- 172.21.15.107:0/3932421454 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f74b80a3910 con 0x7f74c0158ce0 2024-08-17T02:28:01.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.472+0000 7f74c4e00640 1 --2- 172.21.15.107:0/3932421454 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f74a0065150 0x7f74a0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.473+0000 7f74c4e00640 1 --2- 172.21.15.107:0/3932421454 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f74a0065150 0x7f74a0067600 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f74b4009a60 tx=0x7f74b4006f50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:01.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.476+0000 7f74b3e00640 1 -- 172.21.15.107:0/3932421454 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f74b8071de0 con 0x7f74c0158ce0 2024-08-17T02:28:01.655 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.653+0000 7f74c7800640 1 -- 172.21.15.107:0/3932421454 --> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f74c0068480 con 0x7f74a0065150 2024-08-17T02:28:01.655 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.654+0000 7f74b3e00640 1 -- 172.21.15.107:0/3932421454 <== mgr.4110 v2:172.21.15.107:6832/37039 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f74c0068480 con 0x7f74a0065150 2024-08-17T02:28:01.655 INFO:teuthology.orchestra.run.smithi107.stderr:instructed osd(s) 4 to deep-scrub 2024-08-17T02:28:01.657 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.657+0000 7f74c7800640 1 -- 172.21.15.107:0/3932421454 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f74a0065150 msgr2=0x7f74a0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.657+0000 7f74c7800640 1 --2- 172.21.15.107:0/3932421454 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f74a0065150 0x7f74a0067600 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f74b4009a60 tx=0x7f74b4006f50 comp rx=0 tx=0).stop 2024-08-17T02:28:01.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.657+0000 7f74c7800640 1 -- 172.21.15.107:0/3932421454 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74c0158ce0 msgr2=0x7f74c01538f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.657+0000 7f74c7800640 1 --2- 172.21.15.107:0/3932421454 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74c0158ce0 0x7f74c01538f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f74b8009f50 tx=0x7f74b8034000 comp rx=0 tx=0).stop 2024-08-17T02:28:01.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.657+0000 7f74c7800640 1 -- 172.21.15.107:0/3932421454 shutdown_connections 2024-08-17T02:28:01.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.657+0000 7f74c7800640 1 --2- 172.21.15.107:0/3932421454 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f74a0065150 0x7f74a0067600 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.657+0000 7f74c7800640 1 --2- 172.21.15.107:0/3932421454 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74c0158ce0 0x7f74c01538f0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.657+0000 7f74c7800640 1 --2- 172.21.15.107:0/3932421454 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f74c00d08d0 0x7f74c00c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.657+0000 7f74c7800640 1 --2- 172.21.15.107:0/3932421454 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f74c00cb340 0x7f74c00c9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.657+0000 7f74c7800640 1 -- 172.21.15.107:0/3932421454 >> 172.21.15.107:0/3932421454 conn(0x7f74c00cfdc0 msgr2=0x7f74c00675f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:01.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.657+0000 7f74c7800640 1 -- 172.21.15.107:0/3932421454 shutdown_connections 2024-08-17T02:28:01.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.657+0000 7f74c7800640 1 -- 172.21.15.107:0/3932421454 wait complete. 2024-08-17T02:28:01.672 INFO:tasks.ceph:Scrubbing osd.5 2024-08-17T02:28:01.672 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:28:01.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.821+0000 7f86c9400640 1 Processor -- start 2024-08-17T02:28:01.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.822+0000 7f86c9400640 1 -- start start 2024-08-17T02:28:01.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.823+0000 7f86c9400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f86c4155880 0x7f86c40ae630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.823+0000 7f86c9400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86c40aeb70 0x7f86c40af0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.823+0000 7f86c9400640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c4157840 con 0x7f86c4155c50 2024-08-17T02:28:01.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.823+0000 7f86c9400640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86c4156c30 con 0x7f86c4155880 2024-08-17T02:28:01.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.823+0000 7f86c9400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c4156f10 con 0x7f86c40aeb70 2024-08-17T02:28:01.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.823+0000 7f86c3400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86c40aeb70 0x7f86c40af0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.823+0000 7f86c3e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f86c4155880 0x7f86c40ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.823+0000 7f86c8a00640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f86c4155c50 0x7f86c41596b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.107:33638/0 (socket says 172.21.15.107:33638) 2024-08-17T02:28:01.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.824+0000 7f86c8a00640 1 -- 172.21.15.107:0/697629386 learned_addr learned my addr 172.21.15.107:0/697629386 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:28:01.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.824+0000 7f86c2a00640 1 -- 172.21.15.107:0/697629386 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2484953555 0 0) 0x7f86c4157840 con 0x7f86c4155c50 2024-08-17T02:28:01.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.824+0000 7f86c2a00640 1 -- 172.21.15.107:0/697629386 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86a80034e0 con 0x7f86c4155c50 2024-08-17T02:28:01.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.824+0000 7f86c3e00640 1 -- 172.21.15.107:0/697629386 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86c40aeb70 msgr2=0x7f86c40af0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:01.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.824+0000 7f86c3e00640 1 --2- 172.21.15.107:0/697629386 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86c40aeb70 0x7f86c40af0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.824+0000 7f86c3e00640 1 -- 172.21.15.107:0/697629386 >> v1:172.21.15.157:6789/0 conn(0x7f86c4155c50 legacy=0x7f86c41596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.824+0000 7f86c3e00640 1 -- 172.21.15.107:0/697629386 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c41571f0 con 0x7f86c4155880 2024-08-17T02:28:01.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.824+0000 7f86c3400640 1 --2- 172.21.15.107:0/697629386 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86c40aeb70 0x7f86c40af0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:01.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.825+0000 7f86c3e00640 1 --2- 172.21.15.107:0/697629386 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86c4155880 0x7f86c40ae630 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f86b4009850 tx=0x7f86b40090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=880782ba2a134ed7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:01.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.825+0000 7f86c2a00640 1 -- 172.21.15.107:0/697629386 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b402ad80 con 0x7f86c4155880 2024-08-17T02:28:01.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.825+0000 7f86c2a00640 1 -- 172.21.15.107:0/697629386 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b4032440 con 0x7f86c4155880 2024-08-17T02:28:01.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.825+0000 7f86c2a00640 1 -- 172.21.15.107:0/697629386 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b4032820 con 0x7f86c4155880 2024-08-17T02:28:01.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.826+0000 7f86c9400640 1 -- 172.21.15.107:0/697629386 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86c4155880 msgr2=0x7f86c40ae630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.826+0000 7f86c9400640 1 --2- 172.21.15.107:0/697629386 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86c4155880 0x7f86c40ae630 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f86b4009850 tx=0x7f86b40090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.826+0000 7f86c9400640 1 -- 172.21.15.107:0/697629386 shutdown_connections 2024-08-17T02:28:01.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.826+0000 7f86c9400640 1 --2- 172.21.15.107:0/697629386 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86c40aeb70 0x7f86c40af0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.826+0000 7f86c9400640 1 --2- 172.21.15.107:0/697629386 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86c4155880 0x7f86c40ae630 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.826+0000 7f86c9400640 1 -- 172.21.15.107:0/697629386 >> 172.21.15.107:0/697629386 conn(0x7f86c4067750 msgr2=0x7f86c40cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:01.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.826+0000 7f86c9400640 1 -- 172.21.15.107:0/697629386 shutdown_connections 2024-08-17T02:28:01.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.826+0000 7f86c9400640 1 -- 172.21.15.107:0/697629386 wait complete. 2024-08-17T02:28:01.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.827+0000 7f86c9400640 1 Processor -- start 2024-08-17T02:28:01.833 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.828+0000 7f86c9400640 1 -- start start 2024-08-17T02:28:01.833 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.828+0000 7f86c9400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86c40aeb70 0x7f86c413a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.833 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.828+0000 7f86c9400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86c4155880 0x7f86c4144520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.829+0000 7f86c9400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86c4155c50 0x7f86c4144a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.829+0000 7f86c9400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c413ed20 con 0x7f86c40aeb70 2024-08-17T02:28:01.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.829+0000 7f86c9400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c413e3f0 con 0x7f86c4155880 2024-08-17T02:28:01.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.829+0000 7f86c9400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c413e6d0 con 0x7f86c4155c50 2024-08-17T02:28:01.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.829+0000 7f86c3e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86c40aeb70 0x7f86c413a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.829+0000 7f86c3e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86c40aeb70 0x7f86c413a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47184/0 (socket says 172.21.15.107:47184) 2024-08-17T02:28:01.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.829+0000 7f86c3e00640 1 -- 172.21.15.107:0/2583909440 learned_addr learned my addr 172.21.15.107:0/2583909440 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:28:01.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.829+0000 7f86c3400640 1 --2- 172.21.15.107:0/2583909440 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86c4155880 0x7f86c4144520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.829+0000 7f86c8a00640 1 --2- 172.21.15.107:0/2583909440 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86c4155c50 0x7f86c4144a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.829+0000 7f86c3e00640 1 -- 172.21.15.107:0/2583909440 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86c4155c50 msgr2=0x7f86c4144a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.829+0000 7f86c3e00640 1 --2- 172.21.15.107:0/2583909440 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86c4155c50 0x7f86c4144a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.829+0000 7f86c3e00640 1 -- 172.21.15.107:0/2583909440 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86c4155880 msgr2=0x7f86c4144520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.829+0000 7f86c3e00640 1 --2- 172.21.15.107:0/2583909440 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86c4155880 0x7f86c4144520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.829+0000 7f86c3e00640 1 -- 172.21.15.107:0/2583909440 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b0009390 con 0x7f86c40aeb70 2024-08-17T02:28:01.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.830+0000 7f86c3e00640 1 --2- 172.21.15.107:0/2583909440 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86c40aeb70 0x7f86c413a2a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f86b4009360 tx=0x7f86b4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:01.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.830+0000 7f86bb400640 1 -- 172.21.15.107:0/2583909440 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b4031c20 con 0x7f86c40aeb70 2024-08-17T02:28:01.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.830+0000 7f86bb400640 1 -- 172.21.15.107:0/2583909440 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b4031da0 con 0x7f86c40aeb70 2024-08-17T02:28:01.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.830+0000 7f86c9400640 1 -- 172.21.15.107:0/2583909440 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86b4009390 con 0x7f86c40aeb70 2024-08-17T02:28:01.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.830+0000 7f86bb400640 1 -- 172.21.15.107:0/2583909440 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b403d670 con 0x7f86c40aeb70 2024-08-17T02:28:01.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.830+0000 7f86c9400640 1 -- 172.21.15.107:0/2583909440 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c413e020 con 0x7f86c40aeb70 2024-08-17T02:28:01.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.831+0000 7f86c9400640 1 -- 172.21.15.107:0/2583909440 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f86c4071050 con 0x7f86c40aeb70 2024-08-17T02:28:01.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.832+0000 7f86bb400640 1 -- 172.21.15.107:0/2583909440 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f86b4039040 con 0x7f86c40aeb70 2024-08-17T02:28:01.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.833+0000 7f86bb400640 1 --2- 172.21.15.107:0/2583909440 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f86a4065150 0x7f86a4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.833+0000 7f86bb400640 1 -- 172.21.15.107:0/2583909440 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f86b40a2230 con 0x7f86c40aeb70 2024-08-17T02:28:01.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.833+0000 7f86bb400640 1 --2- 172.21.15.107:0/2583909440 >> [v2:172.21.15.157:6802/37328,v1:172.21.15.157:6804/37328] conn(0x7f86a406b040 0x7f86a406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.833+0000 7f86c3400640 1 --2- 172.21.15.107:0/2583909440 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f86a4065150 0x7f86a4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.833+0000 7f86bb400640 1 -- 172.21.15.107:0/2583909440 --> [v2:172.21.15.157:6802/37328,v1:172.21.15.157:6804/37328] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f86a406db00 con 0x7f86a406b040 2024-08-17T02:28:01.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.833+0000 7f86bb400640 1 -- 172.21.15.107:0/2583909440 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f86b40a4810 con 0x7f86c40aeb70 2024-08-17T02:28:01.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.833+0000 7f86c8a00640 1 --2- 172.21.15.107:0/2583909440 >> [v2:172.21.15.157:6802/37328,v1:172.21.15.157:6804/37328] conn(0x7f86a406b040 0x7f86a406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.833+0000 7f86c3400640 1 --2- 172.21.15.107:0/2583909440 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f86a4065150 0x7f86a4067600 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f86c41411e0 tx=0x7f86b00090f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:01.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.834+0000 7f86c8a00640 1 --2- 172.21.15.107:0/2583909440 >> [v2:172.21.15.157:6802/37328,v1:172.21.15.157:6804/37328] conn(0x7f86a406b040 0x7f86a406d450 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:01.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.835+0000 7f86bb400640 1 -- 172.21.15.107:0/2583909440 <== osd.5 v2:172.21.15.157:6802/37328 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f86a406db00 con 0x7f86a406b040 2024-08-17T02:28:01.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.847+0000 7f86c9400640 1 -- 172.21.15.107:0/2583909440 --> [v2:172.21.15.157:6802/37328,v1:172.21.15.157:6804/37328] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f86c40650c0 con 0x7f86a406b040 2024-08-17T02:28:01.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.849+0000 7f86bb400640 1 -- 172.21.15.107:0/2583909440 <== osd.5 v2:172.21.15.157:6802/37328 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f86c40650c0 con 0x7f86a406b040 2024-08-17T02:28:01.849 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-08-17T02:28:01.850 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:28:01.850 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-08-17T02:28:01.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.849+0000 7f86c9400640 1 -- 172.21.15.107:0/2583909440 >> [v2:172.21.15.157:6802/37328,v1:172.21.15.157:6804/37328] conn(0x7f86a406b040 msgr2=0x7f86a406d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.849+0000 7f86c9400640 1 --2- 172.21.15.107:0/2583909440 >> [v2:172.21.15.157:6802/37328,v1:172.21.15.157:6804/37328] conn(0x7f86a406b040 0x7f86a406d450 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.849+0000 7f86c9400640 1 -- 172.21.15.107:0/2583909440 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f86a4065150 msgr2=0x7f86a4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.849+0000 7f86c9400640 1 --2- 172.21.15.107:0/2583909440 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f86a4065150 0x7f86a4067600 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f86c41411e0 tx=0x7f86b00090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.849+0000 7f86c9400640 1 -- 172.21.15.107:0/2583909440 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86c40aeb70 msgr2=0x7f86c413a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.849+0000 7f86c9400640 1 --2- 172.21.15.107:0/2583909440 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86c40aeb70 0x7f86c413a2a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f86b4009360 tx=0x7f86b4032000 comp rx=0 tx=0).stop 2024-08-17T02:28:01.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.849+0000 7f86c8a00640 1 -- 172.21.15.107:0/2583909440 reap_dead start 2024-08-17T02:28:01.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.849+0000 7f86c9400640 1 -- 172.21.15.107:0/2583909440 shutdown_connections 2024-08-17T02:28:01.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.849+0000 7f86c9400640 1 -- 172.21.15.107:0/2583909440 >> 172.21.15.107:0/2583909440 conn(0x7f86c4067750 msgr2=0x7f86c40aef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:01.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.849+0000 7f86c9400640 1 -- 172.21.15.107:0/2583909440 shutdown_connections 2024-08-17T02:28:01.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:01.849+0000 7f86c9400640 1 -- 172.21.15.107:0/2583909440 wait complete. 2024-08-17T02:28:01.864 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-08-17T02:28:02.011 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.010+0000 7f4b23400640 1 Processor -- start 2024-08-17T02:28:02.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.010+0000 7f4b23400640 1 -- start start 2024-08-17T02:28:02.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.011+0000 7f4b23400640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4b1c0aa7d0 0x7f4b1c06ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.011+0000 7f4b23400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4b1c158fa0 0x7f4b1c0ab6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.011+0000 7f4b23400640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b1c0a9a10 con 0x7f4b1c06da20 2024-08-17T02:28:02.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.012+0000 7f4b23400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b1c0ac400 con 0x7f4b1c158fa0 2024-08-17T02:28:02.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.012+0000 7f4b23400640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b1c0a9cf0 con 0x7f4b1c0aa7d0 2024-08-17T02:28:02.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.012+0000 7f4b21400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4b1c158fa0 0x7f4b1c0ab6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.012+0000 7f4b21400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4b1c158fa0 0x7f4b1c0ab6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47198/0 (socket says 172.21.15.107:47198) 2024-08-17T02:28:02.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.012+0000 7f4b21400640 1 -- 172.21.15.107:0/1314979359 learned_addr learned my addr 172.21.15.107:0/1314979359 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:28:02.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.012+0000 7f4b13e00640 1 --2- 172.21.15.107:0/1314979359 >> v2:172.21.15.157:3300/0 conn(0x7f4b1c0aa7d0 0x7f4b1c06ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.012+0000 7f4b21400640 1 -- 172.21.15.107:0/1314979359 >> v2:172.21.15.157:3300/0 conn(0x7f4b1c0aa7d0 msgr2=0x7f4b1c06ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:02.015 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.012+0000 7f4b21400640 1 --2- 172.21.15.107:0/1314979359 >> v2:172.21.15.157:3300/0 conn(0x7f4b1c0aa7d0 0x7f4b1c06ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.015 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.012+0000 7f4b21400640 1 -- 172.21.15.107:0/1314979359 >> v1:172.21.15.157:6789/0 conn(0x7f4b1c06da20 legacy=0x7f4b1c158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.015 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.012+0000 7f4b21400640 1 -- 172.21.15.107:0/1314979359 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b1c0a9fd0 con 0x7f4b1c158fa0 2024-08-17T02:28:02.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.013+0000 7f4b21400640 1 --2- 172.21.15.107:0/1314979359 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b1c158fa0 0x7f4b1c0ab6d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c0ccaa0 tx=0x7f4b14009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dc7294c25b58cd1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:02.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.013+0000 7f4b1be00640 1 -- 172.21.15.107:0/1314979359 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b14031400 con 0x7f4b1c158fa0 2024-08-17T02:28:02.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.014+0000 7f4b1be00640 1 -- 172.21.15.107:0/1314979359 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1402d050 con 0x7f4b1c158fa0 2024-08-17T02:28:02.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.014+0000 7f4b1be00640 1 -- 172.21.15.107:0/1314979359 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b140317d0 con 0x7f4b1c158fa0 2024-08-17T02:28:02.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.014+0000 7f4b23400640 1 -- 172.21.15.107:0/1314979359 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b1c158fa0 msgr2=0x7f4b1c0ab6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.014+0000 7f4b23400640 1 --2- 172.21.15.107:0/1314979359 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b1c158fa0 0x7f4b1c0ab6d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c0ccaa0 tx=0x7f4b14009840 comp rx=0 tx=0).stop 2024-08-17T02:28:02.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.014+0000 7f4b23400640 1 -- 172.21.15.107:0/1314979359 shutdown_connections 2024-08-17T02:28:02.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.014+0000 7f4b23400640 1 --2- 172.21.15.107:0/1314979359 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b1c158fa0 0x7f4b1c0ab6d0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.014+0000 7f4b23400640 1 --2- 172.21.15.107:0/1314979359 >> v2:172.21.15.157:3300/0 conn(0x7f4b1c0aa7d0 0x7f4b1c06ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.014+0000 7f4b23400640 1 -- 172.21.15.107:0/1314979359 >> 172.21.15.107:0/1314979359 conn(0x7f4b1c0cb9b0 msgr2=0x7f4b1c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:02.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.014+0000 7f4b23400640 1 -- 172.21.15.107:0/1314979359 shutdown_connections 2024-08-17T02:28:02.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.014+0000 7f4b23400640 1 -- 172.21.15.107:0/1314979359 wait complete. 2024-08-17T02:28:02.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.016+0000 7f4b23400640 1 Processor -- start 2024-08-17T02:28:02.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.016+0000 7f4b23400640 1 -- start start 2024-08-17T02:28:02.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.016+0000 7f4b23400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b1c06da20 0x7f4b1c157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.017+0000 7f4b23400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b1c0aa7d0 0x7f4b1c15b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.017+0000 7f4b23400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b1c158fa0 0x7f4b1c0caef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.017+0000 7f4b23400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c15a520 con 0x7f4b1c158fa0 2024-08-17T02:28:02.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.017+0000 7f4b23400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c157c90 con 0x7f4b1c06da20 2024-08-17T02:28:02.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.017+0000 7f4b23400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c15a770 con 0x7f4b1c0aa7d0 2024-08-17T02:28:02.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.017+0000 7f4b21400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b1c158fa0 0x7f4b1c0caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.017+0000 7f4b21400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b1c158fa0 0x7f4b1c0caef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47214/0 (socket says 172.21.15.107:47214) 2024-08-17T02:28:02.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.017+0000 7f4b20a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b1c06da20 0x7f4b1c157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.017+0000 7f4b21400640 1 -- 172.21.15.107:0/4230966490 learned_addr learned my addr 172.21.15.107:0/4230966490 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:28:02.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.017+0000 7f4b13e00640 1 --2- 172.21.15.107:0/4230966490 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b1c0aa7d0 0x7f4b1c15b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.017+0000 7f4b21400640 1 -- 172.21.15.107:0/4230966490 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b1c0aa7d0 msgr2=0x7f4b1c15b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.017+0000 7f4b21400640 1 --2- 172.21.15.107:0/4230966490 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b1c0aa7d0 0x7f4b1c15b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.017+0000 7f4b21400640 1 -- 172.21.15.107:0/4230966490 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b1c06da20 msgr2=0x7f4b1c157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.017+0000 7f4b21400640 1 --2- 172.21.15.107:0/4230966490 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b1c06da20 0x7f4b1c157690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.017+0000 7f4b21400640 1 -- 172.21.15.107:0/4230966490 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b14009ae0 con 0x7f4b1c158fa0 2024-08-17T02:28:02.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.017+0000 7f4b20a00640 1 --2- 172.21.15.107:0/4230966490 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b1c06da20 0x7f4b1c157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:02.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.018+0000 7f4b21400640 1 --2- 172.21.15.107:0/4230966490 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b1c158fa0 0x7f4b1c0caef0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4b1402acd0 tx=0x7f4b14034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:02.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.018+0000 7f4b18c00640 1 -- 172.21.15.107:0/4230966490 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b14008e50 con 0x7f4b1c158fa0 2024-08-17T02:28:02.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.018+0000 7f4b18c00640 1 -- 172.21.15.107:0/4230966490 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1403b410 con 0x7f4b1c158fa0 2024-08-17T02:28:02.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.018+0000 7f4b18c00640 1 -- 172.21.15.107:0/4230966490 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1403b7d0 con 0x7f4b1c158fa0 2024-08-17T02:28:02.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.018+0000 7f4b23400640 1 -- 172.21.15.107:0/4230966490 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b1c15aa50 con 0x7f4b1c158fa0 2024-08-17T02:28:02.023 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.018+0000 7f4b23400640 1 -- 172.21.15.107:0/4230966490 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b1c169990 con 0x7f4b1c158fa0 2024-08-17T02:28:02.023 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.019+0000 7f4b23400640 1 -- 172.21.15.107:0/4230966490 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b1c0abb50 con 0x7f4b1c158fa0 2024-08-17T02:28:02.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.020+0000 7f4b18c00640 1 -- 172.21.15.107:0/4230966490 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4b14038050 con 0x7f4b1c158fa0 2024-08-17T02:28:02.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.020+0000 7f4b18c00640 1 --2- 172.21.15.107:0/4230966490 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4af8065150 0x7f4af8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.021+0000 7f4b18c00640 1 -- 172.21.15.107:0/4230966490 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f4b140a2820 con 0x7f4b1c158fa0 2024-08-17T02:28:02.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.021+0000 7f4b20a00640 1 --2- 172.21.15.107:0/4230966490 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4af8065150 0x7f4af8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.021+0000 7f4b20a00640 1 --2- 172.21.15.107:0/4230966490 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4af8065150 0x7f4af8067600 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c007fd0 tx=0x7f4b0c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:02.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.024+0000 7f4b18c00640 1 -- 172.21.15.107:0/4230966490 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4b14070b90 con 0x7f4b1c158fa0 2024-08-17T02:28:02.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.197+0000 7f4b23400640 1 -- 172.21.15.107:0/4230966490 --> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f4b1c064db0 con 0x7f4af8065150 2024-08-17T02:28:02.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.197+0000 7f4b18c00640 1 -- 172.21.15.107:0/4230966490 <== mgr.4110 v2:172.21.15.107:6832/37039 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4b1c064db0 con 0x7f4af8065150 2024-08-17T02:28:02.199 INFO:teuthology.orchestra.run.smithi107.stderr:instructed osd(s) 5 to deep-scrub 2024-08-17T02:28:02.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.199+0000 7f4b23400640 1 -- 172.21.15.107:0/4230966490 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4af8065150 msgr2=0x7f4af8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.199+0000 7f4b23400640 1 --2- 172.21.15.107:0/4230966490 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4af8065150 0x7f4af8067600 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c007fd0 tx=0x7f4b0c009040 comp rx=0 tx=0).stop 2024-08-17T02:28:02.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.199+0000 7f4b23400640 1 -- 172.21.15.107:0/4230966490 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b1c158fa0 msgr2=0x7f4b1c0caef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.199+0000 7f4b23400640 1 --2- 172.21.15.107:0/4230966490 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b1c158fa0 0x7f4b1c0caef0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4b1402acd0 tx=0x7f4b14034000 comp rx=0 tx=0).stop 2024-08-17T02:28:02.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.200+0000 7f4b23400640 1 -- 172.21.15.107:0/4230966490 shutdown_connections 2024-08-17T02:28:02.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.200+0000 7f4b23400640 1 --2- 172.21.15.107:0/4230966490 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4af8065150 0x7f4af8067600 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.200+0000 7f4b23400640 1 --2- 172.21.15.107:0/4230966490 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b1c158fa0 0x7f4b1c0caef0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.200+0000 7f4b23400640 1 --2- 172.21.15.107:0/4230966490 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4b1c0aa7d0 0x7f4b1c15b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.200+0000 7f4b23400640 1 --2- 172.21.15.107:0/4230966490 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b1c06da20 0x7f4b1c157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.200+0000 7f4b23400640 1 -- 172.21.15.107:0/4230966490 >> 172.21.15.107:0/4230966490 conn(0x7f4b1c0cb9b0 msgr2=0x7f4b1c15e890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:02.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.200+0000 7f4b23400640 1 -- 172.21.15.107:0/4230966490 shutdown_connections 2024-08-17T02:28:02.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.200+0000 7f4b23400640 1 -- 172.21.15.107:0/4230966490 wait complete. 2024-08-17T02:28:02.216 INFO:tasks.ceph:Scrubbing osd.6 2024-08-17T02:28:02.216 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:28:02.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.366+0000 7f0ffea00640 1 Processor -- start 2024-08-17T02:28:02.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.366+0000 7f0ffea00640 1 -- start start 2024-08-17T02:28:02.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.367+0000 7f0ffea00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0ff806e5f0 0x7f0ff80c8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.367+0000 7f0ffea00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0ff8156c60 0x7f0ff80c8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.367+0000 7f0ffea00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ff80ae9b0 con 0x7f0ff8156890 2024-08-17T02:28:02.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.367+0000 7f0ffea00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff80c8bb0 con 0x7f0ff8156c60 2024-08-17T02:28:02.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.367+0000 7f0ffea00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff80aa730 con 0x7f0ff806e5f0 2024-08-17T02:28:02.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.367+0000 7f0ffca00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0ff8156c60 0x7f0ff80c8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.367+0000 7f0ffca00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0ff8156c60 0x7f0ff80c8670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47220/0 (socket says 172.21.15.107:47220) 2024-08-17T02:28:02.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.367+0000 7f0ffca00640 1 -- 172.21.15.107:0/2971825495 learned_addr learned my addr 172.21.15.107:0/2971825495 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:28:02.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.368+0000 7f0fef400640 1 --2- 172.21.15.107:0/2971825495 >> v2:172.21.15.157:3300/0 conn(0x7f0ff806e5f0 0x7f0ff80c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.368+0000 7f0ffca00640 1 -- 172.21.15.107:0/2971825495 >> v2:172.21.15.157:3300/0 conn(0x7f0ff806e5f0 msgr2=0x7f0ff80c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:02.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.368+0000 7f0ffca00640 1 --2- 172.21.15.107:0/2971825495 >> v2:172.21.15.157:3300/0 conn(0x7f0ff806e5f0 0x7f0ff80c8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.368+0000 7f0ffca00640 1 -- 172.21.15.107:0/2971825495 >> v1:172.21.15.157:6789/0 conn(0x7f0ff8156890 legacy=0x7f0ff806dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:02.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.368+0000 7f0ffca00640 1 -- 172.21.15.107:0/2971825495 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff80ab320 con 0x7f0ff8156c60 2024-08-17T02:28:02.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.368+0000 7f0fef400640 1 --2- 172.21.15.107:0/2971825495 >> v2:172.21.15.157:3300/0 conn(0x7f0ff806e5f0 0x7f0ff80c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:02.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.369+0000 7f0ffca00640 1 --2- 172.21.15.107:0/2971825495 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ff8156c60 0x7f0ff80c8670 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0ff80ab5e0 tx=0x7f0ff0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6f207c59bf40e9e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:02.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.369+0000 7f0ff7400640 1 -- 172.21.15.107:0/2971825495 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0031400 con 0x7f0ff8156c60 2024-08-17T02:28:02.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.369+0000 7f0ff7400640 1 -- 172.21.15.107:0/2971825495 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff002d050 con 0x7f0ff8156c60 2024-08-17T02:28:02.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.369+0000 7f0ff7400640 1 -- 172.21.15.107:0/2971825495 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff00317d0 con 0x7f0ff8156c60 2024-08-17T02:28:02.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.369+0000 7f0ffea00640 1 -- 172.21.15.107:0/2971825495 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ff8156c60 msgr2=0x7f0ff80c8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.369+0000 7f0ffea00640 1 --2- 172.21.15.107:0/2971825495 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ff8156c60 0x7f0ff80c8670 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0ff80ab5e0 tx=0x7f0ff0009840 comp rx=0 tx=0).stop 2024-08-17T02:28:02.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.370+0000 7f0ffea00640 1 -- 172.21.15.107:0/2971825495 shutdown_connections 2024-08-17T02:28:02.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.370+0000 7f0ffea00640 1 --2- 172.21.15.107:0/2971825495 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ff8156c60 0x7f0ff80c8670 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.370+0000 7f0ffea00640 1 --2- 172.21.15.107:0/2971825495 >> v2:172.21.15.157:3300/0 conn(0x7f0ff806e5f0 0x7f0ff80c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.370+0000 7f0ffea00640 1 -- 172.21.15.107:0/2971825495 >> 172.21.15.107:0/2971825495 conn(0x7f0ff8067750 msgr2=0x7f0ff806c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:02.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.370+0000 7f0ffea00640 1 -- 172.21.15.107:0/2971825495 shutdown_connections 2024-08-17T02:28:02.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.370+0000 7f0ffea00640 1 -- 172.21.15.107:0/2971825495 wait complete. 2024-08-17T02:28:02.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.371+0000 7f0ffea00640 1 Processor -- start 2024-08-17T02:28:02.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.371+0000 7f0ffea00640 1 -- start start 2024-08-17T02:28:02.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.372+0000 7f0ffea00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ff806e5f0 0x7f0ff80ad1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.372+0000 7f0ffea00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ff8156890 0x7f0ff81690d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.372+0000 7f0ffea00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ff8156c60 0x7f0ff813f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.372+0000 7f0ffea00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff814c160 con 0x7f0ff806e5f0 2024-08-17T02:28:02.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.372+0000 7f0ffea00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff8169610 con 0x7f0ff8156c60 2024-08-17T02:28:02.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.372+0000 7f0ffea00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff813f9a0 con 0x7f0ff8156890 2024-08-17T02:28:02.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.372+0000 7f0ff7e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ff806e5f0 0x7f0ff80ad1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.372+0000 7f0ff7e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ff806e5f0 0x7f0ff80ad1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47230/0 (socket says 172.21.15.107:47230) 2024-08-17T02:28:02.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.372+0000 7f0ff7e00640 1 -- 172.21.15.107:0/1314359915 learned_addr learned my addr 172.21.15.107:0/1314359915 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:28:02.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.372+0000 7f0ffca00640 1 --2- 172.21.15.107:0/1314359915 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ff8156c60 0x7f0ff813f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.372+0000 7f0fef400640 1 --2- 172.21.15.107:0/1314359915 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ff8156890 0x7f0ff81690d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.373+0000 7f0ff7e00640 1 -- 172.21.15.107:0/1314359915 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ff8156890 msgr2=0x7f0ff81690d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.373+0000 7f0ff7e00640 1 --2- 172.21.15.107:0/1314359915 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ff8156890 0x7f0ff81690d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.373+0000 7f0ff7e00640 1 -- 172.21.15.107:0/1314359915 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ff8156c60 msgr2=0x7f0ff813f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.373+0000 7f0ff7e00640 1 --2- 172.21.15.107:0/1314359915 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ff8156c60 0x7f0ff813f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.373+0000 7f0ff7e00640 1 -- 172.21.15.107:0/1314359915 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff0009ae0 con 0x7f0ff806e5f0 2024-08-17T02:28:02.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.373+0000 7f0fef400640 1 --2- 172.21.15.107:0/1314359915 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ff8156890 0x7f0ff81690d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:02.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.373+0000 7f0ff7e00640 1 --2- 172.21.15.107:0/1314359915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ff806e5f0 0x7f0ff80ad1c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0fe800c5e0 tx=0x7f0fe8007ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:02.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.373+0000 7f0fefe00640 1 -- 172.21.15.107:0/1314359915 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe8012630 con 0x7f0ff806e5f0 2024-08-17T02:28:02.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.373+0000 7f0fefe00640 1 -- 172.21.15.107:0/1314359915 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe80127b0 con 0x7f0ff806e5f0 2024-08-17T02:28:02.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.373+0000 7f0ffea00640 1 -- 172.21.15.107:0/1314359915 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff8169890 con 0x7f0ff806e5f0 2024-08-17T02:28:02.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.373+0000 7f0fefe00640 1 -- 172.21.15.107:0/1314359915 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe8012b70 con 0x7f0ff806e5f0 2024-08-17T02:28:02.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.373+0000 7f0ffea00640 1 -- 172.21.15.107:0/1314359915 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff8169e50 con 0x7f0ff806e5f0 2024-08-17T02:28:02.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.374+0000 7f0ffea00640 1 -- 172.21.15.107:0/1314359915 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0ff80710c0 con 0x7f0ff806e5f0 2024-08-17T02:28:02.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.375+0000 7f0fefe00640 1 -- 172.21.15.107:0/1314359915 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0fe801b400 con 0x7f0ff806e5f0 2024-08-17T02:28:02.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.376+0000 7f0fefe00640 1 --2- 172.21.15.107:0/1314359915 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f0fd4065150 0x7f0fd4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.376+0000 7f0fefe00640 1 -- 172.21.15.107:0/1314359915 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f0fe80822f0 con 0x7f0ff806e5f0 2024-08-17T02:28:02.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.376+0000 7f0fef400640 1 --2- 172.21.15.107:0/1314359915 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f0fd4065150 0x7f0fd4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.376+0000 7f0fefe00640 1 --2- 172.21.15.107:0/1314359915 >> [v2:172.21.15.157:6800/37330,v1:172.21.15.157:6801/37330] conn(0x7f0fd406b040 0x7f0fd406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.376+0000 7f0fefe00640 1 -- 172.21.15.107:0/1314359915 --> [v2:172.21.15.157:6800/37330,v1:172.21.15.157:6801/37330] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0fd406db00 con 0x7f0fd406b040 2024-08-17T02:28:02.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.376+0000 7f0fefe00640 1 -- 172.21.15.107:0/1314359915 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0fe8084930 con 0x7f0ff806e5f0 2024-08-17T02:28:02.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.377+0000 7f0fef400640 1 --2- 172.21.15.107:0/1314359915 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f0fd4065150 0x7f0fd4067600 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0ff806a730 tx=0x7f0fe0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:02.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.377+0000 7f0ffca00640 1 --2- 172.21.15.107:0/1314359915 >> [v2:172.21.15.157:6800/37330,v1:172.21.15.157:6801/37330] conn(0x7f0fd406b040 0x7f0fd406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.378+0000 7f0ffca00640 1 --2- 172.21.15.107:0/1314359915 >> [v2:172.21.15.157:6800/37330,v1:172.21.15.157:6801/37330] conn(0x7f0fd406b040 0x7f0fd406d450 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:02.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.378+0000 7f0fefe00640 1 -- 172.21.15.107:0/1314359915 <== osd.6 v2:172.21.15.157:6800/37330 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f0fd406db00 con 0x7f0fd406b040 2024-08-17T02:28:02.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.392+0000 7f0ffea00640 1 -- 172.21.15.107:0/1314359915 --> [v2:172.21.15.157:6800/37330,v1:172.21.15.157:6801/37330] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0ff806e2f0 con 0x7f0fd406b040 2024-08-17T02:28:02.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.393+0000 7f0fefe00640 1 -- 172.21.15.107:0/1314359915 <== osd.6 v2:172.21.15.157:6800/37330 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f0ff806e2f0 con 0x7f0fd406b040 2024-08-17T02:28:02.393 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-08-17T02:28:02.393 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:28:02.393 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-08-17T02:28:02.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.393+0000 7f0ffea00640 1 -- 172.21.15.107:0/1314359915 >> [v2:172.21.15.157:6800/37330,v1:172.21.15.157:6801/37330] conn(0x7f0fd406b040 msgr2=0x7f0fd406d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.393+0000 7f0ffea00640 1 --2- 172.21.15.107:0/1314359915 >> [v2:172.21.15.157:6800/37330,v1:172.21.15.157:6801/37330] conn(0x7f0fd406b040 0x7f0fd406d450 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.393+0000 7f0ffea00640 1 -- 172.21.15.107:0/1314359915 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f0fd4065150 msgr2=0x7f0fd4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.393+0000 7f0ffea00640 1 --2- 172.21.15.107:0/1314359915 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f0fd4065150 0x7f0fd4067600 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0ff806a730 tx=0x7f0fe0008040 comp rx=0 tx=0).stop 2024-08-17T02:28:02.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.393+0000 7f0ffea00640 1 -- 172.21.15.107:0/1314359915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ff806e5f0 msgr2=0x7f0ff80ad1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.393+0000 7f0ffea00640 1 --2- 172.21.15.107:0/1314359915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ff806e5f0 0x7f0ff80ad1c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0fe800c5e0 tx=0x7f0fe8007ed0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.393+0000 7f0ffca00640 1 -- 172.21.15.107:0/1314359915 reap_dead start 2024-08-17T02:28:02.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.393+0000 7f0ffea00640 1 -- 172.21.15.107:0/1314359915 shutdown_connections 2024-08-17T02:28:02.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.393+0000 7f0ffea00640 1 -- 172.21.15.107:0/1314359915 >> 172.21.15.107:0/1314359915 conn(0x7f0ff8067750 msgr2=0x7f0ff81541e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:02.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.393+0000 7f0ffea00640 1 -- 172.21.15.107:0/1314359915 shutdown_connections 2024-08-17T02:28:02.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.393+0000 7f0ffea00640 1 -- 172.21.15.107:0/1314359915 wait complete. 2024-08-17T02:28:02.407 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-08-17T02:28:02.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.558+0000 7f4cf7c00640 1 Processor -- start 2024-08-17T02:28:02.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.558+0000 7f4cf7c00640 1 -- start start 2024-08-17T02:28:02.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.558+0000 7f4cf7c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4cf00cc430 0x7f4cf00cc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.558+0000 7f4cf7c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cf00ca700 con 0x7f4cf0062da0 2024-08-17T02:28:02.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.558+0000 7f4cf7c00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cf00684f0 con 0x7f4cf0067ef0 2024-08-17T02:28:02.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.558+0000 7f4cf7c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf00c9dd0 con 0x7f4cf00cc430 2024-08-17T02:28:02.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.558+0000 7f4cefe00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f4cf0062da0 0x7f4cf00cab90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:46978/0 (socket says 172.21.15.107:46978) 2024-08-17T02:28:02.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.558+0000 7f4cefe00640 1 -- 172.21.15.107:0/1700452361 learned_addr learned my addr 172.21.15.107:0/1700452361 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:28:02.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.559+0000 7f4cf5200640 1 --2- 172.21.15.107:0/1700452361 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4cf00cc430 0x7f4cf00cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.559+0000 7f4cef400640 1 -- 172.21.15.107:0/1700452361 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2019751677 0 0) 0x7f4cf00ca700 con 0x7f4cf0062da0 2024-08-17T02:28:02.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.559+0000 7f4cef400640 1 -- 172.21.15.107:0/1700452361 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cd80034e0 con 0x7f4cf0062da0 2024-08-17T02:28:02.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.559+0000 7f4cef400640 1 -- 172.21.15.107:0/1700452361 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 942475614 0 0) 0x7f4cf00684f0 con 0x7f4cf0067ef0 2024-08-17T02:28:02.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.559+0000 7f4cef400640 1 -- 172.21.15.107:0/1700452361 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cf00ca700 con 0x7f4cf0067ef0 2024-08-17T02:28:02.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.559+0000 7f4cef400640 1 -- 172.21.15.107:0/1700452361 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 299314229 0 0) 0x7f4cd80034e0 con 0x7f4cf0062da0 2024-08-17T02:28:02.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.559+0000 7f4cef400640 1 -- 172.21.15.107:0/1700452361 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4cf00cc430 msgr2=0x7f4cf00cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:02.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.559+0000 7f4cef400640 1 --2- 172.21.15.107:0/1700452361 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4cf00cc430 0x7f4cf00cc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.559+0000 7f4cef400640 1 -- 172.21.15.107:0/1700452361 >> v1:172.21.15.157:6789/0 conn(0x7f4cf0067ef0 legacy=0x7f4cf00cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.559+0000 7f4cef400640 1 -- 172.21.15.107:0/1700452361 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf00ca0b0 con 0x7f4cf0062da0 2024-08-17T02:28:02.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.559+0000 7f4cef400640 1 -- 172.21.15.107:0/1700452361 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 537989081 0 0) 0x7f4cdc001470 con 0x7f4cf0062da0 2024-08-17T02:28:02.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.559+0000 7f4cf5200640 1 --2- 172.21.15.107:0/1700452361 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4cf00cc430 0x7f4cf00cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:02.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.559+0000 7f4cef400640 1 -- 172.21.15.107:0/1700452361 >> v1:172.21.15.107:6789/0 conn(0x7f4cf0062da0 legacy=0x7f4cf00cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.559+0000 7f4cef400640 1 --2- 172.21.15.107:0/1700452361 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4cd8003b90 0x7f4cd8003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.559+0000 7f4cef400640 1 --2- 172.21.15.107:0/1700452361 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4cf00cc430 0x7f4cd8004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.564 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.559+0000 7f4cef400640 1 --2- 172.21.15.107:0/1700452361 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cd8004cc0 0x7f4cd8005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.564 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.559+0000 7f4cef400640 1 -- 172.21.15.107:0/1700452361 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf00c9dd0 con 0x7f4cd8004cc0 2024-08-17T02:28:02.564 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.559+0000 7f4cef400640 1 -- 172.21.15.107:0/1700452361 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd800bae0 con 0x7f4cd8003b90 2024-08-17T02:28:02.564 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.559+0000 7f4cef400640 1 -- 172.21.15.107:0/1700452361 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd800bca0 con 0x7f4cf00cc430 2024-08-17T02:28:02.564 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.560+0000 7f4cf5c00640 1 --2- 172.21.15.107:0/1700452361 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cd8004cc0 0x7f4cd8005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.564 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.560+0000 7f4cefe00640 1 --2- 172.21.15.107:0/1700452361 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4cf00cc430 0x7f4cd8004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.564 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.560+0000 7f4cf5200640 1 --2- 172.21.15.107:0/1700452361 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4cd8003b90 0x7f4cd8003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.564 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.560+0000 7f4cf5c00640 1 -- 172.21.15.107:0/1700452361 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4cf00cc430 msgr2=0x7f4cd8004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:02.565 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.560+0000 7f4cf5c00640 1 --2- 172.21.15.107:0/1700452361 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4cf00cc430 0x7f4cd8004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.565 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.560+0000 7f4cf5c00640 1 -- 172.21.15.107:0/1700452361 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4cd8003b90 msgr2=0x7f4cd8003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:02.565 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.560+0000 7f4cf5c00640 1 --2- 172.21.15.107:0/1700452361 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4cd8003b90 0x7f4cd8003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.565 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.560+0000 7f4cf5c00640 1 -- 172.21.15.107:0/1700452361 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce4009390 con 0x7f4cd8004cc0 2024-08-17T02:28:02.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.561+0000 7f4cf5c00640 1 --2- 172.21.15.107:0/1700452361 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cd8004cc0 0x7f4cd8005130 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8002080 tx=0x7f4ce8007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15c13a23aa9b9260 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:02.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.561+0000 7f4cef400640 1 -- 172.21.15.107:0/1700452361 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8031440 con 0x7f4cd8004cc0 2024-08-17T02:28:02.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.561+0000 7f4cef400640 1 -- 172.21.15.107:0/1700452361 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce802d050 con 0x7f4cd8004cc0 2024-08-17T02:28:02.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.561+0000 7f4cef400640 1 -- 172.21.15.107:0/1700452361 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce80317f0 con 0x7f4cd8004cc0 2024-08-17T02:28:02.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.562+0000 7f4cf7c00640 1 -- 172.21.15.107:0/1700452361 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cd8004cc0 msgr2=0x7f4cd8005130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.562+0000 7f4cf7c00640 1 --2- 172.21.15.107:0/1700452361 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cd8004cc0 0x7f4cd8005130 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8002080 tx=0x7f4ce8007f90 comp rx=0 tx=0).stop 2024-08-17T02:28:02.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.562+0000 7f4cf5c00640 1 -- 172.21.15.107:0/1700452361 reap_dead start 2024-08-17T02:28:02.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.562+0000 7f4cf7c00640 1 -- 172.21.15.107:0/1700452361 shutdown_connections 2024-08-17T02:28:02.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.562+0000 7f4cf7c00640 1 -- 172.21.15.107:0/1700452361 >> 172.21.15.107:0/1700452361 conn(0x7f4cf00afc30 msgr2=0x7f4cf00b1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:02.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.562+0000 7f4cf7c00640 1 -- 172.21.15.107:0/1700452361 shutdown_connections 2024-08-17T02:28:02.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.562+0000 7f4cf7c00640 1 -- 172.21.15.107:0/1700452361 wait complete. 2024-08-17T02:28:02.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.563+0000 7f4cf7c00640 1 Processor -- start 2024-08-17T02:28:02.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.564+0000 7f4cf7c00640 1 -- start start 2024-08-17T02:28:02.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.564+0000 7f4cf7c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4cd8004cc0 0x7f4cf01576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.564+0000 7f4cf7c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4cf0158d90 0x7f4cf015ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.564+0000 7f4cf7c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cf01684c0 0x7f4cf0099560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.564+0000 7f4cf7c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf015b160 con 0x7f4cf01684c0 2024-08-17T02:28:02.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.564+0000 7f4cf7c00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf0157cf0 con 0x7f4cd8004cc0 2024-08-17T02:28:02.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.564+0000 7f4cf7c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf0157fd0 con 0x7f4cf0158d90 2024-08-17T02:28:02.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.565+0000 7f4cf5c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cf01684c0 0x7f4cf0099560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.565+0000 7f4cefe00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4cf0158d90 0x7f4cf015ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.565+0000 7f4cf5200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4cd8004cc0 0x7f4cf01576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.565+0000 7f4cefe00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4cf0158d90 0x7f4cf015ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.107:52744/0 (socket says 172.21.15.107:52744) 2024-08-17T02:28:02.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.565+0000 7f4cf5c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cf01684c0 0x7f4cf0099560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47250/0 (socket says 172.21.15.107:47250) 2024-08-17T02:28:02.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.565+0000 7f4cefe00640 1 -- 172.21.15.107:0/1142966916 learned_addr learned my addr 172.21.15.107:0/1142966916 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:28:02.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.565+0000 7f4cf5c00640 1 -- 172.21.15.107:0/1142966916 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4cf0158d90 msgr2=0x7f4cf015ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.565+0000 7f4cf5c00640 1 --2- 172.21.15.107:0/1142966916 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4cf0158d90 0x7f4cf015ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.565+0000 7f4cf5c00640 1 -- 172.21.15.107:0/1142966916 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4cd8004cc0 msgr2=0x7f4cf01576a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.565+0000 7f4cf5c00640 1 --2- 172.21.15.107:0/1142966916 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4cd8004cc0 0x7f4cf01576a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.565+0000 7f4cf5c00640 1 -- 172.21.15.107:0/1142966916 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf01582b0 con 0x7f4cf01684c0 2024-08-17T02:28:02.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.565+0000 7f4cf5c00640 1 --2- 172.21.15.107:0/1142966916 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cf01684c0 0x7f4cf0099560 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8003000 tx=0x7f4ce8034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:02.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.566+0000 7f4ce3e00640 1 -- 172.21.15.107:0/1142966916 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce803d610 con 0x7f4cf01684c0 2024-08-17T02:28:02.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.566+0000 7f4ce3e00640 1 -- 172.21.15.107:0/1142966916 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce803d770 con 0x7f4cf01684c0 2024-08-17T02:28:02.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.566+0000 7f4ce3e00640 1 -- 172.21.15.107:0/1142966916 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce803db30 con 0x7f4cf01684c0 2024-08-17T02:28:02.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.566+0000 7f4cf7c00640 1 -- 172.21.15.107:0/1142966916 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cf0158590 con 0x7f4cf01684c0 2024-08-17T02:28:02.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.566+0000 7f4cf7c00640 1 -- 172.21.15.107:0/1142966916 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cf0168940 con 0x7f4cf01684c0 2024-08-17T02:28:02.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.567+0000 7f4cf7c00640 1 -- 172.21.15.107:0/1142966916 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cf0064db0 con 0x7f4cf01684c0 2024-08-17T02:28:02.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.568+0000 7f4ce3e00640 1 -- 172.21.15.107:0/1142966916 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4ce8038070 con 0x7f4cf01684c0 2024-08-17T02:28:02.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.568+0000 7f4ce3e00640 1 --2- 172.21.15.107:0/1142966916 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4cd0065180 0x7f4cd0067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.568+0000 7f4ce3e00640 1 -- 172.21.15.107:0/1142966916 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f4ce80a1fc0 con 0x7f4cf01684c0 2024-08-17T02:28:02.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.569+0000 7f4cf5200640 1 --2- 172.21.15.107:0/1142966916 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4cd0065180 0x7f4cd0067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.569+0000 7f4cf5200640 1 --2- 172.21.15.107:0/1142966916 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4cd0065180 0x7f4cd0067630 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4ce4006e70 tx=0x7f4ce40090f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:02.574 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.573+0000 7f4ce3e00640 1 -- 172.21.15.107:0/1142966916 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4ce80703f0 con 0x7f4cf01684c0 2024-08-17T02:28:02.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.746+0000 7f4cf7c00640 1 -- 172.21.15.107:0/1142966916 --> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f4cf00cd120 con 0x7f4cd0065180 2024-08-17T02:28:02.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.746+0000 7f4ce3e00640 1 -- 172.21.15.107:0/1142966916 <== mgr.4110 v2:172.21.15.107:6832/37039 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4cf00cd120 con 0x7f4cd0065180 2024-08-17T02:28:02.747 INFO:teuthology.orchestra.run.smithi107.stderr:instructed osd(s) 6 to deep-scrub 2024-08-17T02:28:02.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.748+0000 7f4cf7c00640 1 -- 172.21.15.107:0/1142966916 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4cd0065180 msgr2=0x7f4cd0067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.748+0000 7f4cf7c00640 1 --2- 172.21.15.107:0/1142966916 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4cd0065180 0x7f4cd0067630 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4ce4006e70 tx=0x7f4ce40090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.748+0000 7f4cf7c00640 1 -- 172.21.15.107:0/1142966916 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cf01684c0 msgr2=0x7f4cf0099560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.748+0000 7f4cf7c00640 1 --2- 172.21.15.107:0/1142966916 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cf01684c0 0x7f4cf0099560 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8003000 tx=0x7f4ce8034000 comp rx=0 tx=0).stop 2024-08-17T02:28:02.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.748+0000 7f4cf7c00640 1 -- 172.21.15.107:0/1142966916 shutdown_connections 2024-08-17T02:28:02.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.748+0000 7f4cf7c00640 1 --2- 172.21.15.107:0/1142966916 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4cd0065180 0x7f4cd0067630 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.748+0000 7f4cf7c00640 1 --2- 172.21.15.107:0/1142966916 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cf01684c0 0x7f4cf0099560 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.748+0000 7f4cf7c00640 1 --2- 172.21.15.107:0/1142966916 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4cf0158d90 0x7f4cf015ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.748+0000 7f4cf7c00640 1 --2- 172.21.15.107:0/1142966916 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4cd8004cc0 0x7f4cf01576a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.748+0000 7f4cf7c00640 1 -- 172.21.15.107:0/1142966916 >> 172.21.15.107:0/1142966916 conn(0x7f4cf00afc30 msgr2=0x7f4cf00caa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:02.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.749+0000 7f4cf7c00640 1 -- 172.21.15.107:0/1142966916 shutdown_connections 2024-08-17T02:28:02.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.749+0000 7f4cf7c00640 1 -- 172.21.15.107:0/1142966916 wait complete. 2024-08-17T02:28:02.763 INFO:tasks.ceph:Scrubbing osd.7 2024-08-17T02:28:02.763 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:28:02.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.915+0000 7f7ede400640 1 Processor -- start 2024-08-17T02:28:02.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.915+0000 7f7ede400640 1 -- start start 2024-08-17T02:28:02.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.916+0000 7f7ede400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7ed8150130 0x7f7ed80aa730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.916+0000 7f7ede400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ed81568b0 con 0x7f7ed806e5f0 2024-08-17T02:28:02.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.916+0000 7f7ede400640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ed8150500 con 0x7f7ed8156d40 2024-08-17T02:28:02.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.916+0000 7f7ede400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ed8155fc0 con 0x7f7ed8150130 2024-08-17T02:28:02.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.917+0000 7f7ed7e00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f7ed806e5f0 0x7f7ed80ab510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:46992/0 (socket says 172.21.15.107:46992) 2024-08-17T02:28:02.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.917+0000 7f7ed7e00640 1 -- 172.21.15.107:0/2521582588 learned_addr learned my addr 172.21.15.107:0/2521582588 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:28:02.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.917+0000 7f7ed7400640 1 --2- 172.21.15.107:0/2521582588 >> v2:172.21.15.107:3300/0 conn(0x7f7ed8150130 0x7f7ed80aa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.917+0000 7f7ed6000640 1 -- 172.21.15.107:0/2521582588 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1759481311 0 0) 0x7f7ed81568b0 con 0x7f7ed806e5f0 2024-08-17T02:28:02.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.917+0000 7f7ed7400640 1 -- 172.21.15.107:0/2521582588 >> v1:172.21.15.157:6789/0 conn(0x7f7ed8156d40 legacy=0x7f7ed806dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.917+0000 7f7ed7400640 1 -- 172.21.15.107:0/2521582588 >> v1:172.21.15.107:6789/0 conn(0x7f7ed806e5f0 legacy=0x7f7ed80ab510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.917+0000 7f7ed7400640 1 -- 172.21.15.107:0/2521582588 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed80add60 con 0x7f7ed8150130 2024-08-17T02:28:02.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.918+0000 7f7ed7400640 1 --2- 172.21.15.107:0/2521582588 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ed8150130 0x7f7ed80aa730 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8009850 tx=0x7f7ec80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f67134092a79eb8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:02.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.918+0000 7f7ed6000640 1 -- 172.21.15.107:0/2521582588 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec802adb0 con 0x7f7ed8150130 2024-08-17T02:28:02.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.918+0000 7f7ed6000640 1 -- 172.21.15.107:0/2521582588 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec8032440 con 0x7f7ed8150130 2024-08-17T02:28:02.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.918+0000 7f7ed6000640 1 -- 172.21.15.107:0/2521582588 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec80327e0 con 0x7f7ed8150130 2024-08-17T02:28:02.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.919+0000 7f7ede400640 1 -- 172.21.15.107:0/2521582588 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ed8150130 msgr2=0x7f7ed80aa730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.919+0000 7f7ede400640 1 --2- 172.21.15.107:0/2521582588 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ed8150130 0x7f7ed80aa730 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8009850 tx=0x7f7ec80090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.919+0000 7f7ede400640 1 -- 172.21.15.107:0/2521582588 shutdown_connections 2024-08-17T02:28:02.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.919+0000 7f7ede400640 1 --2- 172.21.15.107:0/2521582588 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ed8150130 0x7f7ed80aa730 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.919+0000 7f7ede400640 1 -- 172.21.15.107:0/2521582588 >> 172.21.15.107:0/2521582588 conn(0x7f7ed8067750 msgr2=0x7f7ed806c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:02.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.919+0000 7f7ede400640 1 -- 172.21.15.107:0/2521582588 shutdown_connections 2024-08-17T02:28:02.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.919+0000 7f7ede400640 1 -- 172.21.15.107:0/2521582588 wait complete. 2024-08-17T02:28:02.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.920+0000 7f7ede400640 1 Processor -- start 2024-08-17T02:28:02.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.920+0000 7f7ede400640 1 -- start start 2024-08-17T02:28:02.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.921+0000 7f7ede400640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ed806e5f0 0x7f7ed813abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.921+0000 7f7ede400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ed8150130 0x7f7ed8155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.921+0000 7f7ede400640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ed8156d40 0x7f7ed806c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.921+0000 7f7ede400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed816ac40 con 0x7f7ed8150130 2024-08-17T02:28:02.924 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.921+0000 7f7ede400640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed8155df0 con 0x7f7ed8156d40 2024-08-17T02:28:02.924 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.921+0000 7f7ede400640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed8155b10 con 0x7f7ed806e5f0 2024-08-17T02:28:02.924 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.921+0000 7f7ed6a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ed8150130 0x7f7ed8155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.924 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.922+0000 7f7ed6a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ed8150130 0x7f7ed8155110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47274/0 (socket says 172.21.15.107:47274) 2024-08-17T02:28:02.924 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.922+0000 7f7ed6a00640 1 -- 172.21.15.107:0/3249241315 learned_addr learned my addr 172.21.15.107:0/3249241315 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:28:02.924 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.922+0000 7f7ed7e00640 1 --2- 172.21.15.107:0/3249241315 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ed8156d40 0x7f7ed806c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.924 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.922+0000 7f7ed7400640 1 --2- 172.21.15.107:0/3249241315 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ed806e5f0 0x7f7ed813abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.924 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.922+0000 7f7ed6a00640 1 -- 172.21.15.107:0/3249241315 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ed806e5f0 msgr2=0x7f7ed813abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.922+0000 7f7ed6a00640 1 --2- 172.21.15.107:0/3249241315 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ed806e5f0 0x7f7ed813abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.922+0000 7f7ed6a00640 1 -- 172.21.15.107:0/3249241315 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ed8156d40 msgr2=0x7f7ed806c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.922+0000 7f7ed6a00640 1 --2- 172.21.15.107:0/3249241315 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ed8156d40 0x7f7ed806c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.922+0000 7f7ed6a00640 1 -- 172.21.15.107:0/3249241315 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec8009390 con 0x7f7ed8150130 2024-08-17T02:28:02.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.922+0000 7f7ed6a00640 1 --2- 172.21.15.107:0/3249241315 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ed8150130 0x7f7ed8155110 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7ec400c4c0 tx=0x7f7ec4007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:02.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.922+0000 7f7ecea00640 1 -- 172.21.15.107:0/3249241315 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec4011590 con 0x7f7ed8150130 2024-08-17T02:28:02.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.922+0000 7f7ecea00640 1 -- 172.21.15.107:0/3249241315 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec4011710 con 0x7f7ed8150130 2024-08-17T02:28:02.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.922+0000 7f7ecea00640 1 -- 172.21.15.107:0/3249241315 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec4011ad0 con 0x7f7ed8150130 2024-08-17T02:28:02.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.922+0000 7f7ede400640 1 -- 172.21.15.107:0/3249241315 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ed816a5f0 con 0x7f7ed8150130 2024-08-17T02:28:02.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.923+0000 7f7ede400640 1 -- 172.21.15.107:0/3249241315 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ed813b130 con 0x7f7ed8150130 2024-08-17T02:28:02.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.924+0000 7f7ede400640 1 -- 172.21.15.107:0/3249241315 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7ed80710c0 con 0x7f7ed8150130 2024-08-17T02:28:02.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.924+0000 7f7ecea00640 1 -- 172.21.15.107:0/3249241315 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7ec401b3b0 con 0x7f7ed8150130 2024-08-17T02:28:02.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.925+0000 7f7ecea00640 1 --2- 172.21.15.107:0/3249241315 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7eb8065150 0x7f7eb8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.925+0000 7f7ecea00640 1 -- 172.21.15.107:0/3249241315 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f7ec4081540 con 0x7f7ed8150130 2024-08-17T02:28:02.928 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.925+0000 7f7ed7400640 1 --2- 172.21.15.107:0/3249241315 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7eb8065150 0x7f7eb8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.928 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.925+0000 7f7ecea00640 1 --2- 172.21.15.107:0/3249241315 >> [v2:172.21.15.157:6824/37373,v1:172.21.15.157:6825/37373] conn(0x7f7eb806b040 0x7f7eb806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.928 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.925+0000 7f7ecea00640 1 -- 172.21.15.107:0/3249241315 --> [v2:172.21.15.157:6824/37373,v1:172.21.15.157:6825/37373] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7eb806db00 con 0x7f7eb806b040 2024-08-17T02:28:02.928 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.925+0000 7f7ecea00640 1 -- 172.21.15.107:0/3249241315 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ec4083b80 con 0x7f7ed8150130 2024-08-17T02:28:02.928 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.926+0000 7f7ed7e00640 1 --2- 172.21.15.107:0/3249241315 >> [v2:172.21.15.157:6824/37373,v1:172.21.15.157:6825/37373] conn(0x7f7eb806b040 0x7f7eb806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.928 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.926+0000 7f7ed7400640 1 --2- 172.21.15.107:0/3249241315 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7eb8065150 0x7f7eb8067600 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8034000 tx=0x7f7ec8032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:02.928 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.926+0000 7f7ed7e00640 1 --2- 172.21.15.107:0/3249241315 >> [v2:172.21.15.157:6824/37373,v1:172.21.15.157:6825/37373] conn(0x7f7eb806b040 0x7f7eb806d450 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:02.928 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.927+0000 7f7ecea00640 1 -- 172.21.15.107:0/3249241315 <== osd.7 v2:172.21.15.157:6824/37373 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f7eb806db00 con 0x7f7eb806b040 2024-08-17T02:28:02.940 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.940+0000 7f7ede400640 1 -- 172.21.15.107:0/3249241315 --> [v2:172.21.15.157:6824/37373,v1:172.21.15.157:6825/37373] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7ed8070740 con 0x7f7eb806b040 2024-08-17T02:28:02.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.941+0000 7f7ecea00640 1 -- 172.21.15.107:0/3249241315 <== osd.7 v2:172.21.15.157:6824/37373 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7ed8070740 con 0x7f7eb806b040 2024-08-17T02:28:02.941 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-08-17T02:28:02.941 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:28:02.941 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-08-17T02:28:02.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.941+0000 7f7ede400640 1 -- 172.21.15.107:0/3249241315 >> [v2:172.21.15.157:6824/37373,v1:172.21.15.157:6825/37373] conn(0x7f7eb806b040 msgr2=0x7f7eb806d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.941+0000 7f7ede400640 1 --2- 172.21.15.107:0/3249241315 >> [v2:172.21.15.157:6824/37373,v1:172.21.15.157:6825/37373] conn(0x7f7eb806b040 0x7f7eb806d450 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.941+0000 7f7ede400640 1 -- 172.21.15.107:0/3249241315 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7eb8065150 msgr2=0x7f7eb8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.941+0000 7f7ede400640 1 --2- 172.21.15.107:0/3249241315 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f7eb8065150 0x7f7eb8067600 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8034000 tx=0x7f7ec8032000 comp rx=0 tx=0).stop 2024-08-17T02:28:02.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.941+0000 7f7ede400640 1 -- 172.21.15.107:0/3249241315 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ed8150130 msgr2=0x7f7ed8155110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.941+0000 7f7ede400640 1 --2- 172.21.15.107:0/3249241315 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ed8150130 0x7f7ed8155110 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7ec400c4c0 tx=0x7f7ec4007ec0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.941+0000 7f7ed7e00640 1 -- 172.21.15.107:0/3249241315 reap_dead start 2024-08-17T02:28:02.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.941+0000 7f7ede400640 1 -- 172.21.15.107:0/3249241315 shutdown_connections 2024-08-17T02:28:02.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.941+0000 7f7ede400640 1 -- 172.21.15.107:0/3249241315 >> 172.21.15.107:0/3249241315 conn(0x7f7ed8067750 msgr2=0x7f7ed8069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:02.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.941+0000 7f7ede400640 1 -- 172.21.15.107:0/3249241315 shutdown_connections 2024-08-17T02:28:02.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:02.941+0000 7f7ede400640 1 -- 172.21.15.107:0/3249241315 wait complete. 2024-08-17T02:28:02.955 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-08-17T02:28:03.103 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.102+0000 7f4782000640 1 Processor -- start 2024-08-17T02:28:03.103 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.103+0000 7f4782000640 1 -- start start 2024-08-17T02:28:03.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.104+0000 7f4782000640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f477c156ad0 0x7f477c0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.104+0000 7f4782000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f477c156ea0 0x7f477c06d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.104+0000 7f4782000640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f477c0caaf0 con 0x7f477c06dab0 2024-08-17T02:28:03.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.104+0000 7f4782000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f477c0ca900 con 0x7f477c156ea0 2024-08-17T02:28:03.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.104+0000 7f4782000640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f477c0cc560 con 0x7f477c156ad0 2024-08-17T02:28:03.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.104+0000 7f4773e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f477c156ea0 0x7f477c06d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.104+0000 7f4773e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f477c156ea0 0x7f477c06d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47278/0 (socket says 172.21.15.107:47278) 2024-08-17T02:28:03.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.104+0000 7f4773e00640 1 -- 172.21.15.107:0/1615616638 learned_addr learned my addr 172.21.15.107:0/1615616638 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:28:03.106 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.104+0000 7f4780c00640 1 --2- 172.21.15.107:0/1615616638 >> v2:172.21.15.157:3300/0 conn(0x7f477c156ad0 0x7f477c0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.105+0000 7f4773e00640 1 -- 172.21.15.107:0/1615616638 >> v2:172.21.15.157:3300/0 conn(0x7f477c156ad0 msgr2=0x7f477c0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:03.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.105+0000 7f4773e00640 1 --2- 172.21.15.107:0/1615616638 >> v2:172.21.15.157:3300/0 conn(0x7f477c156ad0 0x7f477c0cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.105+0000 7f4773e00640 1 -- 172.21.15.107:0/1615616638 >> v1:172.21.15.157:6789/0 conn(0x7f477c06dab0 legacy=0x7f477c0c8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:03.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.105+0000 7f4773e00640 1 -- 172.21.15.107:0/1615616638 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f477c157300 con 0x7f477c156ea0 2024-08-17T02:28:03.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.106+0000 7f4773e00640 1 --2- 172.21.15.107:0/1615616638 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f477c156ea0 0x7f477c06d570 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f477c065fd0 tx=0x7f47640091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98236599173b10d3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:03.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.106+0000 7f477be00640 1 -- 172.21.15.107:0/1615616638 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476402ae00 con 0x7f477c156ea0 2024-08-17T02:28:03.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.106+0000 7f477be00640 1 -- 172.21.15.107:0/1615616638 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4764032440 con 0x7f477c156ea0 2024-08-17T02:28:03.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.106+0000 7f477be00640 1 -- 172.21.15.107:0/1615616638 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47640327e0 con 0x7f477c156ea0 2024-08-17T02:28:03.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.106+0000 7f4782000640 1 -- 172.21.15.107:0/1615616638 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f477c156ea0 msgr2=0x7f477c06d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.106+0000 7f4782000640 1 --2- 172.21.15.107:0/1615616638 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f477c156ea0 0x7f477c06d570 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f477c065fd0 tx=0x7f47640091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.106+0000 7f4782000640 1 -- 172.21.15.107:0/1615616638 shutdown_connections 2024-08-17T02:28:03.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.106+0000 7f4782000640 1 --2- 172.21.15.107:0/1615616638 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f477c156ea0 0x7f477c06d570 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.106+0000 7f4782000640 1 --2- 172.21.15.107:0/1615616638 >> v2:172.21.15.157:3300/0 conn(0x7f477c156ad0 0x7f477c0cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.106+0000 7f4782000640 1 -- 172.21.15.107:0/1615616638 >> 172.21.15.107:0/1615616638 conn(0x7f477c067750 msgr2=0x7f477c0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:03.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.107+0000 7f4782000640 1 -- 172.21.15.107:0/1615616638 shutdown_connections 2024-08-17T02:28:03.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.107+0000 7f4782000640 1 -- 172.21.15.107:0/1615616638 wait complete. 2024-08-17T02:28:03.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.108+0000 7f4782000640 1 Processor -- start 2024-08-17T02:28:03.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.108+0000 7f4782000640 1 -- start start 2024-08-17T02:28:03.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.109+0000 7f4782000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f477c06dab0 0x7f477c166fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.109+0000 7f4782000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f477c156ad0 0x7f477c15aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.109+0000 7f4782000640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f477c156ea0 0x7f477c15b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.112 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.109+0000 7f4782000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477c167a90 con 0x7f477c06dab0 2024-08-17T02:28:03.112 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.109+0000 7f4782000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477c167d70 con 0x7f477c156ad0 2024-08-17T02:28:03.112 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.109+0000 7f4782000640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f477c0c3220 con 0x7f477c156ea0 2024-08-17T02:28:03.112 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.109+0000 7f4780c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f477c06dab0 0x7f477c166fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.109+0000 7f4780c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f477c06dab0 0x7f477c166fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47294/0 (socket says 172.21.15.107:47294) 2024-08-17T02:28:03.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.109+0000 7f4780c00640 1 -- 172.21.15.107:0/1596854123 learned_addr learned my addr 172.21.15.107:0/1596854123 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:28:03.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.109+0000 7f4773e00640 1 --2- 172.21.15.107:0/1596854123 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f477c156ad0 0x7f477c15aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.109+0000 7f4781600640 1 --2- 172.21.15.107:0/1596854123 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f477c156ea0 0x7f477c15b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.110+0000 7f4780c00640 1 -- 172.21.15.107:0/1596854123 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f477c156ea0 msgr2=0x7f477c15b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.110+0000 7f4780c00640 1 --2- 172.21.15.107:0/1596854123 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f477c156ea0 0x7f477c15b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.110+0000 7f4780c00640 1 -- 172.21.15.107:0/1596854123 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f477c156ad0 msgr2=0x7f477c15aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.110+0000 7f4780c00640 1 --2- 172.21.15.107:0/1596854123 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f477c156ad0 0x7f477c15aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.110+0000 7f4780c00640 1 -- 172.21.15.107:0/1596854123 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4764009450 con 0x7f477c06dab0 2024-08-17T02:28:03.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.110+0000 7f4781600640 1 --2- 172.21.15.107:0/1596854123 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f477c156ea0 0x7f477c15b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:03.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.110+0000 7f4780c00640 1 --2- 172.21.15.107:0/1596854123 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f477c06dab0 0x7f477c166fb0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f476c00d890 tx=0x7f476c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:03.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.110+0000 7f4778c00640 1 -- 172.21.15.107:0/1596854123 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c00de20 con 0x7f477c06dab0 2024-08-17T02:28:03.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.110+0000 7f4778c00640 1 -- 172.21.15.107:0/1596854123 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f476c00b8d0 con 0x7f477c06dab0 2024-08-17T02:28:03.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.110+0000 7f4782000640 1 -- 172.21.15.107:0/1596854123 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f477c0c3500 con 0x7f477c06dab0 2024-08-17T02:28:03.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.110+0000 7f4778c00640 1 -- 172.21.15.107:0/1596854123 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c00bc70 con 0x7f477c06dab0 2024-08-17T02:28:03.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.110+0000 7f4782000640 1 -- 172.21.15.107:0/1596854123 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f477c0c2a20 con 0x7f477c06dab0 2024-08-17T02:28:03.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.111+0000 7f4782000640 1 -- 172.21.15.107:0/1596854123 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f477c0c5cf0 con 0x7f477c06dab0 2024-08-17T02:28:03.116 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.112+0000 7f4778c00640 1 -- 172.21.15.107:0/1596854123 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f476c014640 con 0x7f477c06dab0 2024-08-17T02:28:03.116 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.113+0000 7f4778c00640 1 --2- 172.21.15.107:0/1596854123 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4758065150 0x7f4758067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.116 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.113+0000 7f4778c00640 1 -- 172.21.15.107:0/1596854123 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f476c082810 con 0x7f477c06dab0 2024-08-17T02:28:03.116 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.113+0000 7f4773e00640 1 --2- 172.21.15.107:0/1596854123 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4758065150 0x7f4758067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.116 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.114+0000 7f4773e00640 1 --2- 172.21.15.107:0/1596854123 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4758065150 0x7f4758067600 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4764034000 tx=0x7f4764032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:03.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.117+0000 7f4778c00640 1 -- 172.21.15.107:0/1596854123 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f476c050b90 con 0x7f477c06dab0 2024-08-17T02:28:03.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.287+0000 7f4782000640 1 -- 172.21.15.107:0/1596854123 --> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f477c071050 con 0x7f4758065150 2024-08-17T02:28:03.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.288+0000 7f4778c00640 1 -- 172.21.15.107:0/1596854123 <== mgr.4110 v2:172.21.15.107:6832/37039 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f477c071050 con 0x7f4758065150 2024-08-17T02:28:03.288 INFO:teuthology.orchestra.run.smithi107.stderr:instructed osd(s) 7 to deep-scrub 2024-08-17T02:28:03.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.289+0000 7f4782000640 1 -- 172.21.15.107:0/1596854123 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4758065150 msgr2=0x7f4758067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.289+0000 7f4782000640 1 --2- 172.21.15.107:0/1596854123 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4758065150 0x7f4758067600 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4764034000 tx=0x7f4764032000 comp rx=0 tx=0).stop 2024-08-17T02:28:03.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.290+0000 7f4782000640 1 -- 172.21.15.107:0/1596854123 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f477c06dab0 msgr2=0x7f477c166fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.290+0000 7f4782000640 1 --2- 172.21.15.107:0/1596854123 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f477c06dab0 0x7f477c166fb0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f476c00d890 tx=0x7f476c008040 comp rx=0 tx=0).stop 2024-08-17T02:28:03.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.290+0000 7f4782000640 1 -- 172.21.15.107:0/1596854123 shutdown_connections 2024-08-17T02:28:03.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.290+0000 7f4782000640 1 --2- 172.21.15.107:0/1596854123 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f4758065150 0x7f4758067600 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.290+0000 7f4782000640 1 --2- 172.21.15.107:0/1596854123 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f477c156ea0 0x7f477c15b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.290+0000 7f4782000640 1 --2- 172.21.15.107:0/1596854123 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f477c156ad0 0x7f477c15aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.290+0000 7f4782000640 1 --2- 172.21.15.107:0/1596854123 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f477c06dab0 0x7f477c166fb0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.290+0000 7f4782000640 1 -- 172.21.15.107:0/1596854123 >> 172.21.15.107:0/1596854123 conn(0x7f477c067750 msgr2=0x7f477c0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:03.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.290+0000 7f4782000640 1 -- 172.21.15.107:0/1596854123 shutdown_connections 2024-08-17T02:28:03.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.290+0000 7f4782000640 1 -- 172.21.15.107:0/1596854123 wait complete. 2024-08-17T02:28:03.306 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:28:03.452 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.452+0000 7ff2adc00640 1 Processor -- start 2024-08-17T02:28:03.452 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.452+0000 7ff2adc00640 1 -- start start 2024-08-17T02:28:03.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.453+0000 7ff2adc00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2a8155a20 0x7ff2a80adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.453+0000 7ff2adc00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff2a8155df0 0x7ff2a80ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.453+0000 7ff2adc00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff2a806d7f0 0x7ff2a806dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.453+0000 7ff2adc00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2a80b0350 con 0x7ff2a806d7f0 2024-08-17T02:28:03.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.453+0000 7ff2adc00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2a806e1d0 con 0x7ff2a8155df0 2024-08-17T02:28:03.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.453+0000 7ff2adc00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a8156670 con 0x7ff2a8155a20 2024-08-17T02:28:03.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.453+0000 7ff2a7400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff2a806d7f0 0x7ff2a806dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.453+0000 7ff2a7400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff2a806d7f0 0x7ff2a806dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47306/0 (socket says 172.21.15.107:47306) 2024-08-17T02:28:03.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.453+0000 7ff2a7400640 1 -- 172.21.15.107:0/3542074072 learned_addr learned my addr 172.21.15.107:0/3542074072 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:28:03.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.454+0000 7ff2a6a00640 1 --2- 172.21.15.107:0/3542074072 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2a8155a20 0x7ff2a80adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.454+0000 7ff2a7400640 1 -- 172.21.15.107:0/3542074072 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2a8155a20 msgr2=0x7ff2a80adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:03.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.454+0000 7ff2a7400640 1 --2- 172.21.15.107:0/3542074072 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2a8155a20 0x7ff2a80adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.454+0000 7ff2a7400640 1 -- 172.21.15.107:0/3542074072 >> v2:172.21.15.157:3300/0 conn(0x7ff2a8155df0 msgr2=0x7ff2a80ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:03.456 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.454+0000 7ff2a7400640 1 --2- 172.21.15.107:0/3542074072 >> v2:172.21.15.157:3300/0 conn(0x7ff2a8155df0 0x7ff2a80ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.456 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.454+0000 7ff2a7400640 1 -- 172.21.15.107:0/3542074072 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a806e5e0 con 0x7ff2a806d7f0 2024-08-17T02:28:03.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.455+0000 7ff2a7400640 1 --2- 172.21.15.107:0/3542074072 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2a806d7f0 0x7ff2a806dc90 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7ff2a806c4d0 tx=0x7ff2a0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8acfa0ea5f96415 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:03.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.455+0000 7ff2a5600640 1 -- 172.21.15.107:0/3542074072 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a0031400 con 0x7ff2a806d7f0 2024-08-17T02:28:03.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.455+0000 7ff2a5600640 1 -- 172.21.15.107:0/3542074072 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2a002d050 con 0x7ff2a806d7f0 2024-08-17T02:28:03.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.455+0000 7ff2a5600640 1 -- 172.21.15.107:0/3542074072 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a00317d0 con 0x7ff2a806d7f0 2024-08-17T02:28:03.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.456+0000 7ff2adc00640 1 -- 172.21.15.107:0/3542074072 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2a806d7f0 msgr2=0x7ff2a806dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.456+0000 7ff2adc00640 1 --2- 172.21.15.107:0/3542074072 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2a806d7f0 0x7ff2a806dc90 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7ff2a806c4d0 tx=0x7ff2a0009840 comp rx=0 tx=0).stop 2024-08-17T02:28:03.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.456+0000 7ff2adc00640 1 -- 172.21.15.107:0/3542074072 shutdown_connections 2024-08-17T02:28:03.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.456+0000 7ff2adc00640 1 --2- 172.21.15.107:0/3542074072 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2a806d7f0 0x7ff2a806dc90 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.458 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.456+0000 7ff2adc00640 1 --2- 172.21.15.107:0/3542074072 >> v2:172.21.15.157:3300/0 conn(0x7ff2a8155df0 0x7ff2a80ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.458 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.456+0000 7ff2adc00640 1 --2- 172.21.15.107:0/3542074072 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2a8155a20 0x7ff2a80adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.458 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.456+0000 7ff2adc00640 1 -- 172.21.15.107:0/3542074072 >> 172.21.15.107:0/3542074072 conn(0x7ff2a80cb9b0 msgr2=0x7ff2a80cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:03.458 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.456+0000 7ff2adc00640 1 -- 172.21.15.107:0/3542074072 shutdown_connections 2024-08-17T02:28:03.458 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.456+0000 7ff2adc00640 1 -- 172.21.15.107:0/3542074072 wait complete. 2024-08-17T02:28:03.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.457+0000 7ff2adc00640 1 Processor -- start 2024-08-17T02:28:03.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.457+0000 7ff2adc00640 1 -- start start 2024-08-17T02:28:03.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.458+0000 7ff2adc00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2a806d7f0 0x7ff2a8168f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.458+0000 7ff2adc00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2a8155a20 0x7ff2a816bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.458+0000 7ff2adc00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2a8155df0 0x7ff2a8069240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.458+0000 7ff2adc00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a816c2d0 con 0x7ff2a8155a20 2024-08-17T02:28:03.461 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.458+0000 7ff2adc00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a814a740 con 0x7ff2a8155df0 2024-08-17T02:28:03.461 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.458+0000 7ff2adc00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a8149e10 con 0x7ff2a806d7f0 2024-08-17T02:28:03.461 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.459+0000 7ff2a6000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2a8155a20 0x7ff2a816bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.461 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.459+0000 7ff2a6000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2a8155a20 0x7ff2a816bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47314/0 (socket says 172.21.15.107:47314) 2024-08-17T02:28:03.461 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.459+0000 7ff2a6000640 1 -- 172.21.15.107:0/1623469084 learned_addr learned my addr 172.21.15.107:0/1623469084 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:28:03.461 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.459+0000 7ff2a7400640 1 --2- 172.21.15.107:0/1623469084 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2a8155df0 0x7ff2a8069240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.461 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.459+0000 7ff2a6a00640 1 --2- 172.21.15.107:0/1623469084 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2a806d7f0 0x7ff2a8168f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.459+0000 7ff2a6000640 1 -- 172.21.15.107:0/1623469084 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2a806d7f0 msgr2=0x7ff2a8168f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.459+0000 7ff2a6000640 1 --2- 172.21.15.107:0/1623469084 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2a806d7f0 0x7ff2a8168f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.459+0000 7ff2a6000640 1 -- 172.21.15.107:0/1623469084 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2a8155df0 msgr2=0x7ff2a8069240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.459+0000 7ff2a6000640 1 --2- 172.21.15.107:0/1623469084 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2a8155df0 0x7ff2a8069240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.459+0000 7ff2a6000640 1 -- 172.21.15.107:0/1623469084 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a0009ae0 con 0x7ff2a8155a20 2024-08-17T02:28:03.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.459+0000 7ff2a6000640 1 --2- 172.21.15.107:0/1623469084 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2a8155a20 0x7ff2a816bd90 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff29400b5e0 tx=0x7ff294009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:03.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.460+0000 7ff29e000640 1 -- 172.21.15.107:0/1623469084 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29400f590 con 0x7ff2a8155a20 2024-08-17T02:28:03.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.460+0000 7ff29e000640 1 -- 172.21.15.107:0/1623469084 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29400f6f0 con 0x7ff2a8155a20 2024-08-17T02:28:03.463 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.460+0000 7ff29e000640 1 -- 172.21.15.107:0/1623469084 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29400fab0 con 0x7ff2a8155a20 2024-08-17T02:28:03.463 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.460+0000 7ff2adc00640 1 -- 172.21.15.107:0/1623469084 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2a814a0f0 con 0x7ff2a8155a20 2024-08-17T02:28:03.463 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.460+0000 7ff2adc00640 1 -- 172.21.15.107:0/1623469084 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2a8069780 con 0x7ff2a8155a20 2024-08-17T02:28:03.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.461+0000 7ff2adc00640 1 -- 172.21.15.107:0/1623469084 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2a8064db0 con 0x7ff2a8155a20 2024-08-17T02:28:03.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.462+0000 7ff29e000640 1 -- 172.21.15.107:0/1623469084 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff29401a460 con 0x7ff2a8155a20 2024-08-17T02:28:03.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.462+0000 7ff29e000640 1 --2- 172.21.15.107:0/1623469084 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ff288065180 0x7ff288067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.463+0000 7ff29e000640 1 -- 172.21.15.107:0/1623469084 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7ff294081d70 con 0x7ff2a8155a20 2024-08-17T02:28:03.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.463+0000 7ff2a6a00640 1 --2- 172.21.15.107:0/1623469084 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ff288065180 0x7ff288067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.463+0000 7ff2a6a00640 1 --2- 172.21.15.107:0/1623469084 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ff288065180 0x7ff288067630 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff298007ba0 tx=0x7ff298008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:03.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.466+0000 7ff29e000640 1 -- 172.21.15.107:0/1623469084 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff294050160 con 0x7ff2a8155a20 2024-08-17T02:28:03.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.637+0000 7ff2adc00640 1 -- 172.21.15.107:0/1623469084 --> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff2a814a570 con 0x7ff288065180 2024-08-17T02:28:03.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.639+0000 7ff29e000640 1 -- 172.21.15.107:0/1623469084 <== mgr.4110 v2:172.21.15.107:6832/37039 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50572 (secure 0 0 0) 0x7ff2a814a570 con 0x7ff288065180 2024-08-17T02:28:03.640 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:28:03.640 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-08-17T02:28:03.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.641+0000 7ff2adc00640 1 -- 172.21.15.107:0/1623469084 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ff288065180 msgr2=0x7ff288067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.641+0000 7ff2adc00640 1 --2- 172.21.15.107:0/1623469084 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ff288065180 0x7ff288067630 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff298007ba0 tx=0x7ff298008040 comp rx=0 tx=0).stop 2024-08-17T02:28:03.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.641+0000 7ff2adc00640 1 -- 172.21.15.107:0/1623469084 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2a8155a20 msgr2=0x7ff2a816bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.641+0000 7ff2adc00640 1 --2- 172.21.15.107:0/1623469084 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2a8155a20 0x7ff2a816bd90 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff29400b5e0 tx=0x7ff294009120 comp rx=0 tx=0).stop 2024-08-17T02:28:03.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.641+0000 7ff2adc00640 1 -- 172.21.15.107:0/1623469084 shutdown_connections 2024-08-17T02:28:03.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.641+0000 7ff2adc00640 1 --2- 172.21.15.107:0/1623469084 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7ff288065180 0x7ff288067630 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.641+0000 7ff2adc00640 1 --2- 172.21.15.107:0/1623469084 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2a8155df0 0x7ff2a8069240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.641+0000 7ff2adc00640 1 --2- 172.21.15.107:0/1623469084 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2a8155a20 0x7ff2a816bd90 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.641+0000 7ff2adc00640 1 --2- 172.21.15.107:0/1623469084 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2a806d7f0 0x7ff2a8168f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.641+0000 7ff2adc00640 1 -- 172.21.15.107:0/1623469084 >> 172.21.15.107:0/1623469084 conn(0x7ff2a80cb9b0 msgr2=0x7ff2a8150790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:03.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.641+0000 7ff2adc00640 1 -- 172.21.15.107:0/1623469084 shutdown_connections 2024-08-17T02:28:03.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:03.641+0000 7ff2adc00640 1 -- 172.21.15.107:0/1623469084 wait complete. 2024-08-17T02:28:03.656 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2024-08-17T02:28:03.458346+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2404840,"kb_used_data":5160,"kb_used_omap":13,"kb_used_meta":2399538,"kb_avail":752569880,"statfs":{"total":773094113280,"available":770631557120,"internally_reserved":0,"allocated":5283840,"data_stored":2880488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2457127616},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.250256"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":182,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-08-17T02:27:52.527213+0000","last_change":"2024-08-17T02:24:25.092772+0000","last_active":"2024-08-17T02:27:52.527213+0000","last_peered":"2024-08-17T02:27:52.527213+0000","last_clean":"2024-08-17T02:27:52.527213+0000","last_became_active":"2024-08-17T02:24:25.091788+0000","last_became_peered":"2024-08-17T02:24:25.091788+0000","last_unstale":"2024-08-17T02:27:52.527213+0000","last_undegraded":"2024-08-17T02:27:52.527213+0000","last_fullsized":"2024-08-17T02:27:52.527213+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:24.051996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:24.051996+0000","last_clean_scrub_stamp":"2024-08-17T02:24:24.051996+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:31:45.454480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1105920,"data_stored":802837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.60999999999999999,"15min":0.59399999999999997},"min":{"1min":0.50900000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.82499999999999996,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.63800000000000001,"15min":0.625},"min":{"1min":0.51500000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.93000000000000005,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.61399999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.66400000000000003,"15min":0.64200000000000002},"min":{"1min":0.51200000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.67900000000000005,"15min":0.66100000000000003},"min":{"1min":0.61099999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.90200000000000002,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.57899999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.66300000000000003,"15min":0.64200000000000002},"min":{"1min":0.56000000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.85599999999999998,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.69099999999999995,"15min":0.66300000000000003},"min":{"1min":0.628,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85399999999999998,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.63500000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68999999999999995,"15min":0.67600000000000005},"min":{"1min":0.53300000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.85699999999999998,"5min":1.105,"15min":1.105},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.72699999999999998,"15min":0.71899999999999997},"min":{"1min":0.625,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.88900000000000001,"5min":0.995,"15min":0.995},"last":0.67900000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.56299999999999994,"15min":0.57799999999999996},"min":{"1min":0.377,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.70199999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.59199999999999997,"15min":0.60299999999999998},"min":{"1min":0.43099999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.72799999999999998,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.501}]},{"osd":5,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.66400000000000003,"15min":0.68999999999999995},"min":{"1min":0.45200000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.72999999999999998,"15min":0.748},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.86599999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.65600000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.67800000000000005,"15min":0.69199999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.80500000000000005,"5min":0.88,"15min":0.88},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.67100000000000004,"15min":0.68899999999999995},"min":{"1min":0.42699999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82499999999999996,"5min":1.149,"15min":1.149},"last":0.56100000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302020,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069820,"statfs":{"total":96636764160,"available":96327495680,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:28 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.84199999999999997,"15min":0.90000000000000002},"min":{"1min":0.58799999999999997,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.85099999999999998,"5min":4.7380000000000004,"15min":4.7380000000000004},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.83999999999999997,"15min":0.89000000000000001},"min":{"1min":0.64000000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.85199999999999998,"5min":3.2839999999999998,"15min":3.2839999999999998},"last":0.58999999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:27:28 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.67800000000000005,"15min":0.64900000000000002},"min":{"1min":0.59999999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.90200000000000002,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.82699999999999996,"15min":0.86899999999999999},"min":{"1min":0.65700000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.91800000000000004,"5min":2.524,"15min":2.524},"last":0.70099999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:27:28 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.79300000000000004,"15min":0.82299999999999995},"min":{"1min":0.63300000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.82999999999999996,"5min":3.3199999999999998,"15min":3.3199999999999998},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.753,"15min":0.749},"min":{"1min":0.60699999999999998,"5min":0.502,"15min":0.502},"max":{"1min":0.93899999999999995,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.67900000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:27:28 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77800000000000002,"15min":0.78700000000000003},"min":{"1min":0.623,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.91700000000000004,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.81799999999999995,"15min":0.83599999999999997},"min":{"1min":0.627,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.88300000000000001,"5min":3.3610000000000002,"15min":3.3610000000000002},"last":0.76400000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:27:28 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.72199999999999998,"15min":0.77800000000000002},"min":{"1min":0.45100000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.83399999999999996,"5min":3.3999999999999999,"15min":3.3999999999999999},"last":0.62},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.752,"15min":0.82099999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.72399999999999998,"5min":3.4670000000000001,"15min":3.4670000000000001},"last":0.79800000000000004}]},{"osd":5,"last update":"Sat Aug 17 02:27:28 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.67800000000000005,"15min":0.70999999999999996},"min":{"1min":0.46100000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.82199999999999995,"5min":1.73,"15min":1.73},"last":0.75},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.78700000000000003,"15min":0.84099999999999997},"min":{"1min":0.47399999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.90500000000000003,"5min":3.3410000000000002,"15min":3.3410000000000002},"last":0.85599999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:27:28 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.81499999999999995,"15min":0.86899999999999999},"min":{"1min":0.52500000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.90000000000000002,"5min":3.23,"15min":3.23},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.75700000000000001,"15min":0.79100000000000004},"min":{"1min":0.51300000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.86699999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.81499999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302020,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069820,"statfs":{"total":96636764160,"available":96327495680,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.65100000000000002,"15min":0.629},"min":{"1min":0.48599999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.72799999999999998,"15min":0.73199999999999998},"min":{"1min":0.52300000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.046,"5min":3.1440000000000001,"15min":3.1440000000000001},"last":0.53500000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.73099999999999998,"15min":0.71399999999999997},"min":{"1min":0.624,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0740000000000001,"5min":1.119,"15min":1.119},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.70399999999999996,"15min":0.68400000000000005},"min":{"1min":0.56799999999999995,"5min":0.443,"15min":0.443},"max":{"1min":1.0229999999999999,"5min":1.153,"15min":1.153},"last":0.69899999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75,"15min":0.75600000000000001},"min":{"1min":0.55100000000000005,"5min":0.433,"15min":0.433},"max":{"1min":0.90500000000000003,"5min":3.2559999999999998,"15min":3.2559999999999998},"last":0.628},{"interface":"front","average":{"1min":0.75,"5min":0.68200000000000005,"15min":0.66400000000000003},"min":{"1min":0.58899999999999997,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.72199999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.80300000000000005,"15min":0.81200000000000006},"min":{"1min":0.67500000000000004,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.042,"5min":3.2229999999999999,"15min":3.2229999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.82999999999999996,"15min":0.84399999999999997},"min":{"1min":0.62,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0629999999999999,"5min":3.1859999999999999,"15min":3.1859999999999999},"last":0.78300000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.432,"5min":0.317,"15min":0.317},"max":{"1min":0.80500000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.5},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64600000000000002,"15min":0.65400000000000003},"min":{"1min":0.47499999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.93000000000000005,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.67500000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.505,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.95599999999999996,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.75},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.67300000000000004,"15min":0.67000000000000004},"min":{"1min":0.51700000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.91200000000000003,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.57199999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.72099999999999997,"15min":0.72799999999999998},"min":{"1min":0.48199999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.97299999999999998,"5min":1.02,"15min":1.02},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.73699999999999999,"15min":0.73599999999999999},"min":{"1min":0.55100000000000005,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.018,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.80800000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302020,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069820,"statfs":{"total":96636764160,"available":96327495680,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.62,"15min":0.58599999999999997},"min":{"1min":0.53000000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.86299999999999999,"5min":0.999,"15min":0.999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.65400000000000003,"15min":0.63400000000000001},"min":{"1min":0.56299999999999994,"5min":0.437,"15min":0.437},"max":{"1min":0.83299999999999996,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.442}]},{"osd":1,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.70099999999999996,"15min":0.68100000000000005},"min":{"1min":0.50600000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.89800000000000002,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.68899999999999995,"15min":0.66700000000000004},"min":{"1min":0.53400000000000003,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.88400000000000001,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.47499999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.70799999999999996,"15min":0.69399999999999995},"min":{"1min":0.56899999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.92500000000000004,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69699999999999995,"15min":0.68200000000000005},"min":{"1min":0.52800000000000002,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.91100000000000003,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.59299999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.68400000000000005,"15min":0.65800000000000003},"min":{"1min":0.58099999999999996,"5min":0.432,"15min":0.432},"max":{"1min":0.86499999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73999999999999999,"15min":0.73499999999999999},"min":{"1min":0.59399999999999997,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.875,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.61199999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.56899999999999995,"15min":0.58799999999999997},"min":{"1min":0.39400000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.749,"5min":0.752,"15min":0.752},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.63300000000000001,"15min":0.66900000000000004},"min":{"1min":0.434,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.68700000000000006,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.65300000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.64500000000000002,"15min":0.68400000000000005},"min":{"1min":0.44,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77500000000000002,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.65300000000000002,"15min":0.68100000000000005},"min":{"1min":0.47999999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.748,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.629}]},{"osd":7,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69599999999999995,"15min":0.71199999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.88500000000000001,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.748},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.75800000000000001,"15min":0.78500000000000003},"min":{"1min":0.51700000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.86499999999999999,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.67700000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.438,"15min":0.44},"min":{"1min":0.308,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.45500000000000002,"15min":0.439},"min":{"1min":0.36399999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.65400000000000003,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.48799999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47499999999999998,"15min":0.47699999999999998},"min":{"1min":0.35599999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68300000000000005,"5min":1.458,"15min":1.458},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.501,"15min":0.497},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.57599999999999996,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.50900000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.44800000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.72599999999999998,"5min":1.492,"15min":1.492},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.55100000000000005,"15min":0.53900000000000003},"min":{"1min":0.44500000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.74099999999999999,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.47299999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72699999999999998,"15min":0.72499999999999998},"min":{"1min":0.48899999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0069999999999999,"5min":1.01,"15min":1.01},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.75800000000000001,"15min":0.755},"min":{"1min":0.55500000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.97299999999999998,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.69799999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.746,"15min":0.74299999999999999},"min":{"1min":0.58799999999999997,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.01,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.746},{"interface":"front","average":{"1min":0.747,"5min":0.77000000000000002,"15min":0.77400000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.96099999999999997,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.76900000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.77100000000000002,"15min":0.77200000000000002},"min":{"1min":0.59499999999999997,"5min":0.504,"15min":0.504},"max":{"1min":0.98099999999999998,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79100000000000004,"15min":0.79300000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.91100000000000003,"5min":1.077,"15min":1.077},"last":0.70399999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.78000000000000003,"15min":0.79000000000000004},"min":{"1min":0.55400000000000005,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.90000000000000002,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.79400000000000004,"15min":0.79200000000000004},"min":{"1min":0.59799999999999998,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0309999999999999,"5min":1.421,"15min":1.421},"last":0.67800000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.40200000000000002,"15min":0.39200000000000002},"min":{"1min":0.315,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.438},{"interface":"front","average":{"1min":0.443,"5min":0.53700000000000003,"15min":0.57899999999999996},"min":{"1min":0.34300000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.55200000000000005,"5min":3.9060000000000001,"15min":3.9060000000000001},"last":0.36399999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.34699999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.58699999999999997,"5min":0.746,"15min":0.746},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.505,"15min":0.48899999999999999},"min":{"1min":0.436,"5min":0.372,"15min":0.372},"max":{"1min":0.64600000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.497}]},{"osd":3,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.53200000000000003,"15min":0.52300000000000002},"min":{"1min":0.42399999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.65800000000000003,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.56200000000000006,"15min":0.54900000000000004},"min":{"1min":0.496,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.745,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.53000000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.81799999999999995,"15min":0.84199999999999997},"min":{"1min":0.56599999999999995,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.997,"5min":4.1509999999999998,"15min":4.1509999999999998},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.73899999999999999,"15min":0.73499999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0880000000000001,"5min":1.381,"15min":1.381},"last":0.65100000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.72999999999999998,"15min":0.70599999999999996},"min":{"1min":0.60299999999999998,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.82799999999999996,"15min":0.85199999999999998},"min":{"1min":0.60399999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.125,"5min":4.1079999999999997,"15min":4.1079999999999997},"last":0.64000000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.75,"15min":0.73399999999999999},"min":{"1min":0.629,"5min":0.505,"15min":0.505},"max":{"1min":1.0469999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.74299999999999999,"15min":0.72899999999999998},"min":{"1min":0.64600000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.66600000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.84699999999999998,"15min":0.874},"min":{"1min":0.64600000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.97199999999999998,"5min":4.1879999999999997,"15min":4.1879999999999997},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.76800000000000002,"15min":0.752},"min":{"1min":0.58599999999999997,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.157,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.71799999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:25 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.33000000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.432,"15min":0.41999999999999998},"min":{"1min":0.379,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.70599999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:27:25 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.44400000000000001,"15min":0.439},"min":{"1min":0.38,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.41399999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.65000000000000002,"5min":0.746,"15min":0.746},"last":0.46300000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:27:25 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.55700000000000005,"15min":0.54400000000000004},"min":{"1min":0.51700000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.68200000000000005,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.502,"15min":0.48999999999999999},"min":{"1min":0.38800000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.79000000000000004,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.375}]},{"osd":4,"last update":"Sat Aug 17 02:27:25 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.71099999999999997,"15min":0.69899999999999995},"min":{"1min":0.55100000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.022,"5min":1.115,"15min":1.115},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.69899999999999995,"15min":0.68899999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.90900000000000003,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.71999999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:27:25 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.72599999999999998,"15min":0.72199999999999998},"min":{"1min":0.59799999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.99199999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.68500000000000005,"15min":0.66500000000000004},"min":{"1min":0.57299999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.94999999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.68600000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:27:25 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.73699999999999999,"15min":0.73099999999999998},"min":{"1min":0.60499999999999998,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.94399999999999995,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.71699999999999997,"15min":0.70799999999999996},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.93300000000000005,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.57999999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:27:25 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.746,"15min":0.74199999999999999},"min":{"1min":0.64300000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.002,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.64000000000000001,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.93100000000000005,"5min":1.143,"15min":1.143},"last":0.73199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1105920,"data_stored":802837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.41299999999999998,"15min":0.40899999999999997},"min":{"1min":0.34999999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.53600000000000003,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.314},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.46600000000000003,"15min":0.45700000000000002},"min":{"1min":0.34999999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.67500000000000004,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.44}]},{"osd":2,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.48499999999999999,"15min":0.48999999999999999},"min":{"1min":0.35699999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.59399999999999997,"5min":1.169,"15min":1.169},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.52100000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.81100000000000005,"5min":1.262,"15min":1.262},"last":0.48899999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.48699999999999999,"15min":0.47499999999999998},"min":{"1min":0.42999999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67900000000000005,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57599999999999996,"15min":0.59399999999999997},"min":{"1min":0.41999999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.67100000000000004,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":0.47299999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.76800000000000002,"15min":0.76100000000000001},"min":{"1min":0.65600000000000003,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.0449999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.745},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.82999999999999996,"15min":0.86299999999999999},"min":{"1min":0.57799999999999996,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.03,"5min":3.2160000000000002,"15min":3.2160000000000002},"last":0.66000000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.80700000000000005,"15min":0.82699999999999996},"min":{"1min":0.53500000000000003,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.96999999999999997,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.755,"15min":0.751},"min":{"1min":0.65800000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0109999999999999,"5min":1.383,"15min":1.383},"last":0.70499999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.749,"15min":0.74099999999999999},"min":{"1min":0.59799999999999998,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.119,"5min":1.411,"15min":1.411},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.78200000000000003,"15min":0.77300000000000002},"min":{"1min":0.70999999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.101,"5min":1.343,"15min":1.343},"last":0.61499999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.80700000000000005,"15min":0.79700000000000004},"min":{"1min":0.69299999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1459999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.88400000000000001,"15min":0.91000000000000003},"min":{"1min":0.65500000000000003,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.081,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":0.67900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:28:03.660 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-08-17T02:24:24.051996+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=17, tm_hour=2, tm_min=24, tm_sec=24, tm_wday=5, tm_yday=230, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=17, tm_hour=2, tm_min=27, tm_sec=57, tm_wday=5, tm_yday=230, tm_isdst=0) 2024-08-17T02:28:03.660 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-08-17T02:28:04.824 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:04.829 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:23.660 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:28:23.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.818+0000 7faca9e00640 1 Processor -- start 2024-08-17T02:28:23.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.818+0000 7faca9e00640 1 -- start start 2024-08-17T02:28:23.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.819+0000 7faca9e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7faca40aa7d0 0x7faca406ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.819+0000 7faca9e00640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7faca4158fa0 0x7faca40ab6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.819+0000 7faca9e00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faca40a9a10 con 0x7faca406da20 2024-08-17T02:28:23.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.819+0000 7faca9e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faca40ac400 con 0x7faca40aa7d0 2024-08-17T02:28:23.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.819+0000 7faca9e00640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faca40a9cf0 con 0x7faca4158fa0 2024-08-17T02:28:23.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.820+0000 7faca2000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7faca40aa7d0 0x7faca406ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.820+0000 7faca2000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7faca40aa7d0 0x7faca406ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40224/0 (socket says 172.21.15.107:40224) 2024-08-17T02:28:23.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.820+0000 7faca2000640 1 -- 172.21.15.107:0/4009379917 learned_addr learned my addr 172.21.15.107:0/4009379917 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:28:23.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.820+0000 7faca3400640 1 --2- 172.21.15.107:0/4009379917 >> v2:172.21.15.157:3300/0 conn(0x7faca4158fa0 0x7faca40ab6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.820+0000 7faca2000640 1 -- 172.21.15.107:0/4009379917 >> v2:172.21.15.157:3300/0 conn(0x7faca4158fa0 msgr2=0x7faca40ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:23.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.820+0000 7faca2000640 1 --2- 172.21.15.107:0/4009379917 >> v2:172.21.15.157:3300/0 conn(0x7faca4158fa0 0x7faca40ab6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.820+0000 7faca2000640 1 -- 172.21.15.107:0/4009379917 >> v1:172.21.15.157:6789/0 conn(0x7faca406da20 legacy=0x7faca4158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.820+0000 7faca2000640 1 -- 172.21.15.107:0/4009379917 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca40a9fd0 con 0x7faca40aa7d0 2024-08-17T02:28:23.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.821+0000 7faca2000640 1 --2- 172.21.15.107:0/4009379917 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faca40aa7d0 0x7faca406ddf0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7faca40ad2e0 tx=0x7fac900091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e25cc6a4e87b5360 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.821+0000 7faca1600640 1 -- 172.21.15.107:0/4009379917 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9002add0 con 0x7faca40aa7d0 2024-08-17T02:28:23.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.821+0000 7faca1600640 1 -- 172.21.15.107:0/4009379917 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac90032440 con 0x7faca40aa7d0 2024-08-17T02:28:23.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.821+0000 7faca1600640 1 -- 172.21.15.107:0/4009379917 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac90032820 con 0x7faca40aa7d0 2024-08-17T02:28:23.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.822+0000 7faca9e00640 1 -- 172.21.15.107:0/4009379917 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faca40aa7d0 msgr2=0x7faca406ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.822+0000 7faca9e00640 1 --2- 172.21.15.107:0/4009379917 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faca40aa7d0 0x7faca406ddf0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7faca40ad2e0 tx=0x7fac900091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.822+0000 7faca9e00640 1 -- 172.21.15.107:0/4009379917 shutdown_connections 2024-08-17T02:28:23.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.822+0000 7faca9e00640 1 --2- 172.21.15.107:0/4009379917 >> v2:172.21.15.157:3300/0 conn(0x7faca4158fa0 0x7faca40ab6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.822+0000 7faca9e00640 1 --2- 172.21.15.107:0/4009379917 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faca40aa7d0 0x7faca406ddf0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.822+0000 7faca9e00640 1 -- 172.21.15.107:0/4009379917 >> 172.21.15.107:0/4009379917 conn(0x7faca40cb9b0 msgr2=0x7faca40cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:23.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.822+0000 7faca9e00640 1 -- 172.21.15.107:0/4009379917 shutdown_connections 2024-08-17T02:28:23.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.822+0000 7faca9e00640 1 -- 172.21.15.107:0/4009379917 wait complete. 2024-08-17T02:28:23.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.824+0000 7faca9e00640 1 Processor -- start 2024-08-17T02:28:23.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.824+0000 7faca9e00640 1 -- start start 2024-08-17T02:28:23.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.824+0000 7faca9e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faca406da20 0x7faca406a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.825+0000 7faca9e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faca40aa7d0 0x7faca40690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.825+0000 7faca9e00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faca4158fa0 0x7faca41515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.825+0000 7faca9e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca4069c00 con 0x7faca40aa7d0 2024-08-17T02:28:23.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.825+0000 7faca9e00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca4069920 con 0x7faca406da20 2024-08-17T02:28:23.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.825+0000 7faca9e00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faca40c8370 con 0x7faca4158fa0 2024-08-17T02:28:23.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.825+0000 7faca2000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faca40aa7d0 0x7faca40690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.825+0000 7faca2000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faca40aa7d0 0x7faca40690f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40238/0 (socket says 172.21.15.107:40238) 2024-08-17T02:28:23.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.825+0000 7faca2000640 1 -- 172.21.15.107:0/3259065458 learned_addr learned my addr 172.21.15.107:0/3259065458 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:28:23.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.825+0000 7faca2a00640 1 --2- 172.21.15.107:0/3259065458 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faca406da20 0x7faca406a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.825+0000 7faca2000640 1 -- 172.21.15.107:0/3259065458 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faca4158fa0 msgr2=0x7faca41515f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.825+0000 7faca3400640 1 --2- 172.21.15.107:0/3259065458 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faca4158fa0 0x7faca41515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.825+0000 7faca2000640 1 --2- 172.21.15.107:0/3259065458 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faca4158fa0 0x7faca41515f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.825+0000 7faca2000640 1 -- 172.21.15.107:0/3259065458 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faca406da20 msgr2=0x7faca406a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.825+0000 7faca2000640 1 --2- 172.21.15.107:0/3259065458 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faca406da20 0x7faca406a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.825+0000 7faca2000640 1 -- 172.21.15.107:0/3259065458 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac90009450 con 0x7faca40aa7d0 2024-08-17T02:28:23.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.825+0000 7faca2a00640 1 --2- 172.21.15.107:0/3259065458 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faca406da20 0x7faca406a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:23.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.825+0000 7faca3400640 1 --2- 172.21.15.107:0/3259065458 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faca4158fa0 0x7faca41515f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:23.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.825+0000 7faca2000640 1 --2- 172.21.15.107:0/3259065458 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faca40aa7d0 0x7faca40690f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fac90009210 tx=0x7fac90032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.826+0000 7fac9a000640 1 -- 172.21.15.107:0/3259065458 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac90000d10 con 0x7faca40aa7d0 2024-08-17T02:28:23.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.826+0000 7fac9a000640 1 -- 172.21.15.107:0/3259065458 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac90031de0 con 0x7faca40aa7d0 2024-08-17T02:28:23.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.826+0000 7fac9a000640 1 -- 172.21.15.107:0/3259065458 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9003d650 con 0x7faca40aa7d0 2024-08-17T02:28:23.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.826+0000 7faca9e00640 1 -- 172.21.15.107:0/3259065458 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faca40c8650 con 0x7faca40aa7d0 2024-08-17T02:28:23.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.826+0000 7faca9e00640 1 -- 172.21.15.107:0/3259065458 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faca4069630 con 0x7faca40aa7d0 2024-08-17T02:28:23.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.827+0000 7faca9e00640 1 -- 172.21.15.107:0/3259065458 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faca4064db0 con 0x7faca40aa7d0 2024-08-17T02:28:23.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.828+0000 7fac9a000640 1 -- 172.21.15.107:0/3259065458 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fac90039040 con 0x7faca40aa7d0 2024-08-17T02:28:23.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.829+0000 7fac9a000640 1 --2- 172.21.15.107:0/3259065458 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fac84065150 0x7fac84067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.829+0000 7fac9a000640 1 -- 172.21.15.107:0/3259065458 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fac900a21d0 con 0x7faca40aa7d0 2024-08-17T02:28:23.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.829+0000 7faca2a00640 1 --2- 172.21.15.107:0/3259065458 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fac84065150 0x7fac84067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.830+0000 7faca2a00640 1 --2- 172.21.15.107:0/3259065458 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fac84065150 0x7fac84067600 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fac940017a0 tx=0x7fac94009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.833 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:23.834+0000 7fac9a000640 1 -- 172.21.15.107:0/3259065458 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fac90070490 con 0x7faca40aa7d0 2024-08-17T02:28:24.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.003+0000 7faca9e00640 1 -- 172.21.15.107:0/3259065458 --> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faca4156fe0 con 0x7fac84065150 2024-08-17T02:28:24.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.005+0000 7fac9a000640 1 -- 172.21.15.107:0/3259065458 <== mgr.4110 v2:172.21.15.107:6832/37039 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50627 (secure 0 0 0) 0x7faca4156fe0 con 0x7fac84065150 2024-08-17T02:28:24.005 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:28:24.006 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-08-17T02:28:24.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.007+0000 7faca9e00640 1 -- 172.21.15.107:0/3259065458 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fac84065150 msgr2=0x7fac84067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.007+0000 7faca9e00640 1 --2- 172.21.15.107:0/3259065458 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fac84065150 0x7fac84067600 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fac940017a0 tx=0x7fac94009040 comp rx=0 tx=0).stop 2024-08-17T02:28:24.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.007+0000 7faca9e00640 1 -- 172.21.15.107:0/3259065458 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faca40aa7d0 msgr2=0x7faca40690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.007+0000 7faca9e00640 1 --2- 172.21.15.107:0/3259065458 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faca40aa7d0 0x7faca40690f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fac90009210 tx=0x7fac90032000 comp rx=0 tx=0).stop 2024-08-17T02:28:24.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.007+0000 7faca9e00640 1 -- 172.21.15.107:0/3259065458 shutdown_connections 2024-08-17T02:28:24.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.007+0000 7faca9e00640 1 --2- 172.21.15.107:0/3259065458 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7fac84065150 0x7fac84067600 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.007+0000 7faca9e00640 1 --2- 172.21.15.107:0/3259065458 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faca4158fa0 0x7faca41515f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.007+0000 7faca9e00640 1 --2- 172.21.15.107:0/3259065458 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faca40aa7d0 0x7faca40690f0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.007+0000 7faca9e00640 1 --2- 172.21.15.107:0/3259065458 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faca406da20 0x7faca406a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.009 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.007+0000 7faca9e00640 1 -- 172.21.15.107:0/3259065458 >> 172.21.15.107:0/3259065458 conn(0x7faca40cb9b0 msgr2=0x7faca41560e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:24.009 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.007+0000 7faca9e00640 1 -- 172.21.15.107:0/3259065458 shutdown_connections 2024-08-17T02:28:24.009 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.007+0000 7faca9e00640 1 -- 172.21.15.107:0/3259065458 wait complete. 2024-08-17T02:28:24.022 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":157,"stamp":"2024-08-17T02:28:23.462201+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2404824,"kb_used_data":5160,"kb_used_omap":13,"kb_used_meta":2399538,"kb_avail":752569896,"statfs":{"total":773094113280,"available":770631573504,"internally_reserved":0,"allocated":5283840,"data_stored":2880488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2457127616},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002349"},"pg_stats":[{"pgid":"1.0","version":"43'119","reported_seq":195,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-17T02:28:05.615659+0000","last_change":"2024-08-17T02:28:05.615620+0000","last_active":"2024-08-17T02:28:05.615659+0000","last_peered":"2024-08-17T02:28:05.615659+0000","last_clean":"2024-08-17T02:28:05.615659+0000","last_became_active":"2024-08-17T02:24:25.091788+0000","last_became_peered":"2024-08-17T02:24:25.091788+0000","last_unstale":"2024-08-17T02:28:05.615659+0000","last_undegraded":"2024-08-17T02:28:05.615659+0000","last_fullsized":"2024-08-17T02:28:05.615659+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'119","last_scrub_stamp":"2024-08-17T02:28:05.615521+0000","last_deep_scrub":"43'119","last_deep_scrub_stamp":"2024-08-17T02:28:05.615521+0000","last_clean_scrub_stamp":"2024-08-17T02:28:05.615521+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:40:58.347837+0000","scrub_duration":0.0067640340000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302592,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069248,"statfs":{"total":96636764160,"available":96326909952,"internally_reserved":0,"allocated":1105920,"data_stored":802837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.60999999999999999,"15min":0.59399999999999997},"min":{"1min":0.50900000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.82499999999999996,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.63800000000000001,"15min":0.625},"min":{"1min":0.51500000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.93000000000000005,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.65800000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.66400000000000003,"15min":0.64200000000000002},"min":{"1min":0.51200000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.67900000000000005,"15min":0.66100000000000003},"min":{"1min":0.61099999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.90200000000000002,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.752}]},{"osd":2,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.66300000000000003,"15min":0.64200000000000002},"min":{"1min":0.56000000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.85599999999999998,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.69099999999999995,"15min":0.66300000000000003},"min":{"1min":0.628,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85399999999999998,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.78400000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68999999999999995,"15min":0.67600000000000005},"min":{"1min":0.53300000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.85699999999999998,"5min":1.105,"15min":1.105},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.72699999999999998,"15min":0.71899999999999997},"min":{"1min":0.625,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.88900000000000001,"5min":0.995,"15min":0.995},"last":0.74099999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.56299999999999994,"15min":0.57799999999999996},"min":{"1min":0.377,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.70199999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.59199999999999997,"15min":0.60299999999999998},"min":{"1min":0.43099999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.72799999999999998,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.5}]},{"osd":5,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.66400000000000003,"15min":0.68999999999999995},"min":{"1min":0.45200000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.72999999999999998,"15min":0.748},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.86599999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.624}]},{"osd":6,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.67800000000000005,"15min":0.69199999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.80500000000000005,"5min":0.88,"15min":0.88},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.67100000000000004,"15min":0.68899999999999995},"min":{"1min":0.42699999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82499999999999996,"5min":1.149,"15min":1.149},"last":0.70999999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302020,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069820,"statfs":{"total":96636764160,"available":96327495680,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:28 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.84199999999999997,"15min":0.90000000000000002},"min":{"1min":0.58799999999999997,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.85099999999999998,"5min":4.7380000000000004,"15min":4.7380000000000004},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.83999999999999997,"15min":0.89000000000000001},"min":{"1min":0.64000000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.85199999999999998,"5min":3.2839999999999998,"15min":3.2839999999999998},"last":0.745}]},{"osd":1,"last update":"Sat Aug 17 02:27:28 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.67800000000000005,"15min":0.64900000000000002},"min":{"1min":0.59999999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.90200000000000002,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.82699999999999996,"15min":0.86899999999999999},"min":{"1min":0.65700000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.91800000000000004,"5min":2.524,"15min":2.524},"last":0.54800000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:27:28 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.79300000000000004,"15min":0.82299999999999995},"min":{"1min":0.63300000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.82999999999999996,"5min":3.3199999999999998,"15min":3.3199999999999998},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.753,"15min":0.749},"min":{"1min":0.60699999999999998,"5min":0.502,"15min":0.502},"max":{"1min":0.93899999999999995,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.65600000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:27:28 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77800000000000002,"15min":0.78700000000000003},"min":{"1min":0.623,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.91700000000000004,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.81799999999999995,"15min":0.83599999999999997},"min":{"1min":0.627,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.88300000000000001,"5min":3.3610000000000002,"15min":3.3610000000000002},"last":0.77600000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:27:28 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.72199999999999998,"15min":0.77800000000000002},"min":{"1min":0.45100000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.83399999999999996,"5min":3.3999999999999999,"15min":3.3999999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.752,"15min":0.82099999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.72399999999999998,"5min":3.4670000000000001,"15min":3.4670000000000001},"last":0.61799999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:27:28 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.67800000000000005,"15min":0.70999999999999996},"min":{"1min":0.46100000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.82199999999999995,"5min":1.73,"15min":1.73},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.78700000000000003,"15min":0.84099999999999997},"min":{"1min":0.47399999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.90500000000000003,"5min":3.3410000000000002,"15min":3.3410000000000002},"last":0.72999999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:27:28 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.81499999999999995,"15min":0.86899999999999999},"min":{"1min":0.52500000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.90000000000000002,"5min":3.23,"15min":3.23},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.75700000000000001,"15min":0.79100000000000004},"min":{"1min":0.51300000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.86699999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.60799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302020,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069820,"statfs":{"total":96636764160,"available":96327495680,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.65100000000000002,"15min":0.629},"min":{"1min":0.48599999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.72799999999999998,"15min":0.73199999999999998},"min":{"1min":0.52300000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.046,"5min":3.1440000000000001,"15min":3.1440000000000001},"last":0.71299999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.73099999999999998,"15min":0.71399999999999997},"min":{"1min":0.624,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0740000000000001,"5min":1.119,"15min":1.119},"last":0.87},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.70399999999999996,"15min":0.68400000000000005},"min":{"1min":0.56799999999999995,"5min":0.443,"15min":0.443},"max":{"1min":1.0229999999999999,"5min":1.153,"15min":1.153},"last":0.83299999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75,"15min":0.75600000000000001},"min":{"1min":0.55100000000000005,"5min":0.433,"15min":0.433},"max":{"1min":0.90500000000000003,"5min":3.2559999999999998,"15min":3.2559999999999998},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.68200000000000005,"15min":0.66400000000000003},"min":{"1min":0.58899999999999997,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.76800000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.80300000000000005,"15min":0.81200000000000006},"min":{"1min":0.67500000000000004,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.042,"5min":3.2229999999999999,"15min":3.2229999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.82999999999999996,"15min":0.84399999999999997},"min":{"1min":0.62,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0629999999999999,"5min":3.1859999999999999,"15min":3.1859999999999999},"last":0.85699999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.432,"5min":0.317,"15min":0.317},"max":{"1min":0.80500000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64600000000000002,"15min":0.65400000000000003},"min":{"1min":0.47499999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.93000000000000005,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.629}]},{"osd":6,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.505,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.95599999999999996,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.67300000000000004,"15min":0.67000000000000004},"min":{"1min":0.51700000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.91200000000000003,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.52500000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.72099999999999997,"15min":0.72799999999999998},"min":{"1min":0.48199999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.97299999999999998,"5min":1.02,"15min":1.02},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.73699999999999999,"15min":0.73599999999999999},"min":{"1min":0.55100000000000005,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.018,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.64500000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302020,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069820,"statfs":{"total":96636764160,"available":96327495680,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.62,"15min":0.58599999999999997},"min":{"1min":0.53000000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.86299999999999999,"5min":0.999,"15min":0.999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.65400000000000003,"15min":0.63400000000000001},"min":{"1min":0.56299999999999994,"5min":0.437,"15min":0.437},"max":{"1min":0.83299999999999996,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.55200000000000005}]},{"osd":1,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.70099999999999996,"15min":0.68100000000000005},"min":{"1min":0.50600000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.89800000000000002,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.68899999999999995,"15min":0.66700000000000004},"min":{"1min":0.53400000000000003,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.88400000000000001,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.73099999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.70799999999999996,"15min":0.69399999999999995},"min":{"1min":0.56899999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.92500000000000004,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69699999999999995,"15min":0.68200000000000005},"min":{"1min":0.52800000000000002,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.91100000000000003,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.69099999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.68400000000000005,"15min":0.65800000000000003},"min":{"1min":0.58099999999999996,"5min":0.432,"15min":0.432},"max":{"1min":0.86499999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73999999999999999,"15min":0.73499999999999999},"min":{"1min":0.59399999999999997,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.875,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.80300000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.56899999999999995,"15min":0.58799999999999997},"min":{"1min":0.39400000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.749,"5min":0.752,"15min":0.752},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.63300000000000001,"15min":0.66900000000000004},"min":{"1min":0.434,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.68700000000000006,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.48699999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.64500000000000002,"15min":0.68400000000000005},"min":{"1min":0.44,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77500000000000002,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.65300000000000002,"15min":0.68100000000000005},"min":{"1min":0.47999999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.748,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.47099999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69599999999999995,"15min":0.71199999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.88500000000000001,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.748},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.75800000000000001,"15min":0.78500000000000003},"min":{"1min":0.51700000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.86499999999999999,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.53000000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.438,"15min":0.44},"min":{"1min":0.308,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.45500000000000002,"15min":0.439},"min":{"1min":0.36399999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.65400000000000003,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.54500000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47499999999999998,"15min":0.47699999999999998},"min":{"1min":0.35599999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68300000000000005,"5min":1.458,"15min":1.458},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.496,"5min":0.501,"15min":0.497},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.57599999999999996,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.65700000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.44800000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.72599999999999998,"5min":1.492,"15min":1.492},"last":0.625},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.55100000000000005,"15min":0.53900000000000003},"min":{"1min":0.44500000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.74099999999999999,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.76000000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72699999999999998,"15min":0.72499999999999998},"min":{"1min":0.48899999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0069999999999999,"5min":1.01,"15min":1.01},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.75800000000000001,"15min":0.755},"min":{"1min":0.55500000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.97299999999999998,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.879}]},{"osd":5,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.746,"15min":0.74299999999999999},"min":{"1min":0.58799999999999997,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.01,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.77000000000000002,"15min":0.77400000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.96099999999999997,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.75}]},{"osd":6,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.77100000000000002,"15min":0.77200000000000002},"min":{"1min":0.59499999999999997,"5min":0.504,"15min":0.504},"max":{"1min":0.98099999999999998,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79100000000000004,"15min":0.79300000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.91100000000000003,"5min":1.077,"15min":1.077},"last":0.82899999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.78000000000000003,"15min":0.79000000000000004},"min":{"1min":0.55400000000000005,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.90000000000000002,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.79400000000000004,"15min":0.79200000000000004},"min":{"1min":0.59799999999999998,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0309999999999999,"5min":1.421,"15min":1.421},"last":0.92700000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.40200000000000002,"15min":0.39200000000000002},"min":{"1min":0.315,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.443,"5min":0.53700000000000003,"15min":0.57899999999999996},"min":{"1min":0.34300000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.55200000000000005,"5min":3.9060000000000001,"15min":3.9060000000000001},"last":0.49099999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.34699999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.58699999999999997,"5min":0.746,"15min":0.746},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.505,"15min":0.48899999999999999},"min":{"1min":0.436,"5min":0.372,"15min":0.372},"max":{"1min":0.64600000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.56599999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.53200000000000003,"15min":0.52300000000000002},"min":{"1min":0.42399999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.65800000000000003,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.62},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.56200000000000006,"15min":0.54900000000000004},"min":{"1min":0.496,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.745,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.69999999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.81799999999999995,"15min":0.84199999999999997},"min":{"1min":0.56599999999999995,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.997,"5min":4.1509999999999998,"15min":4.1509999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.73899999999999999,"15min":0.73499999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0880000000000001,"5min":1.381,"15min":1.381},"last":0.76400000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.72999999999999998,"15min":0.70599999999999996},"min":{"1min":0.60299999999999998,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.82799999999999996,"15min":0.85199999999999998},"min":{"1min":0.60399999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.125,"5min":4.1079999999999997,"15min":4.1079999999999997},"last":0.751}]},{"osd":6,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.75,"15min":0.73399999999999999},"min":{"1min":0.629,"5min":0.505,"15min":0.505},"max":{"1min":1.0469999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.74299999999999999,"15min":0.72899999999999998},"min":{"1min":0.64600000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.65100000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.84699999999999998,"15min":0.874},"min":{"1min":0.64600000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.97199999999999998,"5min":4.1879999999999997,"15min":4.1879999999999997},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.76800000000000002,"15min":0.752},"min":{"1min":0.58599999999999997,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.157,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.71799999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:25 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.33000000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.432,"15min":0.41999999999999998},"min":{"1min":0.379,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.44800000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:27:25 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.44400000000000001,"15min":0.439},"min":{"1min":0.38,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.41399999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.65000000000000002,"5min":0.746,"15min":0.746},"last":0.60799999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:27:25 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.55700000000000005,"15min":0.54400000000000004},"min":{"1min":0.51700000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.68200000000000005,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.502,"15min":0.48999999999999999},"min":{"1min":0.38800000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.79000000000000004,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.38900000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:27:25 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.71099999999999997,"15min":0.69899999999999995},"min":{"1min":0.55100000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.022,"5min":1.115,"15min":1.115},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.69899999999999995,"15min":0.68899999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.90900000000000003,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.76600000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:27:25 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.72599999999999998,"15min":0.72199999999999998},"min":{"1min":0.59799999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.99199999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.68500000000000005,"15min":0.66500000000000004},"min":{"1min":0.57299999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.94999999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.72599999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:27:25 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.73699999999999999,"15min":0.73099999999999998},"min":{"1min":0.60499999999999998,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.94399999999999995,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.71699999999999997,"15min":0.70799999999999996},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.93300000000000005,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.748}]},{"osd":7,"last update":"Sat Aug 17 02:27:25 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.746,"15min":0.74199999999999999},"min":{"1min":0.64300000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.002,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.64000000000000001,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.93100000000000005,"5min":1.143,"15min":1.143},"last":0.78100000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574898,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302592,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069248,"statfs":{"total":96636764160,"available":96326909952,"internally_reserved":0,"allocated":1105920,"data_stored":802837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.41299999999999998,"15min":0.40899999999999997},"min":{"1min":0.34999999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.53600000000000003,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.46600000000000003,"15min":0.45700000000000002},"min":{"1min":0.34999999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.67500000000000004,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.48099999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.48499999999999999,"15min":0.48999999999999999},"min":{"1min":0.35699999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.59399999999999997,"5min":1.169,"15min":1.169},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.52100000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.81100000000000005,"5min":1.262,"15min":1.262},"last":0.59699999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.48699999999999999,"15min":0.47499999999999998},"min":{"1min":0.42999999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67900000000000005,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57599999999999996,"15min":0.59399999999999997},"min":{"1min":0.41999999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.67100000000000004,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":0.434}]},{"osd":4,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.76800000000000002,"15min":0.76100000000000001},"min":{"1min":0.65600000000000003,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.0449999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.82999999999999996,"15min":0.86299999999999999},"min":{"1min":0.57799999999999996,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.03,"5min":3.2160000000000002,"15min":3.2160000000000002},"last":0.72299999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.80700000000000005,"15min":0.82699999999999996},"min":{"1min":0.53500000000000003,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.96999999999999997,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.755,"15min":0.751},"min":{"1min":0.65800000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0109999999999999,"5min":1.383,"15min":1.383},"last":0.70499999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.749,"15min":0.74099999999999999},"min":{"1min":0.59799999999999998,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.119,"5min":1.411,"15min":1.411},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.78200000000000003,"15min":0.77300000000000002},"min":{"1min":0.70999999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.101,"5min":1.343,"15min":1.343},"last":0.85299999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:27:27 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.80700000000000005,"15min":0.79700000000000004},"min":{"1min":0.69299999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1459999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.88400000000000001,"15min":0.91000000000000003},"min":{"1min":0.65500000000000003,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.081,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":0.67800000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:28:24.024 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-08-17T02:28:24.167 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.167+0000 7f2b73c00640 1 Processor -- start 2024-08-17T02:28:24.167 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.167+0000 7f2b73c00640 1 -- start start 2024-08-17T02:28:24.168 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.168+0000 7f2b73c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b6c0c92e0 0x7f2b6c160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.168 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.168+0000 7f2b73c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b6c1598f0 con 0x7f2b6c0c7db0 2024-08-17T02:28:24.168 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.168+0000 7f2b73c00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b6c159bd0 con 0x7f2b6c155a80 2024-08-17T02:28:24.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.168+0000 7f2b73c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c159eb0 con 0x7f2b6c0c92e0 2024-08-17T02:28:24.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.168+0000 7f2b6be00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f2b6c0c7db0 0x7f2b6c0c8bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:39596/0 (socket says 172.21.15.107:39596) 2024-08-17T02:28:24.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.168+0000 7f2b6be00640 1 -- 172.21.15.107:0/1146442098 learned_addr learned my addr 172.21.15.107:0/1146442098 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:28:24.171 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.169+0000 7f2b71c00640 1 --2- 172.21.15.107:0/1146442098 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b6c0c92e0 0x7f2b6c160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.171 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.169+0000 7f2b6b400640 1 -- 172.21.15.107:0/1146442098 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 321077383 0 0) 0x7f2b6c1598f0 con 0x7f2b6c0c7db0 2024-08-17T02:28:24.171 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.169+0000 7f2b6b400640 1 -- 172.21.15.107:0/1146442098 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b540034e0 con 0x7f2b6c0c7db0 2024-08-17T02:28:24.171 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.169+0000 7f2b6b400640 1 -- 172.21.15.107:0/1146442098 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 255956678 0 0) 0x7f2b540034e0 con 0x7f2b6c0c7db0 2024-08-17T02:28:24.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.169+0000 7f2b6b400640 1 -- 172.21.15.107:0/1146442098 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b6c0c92e0 msgr2=0x7f2b6c160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:24.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.169+0000 7f2b6b400640 1 --2- 172.21.15.107:0/1146442098 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b6c0c92e0 0x7f2b6c160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.169+0000 7f2b6b400640 1 -- 172.21.15.107:0/1146442098 >> v1:172.21.15.157:6789/0 conn(0x7f2b6c155a80 legacy=0x7f2b6c06dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.169+0000 7f2b6b400640 1 -- 172.21.15.107:0/1146442098 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b6c15a190 con 0x7f2b6c0c7db0 2024-08-17T02:28:24.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.169+0000 7f2b6b400640 1 -- 172.21.15.107:0/1146442098 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 537989081 0 0) 0x7f2b58001470 con 0x7f2b6c0c7db0 2024-08-17T02:28:24.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.169+0000 7f2b6b400640 1 -- 172.21.15.107:0/1146442098 >> v1:172.21.15.107:6789/0 conn(0x7f2b6c0c7db0 legacy=0x7f2b6c0c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.169+0000 7f2b6b400640 1 --2- 172.21.15.107:0/1146442098 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b6c0c92e0 0x7f2b54003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.169+0000 7f2b6b400640 1 --2- 172.21.15.107:0/1146442098 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b54003f80 0x7f2b54004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.169+0000 7f2b6b400640 1 --2- 172.21.15.107:0/1146442098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b54004cc0 0x7f2b54005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.169+0000 7f2b6b400640 1 -- 172.21.15.107:0/1146442098 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c159eb0 con 0x7f2b54003f80 2024-08-17T02:28:24.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.169+0000 7f2b6b400640 1 -- 172.21.15.107:0/1146442098 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5400bb60 con 0x7f2b54004cc0 2024-08-17T02:28:24.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.169+0000 7f2b6b400640 1 -- 172.21.15.107:0/1146442098 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5400bd20 con 0x7f2b6c0c92e0 2024-08-17T02:28:24.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.169+0000 7f2b6be00640 1 --2- 172.21.15.107:0/1146442098 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b54003f80 0x7f2b54004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.169+0000 7f2b71c00640 1 --2- 172.21.15.107:0/1146442098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b54004cc0 0x7f2b54005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.170+0000 7f2b71200640 1 --2- 172.21.15.107:0/1146442098 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b6c0c92e0 0x7f2b54003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.170+0000 7f2b6be00640 1 -- 172.21.15.107:0/1146442098 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b6c0c92e0 msgr2=0x7f2b54003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:24.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.170+0000 7f2b6be00640 1 --2- 172.21.15.107:0/1146442098 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b6c0c92e0 0x7f2b54003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.170+0000 7f2b6be00640 1 -- 172.21.15.107:0/1146442098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b54004cc0 msgr2=0x7f2b54005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:24.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.170+0000 7f2b6be00640 1 --2- 172.21.15.107:0/1146442098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b54004cc0 0x7f2b54005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.170+0000 7f2b6be00640 1 -- 172.21.15.107:0/1146442098 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b540034e0 con 0x7f2b54003f80 2024-08-17T02:28:24.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.171+0000 7f2b6be00640 1 --2- 172.21.15.107:0/1146442098 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b54003f80 0x7f2b54004780 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c0c81f0 tx=0x7f2b58001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcd532966e871603 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:24.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.171+0000 7f2b6b400640 1 -- 172.21.15.107:0/1146442098 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b58005890 con 0x7f2b54003f80 2024-08-17T02:28:24.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.171+0000 7f2b6b400640 1 -- 172.21.15.107:0/1146442098 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b5802d070 con 0x7f2b54003f80 2024-08-17T02:28:24.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.171+0000 7f2b6b400640 1 -- 172.21.15.107:0/1146442098 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b58005a50 con 0x7f2b54003f80 2024-08-17T02:28:24.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.171+0000 7f2b73c00640 1 -- 172.21.15.107:0/1146442098 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b54003f80 msgr2=0x7f2b54004780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.171+0000 7f2b73c00640 1 --2- 172.21.15.107:0/1146442098 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b54003f80 0x7f2b54004780 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c0c81f0 tx=0x7f2b58001e50 comp rx=0 tx=0).stop 2024-08-17T02:28:24.178 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.171+0000 7f2b71c00640 1 -- 172.21.15.107:0/1146442098 reap_dead start 2024-08-17T02:28:24.178 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.171+0000 7f2b73c00640 1 -- 172.21.15.107:0/1146442098 shutdown_connections 2024-08-17T02:28:24.178 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.171+0000 7f2b73c00640 1 -- 172.21.15.107:0/1146442098 >> 172.21.15.107:0/1146442098 conn(0x7f2b6c067750 msgr2=0x7f2b6c0c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:24.178 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.172+0000 7f2b73c00640 1 -- 172.21.15.107:0/1146442098 shutdown_connections 2024-08-17T02:28:24.178 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.172+0000 7f2b73c00640 1 -- 172.21.15.107:0/1146442098 wait complete. 2024-08-17T02:28:24.178 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.173+0000 7f2b73c00640 1 Processor -- start 2024-08-17T02:28:24.178 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.173+0000 7f2b73c00640 1 -- start start 2024-08-17T02:28:24.178 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.174+0000 7f2b73c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b54003f80 0x7f2b6c16c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.179 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.174+0000 7f2b73c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b6c1692c0 0x7f2b6c169730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.179 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.174+0000 7f2b73c00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b6c150ff0 0x7f2b6c151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.179 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.174+0000 7f2b73c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c151990 con 0x7f2b54003f80 2024-08-17T02:28:24.179 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.174+0000 7f2b73c00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c155e50 con 0x7f2b6c1692c0 2024-08-17T02:28:24.179 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.174+0000 7f2b73c00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c16a7c0 con 0x7f2b6c150ff0 2024-08-17T02:28:24.179 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.174+0000 7f2b71200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b54003f80 0x7f2b6c16c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.179 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.174+0000 7f2b71200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b54003f80 0x7f2b6c16c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40248/0 (socket says 172.21.15.107:40248) 2024-08-17T02:28:24.179 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.174+0000 7f2b71200640 1 -- 172.21.15.107:0/3046100469 learned_addr learned my addr 172.21.15.107:0/3046100469 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:28:24.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.175+0000 7f2b71c00640 1 --2- 172.21.15.107:0/3046100469 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b6c150ff0 0x7f2b6c151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.175+0000 7f2b6be00640 1 --2- 172.21.15.107:0/3046100469 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b6c1692c0 0x7f2b6c169730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.175+0000 7f2b71200640 1 -- 172.21.15.107:0/3046100469 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b6c150ff0 msgr2=0x7f2b6c151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.175+0000 7f2b71200640 1 --2- 172.21.15.107:0/3046100469 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b6c150ff0 0x7f2b6c151450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.175+0000 7f2b71200640 1 -- 172.21.15.107:0/3046100469 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b6c1692c0 msgr2=0x7f2b6c169730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.175+0000 7f2b71200640 1 --2- 172.21.15.107:0/3046100469 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b6c1692c0 0x7f2b6c169730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.175+0000 7f2b71200640 1 -- 172.21.15.107:0/3046100469 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b6c169df0 con 0x7f2b54003f80 2024-08-17T02:28:24.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.175+0000 7f2b71c00640 1 --2- 172.21.15.107:0/3046100469 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b6c150ff0 0x7f2b6c151450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:24.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.175+0000 7f2b71200640 1 --2- 172.21.15.107:0/3046100469 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b54003f80 0x7f2b6c16c050 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2b6000e840 tx=0x7f2b60009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:24.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.175+0000 7f2b5fe00640 1 -- 172.21.15.107:0/3046100469 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6000c6c0 con 0x7f2b54003f80 2024-08-17T02:28:24.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.175+0000 7f2b5fe00640 1 -- 172.21.15.107:0/3046100469 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6000c820 con 0x7f2b54003f80 2024-08-17T02:28:24.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.175+0000 7f2b73c00640 1 -- 172.21.15.107:0/3046100469 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b6c16a0d0 con 0x7f2b54003f80 2024-08-17T02:28:24.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.175+0000 7f2b5fe00640 1 -- 172.21.15.107:0/3046100469 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6000cbe0 con 0x7f2b54003f80 2024-08-17T02:28:24.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.176+0000 7f2b73c00640 1 -- 172.21.15.107:0/3046100469 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b6c156380 con 0x7f2b54003f80 2024-08-17T02:28:24.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.176+0000 7f2b73c00640 1 -- 172.21.15.107:0/3046100469 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b6c071050 con 0x7f2b54003f80 2024-08-17T02:28:24.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.177+0000 7f2b5fe00640 1 -- 172.21.15.107:0/3046100469 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2b60013420 con 0x7f2b54003f80 2024-08-17T02:28:24.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.178+0000 7f2b5fe00640 1 --2- 172.21.15.107:0/3046100469 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f2b4c065180 0x7f2b4c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.178+0000 7f2b5fe00640 1 -- 172.21.15.107:0/3046100469 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f2b60082670 con 0x7f2b54003f80 2024-08-17T02:28:24.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.178+0000 7f2b6be00640 1 --2- 172.21.15.107:0/3046100469 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f2b4c065180 0x7f2b4c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.179+0000 7f2b6be00640 1 --2- 172.21.15.107:0/3046100469 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f2b4c065180 0x7f2b4c067630 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2b58032000 tx=0x7f2b58033000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:24.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.182+0000 7f2b5fe00640 1 -- 172.21.15.107:0/3046100469 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2b600509f0 con 0x7f2b54003f80 2024-08-17T02:28:24.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.354+0000 7f2b73c00640 1 -- 172.21.15.107:0/3046100469 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f2b6c06aa10 con 0x7f2b54003f80 2024-08-17T02:28:24.359 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.358+0000 7f2b5fe00640 1 -- 172.21.15.107:0/3046100469 <== mon.0 v2:172.21.15.107:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2b600509f0 con 0x7f2b54003f80 2024-08-17T02:28:24.359 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.359+0000 7f2b5fe00640 1 -- 172.21.15.107:0/3046100469 <== mon.0 v2:172.21.15.107:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f2b60054010 con 0x7f2b54003f80 2024-08-17T02:28:24.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.361+0000 7f2b73c00640 1 -- 172.21.15.107:0/3046100469 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f2b4c065180 msgr2=0x7f2b4c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.361+0000 7f2b73c00640 1 --2- 172.21.15.107:0/3046100469 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f2b4c065180 0x7f2b4c067630 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2b58032000 tx=0x7f2b58033000 comp rx=0 tx=0).stop 2024-08-17T02:28:24.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.361+0000 7f2b73c00640 1 -- 172.21.15.107:0/3046100469 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b54003f80 msgr2=0x7f2b6c16c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.361+0000 7f2b73c00640 1 --2- 172.21.15.107:0/3046100469 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b54003f80 0x7f2b6c16c050 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2b6000e840 tx=0x7f2b60009040 comp rx=0 tx=0).stop 2024-08-17T02:28:24.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.361+0000 7f2b73c00640 1 -- 172.21.15.107:0/3046100469 shutdown_connections 2024-08-17T02:28:24.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.361+0000 7f2b73c00640 1 --2- 172.21.15.107:0/3046100469 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f2b4c065180 0x7f2b4c067630 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.361+0000 7f2b73c00640 1 --2- 172.21.15.107:0/3046100469 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b6c150ff0 0x7f2b6c151450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.361+0000 7f2b73c00640 1 --2- 172.21.15.107:0/3046100469 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b6c1692c0 0x7f2b6c169730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.363 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.361+0000 7f2b73c00640 1 --2- 172.21.15.107:0/3046100469 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b54003f80 0x7f2b6c16c050 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.363 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.361+0000 7f2b73c00640 1 -- 172.21.15.107:0/3046100469 >> 172.21.15.107:0/3046100469 conn(0x7f2b6c067750 msgr2=0x7f2b6c0affe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:24.363 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.361+0000 7f2b73c00640 1 -- 172.21.15.107:0/3046100469 shutdown_connections 2024-08-17T02:28:24.363 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.362+0000 7f2b73c00640 1 -- 172.21.15.107:0/3046100469 wait complete. 2024-08-17T02:28:24.377 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:28:24.377 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:28:24.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.525+0000 7f61eea00640 1 Processor -- start 2024-08-17T02:28:24.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.525+0000 7f61eea00640 1 -- start start 2024-08-17T02:28:24.526 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.526+0000 7f61eea00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61e8155900 0x7f61e8155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.526 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.526+0000 7f61eea00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61e8157690 con 0x7f61e80b0270 2024-08-17T02:28:24.526 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.526+0000 7f61eea00640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61e8156a80 con 0x7f61e8158b30 2024-08-17T02:28:24.526 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.526+0000 7f61eea00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e8156d60 con 0x7f61e8155900 2024-08-17T02:28:24.528 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.526+0000 7f61ecc00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f61e80b0270 0x7f61e8156210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:39608/0 (socket says 172.21.15.107:39608) 2024-08-17T02:28:24.528 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.526+0000 7f61ecc00640 1 -- 172.21.15.107:0/3705210570 learned_addr learned my addr 172.21.15.107:0/3705210570 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:28:24.529 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.527+0000 7f61ed600640 1 --2- 172.21.15.107:0/3705210570 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61e8155900 0x7f61e8155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.529 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.527+0000 7f61e7e00640 1 -- 172.21.15.107:0/3705210570 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2725945999 0 0) 0x7f61e8157690 con 0x7f61e80b0270 2024-08-17T02:28:24.529 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.527+0000 7f61e7e00640 1 -- 172.21.15.107:0/3705210570 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61d00034e0 con 0x7f61e80b0270 2024-08-17T02:28:24.529 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.527+0000 7f61e7e00640 1 -- 172.21.15.107:0/3705210570 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4133393744 0 0) 0x7f61e8156a80 con 0x7f61e8158b30 2024-08-17T02:28:24.529 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.527+0000 7f61e7e00640 1 -- 172.21.15.107:0/3705210570 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61e8157690 con 0x7f61e8158b30 2024-08-17T02:28:24.529 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.527+0000 7f61e7e00640 1 -- 172.21.15.107:0/3705210570 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1118956382 0 0) 0x7f61d00034e0 con 0x7f61e80b0270 2024-08-17T02:28:24.529 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.527+0000 7f61e7e00640 1 -- 172.21.15.107:0/3705210570 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61e8155900 msgr2=0x7f61e8155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:24.530 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.527+0000 7f61e7e00640 1 --2- 172.21.15.107:0/3705210570 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61e8155900 0x7f61e8155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.530 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.527+0000 7f61e7e00640 1 -- 172.21.15.107:0/3705210570 >> v1:172.21.15.157:6789/0 conn(0x7f61e8158b30 legacy=0x7f61e80ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.530 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.527+0000 7f61e7e00640 1 -- 172.21.15.107:0/3705210570 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e8157040 con 0x7f61e80b0270 2024-08-17T02:28:24.530 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.527+0000 7f61e7e00640 1 -- 172.21.15.107:0/3705210570 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 537989081 0 0) 0x7f61d4001470 con 0x7f61e80b0270 2024-08-17T02:28:24.530 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.527+0000 7f61e7e00640 1 -- 172.21.15.107:0/3705210570 >> v1:172.21.15.107:6789/0 conn(0x7f61e80b0270 legacy=0x7f61e8156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.530 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.527+0000 7f61e7e00640 1 --2- 172.21.15.107:0/3705210570 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61e8155900 0x7f61d0003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.530 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.527+0000 7f61e7e00640 1 --2- 172.21.15.107:0/3705210570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61d0004140 0x7f61d0004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.530 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.527+0000 7f61e7e00640 1 --2- 172.21.15.107:0/3705210570 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61d0004cc0 0x7f61d0005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.527+0000 7f61e7e00640 1 -- 172.21.15.107:0/3705210570 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e8156d60 con 0x7f61d0004140 2024-08-17T02:28:24.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.527+0000 7f61e7e00640 1 -- 172.21.15.107:0/3705210570 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d000dd70 con 0x7f61d0004cc0 2024-08-17T02:28:24.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.527+0000 7f61e7e00640 1 -- 172.21.15.107:0/3705210570 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d000df30 con 0x7f61e8155900 2024-08-17T02:28:24.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.527+0000 7f61ecc00640 1 --2- 172.21.15.107:0/3705210570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61d0004140 0x7f61d0004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.528+0000 7f61ed600640 1 --2- 172.21.15.107:0/3705210570 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61e8155900 0x7f61d0003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.528+0000 7f61ee000640 1 --2- 172.21.15.107:0/3705210570 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61d0004cc0 0x7f61d0005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.528+0000 7f61ecc00640 1 -- 172.21.15.107:0/3705210570 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61e8155900 msgr2=0x7f61d0003b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:24.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.528+0000 7f61ecc00640 1 --2- 172.21.15.107:0/3705210570 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61e8155900 0x7f61d0003b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.532 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.528+0000 7f61ecc00640 1 -- 172.21.15.107:0/3705210570 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61d0004cc0 msgr2=0x7f61d0005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:24.532 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.528+0000 7f61ecc00640 1 --2- 172.21.15.107:0/3705210570 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61d0004cc0 0x7f61d0005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.532 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.528+0000 7f61ecc00640 1 -- 172.21.15.107:0/3705210570 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d00034e0 con 0x7f61d0004140 2024-08-17T02:28:24.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.529+0000 7f61ecc00640 1 --2- 172.21.15.107:0/3705210570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61d0004140 0x7f61d0004780 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f61d400c190 tx=0x7f61e8157600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f05b22ea1d45288 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:24.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.529+0000 7f61e7e00640 1 -- 172.21.15.107:0/3705210570 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d4005960 con 0x7f61d0004140 2024-08-17T02:28:24.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.529+0000 7f61e7e00640 1 -- 172.21.15.107:0/3705210570 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f61d402d070 con 0x7f61d0004140 2024-08-17T02:28:24.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.529+0000 7f61e7e00640 1 -- 172.21.15.107:0/3705210570 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d4005b40 con 0x7f61d0004140 2024-08-17T02:28:24.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.529+0000 7f61eea00640 1 -- 172.21.15.107:0/3705210570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61d0004140 msgr2=0x7f61d0004780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.529+0000 7f61eea00640 1 --2- 172.21.15.107:0/3705210570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61d0004140 0x7f61d0004780 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f61d400c190 tx=0x7f61e8157600 comp rx=0 tx=0).stop 2024-08-17T02:28:24.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.530+0000 7f61ee000640 1 -- 172.21.15.107:0/3705210570 reap_dead start 2024-08-17T02:28:24.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.530+0000 7f61eea00640 1 -- 172.21.15.107:0/3705210570 shutdown_connections 2024-08-17T02:28:24.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.530+0000 7f61eea00640 1 -- 172.21.15.107:0/3705210570 >> 172.21.15.107:0/3705210570 conn(0x7f61e8067750 msgr2=0x7f61e80cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:24.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.530+0000 7f61eea00640 1 -- 172.21.15.107:0/3705210570 shutdown_connections 2024-08-17T02:28:24.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.530+0000 7f61eea00640 1 -- 172.21.15.107:0/3705210570 wait complete. 2024-08-17T02:28:24.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.531+0000 7f61eea00640 1 Processor -- start 2024-08-17T02:28:24.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.531+0000 7f61eea00640 1 -- start start 2024-08-17T02:28:24.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.532+0000 7f61eea00640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61d0004140 0x7f61e80a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.532+0000 7f61eea00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61e813d810 0x7f61e815dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.532+0000 7f61eea00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61e80ae6b0 0x7f61e80aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.532+0000 7f61eea00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e80af060 con 0x7f61e80ae6b0 2024-08-17T02:28:24.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.532+0000 7f61eea00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e80aaad0 con 0x7f61e813d810 2024-08-17T02:28:24.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.532+0000 7f61eea00640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e80a9ec0 con 0x7f61d0004140 2024-08-17T02:28:24.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.532+0000 7f61ee000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61e80ae6b0 0x7f61e80aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.532+0000 7f61ee000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61e80ae6b0 0x7f61e80aeb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40262/0 (socket says 172.21.15.107:40262) 2024-08-17T02:28:24.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.532+0000 7f61ee000640 1 -- 172.21.15.107:0/453576216 learned_addr learned my addr 172.21.15.107:0/453576216 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:28:24.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.532+0000 7f61ed600640 1 --2- 172.21.15.107:0/453576216 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61d0004140 0x7f61e80a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.532+0000 7f61ecc00640 1 --2- 172.21.15.107:0/453576216 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61e813d810 0x7f61e815dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.533+0000 7f61ee000640 1 -- 172.21.15.107:0/453576216 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61d0004140 msgr2=0x7f61e80a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.533+0000 7f61ee000640 1 --2- 172.21.15.107:0/453576216 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61d0004140 0x7f61e80a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.533+0000 7f61ee000640 1 -- 172.21.15.107:0/453576216 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61e813d810 msgr2=0x7f61e815dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.533+0000 7f61ee000640 1 --2- 172.21.15.107:0/453576216 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61e813d810 0x7f61e815dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.533+0000 7f61ee000640 1 -- 172.21.15.107:0/453576216 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e80aa1a0 con 0x7f61e80ae6b0 2024-08-17T02:28:24.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.533+0000 7f61ee000640 1 --2- 172.21.15.107:0/453576216 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61e80ae6b0 0x7f61e80aeb20 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f61e0001460 tx=0x7f61e0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:24.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.533+0000 7f61e4c00640 1 -- 172.21.15.107:0/453576216 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e000ee80 con 0x7f61e80ae6b0 2024-08-17T02:28:24.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.533+0000 7f61e4c00640 1 -- 172.21.15.107:0/453576216 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f61e00030d0 con 0x7f61e80ae6b0 2024-08-17T02:28:24.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.533+0000 7f61eea00640 1 -- 172.21.15.107:0/453576216 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61e80aa480 con 0x7f61e80ae6b0 2024-08-17T02:28:24.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.533+0000 7f61e4c00640 1 -- 172.21.15.107:0/453576216 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e00034b0 con 0x7f61e80ae6b0 2024-08-17T02:28:24.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.533+0000 7f61eea00640 1 -- 172.21.15.107:0/453576216 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61e815e4e0 con 0x7f61e80ae6b0 2024-08-17T02:28:24.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.534+0000 7f61eea00640 1 -- 172.21.15.107:0/453576216 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61e80aa900 con 0x7f61e80ae6b0 2024-08-17T02:28:24.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.535+0000 7f61e4c00640 1 -- 172.21.15.107:0/453576216 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f61e00018f0 con 0x7f61e80ae6b0 2024-08-17T02:28:24.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.536+0000 7f61e4c00640 1 --2- 172.21.15.107:0/453576216 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f61c8065180 0x7f61c8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.536+0000 7f61e4c00640 1 -- 172.21.15.107:0/453576216 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f61e0081530 con 0x7f61e80ae6b0 2024-08-17T02:28:24.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.536+0000 7f61ed600640 1 --2- 172.21.15.107:0/453576216 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f61c8065180 0x7f61c8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.537+0000 7f61ed600640 1 --2- 172.21.15.107:0/453576216 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f61c8065180 0x7f61c8067630 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f61dc009d70 tx=0x7f61dc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:24.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.540+0000 7f61e4c00640 1 -- 172.21.15.107:0/453576216 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f61e004f920 con 0x7f61e80ae6b0 2024-08-17T02:28:24.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.747+0000 7f61eea00640 1 -- 172.21.15.107:0/453576216 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61e80aac40 con 0x7f61e80ae6b0 2024-08-17T02:28:24.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.748+0000 7f61e4c00640 1 -- 172.21.15.107:0/453576216 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f61e0052f40 con 0x7f61e80ae6b0 2024-08-17T02:28:24.748 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:28:24.749 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":25,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4682,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/855770365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":855770365},{"type":"v1","addr":"172.21.15.107:6836","nonce":855770365}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4688,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6834/1749905502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1749905502},{"type":"v1","addr":"172.21.15.157:6834","nonce":1749905502}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4910,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/3701145841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6833","nonce":3701145841},{"type":"v1","addr":"172.21.15.157:6835","nonce":3701145841}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5388,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/676916413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":676916413},{"type":"v1","addr":"172.21.15.107:6837","nonce":676916413}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[]} 2024-08-17T02:28:24.749 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 25 2024-08-17T02:28:24.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.750+0000 7f61eea00640 1 -- 172.21.15.107:0/453576216 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f61c8065180 msgr2=0x7f61c8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.750+0000 7f61eea00640 1 --2- 172.21.15.107:0/453576216 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f61c8065180 0x7f61c8067630 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f61dc009d70 tx=0x7f61dc008040 comp rx=0 tx=0).stop 2024-08-17T02:28:24.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.750+0000 7f61eea00640 1 -- 172.21.15.107:0/453576216 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61e80ae6b0 msgr2=0x7f61e80aeb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.750+0000 7f61eea00640 1 --2- 172.21.15.107:0/453576216 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61e80ae6b0 0x7f61e80aeb20 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f61e0001460 tx=0x7f61e0009040 comp rx=0 tx=0).stop 2024-08-17T02:28:24.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.750+0000 7f61eea00640 1 -- 172.21.15.107:0/453576216 shutdown_connections 2024-08-17T02:28:24.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.750+0000 7f61eea00640 1 --2- 172.21.15.107:0/453576216 >> [v2:172.21.15.107:6832/37039,v1:172.21.15.107:6833/37039] conn(0x7f61c8065180 0x7f61c8067630 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.750+0000 7f61eea00640 1 --2- 172.21.15.107:0/453576216 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61e80ae6b0 0x7f61e80aeb20 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.750+0000 7f61eea00640 1 --2- 172.21.15.107:0/453576216 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61e813d810 0x7f61e815dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.750+0000 7f61eea00640 1 --2- 172.21.15.107:0/453576216 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61d0004140 0x7f61e80a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.750+0000 7f61eea00640 1 -- 172.21.15.107:0/453576216 >> 172.21.15.107:0/453576216 conn(0x7f61e8067750 msgr2=0x7f61e806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:24.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.750+0000 7f61eea00640 1 -- 172.21.15.107:0/453576216 shutdown_connections 2024-08-17T02:28:24.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:28:24.750+0000 7f61eea00640 1 -- 172.21.15.107:0/453576216 wait complete. 2024-08-17T02:28:24.765 DEBUG:tasks.cephfs.filesystem:already dead... 2024-08-17T02:28:24.766 INFO:teuthology.misc:Shutting down mds daemons... 2024-08-17T02:28:24.766 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-17T02:28:24.766 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:24.779 INFO:tasks.ceph.mds.a:Stopped 2024-08-17T02:28:24.779 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-17T02:28:24.780 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:24.834 INFO:tasks.ceph.mds.c:Stopped 2024-08-17T02:28:24.834 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-17T02:28:24.834 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:24.851 INFO:tasks.ceph.mds.b:Stopped 2024-08-17T02:28:24.851 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-17T02:28:24.851 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:24.907 INFO:tasks.ceph.mds.d:Stopped 2024-08-17T02:28:24.907 INFO:teuthology.misc:Shutting down osd daemons... 2024-08-17T02:28:24.907 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-08-17T02:28:24.907 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:24.952 INFO:tasks.ceph.osd.0:Stopped 2024-08-17T02:28:24.952 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-08-17T02:28:24.952 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:25.007 INFO:tasks.ceph.osd.1:Stopped 2024-08-17T02:28:25.008 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-08-17T02:28:25.008 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:25.066 INFO:tasks.ceph.osd.2:Stopped 2024-08-17T02:28:25.066 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-08-17T02:28:25.066 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:25.127 INFO:tasks.ceph.osd.3:Stopped 2024-08-17T02:28:25.128 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-08-17T02:28:25.128 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:25.169 INFO:tasks.ceph.osd.4:Stopped 2024-08-17T02:28:25.169 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-08-17T02:28:25.170 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:25.217 INFO:tasks.ceph.osd.5:Stopped 2024-08-17T02:28:25.218 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-08-17T02:28:25.218 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:25.256 INFO:tasks.ceph.osd.6:Stopped 2024-08-17T02:28:25.256 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-08-17T02:28:25.256 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:25.339 INFO:tasks.ceph.osd.7:Stopped 2024-08-17T02:28:25.339 INFO:teuthology.misc:Shutting down mgr daemons... 2024-08-17T02:28:25.340 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-08-17T02:28:25.340 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:25.399 INFO:tasks.ceph.mgr.y:Stopped 2024-08-17T02:28:25.399 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-08-17T02:28:25.399 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:25.455 INFO:tasks.ceph.mgr.x:Stopped 2024-08-17T02:28:25.455 INFO:teuthology.misc:Shutting down mon daemons... 2024-08-17T02:28:25.456 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-17T02:28:25.456 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:25.475 INFO:tasks.ceph.mon.a:Stopped 2024-08-17T02:28:25.475 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-17T02:28:25.475 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:25.493 INFO:tasks.ceph.mon.b:Stopped 2024-08-17T02:28:25.493 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-17T02:28:25.493 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:25.554 INFO:tasks.ceph.mon.c:Stopped 2024-08-17T02:28:25.554 INFO:tasks.ceph:Checking cluster log for badness... 2024-08-17T02:28:25.554 DEBUG:teuthology.orchestra.run.smithi107:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-08-17T02:28:25.630 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi107.front.sepia.ceph.com 2024-08-17T02:28:25.631 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-08-17T02:28:25.910 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi107.front.sepia.ceph.com 2024-08-17T02:28:25.910 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-08-17T02:28:26.047 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi107.front.sepia.ceph.com 2024-08-17T02:28:26.047 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-08-17T02:28:26.147 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi107.front.sepia.ceph.com 2024-08-17T02:28:26.147 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-08-17T02:28:26.258 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi157.front.sepia.ceph.com 2024-08-17T02:28:26.258 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-08-17T02:28:26.457 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi157.front.sepia.ceph.com 2024-08-17T02:28:26.458 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-08-17T02:28:26.560 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi157.front.sepia.ceph.com 2024-08-17T02:28:26.561 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-08-17T02:28:26.666 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi157.front.sepia.ceph.com 2024-08-17T02:28:26.666 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-08-17T02:28:26.768 INFO:tasks.ceph:Archiving mon data... 2024-08-17T02:28:26.769 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858278/data/mon.a.tgz 2024-08-17T02:28:26.769 DEBUG:teuthology.orchestra.run.smithi107:> mktemp 2024-08-17T02:28:26.805 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.5t7ec6ydPG 2024-08-17T02:28:26.805 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.5t7ec6ydPG 2024-08-17T02:28:26.978 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.5t7ec6ydPG 2024-08-17T02:28:27.072 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.5t7ec6ydPG is 308KB 2024-08-17T02:28:27.160 DEBUG:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.5t7ec6ydPG 2024-08-17T02:28:27.194 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858278/data/mon.b.tgz 2024-08-17T02:28:27.194 DEBUG:teuthology.orchestra.run.smithi157:> mktemp 2024-08-17T02:28:27.230 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.gSGCRfS0mb 2024-08-17T02:28:27.230 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.gSGCRfS0mb 2024-08-17T02:28:27.427 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.gSGCRfS0mb 2024-08-17T02:28:27.522 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.gSGCRfS0mb is 410KB 2024-08-17T02:28:27.612 DEBUG:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.gSGCRfS0mb 2024-08-17T02:28:27.646 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858278/data/mon.c.tgz 2024-08-17T02:28:27.646 DEBUG:teuthology.orchestra.run.smithi157:> mktemp 2024-08-17T02:28:27.721 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.zrdA9FS9hn 2024-08-17T02:28:27.722 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.zrdA9FS9hn 2024-08-17T02:28:27.900 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.zrdA9FS9hn 2024-08-17T02:28:27.994 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.zrdA9FS9hn is 410KB 2024-08-17T02:28:28.083 DEBUG:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.zrdA9FS9hn 2024-08-17T02:28:28.119 INFO:tasks.ceph:Cleaning ceph cluster... 2024-08-17T02:28:28.119 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-17T02:28:28.124 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-17T02:28:28.216 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-08-17T02:28:28.217 DEBUG:teuthology.orchestra.run.smithi107:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-08-17T02:28:28.221 DEBUG:teuthology.orchestra.run.smithi157:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-08-17T02:28:28.280 INFO:teuthology.orchestra.run.smithi107.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-08-17T02:28:28.283 INFO:teuthology.orchestra.run.smithi157.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-08-17T02:28:28.294 INFO:tasks.ceph:Archiving crash dumps... 2024-08-17T02:28:28.295 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858278/remote/smithi107/crash 2024-08-17T02:28:28.296 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-17T02:28:28.351 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858278/remote/smithi157/crash 2024-08-17T02:28:28.351 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-17T02:28:28.405 INFO:tasks.ceph:Shutting down logrotate 2024-08-17T02:28:28.406 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:28.410 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:28.513 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:28.567 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:28.624 INFO:tasks.ceph:Compressing logs... 2024-08-17T02:28:28.624 DEBUG:teuthology.orchestra.run.smithi107:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-17T02:28:28.628 DEBUG:teuthology.orchestra.run.smithi157:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-17T02:28:28.678 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43052.log 2024-08-17T02:28:28.679 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51490.log 2024-08-17T02:28:28.679 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43727.log 2024-08-17T02:28:28.680 INFO:teuthology.orchestra.run.smithi107.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43052.log.gz 2024-08-17T02:28:28.681 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42834.log 2024-08-17T02:28:28.681 INFO:teuthology.orchestra.run.smithi107.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51490.log.gz 2024-08-17T02:28:28.682 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50263.log 2024-08-17T02:28:28.682 INFO:teuthology.orchestra.run.smithi107.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43727.log.gz 2024-08-17T02:28:28.683 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42317.log 2024-08-17T02:28:28.683 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.41899.log 2024-08-17T02:28:28.684 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45473.log 2024-08-17T02:28:28.684 INFO:teuthology.orchestra.run.smithi107.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42834.log.gz 2024-08-17T02:28:28.684 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45851.log 2024-08-17T02:28:28.684 INFO:teuthology.orchestra.run.smithi107.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50263.log.gz 2024-08-17T02:28:28.685 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47987.log 2024-08-17T02:28:28.685 INFO:teuthology.orchestra.run.smithi107.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45473.log.gz 2024-08-17T02:28:28.689 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43730.log 2024-08-17T02:28:28.689 INFO:teuthology.orchestra.run.smithi107.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45851.log.gz 2024-08-17T02:28:28.689 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49801.log 2024-08-17T02:28:28.689 INFO:teuthology.orchestra.run.smithi107.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47987.log.gz 2024-08-17T02:28:28.689 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43730.log: gzip -5 --verbose -- 87.6% /var/log/ceph/ceph-client.admin.48029.log 2024-08-17T02:28:28.689 INFO:teuthology.orchestra.run.smithi107.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43730.log.gz 2024-08-17T02:28:28.689 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46061.log 2024-08-17T02:28:28.690 INFO:teuthology.orchestra.run.smithi107.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49801.log.gz 2024-08-17T02:28:28.690 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42102.log 2024-08-17T02:28:28.690 INFO:teuthology.orchestra.run.smithi107.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48029.log.gz 2024-08-17T02:28:28.693 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.1.42317.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42317.log.gz 2024-08-17T02:28:28.693 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-17T02:28:28.693 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.3.41899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37068.log 2024-08-17T02:28:28.694 INFO:teuthology.orchestra.run.smithi157.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.41899.log.gz 2024-08-17T02:28:28.694 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37229.log 2024-08-17T02:28:28.694 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.37068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37189.log 2024-08-17T02:28:28.694 INFO:teuthology.orchestra.run.smithi157.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37068.log.gz 91.4% 2024-08-17T02:28:28.694 INFO:teuthology.orchestra.run.smithi157.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2024-08-17T02:28:28.694 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.37229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37149.log 2024-08-17T02:28:28.694 INFO:teuthology.orchestra.run.smithi157.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37229.log.gz 2024-08-17T02:28:28.695 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.37189.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-17T02:28:28.695 INFO:teuthology.orchestra.run.smithi157.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37189.log.gz 2024-08-17T02:28:28.695 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.37149.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37149.log.gz 2024-08-17T02:28:28.695 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37028.log 2024-08-17T02:28:28.695 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-08-17T02:28:28.695 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.37028.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-08-17T02:28:28.696 INFO:teuthology.orchestra.run.smithi157.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37028.log.gz 2024-08-17T02:28:28.696 INFO:teuthology.orchestra.run.smithi157.stderr: 93.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-17T02:28:28.696 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-08-17T02:28:28.696 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41578.log 2024-08-17T02:28:28.696 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-08-17T02:28:28.696 INFO:teuthology.orchestra.run.smithi157.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-08-17T02:28:28.700 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.1.41578.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.1.41578.log.gz -5 2024-08-17T02:28:28.700 INFO:teuthology.orchestra.run.smithi157.stderr: --verbose -- /var/log/ceph/ceph-client.admin.36977.log 2024-08-17T02:28:28.700 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-08-17T02:28:28.700 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.36977.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36977.log.gz 2024-08-17T02:28:28.701 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-08-17T02:28:28.701 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36937.log 2024-08-17T02:28:28.701 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-08-17T02:28:28.701 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.36937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37108.log 2024-08-17T02:28:28.701 INFO:teuthology.orchestra.run.smithi157.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36937.log.gz 2024-08-17T02:28:28.706 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-08-17T02:28:28.706 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.37108.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37108.log.gz 2024-08-17T02:28:28.706 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mds.d.log: 93.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-08-17T02:28:28.707 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-08-17T02:28:28.711 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47352.log 2024-08-17T02:28:28.712 INFO:teuthology.orchestra.run.smithi107.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46061.log.gz 2024-08-17T02:28:28.712 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51112.log 2024-08-17T02:28:28.712 INFO:teuthology.orchestra.run.smithi107.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42102.log.gz 2024-08-17T02:28:28.712 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43043.log 2024-08-17T02:28:28.712 INFO:teuthology.orchestra.run.smithi107.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47352.log.gz 2024-08-17T02:28:28.712 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49549.log 2024-08-17T02:28:28.712 INFO:teuthology.orchestra.run.smithi107.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51112.log.gz 2024-08-17T02:28:28.712 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46633.log 2024-08-17T02:28:28.713 INFO:teuthology.orchestra.run.smithi107.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43043.log.gz 2024-08-17T02:28:28.713 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49465.log 2024-08-17T02:28:28.713 INFO:teuthology.orchestra.run.smithi107.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49549.log.gz 2024-08-17T02:28:28.713 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42732.log 2024-08-17T02:28:28.713 INFO:teuthology.orchestra.run.smithi107.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46633.log.gz 2024-08-17T02:28:28.713 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50692.log 2024-08-17T02:28:28.713 INFO:teuthology.orchestra.run.smithi107.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49465.log.gz 2024-08-17T02:28:28.713 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44556.log 2024-08-17T02:28:28.713 INFO:teuthology.orchestra.run.smithi107.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42732.log.gz 2024-08-17T02:28:28.714 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43926.log 2024-08-17T02:28:28.714 INFO:teuthology.orchestra.run.smithi107.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50692.log.gz 2024-08-17T02:28:28.714 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51364.log 2024-08-17T02:28:28.714 INFO:teuthology.orchestra.run.smithi107.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.44556.log.gz 2024-08-17T02:28:28.714 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51154.log 2024-08-17T02:28:28.714 INFO:teuthology.orchestra.run.smithi107.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43926.log.gz 2024-08-17T02:28:28.714 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45725.log 2024-08-17T02:28:28.714 INFO:teuthology.orchestra.run.smithi107.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51364.log.gz 2024-08-17T02:28:28.715 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51154.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51154.log.gz 2024-08-17T02:28:28.715 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46145.log 2024-08-17T02:28:28.715 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49041.log 2024-08-17T02:28:28.715 INFO:teuthology.orchestra.run.smithi107.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45725.log.gz 2024-08-17T02:28:28.715 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47861.log 2024-08-17T02:28:28.715 INFO:teuthology.orchestra.run.smithi107.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46145.log.gz 2024-08-17T02:28:28.715 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45977.log 2024-08-17T02:28:28.715 INFO:teuthology.orchestra.run.smithi107.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49041.log.gz 2024-08-17T02:28:28.716 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47861.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-17T02:28:28.716 INFO:teuthology.orchestra.run.smithi107.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47861.log.gz 2024-08-17T02:28:28.716 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45641.log 2024-08-17T02:28:28.716 INFO:teuthology.orchestra.run.smithi107.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45977.log.gz 2024-08-17T02:28:28.716 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46271.log 2024-08-17T02:28:28.716 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45641.log: 84.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-17T02:28:28.716 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47479.log 2024-08-17T02:28:28.716 INFO:teuthology.orchestra.run.smithi107.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45641.log.gz 2024-08-17T02:28:28.717 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46271.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-08-17T02:28:28.717 INFO:teuthology.orchestra.run.smithi107.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46271.log.gz 2024-08-17T02:28:28.717 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49969.log 2024-08-17T02:28:28.717 INFO:teuthology.orchestra.run.smithi107.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47479.log.gz 2024-08-17T02:28:28.717 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37422.log 2024-08-17T02:28:28.717 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45515.log 2024-08-17T02:28:28.717 INFO:teuthology.orchestra.run.smithi107.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49969.log.gz 2024-08-17T02:28:28.717 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.37422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51280.log 2024-08-17T02:28:28.717 INFO:teuthology.orchestra.run.smithi107.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37422.log.gz 2024-08-17T02:28:28.718 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50534.log 2024-08-17T02:28:28.718 INFO:teuthology.orchestra.run.smithi107.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45515.log.gz 2024-08-17T02:28:28.718 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51280.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51280.log.gz 2024-08-17T02:28:28.718 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46397.log 2024-08-17T02:28:28.724 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41867.log 2024-08-17T02:28:28.724 INFO:teuthology.orchestra.run.smithi107.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50534.log.gz 2024-08-17T02:28:28.724 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47395.log 2024-08-17T02:28:28.724 INFO:teuthology.orchestra.run.smithi107.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46397.log.gz 2024-08-17T02:28:28.724 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.41867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42044.log 2024-08-17T02:28:28.724 INFO:teuthology.orchestra.run.smithi107.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41867.log.gz 2024-08-17T02:28:28.725 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43057.log 2024-08-17T02:28:28.725 INFO:teuthology.orchestra.run.smithi107.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47395.log.gz 2024-08-17T02:28:28.725 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42044.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-17T02:28:28.725 INFO:teuthology.orchestra.run.smithi107.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42044.log.gz 2024-08-17T02:28:28.725 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48071.log 2024-08-17T02:28:28.725 INFO:teuthology.orchestra.run.smithi107.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43057.log.gz 2024-08-17T02:28:28.725 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48473.log 2024-08-17T02:28:28.725 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51070.log 2024-08-17T02:28:28.725 INFO:teuthology.orchestra.run.smithi107.stderr: 88.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-17T02:28:28.726 INFO:teuthology.orchestra.run.smithi107.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48071.log.gz 2024-08-17T02:28:28.726 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44346.log 2024-08-17T02:28:28.726 INFO:teuthology.orchestra.run.smithi107.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48473.log.gz 2024-08-17T02:28:28.726 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51070.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51070.log.gz 2024-08-17T02:28:28.726 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47521.log 2024-08-17T02:28:28.726 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47689.log 2024-08-17T02:28:28.727 INFO:teuthology.orchestra.run.smithi107.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44346.log.gz 2024-08-17T02:28:28.727 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42480.log 2024-08-17T02:28:28.727 INFO:teuthology.orchestra.run.smithi107.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47521.log.gz 2024-08-17T02:28:28.728 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48323.log 2024-08-17T02:28:28.728 INFO:teuthology.orchestra.run.smithi107.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47689.log.gz 2024-08-17T02:28:28.728 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42480.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42480.log.gz 2024-08-17T02:28:28.728 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49507.log 2024-08-17T02:28:28.733 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48239.log 2024-08-17T02:28:28.733 INFO:teuthology.orchestra.run.smithi107.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48323.log.gz 2024-08-17T02:28:28.733 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47777.log 2024-08-17T02:28:28.733 INFO:teuthology.orchestra.run.smithi107.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49507.log.gz 2024-08-17T02:28:28.733 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49085.log 2024-08-17T02:28:28.734 INFO:teuthology.orchestra.run.smithi107.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48239.log.gz 2024-08-17T02:28:28.734 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44388.log 2024-08-17T02:28:28.734 INFO:teuthology.orchestra.run.smithi107.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47777.log.gz 2024-08-17T02:28:28.734 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51238.log 2024-08-17T02:28:28.734 INFO:teuthology.orchestra.run.smithi107.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49085.log.gz 2024-08-17T02:28:28.734 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48801.log 2024-08-17T02:28:28.734 INFO:teuthology.orchestra.run.smithi107.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44388.log.gz 2024-08-17T02:28:28.734 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49759.log 2024-08-17T02:28:28.735 INFO:teuthology.orchestra.run.smithi107.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51238.log.gz 2024-08-17T02:28:28.735 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48801.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48801.log.gz 2024-08-17T02:28:28.735 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42648.log 2024-08-17T02:28:28.735 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43378.log 2024-08-17T02:28:28.735 INFO:teuthology.orchestra.run.smithi107.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49759.log.gz 2024-08-17T02:28:28.735 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42648.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-08-17T02:28:28.735 INFO:teuthology.orchestra.run.smithi107.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42648.log.gz 2024-08-17T02:28:28.737 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43390.log 2024-08-17T02:28:28.737 INFO:teuthology.orchestra.run.smithi107.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43378.log.gz 2024-08-17T02:28:28.737 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30972.log 2024-08-17T02:28:28.737 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43392.log 2024-08-17T02:28:28.738 INFO:teuthology.orchestra.run.smithi107.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43390.log.gz 2024-08-17T02:28:28.738 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph.tmp-client.admin.30972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42690.log 2024-08-17T02:28:28.738 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30972.log.gz 2024-08-17T02:28:28.738 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43392.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.43392.log.gz 2024-08-17T02:28:28.738 INFO:teuthology.orchestra.run.smithi107.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51634.log 2024-08-17T02:28:28.739 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45935.log 2024-08-17T02:28:28.739 INFO:teuthology.orchestra.run.smithi107.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42690.log.gz 2024-08-17T02:28:28.739 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51634.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51634.log.gz 2024-08-17T02:28:28.739 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46801.log 2024-08-17T02:28:28.740 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43383.log 2024-08-17T02:28:28.740 INFO:teuthology.orchestra.run.smithi107.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45935.log.gz 2024-08-17T02:28:28.741 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46801.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46801.log.gz 2024-08-17T02:28:28.741 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47107.log 2024-08-17T02:28:28.742 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50734.log 2024-08-17T02:28:28.742 INFO:teuthology.orchestra.run.smithi107.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43383.log.gz 2024-08-17T02:28:28.743 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47563.log 2024-08-17T02:28:28.743 INFO:teuthology.orchestra.run.smithi107.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47107.log.gz 2024-08-17T02:28:28.744 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47310.log 2024-08-17T02:28:28.744 INFO:teuthology.orchestra.run.smithi107.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50734.log.gz 2024-08-17T02:28:28.745 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47563.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-08-17T02:28:28.745 INFO:teuthology.orchestra.run.smithi107.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47563.log.gz 2024-08-17T02:28:28.746 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47310.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47310.log.gz 2024-08-17T02:28:28.746 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43389.log 2024-08-17T02:28:28.747 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50408.log 2024-08-17T02:28:28.748 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43389.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43389.log.gz 2024-08-17T02:28:28.748 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49927.log 2024-08-17T02:28:28.749 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50986.log 2024-08-17T02:28:28.749 INFO:teuthology.orchestra.run.smithi107.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50408.log.gz 2024-08-17T02:28:28.750 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49927.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49927.log.gz 2024-08-17T02:28:28.751 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45557.log 2024-08-17T02:28:28.751 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49381.log 2024-08-17T02:28:28.752 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45557.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50986.log.gz 2024-08-17T02:28:28.753 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51532.log 2024-08-17T02:28:28.753 INFO:teuthology.orchestra.run.smithi107.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45557.log.gz 2024-08-17T02:28:28.754 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49381.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49381.log.gz 2024-08-17T02:28:28.754 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41963.log 2024-08-17T02:28:28.755 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44304.log 2024-08-17T02:28:28.755 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.41963.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51532.log.gz 2024-08-17T02:28:28.756 INFO:teuthology.orchestra.run.smithi107.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41963.log.gz 2024-08-17T02:28:28.756 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47437.log 2024-08-17T02:28:28.757 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44304.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44304.log.gz 2024-08-17T02:28:28.757 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-08-17T02:28:28.758 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47437.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-08-17T02:28:28.758 INFO:teuthology.orchestra.run.smithi107.stderr: 88.1%/var/log/ceph/ceph-osd.1.log: -- replaced with /var/log/ceph/ceph-client.admin.47437.log.gz 2024-08-17T02:28:28.759 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50450.log 2024-08-17T02:28:28.760 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42216.log 2024-08-17T02:28:28.762 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50450.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-08-17T02:28:28.763 INFO:teuthology.orchestra.run.smithi107.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50450.log.gz 2024-08-17T02:28:28.763 INFO:teuthology.orchestra.run.smithi107.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-08-17T02:28:28.763 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42163.log 2024-08-17T02:28:28.764 INFO:teuthology.orchestra.run.smithi107.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42216.log.gz 2024-08-17T02:28:28.764 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48957.log 2024-08-17T02:28:28.765 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42163.log: gzip 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42163.log.gz 2024-08-17T02:28:28.765 INFO:teuthology.orchestra.run.smithi107.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43715.log 2024-08-17T02:28:28.766 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mon.b.log: 92.0% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-08-17T02:28:28.766 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49885.log 2024-08-17T02:28:28.767 INFO:teuthology.orchestra.run.smithi107.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48957.log.gz 2024-08-17T02:28:28.768 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42606.log 2024-08-17T02:28:28.768 INFO:teuthology.orchestra.run.smithi107.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43715.log.gz 2024-08-17T02:28:28.769 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44514.log 2024-08-17T02:28:28.769 INFO:teuthology.orchestra.run.smithi107.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49885.log.gz 2024-08-17T02:28:28.771 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46229.log 2024-08-17T02:28:28.771 INFO:teuthology.orchestra.run.smithi107.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42606.log.gz 2024-08-17T02:28:28.772 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44694.log 88.9% 2024-08-17T02:28:28.772 INFO:teuthology.orchestra.run.smithi107.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44514.log.gz 2024-08-17T02:28:28.773 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46229.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46229.log.gz 2024-08-17T02:28:28.773 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42308.log 2024-08-17T02:28:28.774 INFO:teuthology.orchestra.run.smithi107.stderr:gzip/var/log/ceph/ceph-client.admin.44694.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.46927.log 2024-08-17T02:28:28.775 INFO:teuthology.orchestra.run.smithi107.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44694.log.gz 2024-08-17T02:28:28.775 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42308.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42308.log.gz 2024-08-17T02:28:28.775 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47065.log 2024-08-17T02:28:28.777 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50011.log 2024-08-17T02:28:28.777 INFO:teuthology.orchestra.run.smithi107.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46927.log.gz 2024-08-17T02:28:28.778 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47065.log: gzip -5 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47065.log.gz 2024-08-17T02:28:28.778 INFO:teuthology.orchestra.run.smithi107.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45809.log 2024-08-17T02:28:28.779 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45893.log 2024-08-17T02:28:28.779 INFO:teuthology.orchestra.run.smithi107.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50011.log.gz 2024-08-17T02:28:28.781 INFO:teuthology.orchestra.run.smithi157.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-08-17T02:28:28.781 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48113.log 2024-08-17T02:28:28.782 INFO:teuthology.orchestra.run.smithi107.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45809.log.gz 2024-08-17T02:28:28.782 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45893.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45893.log.gz 2024-08-17T02:28:28.782 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49591.log 2024-08-17T02:28:28.783 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45431.log 2024-08-17T02:28:28.783 INFO:teuthology.orchestra.run.smithi107.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48113.log.gz 2024-08-17T02:28:28.784 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43729.log 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49591.log.gz 2024-08-17T02:28:28.784 INFO:teuthology.orchestra.run.smithi107.stderr: 2024-08-17T02:28:28.785 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45431.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.45431.log.gz 2024-08-17T02:28:28.786 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43056.log 2024-08-17T02:28:28.787 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50305.log 2024-08-17T02:28:28.787 INFO:teuthology.orchestra.run.smithi107.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43729.log.gz 2024-08-17T02:28:28.788 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50860.log 2024-08-17T02:28:28.788 INFO:teuthology.orchestra.run.smithi107.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43056.log.gz 2024-08-17T02:28:28.790 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42876.log 2024-08-17T02:28:28.790 INFO:teuthology.orchestra.run.smithi107.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50305.log.gz 2024-08-17T02:28:28.791 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50860.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-08-17T02:28:28.791 INFO:teuthology.orchestra.run.smithi107.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50860.log.gz 2024-08-17T02:28:28.792 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46843.log 88.6% 2024-08-17T02:28:28.792 INFO:teuthology.orchestra.run.smithi107.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42876.log.gz 2024-08-17T02:28:28.795 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.46843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47819.log 2024-08-17T02:28:28.795 INFO:teuthology.orchestra.run.smithi107.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46843.log.gz 2024-08-17T02:28:28.796 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45024.log 2024-08-17T02:28:28.797 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47819.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47819.log.gz 2024-08-17T02:28:28.798 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44472.log/var/log/ceph/ceph-client.0.45024.log: 2024-08-17T02:28:28.798 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45024.log.gz 2024-08-17T02:28:28.799 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49717.log 2024-08-17T02:28:28.803 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44472.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44472.log.gz 2024-08-17T02:28:28.803 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51196.log 2024-08-17T02:28:28.803 INFO:teuthology.orchestra.run.smithi107.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49717.log.gz 2024-08-17T02:28:28.806 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46573.log 2024-08-17T02:28:28.806 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51196.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51196.log.gz 2024-08-17T02:28:28.806 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44010.log 2024-08-17T02:28:28.806 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46573.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46573.log.gz 2024-08-17T02:28:28.807 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43048.log 2024-08-17T02:28:28.808 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44010.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44010.log.gz 2024-08-17T02:28:28.809 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43058.log 2024-08-17T02:28:28.810 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43048.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43048.log.gz 2024-08-17T02:28:28.811 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49633.log 2024-08-17T02:28:28.812 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43058.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43058.log.gz 2024-08-17T02:28:28.813 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46355.log 2024-08-17T02:28:28.813 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49633.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49633.log.gz 2024-08-17T02:28:28.814 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51716.log 2024-08-17T02:28:28.816 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46355.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46355.log.gz 2024-08-17T02:28:28.816 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49339.log 2024-08-17T02:28:28.817 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51716.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51716.log.gz 2024-08-17T02:28:28.818 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44052.log 2024-08-17T02:28:28.819 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49339.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49339.log.gz 2024-08-17T02:28:28.820 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44052.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44052.log.gz 2024-08-17T02:28:28.821 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43718.log 2024-08-17T02:28:28.822 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47268.log 2024-08-17T02:28:28.824 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43718.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43718.log.gz 2024-08-17T02:28:28.824 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50137.log 2024-08-17T02:28:28.825 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47268.log: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-08-17T02:28:28.825 INFO:teuthology.orchestra.run.smithi107.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47268.log.gz 2024-08-17T02:28:28.826 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48660.log 2024-08-17T02:28:28.827 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47605.log 2024-08-17T02:28:28.827 INFO:teuthology.orchestra.run.smithi107.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.50137.log.gz 2024-08-17T02:28:28.828 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.0.48660.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48660.log.gz 2024-08-17T02:28:28.828 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45683.log 2024-08-17T02:28:28.830 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42522.log 2024-08-17T02:28:28.830 INFO:teuthology.orchestra.run.smithi107.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47605.log.gz 2024-08-17T02:28:28.831 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43968.log 2024-08-17T02:28:28.831 INFO:teuthology.orchestra.run.smithi107.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45683.log.gz 2024-08-17T02:28:28.832 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42522.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42522.log.gz 2024-08-17T02:28:28.833 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43968.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43968.log.gz 2024-08-17T02:28:28.834 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50902.log 2024-08-17T02:28:28.835 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45087.log 2024-08-17T02:28:28.836 INFO:teuthology.orchestra.run.smithi157.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-08-17T02:28:28.836 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48758.log 2024-08-17T02:28:28.836 INFO:teuthology.orchestra.run.smithi107.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50902.log.gz 2024-08-17T02:28:28.837 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45087.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45087.log.gz 2024-08-17T02:28:28.838 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46313.log 2024-08-17T02:28:28.839 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48758.log: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50492.log 2024-08-17T02:28:28.839 INFO:teuthology.orchestra.run.smithi107.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48758.log.gz 2024-08-17T02:28:28.840 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49423.log 2024-08-17T02:28:28.840 INFO:teuthology.orchestra.run.smithi107.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46313.log.gz 2024-08-17T02:28:28.842 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50492.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50492.log.gz 2024-08-17T02:28:28.842 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50053.log 2024-08-17T02:28:28.843 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49423.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49423.log.gz 2024-08-17T02:28:28.844 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50365.log 2024-08-17T02:28:28.845 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49255.log 2024-08-17T02:28:28.845 INFO:teuthology.orchestra.run.smithi107.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50053.log.gz 2024-08-17T02:28:28.847 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50365.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50365.log.gz 2024-08-17T02:28:28.847 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43044.log 2024-08-17T02:28:28.847 INFO:teuthology.orchestra.run.smithi107.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49255.log.gz 2024-08-17T02:28:28.848 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43386.log 2024-08-17T02:28:28.849 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47903.log 2024-08-17T02:28:28.850 INFO:teuthology.orchestra.run.smithi107.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43044.log.gz 2024-08-17T02:28:28.851 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46019.log 2024-08-17T02:28:28.851 INFO:teuthology.orchestra.run.smithi107.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43386.log.gz 2024-08-17T02:28:28.852 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47903.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47903.log.gz 2024-08-17T02:28:28.853 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43393.log 2024-08-17T02:28:28.853 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46019.log: 93.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-08-17T02:28:28.853 INFO:teuthology.orchestra.run.smithi107.stderr: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43394.log 2024-08-17T02:28:28.853 INFO:teuthology.orchestra.run.smithi107.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46019.log.gz 2024-08-17T02:28:28.855 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48407.log 2024-08-17T02:28:28.855 INFO:teuthology.orchestra.run.smithi107.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43393.log.gz 2024-08-17T02:28:28.856 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42564.log 2024-08-17T02:28:28.856 INFO:teuthology.orchestra.run.smithi107.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43394.log.gz 2024-08-17T02:28:28.857 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48155.log 2024-08-17T02:28:28.857 INFO:teuthology.orchestra.run.smithi107.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.48407.log.gz 2024-08-17T02:28:28.859 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48705.log 2024-08-17T02:28:28.859 INFO:teuthology.orchestra.run.smithi107.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42564.log.gz 2024-08-17T02:28:28.859 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48281.log 2024-08-17T02:28:28.859 INFO:teuthology.orchestra.run.smithi107.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48155.log.gz 2024-08-17T02:28:28.860 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48705.log: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43055.log 2024-08-17T02:28:28.861 INFO:teuthology.orchestra.run.smithi107.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48705.log.gz 2024-08-17T02:28:28.861 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44178.log 2024-08-17T02:28:28.862 INFO:teuthology.orchestra.run.smithi107.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48281.log.gz 2024-08-17T02:28:28.863 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46675.log 2024-08-17T02:28:28.863 INFO:teuthology.orchestra.run.smithi107.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43055.log.gz 2024-08-17T02:28:28.864 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44178.log: gzip -5 --verbose -- 89.5% /var/log/ceph/ceph-client.admin.49297.log 2024-08-17T02:28:28.864 INFO:teuthology.orchestra.run.smithi107.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44178.log.gz 2024-08-17T02:28:28.865 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43724.log 2024-08-17T02:28:28.865 INFO:teuthology.orchestra.run.smithi107.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46675.log.gz 2024-08-17T02:28:28.866 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42792.log 2024-08-17T02:28:28.866 INFO:teuthology.orchestra.run.smithi107.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49297.log.gz 2024-08-17T02:28:28.867 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43724.log: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48365.log 2024-08-17T02:28:28.867 INFO:teuthology.orchestra.run.smithi107.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43724.log.gz 2024-08-17T02:28:28.868 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48197.log 2024-08-17T02:28:28.869 INFO:teuthology.orchestra.run.smithi107.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42792.log.gz 2024-08-17T02:28:28.869 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43728.log 2024-08-17T02:28:28.869 INFO:teuthology.orchestra.run.smithi107.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48365.log.gz 2024-08-17T02:28:28.871 INFO:teuthology.orchestra.run.smithi157.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-08-17T02:28:28.871 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48197.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48197.log.gz 2024-08-17T02:28:28.871 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43607.log 2024-08-17T02:28:28.872 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42396.log 2024-08-17T02:28:28.872 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.43607.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43728.log.gz 2024-08-17T02:28:28.873 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47647.log 2024-08-17T02:28:28.873 INFO:teuthology.orchestra.run.smithi107.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43607.log.gz 2024-08-17T02:28:28.874 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46187.log 2024-08-17T02:28:28.874 INFO:teuthology.orchestra.run.smithi107.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42396.log.gz 2024-08-17T02:28:28.875 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47647.log: gzip 87.9% -5 -- replaced with /var/log/ceph/ceph-client.admin.47647.log.gz --verbose 2024-08-17T02:28:28.875 INFO:teuthology.orchestra.run.smithi107.stderr: -- /var/log/ceph/ceph-client.admin.50221.log 2024-08-17T02:28:28.876 INFO:teuthology.orchestra.run.smithi107.stderr:gzip/var/log/ceph/ceph-client.admin.46187.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.51448.log 2024-08-17T02:28:28.877 INFO:teuthology.orchestra.run.smithi107.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46187.log.gz 2024-08-17T02:28:28.877 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50221.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50221.log.gz 2024-08-17T02:28:28.877 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50818.log 2024-08-17T02:28:28.878 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46970.log 2024-08-17T02:28:28.879 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51448.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51448.log.gz 2024-08-17T02:28:28.880 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37304.log 2024-08-17T02:28:28.880 INFO:teuthology.orchestra.run.smithi107.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50818.log.gz 2024-08-17T02:28:28.880 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44220.log 2024-08-17T02:28:28.881 INFO:teuthology.orchestra.run.smithi107.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46970.log.gz 2024-08-17T02:28:28.882 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.37304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46717.log 2024-08-17T02:28:28.882 INFO:teuthology.orchestra.run.smithi107.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37304.log.gz 2024-08-17T02:28:28.883 INFO:teuthology.orchestra.run.smithi157.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-08-17T02:28:28.883 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47187.log 2024-08-17T02:28:28.883 INFO:teuthology.orchestra.run.smithi107.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44220.log.gz 2024-08-17T02:28:28.884 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48999.log 2024-08-17T02:28:28.884 INFO:teuthology.orchestra.run.smithi107.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46717.log.gz 2024-08-17T02:28:28.885 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47187.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-08-17T02:28:28.885 INFO:teuthology.orchestra.run.smithi107.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47187.log.gz 2024-08-17T02:28:28.886 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48999.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48999.log.gz 2024-08-17T02:28:28.887 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48843.log 2024-08-17T02:28:28.887 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49843.log 2024-08-17T02:28:28.889 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47733.log 2024-08-17T02:28:28.889 INFO:teuthology.orchestra.run.smithi107.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48843.log.gz 2024-08-17T02:28:28.889 INFO:teuthology.orchestra.run.smithi107.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-08-17T02:28:28.890 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50944.log 2024-08-17T02:28:28.890 INFO:teuthology.orchestra.run.smithi107.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49843.log.gz 2024-08-17T02:28:28.891 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46531.log 2024-08-17T02:28:28.891 INFO:teuthology.orchestra.run.smithi107.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47733.log.gz 2024-08-17T02:28:28.892 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45387.log 2024-08-17T02:28:28.892 INFO:teuthology.orchestra.run.smithi107.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50944.log.gz 2024-08-17T02:28:28.893 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50095.log 2024-08-17T02:28:28.893 INFO:teuthology.orchestra.run.smithi107.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46531.log.gz 2024-08-17T02:28:28.894 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.2.45387.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.45387.log.gz 2024-08-17T02:28:28.895 INFO:teuthology.orchestra.run.smithi157.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-08-17T02:28:28.895 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42352.log 2024-08-17T02:28:28.896 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45599.log 2024-08-17T02:28:28.897 INFO:teuthology.orchestra.run.smithi107.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50095.log.gz 2024-08-17T02:28:28.897 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51406.log 2024-08-17T02:28:28.897 INFO:teuthology.orchestra.run.smithi107.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42352.log.gz 2024-08-17T02:28:28.898 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45599.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45599.log.gz 2024-08-17T02:28:28.898 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37037.log 2024-08-17T02:28:28.899 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42438.log 2024-08-17T02:28:28.899 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51406.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51406.log.gz/var/log/ceph/ceph-client.admin.37037.log: 2024-08-17T02:28:28.900 INFO:teuthology.orchestra.run.smithi107.stderr: 89.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50776.log 2024-08-17T02:28:28.900 INFO:teuthology.orchestra.run.smithi107.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37037.log.gz 2024-08-17T02:28:28.901 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46759.log 2024-08-17T02:28:28.901 INFO:teuthology.orchestra.run.smithi107.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42438.log.gz 2024-08-17T02:28:28.902 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51028.log 2024-08-17T02:28:28.903 INFO:teuthology.orchestra.run.smithi107.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50776.log.gz 2024-08-17T02:28:28.904 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47945.log 2024-08-17T02:28:28.904 INFO:teuthology.orchestra.run.smithi107.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46759.log.gz 2024-08-17T02:28:28.906 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42258.log 2024-08-17T02:28:28.906 INFO:teuthology.orchestra.run.smithi107.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51028.log.gz 2024-08-17T02:28:28.906 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47015.log 2024-08-17T02:28:28.906 INFO:teuthology.orchestra.run.smithi107.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47945.log.gz 2024-08-17T02:28:28.907 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.42258.log: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49675.log 2024-08-17T02:28:28.908 INFO:teuthology.orchestra.run.smithi107.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42258.log.gz 2024-08-17T02:28:28.908 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.47015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50179.log 2024-08-17T02:28:28.909 INFO:teuthology.orchestra.run.smithi107.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47015.log.gz 2024-08-17T02:28:28.909 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51322.log 2024-08-17T02:28:28.910 INFO:teuthology.orchestra.run.smithi107.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49675.log.gz 2024-08-17T02:28:28.911 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51574.log 2024-08-17T02:28:28.911 INFO:teuthology.orchestra.run.smithi107.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50179.log.gz 2024-08-17T02:28:28.912 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44430.log 2024-08-17T02:28:28.912 INFO:teuthology.orchestra.run.smithi107.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51322.log.gz 2024-08-17T02:28:28.913 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51574.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51574.log.gz 2024-08-17T02:28:28.913 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48885.log 2024-08-17T02:28:28.914 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51674.log 2024-08-17T02:28:28.914 INFO:teuthology.orchestra.run.smithi107.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44430.log.gz 2024-08-17T02:28:28.915 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46103.log 2024-08-17T02:28:28.915 INFO:teuthology.orchestra.run.smithi107.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48885.log.gz 2024-08-17T02:28:28.916 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44262.log 2024-08-17T02:28:28.916 INFO:teuthology.orchestra.run.smithi107.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51674.log.gz 2024-08-17T02:28:28.918 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44094.log 2024-08-17T02:28:28.918 INFO:teuthology.orchestra.run.smithi107.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46103.log.gz 2024-08-17T02:28:28.919 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44136.log 2024-08-17T02:28:28.919 INFO:teuthology.orchestra.run.smithi107.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44262.log.gz 2024-08-17T02:28:28.920 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45767.log 2024-08-17T02:28:28.920 INFO:teuthology.orchestra.run.smithi107.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.44094.log.gz 2024-08-17T02:28:28.920 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.44136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46885.log 2024-08-17T02:28:28.921 INFO:teuthology.orchestra.run.smithi107.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44136.log.gz 2024-08-17T02:28:28.921 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45767.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45767.log.gz 2024-08-17T02:28:28.922 INFO:teuthology.orchestra.run.smithi157.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-08-17T02:28:28.923 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.46885.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46885.log.gz 2024-08-17T02:28:28.925 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-08-17T02:28:28.925 INFO:teuthology.orchestra.run.smithi157.stderr:real 0m0.264s 2024-08-17T02:28:28.925 INFO:teuthology.orchestra.run.smithi157.stderr:user 0m1.004s 2024-08-17T02:28:28.925 INFO:teuthology.orchestra.run.smithi157.stderr:sys 0m0.167s 2024-08-17T02:28:28.958 INFO:teuthology.orchestra.run.smithi107.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-08-17T02:28:28.995 INFO:teuthology.orchestra.run.smithi107.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-08-17T02:28:29.001 INFO:teuthology.orchestra.run.smithi107.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-08-17T02:28:29.048 INFO:teuthology.orchestra.run.smithi107.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-08-17T02:28:29.051 INFO:teuthology.orchestra.run.smithi107.stderr: 2024-08-17T02:28:29.052 INFO:teuthology.orchestra.run.smithi107.stderr:real 0m0.395s 2024-08-17T02:28:29.052 INFO:teuthology.orchestra.run.smithi107.stderr:user 0m1.156s 2024-08-17T02:28:29.052 INFO:teuthology.orchestra.run.smithi107.stderr:sys 0m0.630s 2024-08-17T02:28:29.053 INFO:tasks.ceph:Archiving logs... 2024-08-17T02:28:29.053 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858278/remote/smithi107/log 2024-08-17T02:28:29.054 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-17T02:28:29.418 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858278/remote/smithi157/log 2024-08-17T02:28:29.419 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-17T02:28:29.617 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-17T02:28:29.626 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-17T02:28:29.626 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-17T02:28:29.631 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-17T02:28:29.747 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-17T02:28:29.756 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-17T02:28:29.756 DEBUG:teuthology.orchestra.run.smithi107:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:28:29.760 DEBUG:teuthology.orchestra.run.smithi157:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:28:29.789 INFO:teuthology.orchestra.run.smithi107.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:28:29.794 INFO:teuthology.orchestra.run.smithi157.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:28:29.796 INFO:teuthology.orchestra.run.smithi107.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:28:29.796 INFO:teuthology.orchestra.run.smithi107.stdout:=============================================================================== 2024-08-17T02:28:29.797 INFO:teuthology.orchestra.run.smithi107.stdout:^* hv01.front.sepia.ceph.com 3 6 377 4 -37us[ -37us] +/- 58ms 2024-08-17T02:28:29.797 INFO:teuthology.orchestra.run.smithi107.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 6 -84us[ -84us] +/- 60ms 2024-08-17T02:28:29.797 INFO:teuthology.orchestra.run.smithi107.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 6 +207us[ +206us] +/- 90ms 2024-08-17T02:28:29.797 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:28:29.800 INFO:teuthology.orchestra.run.smithi157.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:28:29.800 INFO:teuthology.orchestra.run.smithi157.stdout:=============================================================================== 2024-08-17T02:28:29.800 INFO:teuthology.orchestra.run.smithi157.stdout:^* hv01.front.sepia.ceph.com 3 6 377 4 -40us[ -12us] +/- 58ms 2024-08-17T02:28:29.800 INFO:teuthology.orchestra.run.smithi157.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 5 -55us[ -27us] +/- 60ms 2024-08-17T02:28:29.800 INFO:teuthology.orchestra.run.smithi157.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 5 +200us[ +228us] +/- 90ms 2024-08-17T02:28:29.801 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:28:29.801 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-17T02:28:29.811 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-17T02:28:29.811 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-17T02:28:29.820 DEBUG:teuthology.orchestra.run.smithi107:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-17T02:28:29.954 DEBUG:teuthology.orchestra.run.smithi157:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-17T02:28:30.067 DEBUG:teuthology.orchestra.run.smithi107:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:28:30.126 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:28:30.127 DEBUG:teuthology.orchestra.run.smithi157:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:28:30.187 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:28:30.188 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-17T02:28:30.198 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-17T02:28:30.216 INFO:teuthology.task.internal:Duration was 739.286261 seconds 2024-08-17T02:28:30.216 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-17T02:28:30.225 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-17T02:28:30.225 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-17T02:28:30.229 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-17T02:28:30.312 INFO:teuthology.orchestra.run.smithi107.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:28:30.317 INFO:teuthology.orchestra.run.smithi157.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:28:30.673 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-17T02:28:30.674 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi107.front.sepia.ceph.com 2024-08-17T02:28:30.674 DEBUG:teuthology.orchestra.run.smithi107:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-17T02:28:30.723 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi157.front.sepia.ceph.com 2024-08-17T02:28:30.723 DEBUG:teuthology.orchestra.run.smithi157:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-17T02:28:30.773 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-17T02:28:30.774 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-17T02:28:30.778 DEBUG:teuthology.orchestra.run.smithi157:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-17T02:28:30.837 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-17T02:28:30.837 DEBUG:teuthology.orchestra.run.smithi107:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-17T02:28:30.841 DEBUG:teuthology.orchestra.run.smithi157:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-17T02:28:30.982 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-17T02:28:30.992 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-17T02:28:30.993 DEBUG:teuthology.orchestra.run.smithi107:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-17T02:28:31.048 DEBUG:teuthology.orchestra.run.smithi157:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-17T02:28:31.104 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-17T02:28:31.113 DEBUG:teuthology.orchestra.run.smithi107:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:28:31.118 DEBUG:teuthology.orchestra.run.smithi157:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:28:31.184 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = core 2024-08-17T02:28:31.188 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = core 2024-08-17T02:28:31.219 DEBUG:teuthology.orchestra.run.smithi107:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:28:31.251 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:28:31.252 DEBUG:teuthology.orchestra.run.smithi157:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:28:31.286 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:28:31.286 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-17T02:28:31.297 INFO:teuthology.task.internal:Transferring archived files... 2024-08-17T02:28:31.298 DEBUG:teuthology.misc:Transferring archived files from smithi107:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858278/remote/smithi107 2024-08-17T02:28:31.298 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-17T02:28:31.361 DEBUG:teuthology.misc:Transferring archived files from smithi157:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858278/remote/smithi157 2024-08-17T02:28:31.361 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-17T02:28:31.424 INFO:teuthology.task.internal:Removing archive directory... 2024-08-17T02:28:31.424 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-17T02:28:31.428 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-17T02:28:31.463 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-17T02:28:31.474 INFO:teuthology.task.internal:Not uploading archives. 2024-08-17T02:28:31.474 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-17T02:28:31.483 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-17T02:28:31.484 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-17T02:28:31.504 DEBUG:teuthology.orchestra.run.smithi157:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-17T02:28:31.534 INFO:teuthology.orchestra.run.smithi107.stdout: 393951 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 02:28 /home/ubuntu/cephtest 2024-08-17T02:28:31.538 INFO:teuthology.orchestra.run.smithi157.stdout: 524324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 02:28 /home/ubuntu/cephtest 2024-08-17T02:28:31.541 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-17T02:28:31.551 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-17T02:28:31.573 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 client.1-kernel-sha1: 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} duration: 739.286260843277 failure_reason: 'Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes)' flavor: default owner: scheduled_mchangir@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=3b4b8decc3d14579b96431cf3dd8cae6 status: fail success: false 2024-08-17T02:28:31.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-17T02:28:31.657 INFO:teuthology.run:FAIL